Jul 29 14:36:35 user nova-compute[70924]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Jul 29 14:36:38 user nova-compute[70924]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=70924) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=70924) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=70924) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Jul 29 14:36:38 user nova-compute[70924]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:36:38 user nova-compute[70924]: INFO nova.virt.driver [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] Loading compute driver 'libvirt.LibvirtDriver'
Jul 29 14:36:38 user nova-compute[70924]: INFO nova.compute.provider_config [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] Acquiring lock "singleton_lock" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] Acquired lock "singleton_lock" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] Releasing lock "singleton_lock" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] Full set of CONF: {{(pid=70924) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] ******************************************************************************** {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] Configuration options gathered from: {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] ================================================================================ {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] allow_resize_to_same_host      = True {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] arq_binding_timeout            = 300 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] backdoor_port                  = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] backdoor_socket                = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] block_device_allocate_retries  = 300 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] block_device_allocate_retries_interval = 5 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] cert                           = self.pem {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] compute_monitors               = [] {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] config_dir                     = [] {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] config_drive_format            = iso9660 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] config_source                  = [] {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] console_host                   = user {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] control_exchange               = nova {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] cpu_allocation_ratio           = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] daemon                         = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] debug                          = True {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] default_access_ip_network_name = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] default_availability_zone      = nova {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] default_ephemeral_format       = ext4 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] default_schedule_zone          = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] disk_allocation_ratio          = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] enable_new_services            = True {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] enabled_apis                   = ['osapi_compute'] {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] enabled_ssl_apis               = [] {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] flat_injected                  = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] force_config_drive             = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] force_raw_images               = True {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] graceful_shutdown_timeout      = 5 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] heal_instance_info_cache_interval = 60 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] host                           = user {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] instance_build_timeout         = 0 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] instance_delete_interval       = 300 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] instance_format                = [instance: %(uuid)s]  {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] instance_name_template         = instance-%08x {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] instance_usage_audit           = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] instance_usage_audit_period    = month {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] internal_service_availability_zone = internal {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] key                            = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] live_migration_retry_count     = 30 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] log_config_append              = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] log_dir                        = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] log_file                       = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] log_options                    = True {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] log_rotate_interval            = 1 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] log_rotate_interval_type       = days {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] log_rotation_type              = none {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] long_rpc_timeout               = 1800 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] max_concurrent_builds          = 10 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] max_concurrent_live_migrations = 1 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] max_concurrent_snapshots       = 5 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] max_local_block_devices        = 3 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] max_logfile_count              = 30 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] max_logfile_size_mb            = 200 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] maximum_instance_delete_attempts = 5 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] metadata_listen                = 0.0.0.0 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] metadata_listen_port           = 8775 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] metadata_workers               = 3 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] migrate_max_retries            = -1 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] mkisofs_cmd                    = genisoimage {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] my_ip                          = 10.0.0.210 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] network_allocate_retries       = 0 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] osapi_compute_listen_port      = 8774 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] osapi_compute_unique_server_name_scope =  {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] osapi_compute_workers          = 3 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] password_length                = 12 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] periodic_enable                = True {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] periodic_fuzzy_delay           = 60 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] pointer_model                  = ps2mouse {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] preallocate_images             = none {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] publish_errors                 = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] pybasedir                      = /opt/stack/nova {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] ram_allocation_ratio           = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] rate_limit_burst               = 0 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] rate_limit_except_level        = CRITICAL {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] rate_limit_interval            = 0 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] reboot_timeout                 = 0 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] reclaim_instance_interval      = 0 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] record                         = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] reimage_timeout_per_gb         = 60 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] report_interval                = 10 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] rescue_timeout                 = 0 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] reserved_host_cpus             = 0 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] reserved_host_disk_mb          = 0 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] reserved_host_memory_mb        = 512 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] reserved_huge_pages            = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] resize_confirm_window          = 0 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] resize_fs_using_block_device   = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] resume_guests_state_on_host_boot = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] rpc_response_timeout           = 60 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] run_external_periodic_tasks    = True {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] running_deleted_instance_action = reap {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] running_deleted_instance_poll_interval = 1800 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] running_deleted_instance_timeout = 0 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] scheduler_instance_sync_interval = 120 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] service_down_time              = 60 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] servicegroup_driver            = db {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] shelved_offload_time           = 0 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] shelved_poll_interval          = 3600 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] shutdown_timeout               = 0 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] source_is_ipv6                 = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] ssl_only                       = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] state_path                     = /opt/stack/data/nova {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] sync_power_state_interval      = 600 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] sync_power_state_pool_size     = 1000 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] syslog_log_facility            = LOG_USER {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] tempdir                        = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] timeout_nbd                    = 10 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] transport_url                  = **** {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] update_resources_interval      = 0 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] use_cow_images                 = True {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] use_eventlog                   = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] use_journal                    = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] use_json                       = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] use_rootwrap_daemon            = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] use_stderr                     = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] use_syslog                     = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vcpu_pin_set                   = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vif_plugging_is_fatal          = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vif_plugging_timeout           = 0 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] virt_mkfs                      = [] {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] volume_usage_poll_interval     = 0 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] watch_log_file                 = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] web                            = /usr/share/spice-html5 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_concurrency.disable_process_locking = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] api.auth_strategy              = keystone {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] api.compute_link_prefix        = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] api.dhcp_domain                = novalocal {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] api.enable_instance_password   = True {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] api.glance_link_prefix         = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] api.instance_list_per_project_cells = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] api.list_records_by_skipping_down_cells = True {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] api.local_metadata_per_cell    = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] api.max_limit                  = 1000 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] api.metadata_cache_expiration  = 15 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] api.neutron_default_tenant_id  = default {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] api.use_forwarded_for          = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] api.use_neutron_default_nets   = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] api.vendordata_dynamic_targets = [] {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] api.vendordata_jsonfile_path   = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] cache.backend                  = dogpile.cache.memcached {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] cache.backend_argument         = **** {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] cache.config_prefix            = cache.oslo {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] cache.dead_timeout             = 60.0 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] cache.debug_cache_backend      = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] cache.enable_retry_client      = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] cache.enable_socket_keepalive  = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] cache.enabled                  = True {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] cache.expiration_time          = 600 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] cache.hashclient_retry_attempts = 2 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] cache.memcache_dead_retry      = 300 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] cache.memcache_password        =  {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] cache.memcache_pool_maxsize    = 10 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] cache.memcache_sasl_enabled    = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] cache.memcache_username        =  {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] cache.proxies                  = [] {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] cache.retry_attempts           = 2 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] cache.retry_delay              = 0.0 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] cache.socket_keepalive_count   = 1 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] cache.socket_keepalive_idle    = 1 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] cache.socket_keepalive_interval = 1 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] cache.tls_allowed_ciphers      = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] cache.tls_cafile               = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] cache.tls_certfile             = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] cache.tls_enabled              = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] cache.tls_keyfile              = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] cinder.auth_section            = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] cinder.auth_type               = password {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] cinder.cafile                  = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] cinder.certfile                = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] cinder.collect_timing          = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] cinder.cross_az_attach         = True {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] cinder.debug                   = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] cinder.endpoint_template       = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] cinder.http_retries            = 3 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] cinder.insecure                = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] cinder.keyfile                 = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] cinder.os_region_name          = RegionOne {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] cinder.split_loggers           = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] cinder.timeout                 = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] compute.cpu_dedicated_set      = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] compute.cpu_shared_set         = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] compute.image_type_exclude_list = [] {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] compute.max_concurrent_disk_ops = 0 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] compute.max_disk_devices_to_attach = -1 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] compute.resource_provider_association_refresh = 300 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] compute.shutdown_retry_interval = 10 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] conductor.workers              = 3 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] console.allowed_origins        = [] {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] console.ssl_ciphers            = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] console.ssl_minimum_version    = default {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] consoleauth.token_ttl          = 600 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] cyborg.cafile                  = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] cyborg.certfile                = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] cyborg.collect_timing          = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] cyborg.connect_retries         = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] cyborg.connect_retry_delay     = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] cyborg.endpoint_override       = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] cyborg.insecure                = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] cyborg.keyfile                 = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] cyborg.max_version             = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] cyborg.min_version             = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] cyborg.region_name             = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] cyborg.service_name            = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] cyborg.service_type            = accelerator {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] cyborg.split_loggers           = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] cyborg.status_code_retries     = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] cyborg.status_code_retry_delay = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] cyborg.timeout                 = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] cyborg.version                 = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] database.backend               = sqlalchemy {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] database.connection            = **** {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] database.connection_debug      = 0 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] database.connection_parameters =  {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] database.connection_recycle_time = 3600 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] database.connection_trace      = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] database.db_inc_retry_interval = True {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] database.db_max_retries        = 20 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] database.db_max_retry_interval = 10 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] database.db_retry_interval     = 1 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] database.max_overflow          = 50 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] database.max_pool_size         = 5 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] database.max_retries           = 10 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] database.mysql_enable_ndb      = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] database.mysql_wsrep_sync_wait = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] database.pool_timeout          = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] database.retry_interval        = 10 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] database.slave_connection      = **** {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] database.sqlite_synchronous    = True {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] api_database.backend           = sqlalchemy {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] api_database.connection        = **** {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] api_database.connection_debug  = 0 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] api_database.connection_parameters =  {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] api_database.connection_recycle_time = 3600 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] api_database.connection_trace  = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] api_database.db_inc_retry_interval = True {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] api_database.db_max_retries    = 20 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] api_database.db_max_retry_interval = 10 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] api_database.db_retry_interval = 1 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] api_database.max_overflow      = 50 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] api_database.max_pool_size     = 5 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] api_database.max_retries       = 10 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] api_database.mysql_enable_ndb  = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] api_database.pool_timeout      = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] api_database.retry_interval    = 10 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] api_database.slave_connection  = **** {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] api_database.sqlite_synchronous = True {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] devices.enabled_mdev_types     = [] {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] ephemeral_storage_encryption.enabled = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] glance.api_servers             = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] glance.cafile                  = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] glance.certfile                = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] glance.collect_timing          = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] glance.connect_retries         = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] glance.connect_retry_delay     = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] glance.debug                   = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] glance.default_trusted_certificate_ids = [] {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] glance.enable_certificate_validation = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] glance.enable_rbd_download     = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] glance.endpoint_override       = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] glance.insecure                = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] glance.keyfile                 = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] glance.max_version             = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] glance.min_version             = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] glance.num_retries             = 3 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] glance.rbd_ceph_conf           =  {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] glance.rbd_connect_timeout     = 5 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] glance.rbd_pool                =  {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] glance.rbd_user                =  {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] glance.region_name             = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] glance.service_name            = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] glance.service_type            = image {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] glance.split_loggers           = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] glance.status_code_retries     = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] glance.status_code_retry_delay = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] glance.timeout                 = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] glance.verify_glance_signatures = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] glance.version                 = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] guestfs.debug                  = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] hyperv.config_drive_cdrom      = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] hyperv.config_drive_inject_password = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] hyperv.enable_instance_metrics_collection = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] hyperv.enable_remotefx         = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] hyperv.instances_path_share    =  {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] hyperv.iscsi_initiator_list    = [] {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] hyperv.limit_cpu_features      = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] hyperv.power_state_check_timeframe = 60 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] hyperv.use_multipath_io        = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] hyperv.volume_attach_retry_count = 10 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] hyperv.vswitch_name            = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] mks.enabled                    = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] image_cache.manager_interval   = 2400 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] image_cache.precache_concurrency = 1 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] image_cache.remove_unused_base_images = True {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] image_cache.subdirectory_name  = _base {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] ironic.api_max_retries         = 60 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] ironic.api_retry_interval      = 2 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] ironic.auth_section            = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] ironic.auth_type               = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] ironic.cafile                  = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] ironic.certfile                = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] ironic.collect_timing          = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] ironic.connect_retries         = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] ironic.connect_retry_delay     = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] ironic.endpoint_override       = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] ironic.insecure                = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] ironic.keyfile                 = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] ironic.max_version             = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] ironic.min_version             = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] ironic.partition_key           = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] ironic.peer_list               = [] {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] ironic.region_name             = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] ironic.serial_console_state_timeout = 10 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] ironic.service_name            = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] ironic.service_type            = baremetal {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] ironic.split_loggers           = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] ironic.status_code_retries     = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] ironic.status_code_retry_delay = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] ironic.timeout                 = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] ironic.version                 = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] key_manager.fixed_key          = **** {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] barbican.barbican_api_version  = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] barbican.barbican_endpoint     = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] barbican.barbican_endpoint_type = public {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] barbican.barbican_region_name  = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] barbican.cafile                = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] barbican.certfile              = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] barbican.collect_timing        = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] barbican.insecure              = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] barbican.keyfile               = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] barbican.number_of_retries     = 60 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] barbican.retry_delay           = 1 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] barbican.send_service_user_token = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] barbican.split_loggers         = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] barbican.timeout               = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] barbican.verify_ssl            = True {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] barbican.verify_ssl_path       = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] barbican_service_user.auth_section = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] barbican_service_user.auth_type = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] barbican_service_user.cafile   = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] barbican_service_user.certfile = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] barbican_service_user.collect_timing = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] barbican_service_user.insecure = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] barbican_service_user.keyfile  = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] barbican_service_user.split_loggers = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] barbican_service_user.timeout  = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vault.approle_role_id          = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vault.approle_secret_id        = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vault.cafile                   = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vault.certfile                 = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vault.collect_timing           = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vault.insecure                 = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vault.keyfile                  = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vault.kv_mountpoint            = secret {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vault.kv_version               = 2 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vault.namespace                = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vault.root_token_id            = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vault.split_loggers            = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vault.ssl_ca_crt_file          = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vault.timeout                  = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vault.use_ssl                  = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] keystone.cafile                = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] keystone.certfile              = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] keystone.collect_timing        = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] keystone.connect_retries       = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] keystone.connect_retry_delay   = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] keystone.endpoint_override     = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] keystone.insecure              = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] keystone.keyfile               = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] keystone.max_version           = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] keystone.min_version           = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] keystone.region_name           = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] keystone.service_name          = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] keystone.service_type          = identity {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] keystone.split_loggers         = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] keystone.status_code_retries   = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] keystone.status_code_retry_delay = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] keystone.timeout               = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] keystone.version               = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.connection_uri         =  {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.cpu_mode               = custom {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: WARNING oslo_config.cfg [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.cpu_power_governor_high = performance {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.cpu_power_governor_low = powersave {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.cpu_power_management   = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.device_detach_attempts = 8 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.device_detach_timeout  = 20 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.disk_cachemodes        = [] {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.disk_prefix            = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.enabled_perf_events    = [] {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.file_backed_memory     = 0 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.gid_maps               = [] {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.hw_disk_discard        = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.hw_machine_type        = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.images_rbd_glance_store_name =  {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.images_rbd_pool        = rbd {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.images_type            = default {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.images_volume_group    = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.inject_key             = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.inject_partition       = -2 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.inject_password        = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.iscsi_iface            = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.iser_use_multipath     = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.live_migration_bandwidth = 0 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.live_migration_downtime = 500 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.live_migration_inbound_addr = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.live_migration_permit_post_copy = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.live_migration_scheme  = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.live_migration_timeout_action = abort {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.live_migration_tunnelled = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: WARNING oslo_config.cfg [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Jul 29 14:36:38 user nova-compute[70924]: live_migration_uri is deprecated for removal in favor of two other options that
Jul 29 14:36:38 user nova-compute[70924]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Jul 29 14:36:38 user nova-compute[70924]: and ``live_migration_inbound_addr`` respectively.
Jul 29 14:36:38 user nova-compute[70924]: ).  Its value may be silently ignored in the future.
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.live_migration_with_native_tls = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.max_queues             = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.nfs_mount_options      = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.num_memory_encrypted_guests = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.num_pcie_ports         = 0 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.pmem_namespaces        = [] {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.quobyte_client_cfg     = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.rbd_secret_uuid        = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.rbd_user               = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.remote_filesystem_transport = ssh {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.rescue_image_id        = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.rescue_kernel_id       = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.rescue_ramdisk_id      = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.rx_queue_size          = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.smbfs_mount_options    =  {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.snapshot_compression   = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.snapshot_image_format  = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.sparse_logical_volumes = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.swtpm_enabled          = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.swtpm_group            = tss {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.swtpm_user             = tss {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.sysinfo_serial         = unique {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.tb_cache_size          = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.tx_queue_size          = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.uid_maps               = [] {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.use_virtio_for_bridges = True {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.virt_type              = kvm {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.volume_clear           = zero {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.volume_clear_size      = 0 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.volume_use_multipath   = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.vzstorage_cache_path   = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.vzstorage_mount_user   = stack {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] neutron.auth_section           = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] neutron.auth_type              = password {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] neutron.cafile                 = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] neutron.certfile               = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] neutron.collect_timing         = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] neutron.connect_retries        = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] neutron.connect_retry_delay    = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] neutron.default_floating_pool  = public {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] neutron.endpoint_override      = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] neutron.extension_sync_interval = 600 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] neutron.http_retries           = 3 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] neutron.insecure               = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] neutron.keyfile                = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] neutron.max_version            = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] neutron.min_version            = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] neutron.ovs_bridge             = br-int {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] neutron.physnets               = [] {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] neutron.region_name            = RegionOne {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] neutron.service_metadata_proxy = True {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] neutron.service_name           = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] neutron.service_type           = network {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] neutron.split_loggers          = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] neutron.status_code_retries    = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] neutron.status_code_retry_delay = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] neutron.timeout                = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] neutron.version                = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] notifications.bdms_in_notifications = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] notifications.default_level    = INFO {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] notifications.notification_format = unversioned {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] notifications.notify_on_state_change = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] pci.alias                      = [] {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] pci.device_spec                = [] {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] pci.report_in_placement        = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] placement.auth_section         = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] placement.auth_type            = password {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] placement.cafile               = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] placement.certfile             = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] placement.collect_timing       = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] placement.connect_retries      = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] placement.connect_retry_delay  = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] placement.default_domain_id    = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] placement.default_domain_name  = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] placement.domain_id            = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] placement.domain_name          = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] placement.endpoint_override    = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] placement.insecure             = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] placement.keyfile              = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] placement.max_version          = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] placement.min_version          = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] placement.password             = **** {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] placement.project_domain_id    = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] placement.project_domain_name  = Default {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] placement.project_id           = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] placement.project_name         = service {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] placement.region_name          = RegionOne {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] placement.service_name         = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] placement.service_type         = placement {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] placement.split_loggers        = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] placement.status_code_retries  = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] placement.status_code_retry_delay = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] placement.system_scope         = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] placement.timeout              = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] placement.trust_id             = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] placement.user_domain_id       = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] placement.user_domain_name     = Default {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] placement.user_id              = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] placement.username             = placement {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] placement.version              = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] quota.cores                    = 20 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] quota.count_usage_from_placement = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] quota.injected_file_content_bytes = 10240 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] quota.injected_file_path_length = 255 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] quota.injected_files           = 5 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] quota.instances                = 10 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] quota.key_pairs                = 100 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] quota.metadata_items           = 128 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] quota.ram                      = 51200 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] quota.recheck_quota            = True {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] quota.server_group_members     = 10 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] quota.server_groups            = 10 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] rdp.enabled                    = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] scheduler.image_metadata_prefilter = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] scheduler.max_attempts         = 3 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] scheduler.max_placement_results = 1000 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] scheduler.query_placement_for_availability_zone = True {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] scheduler.query_placement_for_image_type_support = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] scheduler.workers              = 3 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] filter_scheduler.host_subset_size = 1 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] filter_scheduler.isolated_hosts = [] {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] filter_scheduler.isolated_images = [] {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] filter_scheduler.pci_in_placement = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] filter_scheduler.track_instance_changes = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] metrics.required               = True {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] metrics.weight_multiplier      = 1.0 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] metrics.weight_setting         = [] {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] serial_console.enabled         = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] serial_console.port_range      = 10000:20000 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] serial_console.serialproxy_port = 6083 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] service_user.auth_section      = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] service_user.auth_type         = password {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] service_user.cafile            = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] service_user.certfile          = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] service_user.collect_timing    = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] service_user.insecure          = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] service_user.keyfile           = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] service_user.send_service_user_token = True {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] service_user.split_loggers     = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] service_user.timeout           = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] spice.agent_enabled            = True {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] spice.enabled                  = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] spice.html5proxy_port          = 6082 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] spice.image_compression        = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] spice.jpeg_compression         = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] spice.playback_compression     = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] spice.server_listen            = 127.0.0.1 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] spice.streaming_mode           = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] spice.zlib_compression         = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] upgrade_levels.baseapi         = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] upgrade_levels.cert            = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] upgrade_levels.compute         = auto {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] upgrade_levels.conductor       = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] upgrade_levels.scheduler       = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vendordata_dynamic_auth.auth_section = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vendordata_dynamic_auth.auth_type = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vendordata_dynamic_auth.cafile = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vendordata_dynamic_auth.certfile = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vendordata_dynamic_auth.insecure = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vendordata_dynamic_auth.keyfile = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vendordata_dynamic_auth.timeout = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vmware.api_retry_count         = 10 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vmware.ca_file                 = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vmware.cache_prefix            = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vmware.cluster_name            = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vmware.connection_pool_size    = 10 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vmware.console_delay_seconds   = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vmware.datastore_regex         = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vmware.host_ip                 = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vmware.host_password           = **** {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vmware.host_port               = 443 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vmware.host_username           = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vmware.insecure                = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vmware.integration_bridge      = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vmware.maximum_objects         = 100 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vmware.pbm_default_policy      = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vmware.pbm_enabled             = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vmware.pbm_wsdl_location       = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vmware.serial_port_proxy_uri   = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vmware.serial_port_service_uri = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vmware.task_poll_interval      = 0.5 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vmware.use_linked_clone        = True {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vmware.vnc_keymap              = en-us {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vmware.vnc_port                = 5900 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vmware.vnc_port_total          = 10000 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vnc.auth_schemes               = ['none'] {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vnc.enabled                    = True {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vnc.novncproxy_port            = 6080 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vnc.server_listen              = 0.0.0.0 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vnc.vencrypt_ca_certs          = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vnc.vencrypt_client_cert       = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vnc.vencrypt_client_key        = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] workarounds.disable_rootwrap   = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] workarounds.enable_numa_live_migration = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] workarounds.libvirt_disable_apic = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] wsgi.client_socket_timeout     = 900 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] wsgi.default_pool_size         = 1000 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] wsgi.keep_alive                = True {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] wsgi.max_header_line           = 16384 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] wsgi.ssl_ca_file               = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] wsgi.ssl_cert_file             = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] wsgi.ssl_key_file              = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] wsgi.tcp_keepidle              = 600 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] zvm.ca_file                    = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] zvm.cloud_connector_url        = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] zvm.reachable_timeout          = 300 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_policy.enforce_new_defaults = True {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_policy.enforce_scope      = True {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_policy.policy_default_rule = default {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_policy.policy_file        = policy.yaml {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] profiler.connection_string     = messaging:// {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] profiler.enabled               = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] profiler.es_doc_type           = notification {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] profiler.es_scroll_size        = 10000 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] profiler.es_scroll_time        = 2m {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] profiler.filter_error_trace    = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] profiler.hmac_keys             = **** {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] profiler.sentinel_service_name = mymaster {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] profiler.socket_timeout        = 0.1 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] profiler.trace_requests        = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] profiler.trace_sqlalchemy      = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] profiler_jaeger.process_tags   = {} {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] profiler_jaeger.service_name_prefix = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] profiler_otlp.service_name_prefix = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] remote_debug.host              = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] remote_debug.port              = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_messaging_rabbit.ssl      = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_messaging_notifications.retry = -1 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_messaging_notifications.transport_url = **** {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_limit.auth_section        = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_limit.auth_type           = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_limit.cafile              = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_limit.certfile            = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_limit.collect_timing      = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_limit.connect_retries     = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_limit.connect_retry_delay = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_limit.endpoint_id         = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_limit.endpoint_override   = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_limit.insecure            = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_limit.keyfile             = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_limit.max_version         = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_limit.min_version         = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_limit.region_name         = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_limit.service_name        = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_limit.service_type        = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_limit.split_loggers       = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_limit.status_code_retries = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_limit.status_code_retry_delay = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_limit.timeout             = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_limit.valid_interfaces    = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_limit.version             = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_reports.file_event_handler = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] oslo_reports.log_dir           = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vif_plug_ovs_privileged.group  = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] vif_plug_ovs_privileged.user   = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] os_vif_linux_bridge.flat_interface = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] os_vif_ovs.isolate_vif         = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] os_vif_ovs.per_port_bridge     = False {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] os_brick.lock_path             = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] privsep_osbrick.capabilities   = [21] {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] privsep_osbrick.group          = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] privsep_osbrick.helper_command = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] privsep_osbrick.user           = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] nova_sys_admin.group           = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] nova_sys_admin.helper_command  = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] nova_sys_admin.user            = None {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 14:36:38 user nova-compute[70924]: DEBUG oslo_service.service [None req-2202bd3c-445a-4d3c-adb3-38260cfc2621 None None] ******************************************************************************** {{(pid=70924) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Jul 29 14:36:38 user nova-compute[70924]: INFO nova.service [-] Starting compute node (version 0.0.0)
Jul 29 14:36:39 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Starting native event thread {{(pid=70924) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Jul 29 14:36:39 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Starting green dispatch thread {{(pid=70924) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Jul 29 14:36:39 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Starting connection event dispatch thread {{(pid=70924) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Jul 29 14:36:39 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Connecting to libvirt: qemu:///system {{(pid=70924) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Jul 29 14:36:39 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7feee58bb7c0> {{(pid=70924) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Jul 29 14:36:39 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7feee58bb7c0> {{(pid=70924) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Jul 29 14:36:39 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Connection event '1' reason 'None'
Jul 29 14:36:39 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Jul 29 14:36:39 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.mount [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Initialising _HostMountState generation 0 {{(pid=70924) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Jul 29 14:36:46 user nova-compute[70924]: INFO nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Libvirt host capabilities <capabilities>
Jul 29 14:36:46 user nova-compute[70924]:   <host>
Jul 29 14:36:46 user nova-compute[70924]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Jul 29 14:36:46 user nova-compute[70924]:     <cpu>
Jul 29 14:36:46 user nova-compute[70924]:       <arch>x86_64</arch>
Jul 29 14:36:46 user nova-compute[70924]:       <model>IvyBridge-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <vendor>Intel</vendor>
Jul 29 14:36:46 user nova-compute[70924]:       <microcode version='1070'/>
Jul 29 14:36:46 user nova-compute[70924]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Jul 29 14:36:46 user nova-compute[70924]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature name='ss'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature name='vmx'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature name='pcid'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature name='osxsave'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature name='hypervisor'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature name='arat'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature name='tsc_adjust'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature name='md-clear'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature name='stibp'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature name='arch-capabilities'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature name='ssbd'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature name='invtsc'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature name='rsba'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature name='skip-l1dfl-vmentry'/>
Jul 29 14:36:46 user nova-compute[70924]:       <pages unit='KiB' size='4'/>
Jul 29 14:36:46 user nova-compute[70924]:       <pages unit='KiB' size='2048'/>
Jul 29 14:36:46 user nova-compute[70924]:     </cpu>
Jul 29 14:36:46 user nova-compute[70924]:     <power_management>
Jul 29 14:36:46 user nova-compute[70924]:       <suspend_mem/>
Jul 29 14:36:46 user nova-compute[70924]:       <suspend_disk/>
Jul 29 14:36:46 user nova-compute[70924]:       <suspend_hybrid/>
Jul 29 14:36:46 user nova-compute[70924]:     </power_management>
Jul 29 14:36:46 user nova-compute[70924]:     <iommu support='no'/>
Jul 29 14:36:46 user nova-compute[70924]:     <migration_features>
Jul 29 14:36:46 user nova-compute[70924]:       <live/>
Jul 29 14:36:46 user nova-compute[70924]:       <uri_transports>
Jul 29 14:36:46 user nova-compute[70924]:         <uri_transport>tcp</uri_transport>
Jul 29 14:36:46 user nova-compute[70924]:         <uri_transport>rdma</uri_transport>
Jul 29 14:36:46 user nova-compute[70924]:       </uri_transports>
Jul 29 14:36:46 user nova-compute[70924]:     </migration_features>
Jul 29 14:36:46 user nova-compute[70924]:     <topology>
Jul 29 14:36:46 user nova-compute[70924]:       <cells num='2'>
Jul 29 14:36:46 user nova-compute[70924]:         <cell id='0'>
Jul 29 14:36:46 user nova-compute[70924]:           <memory unit='KiB'>8189224</memory>
Jul 29 14:36:46 user nova-compute[70924]:           <pages unit='KiB' size='4'>2047306</pages>
Jul 29 14:36:46 user nova-compute[70924]:           <pages unit='KiB' size='2048'>0</pages>
Jul 29 14:36:46 user nova-compute[70924]:           <distances>
Jul 29 14:36:46 user nova-compute[70924]:             <sibling id='0' value='10'/>
Jul 29 14:36:46 user nova-compute[70924]:             <sibling id='1' value='20'/>
Jul 29 14:36:46 user nova-compute[70924]:           </distances>
Jul 29 14:36:46 user nova-compute[70924]:           <cpus num='6'>
Jul 29 14:36:46 user nova-compute[70924]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Jul 29 14:36:46 user nova-compute[70924]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Jul 29 14:36:46 user nova-compute[70924]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Jul 29 14:36:46 user nova-compute[70924]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Jul 29 14:36:46 user nova-compute[70924]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Jul 29 14:36:46 user nova-compute[70924]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Jul 29 14:36:46 user nova-compute[70924]:           </cpus>
Jul 29 14:36:46 user nova-compute[70924]:         </cell>
Jul 29 14:36:46 user nova-compute[70924]:         <cell id='1'>
Jul 29 14:36:46 user nova-compute[70924]:           <memory unit='KiB'>8206460</memory>
Jul 29 14:36:46 user nova-compute[70924]:           <pages unit='KiB' size='4'>2051615</pages>
Jul 29 14:36:46 user nova-compute[70924]:           <pages unit='KiB' size='2048'>0</pages>
Jul 29 14:36:46 user nova-compute[70924]:           <distances>
Jul 29 14:36:46 user nova-compute[70924]:             <sibling id='0' value='20'/>
Jul 29 14:36:46 user nova-compute[70924]:             <sibling id='1' value='10'/>
Jul 29 14:36:46 user nova-compute[70924]:           </distances>
Jul 29 14:36:46 user nova-compute[70924]:           <cpus num='6'>
Jul 29 14:36:46 user nova-compute[70924]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Jul 29 14:36:46 user nova-compute[70924]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Jul 29 14:36:46 user nova-compute[70924]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Jul 29 14:36:46 user nova-compute[70924]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Jul 29 14:36:46 user nova-compute[70924]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Jul 29 14:36:46 user nova-compute[70924]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Jul 29 14:36:46 user nova-compute[70924]:           </cpus>
Jul 29 14:36:46 user nova-compute[70924]:         </cell>
Jul 29 14:36:46 user nova-compute[70924]:       </cells>
Jul 29 14:36:46 user nova-compute[70924]:     </topology>
Jul 29 14:36:46 user nova-compute[70924]:     <cache>
Jul 29 14:36:46 user nova-compute[70924]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Jul 29 14:36:46 user nova-compute[70924]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Jul 29 14:36:46 user nova-compute[70924]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Jul 29 14:36:46 user nova-compute[70924]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Jul 29 14:36:46 user nova-compute[70924]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Jul 29 14:36:46 user nova-compute[70924]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Jul 29 14:36:46 user nova-compute[70924]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Jul 29 14:36:46 user nova-compute[70924]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Jul 29 14:36:46 user nova-compute[70924]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Jul 29 14:36:46 user nova-compute[70924]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Jul 29 14:36:46 user nova-compute[70924]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Jul 29 14:36:46 user nova-compute[70924]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Jul 29 14:36:46 user nova-compute[70924]:     </cache>
Jul 29 14:36:46 user nova-compute[70924]:     <secmodel>
Jul 29 14:36:46 user nova-compute[70924]:       <model>apparmor</model>
Jul 29 14:36:46 user nova-compute[70924]:       <doi>0</doi>
Jul 29 14:36:46 user nova-compute[70924]:     </secmodel>
Jul 29 14:36:46 user nova-compute[70924]:     <secmodel>
Jul 29 14:36:46 user nova-compute[70924]:       <model>dac</model>
Jul 29 14:36:46 user nova-compute[70924]:       <doi>0</doi>
Jul 29 14:36:46 user nova-compute[70924]:       <baselabel type='kvm'>+64055:+108</baselabel>
Jul 29 14:36:46 user nova-compute[70924]:       <baselabel type='qemu'>+64055:+108</baselabel>
Jul 29 14:36:46 user nova-compute[70924]:     </secmodel>
Jul 29 14:36:46 user nova-compute[70924]:   </host>
Jul 29 14:36:46 user nova-compute[70924]:   <guest>
Jul 29 14:36:46 user nova-compute[70924]:     <os_type>hvm</os_type>
Jul 29 14:36:46 user nova-compute[70924]:     <arch name='alpha'>
Jul 29 14:36:46 user nova-compute[70924]:       <wordsize>64</wordsize>
Jul 29 14:36:46 user nova-compute[70924]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='4'>clipper</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <domain type='qemu'/>
Jul 29 14:36:46 user nova-compute[70924]:     </arch>
Jul 29 14:36:46 user nova-compute[70924]:     <features>
Jul 29 14:36:46 user nova-compute[70924]:       <cpuselection/>
Jul 29 14:36:46 user nova-compute[70924]:       <deviceboot/>
Jul 29 14:36:46 user nova-compute[70924]:       <disksnapshot default='on' toggle='no'/>
Jul 29 14:36:46 user nova-compute[70924]:     </features>
Jul 29 14:36:46 user nova-compute[70924]:   </guest>
Jul 29 14:36:46 user nova-compute[70924]:   <guest>
Jul 29 14:36:46 user nova-compute[70924]:     <os_type>hvm</os_type>
Jul 29 14:36:46 user nova-compute[70924]:     <arch name='armv6l'>
Jul 29 14:36:46 user nova-compute[70924]:       <wordsize>32</wordsize>
Jul 29 14:36:46 user nova-compute[70924]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>integratorcp</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2'>ast2600-evb</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>borzoi</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>spitz</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>virt-2.7</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2'>nuri</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>romulus-bmc</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='512'>virt-3.0</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='512'>virt-5.0</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2'>npcm750-evb</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>virt-2.10</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2'>rainier-bmc</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>mps3-an547</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2'>musca-b1</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>versatileab</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>kzm</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>virt-2.8</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2'>musca-a</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='512'>virt-3.1</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='512'>virt-5.1</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2'>smdkc210</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>sx1</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>virt-2.11</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>imx25-pdk</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>virt-2.9</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='4'>orangepi-pc</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>z2</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='512'>virt-5.2</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>tosa</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>mps2-an500</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>virt-2.12</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2'>mps2-an521</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='4'>sabrelite</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>mps2-an511</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>canon-a1100</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>realview-eb</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>emcraft-sf2</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>realview-pb-a8</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='512'>virt-4.0</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>raspi1ap</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>palmetto-bmc</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>sx1-v1</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>n810</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>g220a-bmc</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>n800</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2'>tacoma-bmc</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='512'>virt-4.1</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2'>quanta-gsj</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>versatilepb</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>terrier</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>mainstone</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='512'>virt-4.2</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2'>mps3-an524</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2'>kudo-bmc</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='4'>vexpress-a9</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='4'>midway</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>musicpal</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>lm3s811evb</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>lm3s6965evb</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>microbit</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>mps2-an505</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>mps2-an385</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='512'>virt-6.0</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>cubieboard</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>verdex</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>netduino2</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>mps2-an386</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='512'>virt-6.1</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='4'>raspi2b</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='4'>vexpress-a15</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2'>fuji-bmc</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='512'>virt-6.2</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>cheetah</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>virt-2.6</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>ast2500-evb</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='4'>highbank</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>akita</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>connex</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>netduinoplus2</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>collie</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>raspi0</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <domain type='qemu'/>
Jul 29 14:36:46 user nova-compute[70924]:     </arch>
Jul 29 14:36:46 user nova-compute[70924]:     <features>
Jul 29 14:36:46 user nova-compute[70924]:       <cpuselection/>
Jul 29 14:36:46 user nova-compute[70924]:       <deviceboot/>
Jul 29 14:36:46 user nova-compute[70924]:       <disksnapshot default='on' toggle='no'/>
Jul 29 14:36:46 user nova-compute[70924]:     </features>
Jul 29 14:36:46 user nova-compute[70924]:   </guest>
Jul 29 14:36:46 user nova-compute[70924]:   <guest>
Jul 29 14:36:46 user nova-compute[70924]:     <os_type>hvm</os_type>
Jul 29 14:36:46 user nova-compute[70924]:     <arch name='armv7l'>
Jul 29 14:36:46 user nova-compute[70924]:       <wordsize>32</wordsize>
Jul 29 14:36:46 user nova-compute[70924]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>integratorcp</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2'>ast2600-evb</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>borzoi</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>spitz</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>virt-2.7</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2'>nuri</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>romulus-bmc</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='512'>virt-3.0</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='512'>virt-5.0</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2'>npcm750-evb</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>virt-2.10</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2'>rainier-bmc</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>mps3-an547</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2'>musca-b1</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>versatileab</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>kzm</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>virt-2.8</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2'>musca-a</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='512'>virt-3.1</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='512'>virt-5.1</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2'>smdkc210</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>sx1</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>virt-2.11</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>imx25-pdk</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>virt-2.9</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='4'>orangepi-pc</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>z2</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='512'>virt-5.2</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>tosa</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>mps2-an500</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>virt-2.12</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2'>mps2-an521</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='4'>sabrelite</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>mps2-an511</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>canon-a1100</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>realview-eb</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>emcraft-sf2</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>realview-pb-a8</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='512'>virt-4.0</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>raspi1ap</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>palmetto-bmc</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>sx1-v1</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>n810</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>g220a-bmc</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>n800</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2'>tacoma-bmc</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='512'>virt-4.1</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2'>quanta-gsj</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>versatilepb</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>terrier</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>mainstone</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='512'>virt-4.2</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2'>mps3-an524</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2'>kudo-bmc</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='4'>vexpress-a9</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='4'>midway</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>musicpal</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>lm3s811evb</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>lm3s6965evb</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>microbit</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>mps2-an505</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>mps2-an385</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='512'>virt-6.0</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>cubieboard</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>verdex</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>netduino2</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>mps2-an386</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='512'>virt-6.1</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='4'>raspi2b</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='4'>vexpress-a15</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2'>fuji-bmc</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='512'>virt-6.2</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>cheetah</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>virt-2.6</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>ast2500-evb</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='4'>highbank</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>akita</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>connex</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>netduinoplus2</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>collie</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>raspi0</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <domain type='qemu'/>
Jul 29 14:36:46 user nova-compute[70924]:     </arch>
Jul 29 14:36:46 user nova-compute[70924]:     <features>
Jul 29 14:36:46 user nova-compute[70924]:       <cpuselection/>
Jul 29 14:36:46 user nova-compute[70924]:       <deviceboot/>
Jul 29 14:36:46 user nova-compute[70924]:       <disksnapshot default='on' toggle='no'/>
Jul 29 14:36:46 user nova-compute[70924]:     </features>
Jul 29 14:36:46 user nova-compute[70924]:   </guest>
Jul 29 14:36:46 user nova-compute[70924]:   <guest>
Jul 29 14:36:46 user nova-compute[70924]:     <os_type>hvm</os_type>
Jul 29 14:36:46 user nova-compute[70924]:     <arch name='aarch64'>
Jul 29 14:36:46 user nova-compute[70924]:       <wordsize>64</wordsize>
Jul 29 14:36:46 user nova-compute[70924]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>integratorcp</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2'>ast2600-evb</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>borzoi</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>spitz</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>virt-2.7</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2'>nuri</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>romulus-bmc</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='512'>virt-3.0</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='512'>virt-5.0</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2'>npcm750-evb</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>virt-2.10</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2'>rainier-bmc</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>mps3-an547</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>virt-2.8</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2'>musca-b1</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>versatileab</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>kzm</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2'>musca-a</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='512'>virt-3.1</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='512'>virt-5.1</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2'>smdkc210</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>sx1</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>virt-2.11</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>imx25-pdk</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>virt-2.9</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='4'>orangepi-pc</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>z2</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='512'>virt-5.2</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>tosa</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>mps2-an500</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>virt-2.12</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2'>mps2-an521</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='4'>sabrelite</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>mps2-an511</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>canon-a1100</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>realview-eb</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>emcraft-sf2</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>realview-pb-a8</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='512'>sbsa-ref</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='512'>virt-4.0</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>raspi1ap</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>palmetto-bmc</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>sx1-v1</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>n810</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>g220a-bmc</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>n800</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2'>tacoma-bmc</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='512'>virt-4.1</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2'>quanta-gsj</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>versatilepb</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>terrier</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>mainstone</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='512'>virt-4.2</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2'>mps3-an524</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2'>kudo-bmc</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='4'>vexpress-a9</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='4'>midway</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>musicpal</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>lm3s811evb</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>lm3s6965evb</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>microbit</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>mps2-an505</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>mps2-an385</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='512'>virt-6.0</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='4'>raspi3ap</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>cubieboard</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>verdex</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>netduino2</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>mps2-an386</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='512'>virt-6.1</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='4'>raspi3b</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='4'>raspi2b</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='4'>vexpress-a15</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2'>fuji-bmc</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='512'>virt-6.2</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>cheetah</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>virt-2.6</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>ast2500-evb</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='4'>highbank</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>akita</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>connex</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>netduinoplus2</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>collie</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>raspi0</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <domain type='qemu'/>
Jul 29 14:36:46 user nova-compute[70924]:     </arch>
Jul 29 14:36:46 user nova-compute[70924]:     <features>
Jul 29 14:36:46 user nova-compute[70924]:       <acpi default='on' toggle='yes'/>
Jul 29 14:36:46 user nova-compute[70924]:       <cpuselection/>
Jul 29 14:36:46 user nova-compute[70924]:       <deviceboot/>
Jul 29 14:36:46 user nova-compute[70924]:       <disksnapshot default='on' toggle='no'/>
Jul 29 14:36:46 user nova-compute[70924]:     </features>
Jul 29 14:36:46 user nova-compute[70924]:   </guest>
Jul 29 14:36:46 user nova-compute[70924]:   <guest>
Jul 29 14:36:46 user nova-compute[70924]:     <os_type>hvm</os_type>
Jul 29 14:36:46 user nova-compute[70924]:     <arch name='cris'>
Jul 29 14:36:46 user nova-compute[70924]:       <wordsize>32</wordsize>
Jul 29 14:36:46 user nova-compute[70924]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>axis-dev88</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <domain type='qemu'/>
Jul 29 14:36:46 user nova-compute[70924]:     </arch>
Jul 29 14:36:46 user nova-compute[70924]:     <features>
Jul 29 14:36:46 user nova-compute[70924]:       <cpuselection/>
Jul 29 14:36:46 user nova-compute[70924]:       <deviceboot/>
Jul 29 14:36:46 user nova-compute[70924]:       <disksnapshot default='on' toggle='no'/>
Jul 29 14:36:46 user nova-compute[70924]:     </features>
Jul 29 14:36:46 user nova-compute[70924]:   </guest>
Jul 29 14:36:46 user nova-compute[70924]:   <guest>
Jul 29 14:36:46 user nova-compute[70924]:     <os_type>hvm</os_type>
Jul 29 14:36:46 user nova-compute[70924]:     <arch name='i686'>
Jul 29 14:36:46 user nova-compute[70924]:       <wordsize>32</wordsize>
Jul 29 14:36:46 user nova-compute[70924]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-artful</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>x-remote</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>isapc</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-disco</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-impish</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-focal</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>microvm</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <domain type='qemu'/>
Jul 29 14:36:46 user nova-compute[70924]:       <domain type='kvm'/>
Jul 29 14:36:46 user nova-compute[70924]:     </arch>
Jul 29 14:36:46 user nova-compute[70924]:     <features>
Jul 29 14:36:46 user nova-compute[70924]:       <pae/>
Jul 29 14:36:46 user nova-compute[70924]:       <nonpae/>
Jul 29 14:36:46 user nova-compute[70924]:       <acpi default='on' toggle='yes'/>
Jul 29 14:36:46 user nova-compute[70924]:       <apic default='on' toggle='no'/>
Jul 29 14:36:46 user nova-compute[70924]:       <cpuselection/>
Jul 29 14:36:46 user nova-compute[70924]:       <deviceboot/>
Jul 29 14:36:46 user nova-compute[70924]:       <disksnapshot default='on' toggle='no'/>
Jul 29 14:36:46 user nova-compute[70924]:     </features>
Jul 29 14:36:46 user nova-compute[70924]:   </guest>
Jul 29 14:36:46 user nova-compute[70924]:   <guest>
Jul 29 14:36:46 user nova-compute[70924]:     <os_type>hvm</os_type>
Jul 29 14:36:46 user nova-compute[70924]:     <arch name='m68k'>
Jul 29 14:36:46 user nova-compute[70924]:       <wordsize>32</wordsize>
Jul 29 14:36:46 user nova-compute[70924]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>mcf5208evb</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>an5206</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>virt-6.0</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>q800</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>virt-6.2</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>next-cube</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>virt-6.1</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <domain type='qemu'/>
Jul 29 14:36:46 user nova-compute[70924]:     </arch>
Jul 29 14:36:46 user nova-compute[70924]:     <features>
Jul 29 14:36:46 user nova-compute[70924]:       <cpuselection/>
Jul 29 14:36:46 user nova-compute[70924]:       <deviceboot/>
Jul 29 14:36:46 user nova-compute[70924]:       <disksnapshot default='on' toggle='no'/>
Jul 29 14:36:46 user nova-compute[70924]:     </features>
Jul 29 14:36:46 user nova-compute[70924]:   </guest>
Jul 29 14:36:46 user nova-compute[70924]:   <guest>
Jul 29 14:36:46 user nova-compute[70924]:     <os_type>hvm</os_type>
Jul 29 14:36:46 user nova-compute[70924]:     <arch name='microblaze'>
Jul 29 14:36:46 user nova-compute[70924]:       <wordsize>32</wordsize>
Jul 29 14:36:46 user nova-compute[70924]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>petalogix-ml605</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <domain type='qemu'/>
Jul 29 14:36:46 user nova-compute[70924]:     </arch>
Jul 29 14:36:46 user nova-compute[70924]:     <features>
Jul 29 14:36:46 user nova-compute[70924]:       <cpuselection/>
Jul 29 14:36:46 user nova-compute[70924]:       <deviceboot/>
Jul 29 14:36:46 user nova-compute[70924]:       <disksnapshot default='on' toggle='no'/>
Jul 29 14:36:46 user nova-compute[70924]:     </features>
Jul 29 14:36:46 user nova-compute[70924]:   </guest>
Jul 29 14:36:46 user nova-compute[70924]:   <guest>
Jul 29 14:36:46 user nova-compute[70924]:     <os_type>hvm</os_type>
Jul 29 14:36:46 user nova-compute[70924]:     <arch name='microblazeel'>
Jul 29 14:36:46 user nova-compute[70924]:       <wordsize>32</wordsize>
Jul 29 14:36:46 user nova-compute[70924]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>petalogix-ml605</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <domain type='qemu'/>
Jul 29 14:36:46 user nova-compute[70924]:     </arch>
Jul 29 14:36:46 user nova-compute[70924]:     <features>
Jul 29 14:36:46 user nova-compute[70924]:       <cpuselection/>
Jul 29 14:36:46 user nova-compute[70924]:       <deviceboot/>
Jul 29 14:36:46 user nova-compute[70924]:       <disksnapshot default='on' toggle='no'/>
Jul 29 14:36:46 user nova-compute[70924]:     </features>
Jul 29 14:36:46 user nova-compute[70924]:   </guest>
Jul 29 14:36:46 user nova-compute[70924]:   <guest>
Jul 29 14:36:46 user nova-compute[70924]:     <os_type>hvm</os_type>
Jul 29 14:36:46 user nova-compute[70924]:     <arch name='mips'>
Jul 29 14:36:46 user nova-compute[70924]:       <wordsize>32</wordsize>
Jul 29 14:36:46 user nova-compute[70924]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='16'>malta</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>mipssim</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <domain type='qemu'/>
Jul 29 14:36:46 user nova-compute[70924]:     </arch>
Jul 29 14:36:46 user nova-compute[70924]:     <features>
Jul 29 14:36:46 user nova-compute[70924]:       <cpuselection/>
Jul 29 14:36:46 user nova-compute[70924]:       <deviceboot/>
Jul 29 14:36:46 user nova-compute[70924]:       <disksnapshot default='on' toggle='no'/>
Jul 29 14:36:46 user nova-compute[70924]:     </features>
Jul 29 14:36:46 user nova-compute[70924]:   </guest>
Jul 29 14:36:46 user nova-compute[70924]:   <guest>
Jul 29 14:36:46 user nova-compute[70924]:     <os_type>hvm</os_type>
Jul 29 14:36:46 user nova-compute[70924]:     <arch name='mipsel'>
Jul 29 14:36:46 user nova-compute[70924]:       <wordsize>32</wordsize>
Jul 29 14:36:46 user nova-compute[70924]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='16'>malta</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>mipssim</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <domain type='qemu'/>
Jul 29 14:36:46 user nova-compute[70924]:     </arch>
Jul 29 14:36:46 user nova-compute[70924]:     <features>
Jul 29 14:36:46 user nova-compute[70924]:       <cpuselection/>
Jul 29 14:36:46 user nova-compute[70924]:       <deviceboot/>
Jul 29 14:36:46 user nova-compute[70924]:       <disksnapshot default='on' toggle='no'/>
Jul 29 14:36:46 user nova-compute[70924]:     </features>
Jul 29 14:36:46 user nova-compute[70924]:   </guest>
Jul 29 14:36:46 user nova-compute[70924]:   <guest>
Jul 29 14:36:46 user nova-compute[70924]:     <os_type>hvm</os_type>
Jul 29 14:36:46 user nova-compute[70924]:     <arch name='mips64'>
Jul 29 14:36:46 user nova-compute[70924]:       <wordsize>64</wordsize>
Jul 29 14:36:46 user nova-compute[70924]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='16'>malta</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>mipssim</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>pica61</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>magnum</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <domain type='qemu'/>
Jul 29 14:36:46 user nova-compute[70924]:     </arch>
Jul 29 14:36:46 user nova-compute[70924]:     <features>
Jul 29 14:36:46 user nova-compute[70924]:       <cpuselection/>
Jul 29 14:36:46 user nova-compute[70924]:       <deviceboot/>
Jul 29 14:36:46 user nova-compute[70924]:       <disksnapshot default='on' toggle='no'/>
Jul 29 14:36:46 user nova-compute[70924]:     </features>
Jul 29 14:36:46 user nova-compute[70924]:   </guest>
Jul 29 14:36:46 user nova-compute[70924]:   <guest>
Jul 29 14:36:46 user nova-compute[70924]:     <os_type>hvm</os_type>
Jul 29 14:36:46 user nova-compute[70924]:     <arch name='mips64el'>
Jul 29 14:36:46 user nova-compute[70924]:       <wordsize>64</wordsize>
Jul 29 14:36:46 user nova-compute[70924]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='16'>malta</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='16'>loongson3-virt</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>mipssim</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>pica61</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>magnum</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='16'>boston</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>fuloong2e</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <domain type='qemu'/>
Jul 29 14:36:46 user nova-compute[70924]:     </arch>
Jul 29 14:36:46 user nova-compute[70924]:     <features>
Jul 29 14:36:46 user nova-compute[70924]:       <cpuselection/>
Jul 29 14:36:46 user nova-compute[70924]:       <deviceboot/>
Jul 29 14:36:46 user nova-compute[70924]:       <disksnapshot default='on' toggle='no'/>
Jul 29 14:36:46 user nova-compute[70924]:     </features>
Jul 29 14:36:46 user nova-compute[70924]:   </guest>
Jul 29 14:36:46 user nova-compute[70924]:   <guest>
Jul 29 14:36:46 user nova-compute[70924]:     <os_type>hvm</os_type>
Jul 29 14:36:46 user nova-compute[70924]:     <arch name='ppc'>
Jul 29 14:36:46 user nova-compute[70924]:       <wordsize>32</wordsize>
Jul 29 14:36:46 user nova-compute[70924]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>g3beige</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>virtex-ml507</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>mac99</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='32'>ppce500</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>pegasos2</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>sam460ex</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>bamboo</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>40p</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>ref405ep</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='15'>mpc8544ds</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>taihu</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <domain type='qemu'/>
Jul 29 14:36:46 user nova-compute[70924]:     </arch>
Jul 29 14:36:46 user nova-compute[70924]:     <features>
Jul 29 14:36:46 user nova-compute[70924]:       <cpuselection/>
Jul 29 14:36:46 user nova-compute[70924]:       <deviceboot/>
Jul 29 14:36:46 user nova-compute[70924]:       <disksnapshot default='on' toggle='no'/>
Jul 29 14:36:46 user nova-compute[70924]:     </features>
Jul 29 14:36:46 user nova-compute[70924]:   </guest>
Jul 29 14:36:46 user nova-compute[70924]:   <guest>
Jul 29 14:36:46 user nova-compute[70924]:     <os_type>hvm</os_type>
Jul 29 14:36:46 user nova-compute[70924]:     <arch name='ppc64'>
Jul 29 14:36:46 user nova-compute[70924]:       <wordsize>64</wordsize>
Jul 29 14:36:46 user nova-compute[70924]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2048'>powernv9</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>taihu</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='15'>mpc8544ds</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2048'>powernv10</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='32'>ppce500</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>40p</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>pegasos2</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>bamboo</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>g3beige</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>virtex-ml507</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>mac99</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>sam460ex</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>ref405ep</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2048'>powernv8</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <domain type='qemu'/>
Jul 29 14:36:46 user nova-compute[70924]:     </arch>
Jul 29 14:36:46 user nova-compute[70924]:     <features>
Jul 29 14:36:46 user nova-compute[70924]:       <cpuselection/>
Jul 29 14:36:46 user nova-compute[70924]:       <deviceboot/>
Jul 29 14:36:46 user nova-compute[70924]:       <disksnapshot default='on' toggle='no'/>
Jul 29 14:36:46 user nova-compute[70924]:     </features>
Jul 29 14:36:46 user nova-compute[70924]:   </guest>
Jul 29 14:36:46 user nova-compute[70924]:   <guest>
Jul 29 14:36:46 user nova-compute[70924]:     <os_type>hvm</os_type>
Jul 29 14:36:46 user nova-compute[70924]:     <arch name='ppc64le'>
Jul 29 14:36:46 user nova-compute[70924]:       <wordsize>64</wordsize>
Jul 29 14:36:46 user nova-compute[70924]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2048'>powernv9</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>taihu</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='15'>mpc8544ds</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2048'>powernv10</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='32'>ppce500</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>40p</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>pegasos2</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>bamboo</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>g3beige</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>virtex-ml507</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>mac99</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>sam460ex</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>ref405ep</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2048'>powernv8</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <domain type='qemu'/>
Jul 29 14:36:46 user nova-compute[70924]:     </arch>
Jul 29 14:36:46 user nova-compute[70924]:     <features>
Jul 29 14:36:46 user nova-compute[70924]:       <cpuselection/>
Jul 29 14:36:46 user nova-compute[70924]:       <deviceboot/>
Jul 29 14:36:46 user nova-compute[70924]:       <disksnapshot default='on' toggle='no'/>
Jul 29 14:36:46 user nova-compute[70924]:     </features>
Jul 29 14:36:46 user nova-compute[70924]:   </guest>
Jul 29 14:36:46 user nova-compute[70924]:   <guest>
Jul 29 14:36:46 user nova-compute[70924]:     <os_type>hvm</os_type>
Jul 29 14:36:46 user nova-compute[70924]:     <arch name='riscv32'>
Jul 29 14:36:46 user nova-compute[70924]:       <wordsize>32</wordsize>
Jul 29 14:36:46 user nova-compute[70924]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='8'>spike</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>opentitan</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='5'>sifive_u</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>sifive_e</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='8'>virt</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <domain type='qemu'/>
Jul 29 14:36:46 user nova-compute[70924]:     </arch>
Jul 29 14:36:46 user nova-compute[70924]:     <features>
Jul 29 14:36:46 user nova-compute[70924]:       <cpuselection/>
Jul 29 14:36:46 user nova-compute[70924]:       <deviceboot/>
Jul 29 14:36:46 user nova-compute[70924]:       <disksnapshot default='on' toggle='no'/>
Jul 29 14:36:46 user nova-compute[70924]:     </features>
Jul 29 14:36:46 user nova-compute[70924]:   </guest>
Jul 29 14:36:46 user nova-compute[70924]:   <guest>
Jul 29 14:36:46 user nova-compute[70924]:     <os_type>hvm</os_type>
Jul 29 14:36:46 user nova-compute[70924]:     <arch name='riscv64'>
Jul 29 14:36:46 user nova-compute[70924]:       <wordsize>64</wordsize>
Jul 29 14:36:46 user nova-compute[70924]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='8'>spike</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='5'>sifive_u</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>shakti_c</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>sifive_e</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='8'>virt</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <domain type='qemu'/>
Jul 29 14:36:46 user nova-compute[70924]:     </arch>
Jul 29 14:36:46 user nova-compute[70924]:     <features>
Jul 29 14:36:46 user nova-compute[70924]:       <cpuselection/>
Jul 29 14:36:46 user nova-compute[70924]:       <deviceboot/>
Jul 29 14:36:46 user nova-compute[70924]:       <disksnapshot default='on' toggle='no'/>
Jul 29 14:36:46 user nova-compute[70924]:     </features>
Jul 29 14:36:46 user nova-compute[70924]:   </guest>
Jul 29 14:36:46 user nova-compute[70924]:   <guest>
Jul 29 14:36:46 user nova-compute[70924]:     <os_type>hvm</os_type>
Jul 29 14:36:46 user nova-compute[70924]:     <arch name='s390x'>
Jul 29 14:36:46 user nova-compute[70924]:       <wordsize>64</wordsize>
Jul 29 14:36:46 user nova-compute[70924]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <domain type='qemu'/>
Jul 29 14:36:46 user nova-compute[70924]:     </arch>
Jul 29 14:36:46 user nova-compute[70924]:     <features>
Jul 29 14:36:46 user nova-compute[70924]:       <cpuselection/>
Jul 29 14:36:46 user nova-compute[70924]:       <deviceboot/>
Jul 29 14:36:46 user nova-compute[70924]:       <disksnapshot default='on' toggle='no'/>
Jul 29 14:36:46 user nova-compute[70924]:     </features>
Jul 29 14:36:46 user nova-compute[70924]:   </guest>
Jul 29 14:36:46 user nova-compute[70924]:   <guest>
Jul 29 14:36:46 user nova-compute[70924]:     <os_type>hvm</os_type>
Jul 29 14:36:46 user nova-compute[70924]:     <arch name='sh4'>
Jul 29 14:36:46 user nova-compute[70924]:       <wordsize>32</wordsize>
Jul 29 14:36:46 user nova-compute[70924]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>shix</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>r2d</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <domain type='qemu'/>
Jul 29 14:36:46 user nova-compute[70924]:     </arch>
Jul 29 14:36:46 user nova-compute[70924]:     <features>
Jul 29 14:36:46 user nova-compute[70924]:       <cpuselection/>
Jul 29 14:36:46 user nova-compute[70924]:       <deviceboot/>
Jul 29 14:36:46 user nova-compute[70924]:       <disksnapshot default='on' toggle='no'/>
Jul 29 14:36:46 user nova-compute[70924]:     </features>
Jul 29 14:36:46 user nova-compute[70924]:   </guest>
Jul 29 14:36:46 user nova-compute[70924]:   <guest>
Jul 29 14:36:46 user nova-compute[70924]:     <os_type>hvm</os_type>
Jul 29 14:36:46 user nova-compute[70924]:     <arch name='sh4eb'>
Jul 29 14:36:46 user nova-compute[70924]:       <wordsize>64</wordsize>
Jul 29 14:36:46 user nova-compute[70924]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>shix</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>r2d</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <domain type='qemu'/>
Jul 29 14:36:46 user nova-compute[70924]:     </arch>
Jul 29 14:36:46 user nova-compute[70924]:     <features>
Jul 29 14:36:46 user nova-compute[70924]:       <cpuselection/>
Jul 29 14:36:46 user nova-compute[70924]:       <deviceboot/>
Jul 29 14:36:46 user nova-compute[70924]:       <disksnapshot default='on' toggle='no'/>
Jul 29 14:36:46 user nova-compute[70924]:     </features>
Jul 29 14:36:46 user nova-compute[70924]:   </guest>
Jul 29 14:36:46 user nova-compute[70924]:   <guest>
Jul 29 14:36:46 user nova-compute[70924]:     <os_type>hvm</os_type>
Jul 29 14:36:46 user nova-compute[70924]:     <arch name='sparc'>
Jul 29 14:36:46 user nova-compute[70924]:       <wordsize>32</wordsize>
Jul 29 14:36:46 user nova-compute[70924]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>SS-5</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='4'>SS-20</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>LX</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>SPARCClassic</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>leon3_generic</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>SPARCbook</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>SS-4</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='4'>SS-600MP</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='4'>SS-10</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>Voyager</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <domain type='qemu'/>
Jul 29 14:36:46 user nova-compute[70924]:     </arch>
Jul 29 14:36:46 user nova-compute[70924]:     <features>
Jul 29 14:36:46 user nova-compute[70924]:       <cpuselection/>
Jul 29 14:36:46 user nova-compute[70924]:       <deviceboot/>
Jul 29 14:36:46 user nova-compute[70924]:       <disksnapshot default='on' toggle='no'/>
Jul 29 14:36:46 user nova-compute[70924]:     </features>
Jul 29 14:36:46 user nova-compute[70924]:   </guest>
Jul 29 14:36:46 user nova-compute[70924]:   <guest>
Jul 29 14:36:46 user nova-compute[70924]:     <os_type>hvm</os_type>
Jul 29 14:36:46 user nova-compute[70924]:     <arch name='sparc64'>
Jul 29 14:36:46 user nova-compute[70924]:       <wordsize>64</wordsize>
Jul 29 14:36:46 user nova-compute[70924]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>sun4u</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>niagara</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>sun4v</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <domain type='qemu'/>
Jul 29 14:36:46 user nova-compute[70924]:     </arch>
Jul 29 14:36:46 user nova-compute[70924]:     <features>
Jul 29 14:36:46 user nova-compute[70924]:       <cpuselection/>
Jul 29 14:36:46 user nova-compute[70924]:       <deviceboot/>
Jul 29 14:36:46 user nova-compute[70924]:       <disksnapshot default='on' toggle='no'/>
Jul 29 14:36:46 user nova-compute[70924]:     </features>
Jul 29 14:36:46 user nova-compute[70924]:   </guest>
Jul 29 14:36:46 user nova-compute[70924]:   <guest>
Jul 29 14:36:46 user nova-compute[70924]:     <os_type>hvm</os_type>
Jul 29 14:36:46 user nova-compute[70924]:     <arch name='x86_64'>
Jul 29 14:36:46 user nova-compute[70924]:       <wordsize>64</wordsize>
Jul 29 14:36:46 user nova-compute[70924]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-artful</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>x-remote</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='1'>isapc</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-disco</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-impish</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-focal</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>microvm</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <domain type='qemu'/>
Jul 29 14:36:46 user nova-compute[70924]:       <domain type='kvm'/>
Jul 29 14:36:46 user nova-compute[70924]:     </arch>
Jul 29 14:36:46 user nova-compute[70924]:     <features>
Jul 29 14:36:46 user nova-compute[70924]:       <acpi default='on' toggle='yes'/>
Jul 29 14:36:46 user nova-compute[70924]:       <apic default='on' toggle='no'/>
Jul 29 14:36:46 user nova-compute[70924]:       <cpuselection/>
Jul 29 14:36:46 user nova-compute[70924]:       <deviceboot/>
Jul 29 14:36:46 user nova-compute[70924]:       <disksnapshot default='on' toggle='no'/>
Jul 29 14:36:46 user nova-compute[70924]:     </features>
Jul 29 14:36:46 user nova-compute[70924]:   </guest>
Jul 29 14:36:46 user nova-compute[70924]:   <guest>
Jul 29 14:36:46 user nova-compute[70924]:     <os_type>hvm</os_type>
Jul 29 14:36:46 user nova-compute[70924]:     <arch name='xtensa'>
Jul 29 14:36:46 user nova-compute[70924]:       <wordsize>32</wordsize>
Jul 29 14:36:46 user nova-compute[70924]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='4'>sim</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='32'>kc705</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='32'>ml605</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='32'>ml605-nommu</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='32'>virt</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='32'>lx60-nommu</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='32'>lx200</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='32'>lx200-nommu</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='32'>lx60</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='32'>kc705-nommu</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <domain type='qemu'/>
Jul 29 14:36:46 user nova-compute[70924]:     </arch>
Jul 29 14:36:46 user nova-compute[70924]:     <features>
Jul 29 14:36:46 user nova-compute[70924]:       <cpuselection/>
Jul 29 14:36:46 user nova-compute[70924]:       <deviceboot/>
Jul 29 14:36:46 user nova-compute[70924]:       <disksnapshot default='on' toggle='no'/>
Jul 29 14:36:46 user nova-compute[70924]:     </features>
Jul 29 14:36:46 user nova-compute[70924]:   </guest>
Jul 29 14:36:46 user nova-compute[70924]:   <guest>
Jul 29 14:36:46 user nova-compute[70924]:     <os_type>hvm</os_type>
Jul 29 14:36:46 user nova-compute[70924]:     <arch name='xtensaeb'>
Jul 29 14:36:46 user nova-compute[70924]:       <wordsize>32</wordsize>
Jul 29 14:36:46 user nova-compute[70924]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='4'>sim</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='32'>kc705</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='32'>ml605</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='32'>ml605-nommu</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='32'>virt</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='32'>lx60-nommu</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='32'>lx200</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='32'>lx200-nommu</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='32'>lx60</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <machine maxCpus='32'>kc705-nommu</machine>
Jul 29 14:36:46 user nova-compute[70924]:       <domain type='qemu'/>
Jul 29 14:36:46 user nova-compute[70924]:     </arch>
Jul 29 14:36:46 user nova-compute[70924]:     <features>
Jul 29 14:36:46 user nova-compute[70924]:       <cpuselection/>
Jul 29 14:36:46 user nova-compute[70924]:       <deviceboot/>
Jul 29 14:36:46 user nova-compute[70924]:       <disksnapshot default='on' toggle='no'/>
Jul 29 14:36:46 user nova-compute[70924]:     </features>
Jul 29 14:36:46 user nova-compute[70924]:   </guest>
Jul 29 14:36:46 user nova-compute[70924]: </capabilities>
Jul 29 14:36:46 user nova-compute[70924]: 
Jul 29 14:36:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=70924) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 29 14:36:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=70924) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 29 14:36:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=70924) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 29 14:36:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=70924) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 29 14:36:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=70924) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 29 14:36:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=70924) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 29 14:36:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=70924) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 29 14:36:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=70924) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 29 14:36:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=70924) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 29 14:36:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=70924) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 29 14:36:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=70924) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 29 14:36:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Getting domain capabilities for i686 via machine types: {'q35', 'pc', 'ubuntu-q35', 'ubuntu'} {{(pid=70924) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 29 14:36:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Jul 29 14:36:46 user nova-compute[70924]: <domainCapabilities>
Jul 29 14:36:46 user nova-compute[70924]:   <path>/usr/bin/qemu-system-i386</path>
Jul 29 14:36:46 user nova-compute[70924]:   <domain>kvm</domain>
Jul 29 14:36:46 user nova-compute[70924]:   <machine>pc-q35-6.2</machine>
Jul 29 14:36:46 user nova-compute[70924]:   <arch>i686</arch>
Jul 29 14:36:46 user nova-compute[70924]:   <vcpu max='288'/>
Jul 29 14:36:46 user nova-compute[70924]:   <iothreads supported='yes'/>
Jul 29 14:36:46 user nova-compute[70924]:   <os supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:     <enum name='firmware'/>
Jul 29 14:36:46 user nova-compute[70924]:     <loader supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 29 14:36:46 user nova-compute[70924]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 29 14:36:46 user nova-compute[70924]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 29 14:36:46 user nova-compute[70924]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 29 14:36:46 user nova-compute[70924]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='type'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>rom</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>pflash</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='readonly'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>yes</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>no</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='secure'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>no</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </loader>
Jul 29 14:36:46 user nova-compute[70924]:   </os>
Jul 29 14:36:46 user nova-compute[70924]:   <cpu>
Jul 29 14:36:46 user nova-compute[70924]:     <mode name='host-passthrough' supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='hostPassthroughMigratable'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>off</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </mode>
Jul 29 14:36:46 user nova-compute[70924]:     <mode name='maximum' supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='maximumMigratable'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>on</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>off</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </mode>
Jul 29 14:36:46 user nova-compute[70924]:     <mode name='host-model' supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <vendor>Intel</vendor>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='ss'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='vmx'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='pcid'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='hypervisor'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='arat'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='tsc_adjust'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='umip'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='md-clear'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='stibp'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='arch-capabilities'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='ssbd'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='ibpb'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='ibrs'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='amd-stibp'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='amd-ssbd'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='disable' name='erms'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='disable' name='xsaveopt'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='disable' name='lm'/>
Jul 29 14:36:46 user nova-compute[70924]:     </mode>
Jul 29 14:36:46 user nova-compute[70924]:     <mode name='custom' supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>qemu64</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>qemu32</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>phenom</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>pentium3</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>pentium2</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>pentium</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>n270</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>kvm64</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>kvm32</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>coreduo</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>core2duo</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>athlon</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Westmere-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Westmere</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Snowridge</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Skylake-Server</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Skylake-Client</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>SandyBridge</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Penryn</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Opteron_G5</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Opteron_G4</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Opteron_G3</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Opteron_G2</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Opteron_G1</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Nehalem-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Nehalem</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>IvyBridge</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Icelake-Server</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Haswell-noTSX</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Haswell-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Haswell</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>EPYC-Rome</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>EPYC-Milan</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>EPYC-IBPB</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>EPYC</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Dhyana</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Cooperlake</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Conroe</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Cascadelake-Server</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Broadwell-noTSX</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Broadwell-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Broadwell</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>486</model>
Jul 29 14:36:46 user nova-compute[70924]:     </mode>
Jul 29 14:36:46 user nova-compute[70924]:   </cpu>
Jul 29 14:36:46 user nova-compute[70924]:   <memoryBacking supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:     <enum name='sourceType'>
Jul 29 14:36:46 user nova-compute[70924]:       <value>file</value>
Jul 29 14:36:46 user nova-compute[70924]:       <value>anonymous</value>
Jul 29 14:36:46 user nova-compute[70924]:       <value>memfd</value>
Jul 29 14:36:46 user nova-compute[70924]:     </enum>
Jul 29 14:36:46 user nova-compute[70924]:   </memoryBacking>
Jul 29 14:36:46 user nova-compute[70924]:   <devices>
Jul 29 14:36:46 user nova-compute[70924]:     <disk supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='diskDevice'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>disk</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>cdrom</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>floppy</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>lun</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='bus'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>fdc</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>scsi</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtio</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>usb</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>sata</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='model'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtio</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtio-transitional</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtio-non-transitional</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </disk>
Jul 29 14:36:46 user nova-compute[70924]:     <graphics supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='type'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>sdl</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>vnc</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>spice</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>egl-headless</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </graphics>
Jul 29 14:36:46 user nova-compute[70924]:     <video supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='modelType'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>vga</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>cirrus</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>vmvga</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>qxl</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtio</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>none</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>bochs</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>ramfb</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </video>
Jul 29 14:36:46 user nova-compute[70924]:     <hostdev supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='mode'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>subsystem</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='startupPolicy'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>default</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>mandatory</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>requisite</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>optional</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='subsysType'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>usb</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>pci</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>scsi</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='capsType'/>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='pciBackend'/>
Jul 29 14:36:46 user nova-compute[70924]:     </hostdev>
Jul 29 14:36:46 user nova-compute[70924]:     <rng supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='model'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtio</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtio-transitional</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtio-non-transitional</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='backendModel'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>random</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>egd</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>builtin</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </rng>
Jul 29 14:36:46 user nova-compute[70924]:     <filesystem supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='driverType'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>path</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>handle</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtiofs</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </filesystem>
Jul 29 14:36:46 user nova-compute[70924]:     <tpm supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='model'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>tpm-tis</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>tpm-crb</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='backendModel'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>passthrough</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>emulator</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </tpm>
Jul 29 14:36:46 user nova-compute[70924]:   </devices>
Jul 29 14:36:46 user nova-compute[70924]:   <features>
Jul 29 14:36:46 user nova-compute[70924]:     <gic supported='no'/>
Jul 29 14:36:46 user nova-compute[70924]:     <vmcoreinfo supported='yes'/>
Jul 29 14:36:46 user nova-compute[70924]:     <genid supported='yes'/>
Jul 29 14:36:46 user nova-compute[70924]:     <backingStoreInput supported='yes'/>
Jul 29 14:36:46 user nova-compute[70924]:     <backup supported='yes'/>
Jul 29 14:36:46 user nova-compute[70924]:     <sev supported='no'/>
Jul 29 14:36:46 user nova-compute[70924]:   </features>
Jul 29 14:36:46 user nova-compute[70924]: </domainCapabilities>
Jul 29 14:36:46 user nova-compute[70924]:  {{(pid=70924) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 29 14:36:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Jul 29 14:36:46 user nova-compute[70924]: <domainCapabilities>
Jul 29 14:36:46 user nova-compute[70924]:   <path>/usr/bin/qemu-system-i386</path>
Jul 29 14:36:46 user nova-compute[70924]:   <domain>kvm</domain>
Jul 29 14:36:46 user nova-compute[70924]:   <machine>pc-i440fx-6.2</machine>
Jul 29 14:36:46 user nova-compute[70924]:   <arch>i686</arch>
Jul 29 14:36:46 user nova-compute[70924]:   <vcpu max='255'/>
Jul 29 14:36:46 user nova-compute[70924]:   <iothreads supported='yes'/>
Jul 29 14:36:46 user nova-compute[70924]:   <os supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:     <enum name='firmware'/>
Jul 29 14:36:46 user nova-compute[70924]:     <loader supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 29 14:36:46 user nova-compute[70924]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 29 14:36:46 user nova-compute[70924]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 29 14:36:46 user nova-compute[70924]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 29 14:36:46 user nova-compute[70924]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='type'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>rom</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>pflash</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='readonly'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>yes</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>no</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='secure'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>no</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </loader>
Jul 29 14:36:46 user nova-compute[70924]:   </os>
Jul 29 14:36:46 user nova-compute[70924]:   <cpu>
Jul 29 14:36:46 user nova-compute[70924]:     <mode name='host-passthrough' supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='hostPassthroughMigratable'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>off</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </mode>
Jul 29 14:36:46 user nova-compute[70924]:     <mode name='maximum' supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='maximumMigratable'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>on</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>off</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </mode>
Jul 29 14:36:46 user nova-compute[70924]:     <mode name='host-model' supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <vendor>Intel</vendor>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='ss'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='vmx'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='pcid'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='hypervisor'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='arat'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='tsc_adjust'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='umip'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='md-clear'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='stibp'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='arch-capabilities'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='ssbd'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='ibpb'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='ibrs'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='amd-stibp'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='amd-ssbd'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='disable' name='erms'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='disable' name='xsaveopt'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='disable' name='lm'/>
Jul 29 14:36:46 user nova-compute[70924]:     </mode>
Jul 29 14:36:46 user nova-compute[70924]:     <mode name='custom' supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>qemu64</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>qemu32</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>phenom</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>pentium3</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>pentium2</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>pentium</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>n270</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>kvm64</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>kvm32</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>coreduo</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>core2duo</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>athlon</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Westmere-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Westmere</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Snowridge</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Skylake-Server</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Skylake-Client</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>SandyBridge</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Penryn</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Opteron_G5</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Opteron_G4</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Opteron_G3</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Opteron_G2</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Opteron_G1</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Nehalem-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Nehalem</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>IvyBridge</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Icelake-Server</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Haswell-noTSX</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Haswell-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Haswell</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>EPYC-Rome</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>EPYC-Milan</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>EPYC-IBPB</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>EPYC</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Dhyana</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Cooperlake</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Conroe</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Cascadelake-Server</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Broadwell-noTSX</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Broadwell-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Broadwell</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>486</model>
Jul 29 14:36:46 user nova-compute[70924]:     </mode>
Jul 29 14:36:46 user nova-compute[70924]:   </cpu>
Jul 29 14:36:46 user nova-compute[70924]:   <memoryBacking supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:     <enum name='sourceType'>
Jul 29 14:36:46 user nova-compute[70924]:       <value>file</value>
Jul 29 14:36:46 user nova-compute[70924]:       <value>anonymous</value>
Jul 29 14:36:46 user nova-compute[70924]:       <value>memfd</value>
Jul 29 14:36:46 user nova-compute[70924]:     </enum>
Jul 29 14:36:46 user nova-compute[70924]:   </memoryBacking>
Jul 29 14:36:46 user nova-compute[70924]:   <devices>
Jul 29 14:36:46 user nova-compute[70924]:     <disk supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='diskDevice'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>disk</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>cdrom</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>floppy</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>lun</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='bus'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>ide</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>fdc</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>scsi</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtio</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>usb</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>sata</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='model'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtio</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtio-transitional</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtio-non-transitional</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </disk>
Jul 29 14:36:46 user nova-compute[70924]:     <graphics supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='type'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>sdl</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>vnc</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>spice</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>egl-headless</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </graphics>
Jul 29 14:36:46 user nova-compute[70924]:     <video supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='modelType'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>vga</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>cirrus</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>vmvga</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>qxl</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtio</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>none</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>bochs</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>ramfb</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </video>
Jul 29 14:36:46 user nova-compute[70924]:     <hostdev supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='mode'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>subsystem</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='startupPolicy'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>default</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>mandatory</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>requisite</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>optional</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='subsysType'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>usb</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>pci</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>scsi</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='capsType'/>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='pciBackend'/>
Jul 29 14:36:46 user nova-compute[70924]:     </hostdev>
Jul 29 14:36:46 user nova-compute[70924]:     <rng supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='model'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtio</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtio-transitional</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtio-non-transitional</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='backendModel'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>random</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>egd</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>builtin</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </rng>
Jul 29 14:36:46 user nova-compute[70924]:     <filesystem supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='driverType'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>path</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>handle</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtiofs</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </filesystem>
Jul 29 14:36:46 user nova-compute[70924]:     <tpm supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='model'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>tpm-tis</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>tpm-crb</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='backendModel'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>passthrough</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>emulator</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </tpm>
Jul 29 14:36:46 user nova-compute[70924]:   </devices>
Jul 29 14:36:46 user nova-compute[70924]:   <features>
Jul 29 14:36:46 user nova-compute[70924]:     <gic supported='no'/>
Jul 29 14:36:46 user nova-compute[70924]:     <vmcoreinfo supported='yes'/>
Jul 29 14:36:46 user nova-compute[70924]:     <genid supported='yes'/>
Jul 29 14:36:46 user nova-compute[70924]:     <backingStoreInput supported='yes'/>
Jul 29 14:36:46 user nova-compute[70924]:     <backup supported='yes'/>
Jul 29 14:36:46 user nova-compute[70924]:     <sev supported='no'/>
Jul 29 14:36:46 user nova-compute[70924]:   </features>
Jul 29 14:36:46 user nova-compute[70924]: </domainCapabilities>
Jul 29 14:36:46 user nova-compute[70924]:  {{(pid=70924) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 29 14:36:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Jul 29 14:36:46 user nova-compute[70924]: <domainCapabilities>
Jul 29 14:36:46 user nova-compute[70924]:   <path>/usr/bin/qemu-system-i386</path>
Jul 29 14:36:46 user nova-compute[70924]:   <domain>kvm</domain>
Jul 29 14:36:46 user nova-compute[70924]:   <machine>pc-q35-jammy</machine>
Jul 29 14:36:46 user nova-compute[70924]:   <arch>i686</arch>
Jul 29 14:36:46 user nova-compute[70924]:   <vcpu max='288'/>
Jul 29 14:36:46 user nova-compute[70924]:   <iothreads supported='yes'/>
Jul 29 14:36:46 user nova-compute[70924]:   <os supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:     <enum name='firmware'/>
Jul 29 14:36:46 user nova-compute[70924]:     <loader supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 29 14:36:46 user nova-compute[70924]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 29 14:36:46 user nova-compute[70924]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 29 14:36:46 user nova-compute[70924]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 29 14:36:46 user nova-compute[70924]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='type'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>rom</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>pflash</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='readonly'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>yes</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>no</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='secure'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>no</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </loader>
Jul 29 14:36:46 user nova-compute[70924]:   </os>
Jul 29 14:36:46 user nova-compute[70924]:   <cpu>
Jul 29 14:36:46 user nova-compute[70924]:     <mode name='host-passthrough' supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='hostPassthroughMigratable'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>off</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </mode>
Jul 29 14:36:46 user nova-compute[70924]:     <mode name='maximum' supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='maximumMigratable'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>on</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>off</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </mode>
Jul 29 14:36:46 user nova-compute[70924]:     <mode name='host-model' supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <vendor>Intel</vendor>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='ss'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='vmx'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='pcid'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='hypervisor'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='arat'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='tsc_adjust'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='umip'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='md-clear'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='stibp'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='arch-capabilities'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='ssbd'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='ibpb'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='ibrs'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='amd-stibp'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='amd-ssbd'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='disable' name='erms'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='disable' name='xsaveopt'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='disable' name='lm'/>
Jul 29 14:36:46 user nova-compute[70924]:     </mode>
Jul 29 14:36:46 user nova-compute[70924]:     <mode name='custom' supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>qemu64</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>qemu32</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>phenom</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>pentium3</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>pentium2</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>pentium</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>n270</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>kvm64</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>kvm32</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>coreduo</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>core2duo</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>athlon</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Westmere-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Westmere</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Snowridge</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Skylake-Server</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Skylake-Client</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>SandyBridge</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Penryn</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Opteron_G5</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Opteron_G4</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Opteron_G3</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Opteron_G2</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Opteron_G1</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Nehalem-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Nehalem</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>IvyBridge</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Icelake-Server</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Haswell-noTSX</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Haswell-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Haswell</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>EPYC-Rome</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>EPYC-Milan</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>EPYC-IBPB</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>EPYC</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Dhyana</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Cooperlake</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Conroe</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Cascadelake-Server</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Broadwell-noTSX</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Broadwell-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Broadwell</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>486</model>
Jul 29 14:36:46 user nova-compute[70924]:     </mode>
Jul 29 14:36:46 user nova-compute[70924]:   </cpu>
Jul 29 14:36:46 user nova-compute[70924]:   <memoryBacking supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:     <enum name='sourceType'>
Jul 29 14:36:46 user nova-compute[70924]:       <value>file</value>
Jul 29 14:36:46 user nova-compute[70924]:       <value>anonymous</value>
Jul 29 14:36:46 user nova-compute[70924]:       <value>memfd</value>
Jul 29 14:36:46 user nova-compute[70924]:     </enum>
Jul 29 14:36:46 user nova-compute[70924]:   </memoryBacking>
Jul 29 14:36:46 user nova-compute[70924]:   <devices>
Jul 29 14:36:46 user nova-compute[70924]:     <disk supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='diskDevice'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>disk</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>cdrom</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>floppy</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>lun</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='bus'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>fdc</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>scsi</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtio</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>usb</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>sata</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='model'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtio</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtio-transitional</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtio-non-transitional</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </disk>
Jul 29 14:36:46 user nova-compute[70924]:     <graphics supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='type'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>sdl</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>vnc</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>spice</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>egl-headless</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </graphics>
Jul 29 14:36:46 user nova-compute[70924]:     <video supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='modelType'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>vga</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>cirrus</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>vmvga</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>qxl</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtio</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>none</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>bochs</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>ramfb</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </video>
Jul 29 14:36:46 user nova-compute[70924]:     <hostdev supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='mode'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>subsystem</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='startupPolicy'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>default</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>mandatory</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>requisite</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>optional</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='subsysType'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>usb</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>pci</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>scsi</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='capsType'/>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='pciBackend'/>
Jul 29 14:36:46 user nova-compute[70924]:     </hostdev>
Jul 29 14:36:46 user nova-compute[70924]:     <rng supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='model'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtio</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtio-transitional</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtio-non-transitional</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='backendModel'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>random</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>egd</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>builtin</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </rng>
Jul 29 14:36:46 user nova-compute[70924]:     <filesystem supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='driverType'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>path</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>handle</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtiofs</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </filesystem>
Jul 29 14:36:46 user nova-compute[70924]:     <tpm supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='model'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>tpm-tis</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>tpm-crb</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='backendModel'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>passthrough</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>emulator</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </tpm>
Jul 29 14:36:46 user nova-compute[70924]:   </devices>
Jul 29 14:36:46 user nova-compute[70924]:   <features>
Jul 29 14:36:46 user nova-compute[70924]:     <gic supported='no'/>
Jul 29 14:36:46 user nova-compute[70924]:     <vmcoreinfo supported='yes'/>
Jul 29 14:36:46 user nova-compute[70924]:     <genid supported='yes'/>
Jul 29 14:36:46 user nova-compute[70924]:     <backingStoreInput supported='yes'/>
Jul 29 14:36:46 user nova-compute[70924]:     <backup supported='yes'/>
Jul 29 14:36:46 user nova-compute[70924]:     <sev supported='no'/>
Jul 29 14:36:46 user nova-compute[70924]:   </features>
Jul 29 14:36:46 user nova-compute[70924]: </domainCapabilities>
Jul 29 14:36:46 user nova-compute[70924]:  {{(pid=70924) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 29 14:36:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Jul 29 14:36:46 user nova-compute[70924]: <domainCapabilities>
Jul 29 14:36:46 user nova-compute[70924]:   <path>/usr/bin/qemu-system-i386</path>
Jul 29 14:36:46 user nova-compute[70924]:   <domain>kvm</domain>
Jul 29 14:36:46 user nova-compute[70924]:   <machine>pc-i440fx-jammy</machine>
Jul 29 14:36:46 user nova-compute[70924]:   <arch>i686</arch>
Jul 29 14:36:46 user nova-compute[70924]:   <vcpu max='255'/>
Jul 29 14:36:46 user nova-compute[70924]:   <iothreads supported='yes'/>
Jul 29 14:36:46 user nova-compute[70924]:   <os supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:     <enum name='firmware'/>
Jul 29 14:36:46 user nova-compute[70924]:     <loader supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 29 14:36:46 user nova-compute[70924]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 29 14:36:46 user nova-compute[70924]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 29 14:36:46 user nova-compute[70924]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 29 14:36:46 user nova-compute[70924]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='type'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>rom</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>pflash</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='readonly'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>yes</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>no</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='secure'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>no</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </loader>
Jul 29 14:36:46 user nova-compute[70924]:   </os>
Jul 29 14:36:46 user nova-compute[70924]:   <cpu>
Jul 29 14:36:46 user nova-compute[70924]:     <mode name='host-passthrough' supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='hostPassthroughMigratable'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>off</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </mode>
Jul 29 14:36:46 user nova-compute[70924]:     <mode name='maximum' supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='maximumMigratable'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>on</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>off</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </mode>
Jul 29 14:36:46 user nova-compute[70924]:     <mode name='host-model' supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <vendor>Intel</vendor>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='ss'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='vmx'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='pcid'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='hypervisor'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='arat'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='tsc_adjust'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='umip'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='md-clear'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='stibp'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='arch-capabilities'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='ssbd'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='ibpb'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='ibrs'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='amd-stibp'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='amd-ssbd'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='disable' name='erms'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='disable' name='xsaveopt'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='disable' name='lm'/>
Jul 29 14:36:46 user nova-compute[70924]:     </mode>
Jul 29 14:36:46 user nova-compute[70924]:     <mode name='custom' supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>qemu64</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>qemu32</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>phenom</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>pentium3</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>pentium2</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>pentium</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>n270</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>kvm64</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>kvm32</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>coreduo</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>core2duo</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>athlon</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Westmere-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Westmere</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Snowridge</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Skylake-Server</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Skylake-Client</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>SandyBridge</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Penryn</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Opteron_G5</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Opteron_G4</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Opteron_G3</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Opteron_G2</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Opteron_G1</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Nehalem-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Nehalem</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>IvyBridge</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Icelake-Server</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Haswell-noTSX</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Haswell-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Haswell</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>EPYC-Rome</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>EPYC-Milan</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>EPYC-IBPB</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>EPYC</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Dhyana</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Cooperlake</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Conroe</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Cascadelake-Server</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Broadwell-noTSX</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Broadwell-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Broadwell</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>486</model>
Jul 29 14:36:46 user nova-compute[70924]:     </mode>
Jul 29 14:36:46 user nova-compute[70924]:   </cpu>
Jul 29 14:36:46 user nova-compute[70924]:   <memoryBacking supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:     <enum name='sourceType'>
Jul 29 14:36:46 user nova-compute[70924]:       <value>file</value>
Jul 29 14:36:46 user nova-compute[70924]:       <value>anonymous</value>
Jul 29 14:36:46 user nova-compute[70924]:       <value>memfd</value>
Jul 29 14:36:46 user nova-compute[70924]:     </enum>
Jul 29 14:36:46 user nova-compute[70924]:   </memoryBacking>
Jul 29 14:36:46 user nova-compute[70924]:   <devices>
Jul 29 14:36:46 user nova-compute[70924]:     <disk supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='diskDevice'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>disk</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>cdrom</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>floppy</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>lun</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='bus'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>ide</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>fdc</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>scsi</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtio</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>usb</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>sata</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='model'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtio</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtio-transitional</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtio-non-transitional</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </disk>
Jul 29 14:36:46 user nova-compute[70924]:     <graphics supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='type'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>sdl</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>vnc</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>spice</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>egl-headless</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </graphics>
Jul 29 14:36:46 user nova-compute[70924]:     <video supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='modelType'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>vga</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>cirrus</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>vmvga</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>qxl</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtio</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>none</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>bochs</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>ramfb</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </video>
Jul 29 14:36:46 user nova-compute[70924]:     <hostdev supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='mode'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>subsystem</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='startupPolicy'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>default</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>mandatory</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>requisite</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>optional</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='subsysType'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>usb</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>pci</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>scsi</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='capsType'/>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='pciBackend'/>
Jul 29 14:36:46 user nova-compute[70924]:     </hostdev>
Jul 29 14:36:46 user nova-compute[70924]:     <rng supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='model'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtio</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtio-transitional</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtio-non-transitional</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='backendModel'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>random</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>egd</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>builtin</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </rng>
Jul 29 14:36:46 user nova-compute[70924]:     <filesystem supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='driverType'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>path</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>handle</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtiofs</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </filesystem>
Jul 29 14:36:46 user nova-compute[70924]:     <tpm supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='model'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>tpm-tis</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>tpm-crb</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='backendModel'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>passthrough</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>emulator</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </tpm>
Jul 29 14:36:46 user nova-compute[70924]:   </devices>
Jul 29 14:36:46 user nova-compute[70924]:   <features>
Jul 29 14:36:46 user nova-compute[70924]:     <gic supported='no'/>
Jul 29 14:36:46 user nova-compute[70924]:     <vmcoreinfo supported='yes'/>
Jul 29 14:36:46 user nova-compute[70924]:     <genid supported='yes'/>
Jul 29 14:36:46 user nova-compute[70924]:     <backingStoreInput supported='yes'/>
Jul 29 14:36:46 user nova-compute[70924]:     <backup supported='yes'/>
Jul 29 14:36:46 user nova-compute[70924]:     <sev supported='no'/>
Jul 29 14:36:46 user nova-compute[70924]:   </features>
Jul 29 14:36:46 user nova-compute[70924]: </domainCapabilities>
Jul 29 14:36:46 user nova-compute[70924]:  {{(pid=70924) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 29 14:36:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=70924) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 29 14:36:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=70924) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 29 14:36:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=70924) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 29 14:36:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=70924) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 29 14:36:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=70924) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 29 14:36:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=70924) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 29 14:36:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=70924) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 29 14:36:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=70924) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 29 14:36:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=70924) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 29 14:36:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=70924) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 29 14:36:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=70924) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 29 14:36:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=70924) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 29 14:36:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=70924) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 29 14:36:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=70924) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 29 14:36:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=70924) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 29 14:36:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=70924) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 29 14:36:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=70924) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 29 14:36:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', None, 'powernv'} {{(pid=70924) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 29 14:36:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=70924) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 29 14:36:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=70924) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 29 14:36:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=70924) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 29 14:36:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=70924) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 29 14:36:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=70924) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 29 14:36:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=70924) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 29 14:36:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=70924) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 29 14:36:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=70924) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 29 14:36:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=70924) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 29 14:36:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=70924) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 29 14:36:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=70924) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 29 14:36:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=70924) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 29 14:36:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=70924) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 29 14:36:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=70924) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 29 14:36:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=70924) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 29 14:36:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=70924) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 29 14:36:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=70924) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 29 14:36:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=70924) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 29 14:36:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=70924) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 29 14:36:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=70924) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 29 14:36:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'pc', 'ubuntu-q35', 'ubuntu'} {{(pid=70924) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 29 14:36:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Jul 29 14:36:46 user nova-compute[70924]: <domainCapabilities>
Jul 29 14:36:46 user nova-compute[70924]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 29 14:36:46 user nova-compute[70924]:   <domain>kvm</domain>
Jul 29 14:36:46 user nova-compute[70924]:   <machine>pc-q35-6.2</machine>
Jul 29 14:36:46 user nova-compute[70924]:   <arch>x86_64</arch>
Jul 29 14:36:46 user nova-compute[70924]:   <vcpu max='288'/>
Jul 29 14:36:46 user nova-compute[70924]:   <iothreads supported='yes'/>
Jul 29 14:36:46 user nova-compute[70924]:   <os supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:     <enum name='firmware'>
Jul 29 14:36:46 user nova-compute[70924]:       <value>efi</value>
Jul 29 14:36:46 user nova-compute[70924]:     </enum>
Jul 29 14:36:46 user nova-compute[70924]:     <loader supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Jul 29 14:36:46 user nova-compute[70924]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Jul 29 14:36:46 user nova-compute[70924]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='type'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>rom</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>pflash</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='readonly'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>yes</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>no</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='secure'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>yes</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>no</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </loader>
Jul 29 14:36:46 user nova-compute[70924]:   </os>
Jul 29 14:36:46 user nova-compute[70924]:   <cpu>
Jul 29 14:36:46 user nova-compute[70924]:     <mode name='host-passthrough' supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='hostPassthroughMigratable'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>on</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>off</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </mode>
Jul 29 14:36:46 user nova-compute[70924]:     <mode name='maximum' supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='maximumMigratable'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>on</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>off</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </mode>
Jul 29 14:36:46 user nova-compute[70924]:     <mode name='host-model' supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <vendor>Intel</vendor>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='ss'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='vmx'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='pcid'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='hypervisor'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='arat'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='tsc_adjust'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='umip'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='md-clear'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='stibp'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='arch-capabilities'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='ssbd'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='invtsc'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='ibpb'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='ibrs'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='amd-stibp'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='amd-ssbd'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='rsba'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='pschange-mc-no'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='disable' name='erms'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='disable' name='xsaveopt'/>
Jul 29 14:36:46 user nova-compute[70924]:     </mode>
Jul 29 14:36:46 user nova-compute[70924]:     <mode name='custom' supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>qemu64</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>qemu32</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>phenom</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>pentium3</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>pentium2</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>pentium</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>n270</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>kvm64</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>kvm32</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>coreduo</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>core2duo</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>athlon</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>Westmere-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>Westmere</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Snowridge</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Skylake-Server</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Skylake-Client</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>SandyBridge</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>Penryn</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Opteron_G5</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Opteron_G4</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Opteron_G3</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Opteron_G2</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>Opteron_G1</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>Nehalem</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>IvyBridge</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Icelake-Server</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Haswell-noTSX</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Haswell-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Haswell</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>EPYC-Rome</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>EPYC-Milan</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>EPYC-IBPB</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>EPYC</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Dhyana</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Cooperlake</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>Conroe</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Cascadelake-Server</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Broadwell-noTSX</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Broadwell-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Broadwell</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>486</model>
Jul 29 14:36:46 user nova-compute[70924]:     </mode>
Jul 29 14:36:46 user nova-compute[70924]:   </cpu>
Jul 29 14:36:46 user nova-compute[70924]:   <memoryBacking supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:     <enum name='sourceType'>
Jul 29 14:36:46 user nova-compute[70924]:       <value>file</value>
Jul 29 14:36:46 user nova-compute[70924]:       <value>anonymous</value>
Jul 29 14:36:46 user nova-compute[70924]:       <value>memfd</value>
Jul 29 14:36:46 user nova-compute[70924]:     </enum>
Jul 29 14:36:46 user nova-compute[70924]:   </memoryBacking>
Jul 29 14:36:46 user nova-compute[70924]:   <devices>
Jul 29 14:36:46 user nova-compute[70924]:     <disk supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='diskDevice'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>disk</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>cdrom</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>floppy</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>lun</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='bus'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>fdc</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>scsi</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtio</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>usb</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>sata</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='model'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtio</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtio-transitional</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtio-non-transitional</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </disk>
Jul 29 14:36:46 user nova-compute[70924]:     <graphics supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='type'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>sdl</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>vnc</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>spice</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>egl-headless</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </graphics>
Jul 29 14:36:46 user nova-compute[70924]:     <video supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='modelType'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>vga</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>cirrus</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>vmvga</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>qxl</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtio</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>none</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>bochs</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>ramfb</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </video>
Jul 29 14:36:46 user nova-compute[70924]:     <hostdev supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='mode'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>subsystem</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='startupPolicy'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>default</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>mandatory</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>requisite</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>optional</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='subsysType'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>usb</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>pci</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>scsi</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='capsType'/>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='pciBackend'/>
Jul 29 14:36:46 user nova-compute[70924]:     </hostdev>
Jul 29 14:36:46 user nova-compute[70924]:     <rng supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='model'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtio</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtio-transitional</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtio-non-transitional</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='backendModel'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>random</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>egd</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>builtin</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </rng>
Jul 29 14:36:46 user nova-compute[70924]:     <filesystem supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='driverType'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>path</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>handle</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtiofs</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </filesystem>
Jul 29 14:36:46 user nova-compute[70924]:     <tpm supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='model'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>tpm-tis</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>tpm-crb</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='backendModel'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>passthrough</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>emulator</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </tpm>
Jul 29 14:36:46 user nova-compute[70924]:   </devices>
Jul 29 14:36:46 user nova-compute[70924]:   <features>
Jul 29 14:36:46 user nova-compute[70924]:     <gic supported='no'/>
Jul 29 14:36:46 user nova-compute[70924]:     <vmcoreinfo supported='yes'/>
Jul 29 14:36:46 user nova-compute[70924]:     <genid supported='yes'/>
Jul 29 14:36:46 user nova-compute[70924]:     <backingStoreInput supported='yes'/>
Jul 29 14:36:46 user nova-compute[70924]:     <backup supported='yes'/>
Jul 29 14:36:46 user nova-compute[70924]:     <sev supported='no'/>
Jul 29 14:36:46 user nova-compute[70924]:   </features>
Jul 29 14:36:46 user nova-compute[70924]: </domainCapabilities>
Jul 29 14:36:46 user nova-compute[70924]:  {{(pid=70924) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 29 14:36:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Jul 29 14:36:46 user nova-compute[70924]: <domainCapabilities>
Jul 29 14:36:46 user nova-compute[70924]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 29 14:36:46 user nova-compute[70924]:   <domain>kvm</domain>
Jul 29 14:36:46 user nova-compute[70924]:   <machine>pc-i440fx-6.2</machine>
Jul 29 14:36:46 user nova-compute[70924]:   <arch>x86_64</arch>
Jul 29 14:36:46 user nova-compute[70924]:   <vcpu max='255'/>
Jul 29 14:36:46 user nova-compute[70924]:   <iothreads supported='yes'/>
Jul 29 14:36:46 user nova-compute[70924]:   <os supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:     <enum name='firmware'>
Jul 29 14:36:46 user nova-compute[70924]:       <value>efi</value>
Jul 29 14:36:46 user nova-compute[70924]:     </enum>
Jul 29 14:36:46 user nova-compute[70924]:     <loader supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='type'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>rom</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>pflash</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='readonly'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>yes</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>no</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='secure'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>no</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </loader>
Jul 29 14:36:46 user nova-compute[70924]:   </os>
Jul 29 14:36:46 user nova-compute[70924]:   <cpu>
Jul 29 14:36:46 user nova-compute[70924]:     <mode name='host-passthrough' supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='hostPassthroughMigratable'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>on</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>off</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </mode>
Jul 29 14:36:46 user nova-compute[70924]:     <mode name='maximum' supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='maximumMigratable'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>on</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>off</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </mode>
Jul 29 14:36:46 user nova-compute[70924]:     <mode name='host-model' supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <vendor>Intel</vendor>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='ss'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='vmx'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='pcid'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='hypervisor'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='arat'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='tsc_adjust'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='umip'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='md-clear'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='stibp'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='arch-capabilities'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='ssbd'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='invtsc'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='ibpb'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='ibrs'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='amd-stibp'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='amd-ssbd'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='rsba'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='pschange-mc-no'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='disable' name='erms'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='disable' name='xsaveopt'/>
Jul 29 14:36:46 user nova-compute[70924]:     </mode>
Jul 29 14:36:46 user nova-compute[70924]:     <mode name='custom' supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>qemu64</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>qemu32</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>phenom</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>pentium3</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>pentium2</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>pentium</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>n270</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>kvm64</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>kvm32</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>coreduo</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>core2duo</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>athlon</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>Westmere-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>Westmere</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Snowridge</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Skylake-Server</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Skylake-Client</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>SandyBridge</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>Penryn</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Opteron_G5</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Opteron_G4</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Opteron_G3</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Opteron_G2</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>Opteron_G1</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>Nehalem</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>IvyBridge</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Icelake-Server</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Haswell-noTSX</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Haswell-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Haswell</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>EPYC-Rome</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>EPYC-Milan</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>EPYC-IBPB</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>EPYC</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Dhyana</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Cooperlake</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>Conroe</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Cascadelake-Server</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Broadwell-noTSX</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Broadwell-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Broadwell</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>486</model>
Jul 29 14:36:46 user nova-compute[70924]:     </mode>
Jul 29 14:36:46 user nova-compute[70924]:   </cpu>
Jul 29 14:36:46 user nova-compute[70924]:   <memoryBacking supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:     <enum name='sourceType'>
Jul 29 14:36:46 user nova-compute[70924]:       <value>file</value>
Jul 29 14:36:46 user nova-compute[70924]:       <value>anonymous</value>
Jul 29 14:36:46 user nova-compute[70924]:       <value>memfd</value>
Jul 29 14:36:46 user nova-compute[70924]:     </enum>
Jul 29 14:36:46 user nova-compute[70924]:   </memoryBacking>
Jul 29 14:36:46 user nova-compute[70924]:   <devices>
Jul 29 14:36:46 user nova-compute[70924]:     <disk supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='diskDevice'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>disk</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>cdrom</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>floppy</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>lun</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='bus'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>ide</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>fdc</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>scsi</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtio</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>usb</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>sata</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='model'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtio</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtio-transitional</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtio-non-transitional</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </disk>
Jul 29 14:36:46 user nova-compute[70924]:     <graphics supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='type'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>sdl</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>vnc</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>spice</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>egl-headless</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </graphics>
Jul 29 14:36:46 user nova-compute[70924]:     <video supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='modelType'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>vga</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>cirrus</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>vmvga</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>qxl</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtio</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>none</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>bochs</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>ramfb</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </video>
Jul 29 14:36:46 user nova-compute[70924]:     <hostdev supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='mode'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>subsystem</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='startupPolicy'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>default</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>mandatory</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>requisite</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>optional</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='subsysType'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>usb</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>pci</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>scsi</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='capsType'/>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='pciBackend'/>
Jul 29 14:36:46 user nova-compute[70924]:     </hostdev>
Jul 29 14:36:46 user nova-compute[70924]:     <rng supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='model'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtio</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtio-transitional</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtio-non-transitional</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='backendModel'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>random</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>egd</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>builtin</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </rng>
Jul 29 14:36:46 user nova-compute[70924]:     <filesystem supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='driverType'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>path</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>handle</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtiofs</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </filesystem>
Jul 29 14:36:46 user nova-compute[70924]:     <tpm supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='model'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>tpm-tis</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>tpm-crb</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='backendModel'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>passthrough</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>emulator</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </tpm>
Jul 29 14:36:46 user nova-compute[70924]:   </devices>
Jul 29 14:36:46 user nova-compute[70924]:   <features>
Jul 29 14:36:46 user nova-compute[70924]:     <gic supported='no'/>
Jul 29 14:36:46 user nova-compute[70924]:     <vmcoreinfo supported='yes'/>
Jul 29 14:36:46 user nova-compute[70924]:     <genid supported='yes'/>
Jul 29 14:36:46 user nova-compute[70924]:     <backingStoreInput supported='yes'/>
Jul 29 14:36:46 user nova-compute[70924]:     <backup supported='yes'/>
Jul 29 14:36:46 user nova-compute[70924]:     <sev supported='no'/>
Jul 29 14:36:46 user nova-compute[70924]:   </features>
Jul 29 14:36:46 user nova-compute[70924]: </domainCapabilities>
Jul 29 14:36:46 user nova-compute[70924]:  {{(pid=70924) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 29 14:36:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Jul 29 14:36:46 user nova-compute[70924]: <domainCapabilities>
Jul 29 14:36:46 user nova-compute[70924]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 29 14:36:46 user nova-compute[70924]:   <domain>kvm</domain>
Jul 29 14:36:46 user nova-compute[70924]:   <machine>pc-q35-jammy</machine>
Jul 29 14:36:46 user nova-compute[70924]:   <arch>x86_64</arch>
Jul 29 14:36:46 user nova-compute[70924]:   <vcpu max='288'/>
Jul 29 14:36:46 user nova-compute[70924]:   <iothreads supported='yes'/>
Jul 29 14:36:46 user nova-compute[70924]:   <os supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:     <enum name='firmware'>
Jul 29 14:36:46 user nova-compute[70924]:       <value>efi</value>
Jul 29 14:36:46 user nova-compute[70924]:     </enum>
Jul 29 14:36:46 user nova-compute[70924]:     <loader supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Jul 29 14:36:46 user nova-compute[70924]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Jul 29 14:36:46 user nova-compute[70924]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='type'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>rom</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>pflash</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='readonly'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>yes</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>no</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='secure'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>yes</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>no</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </loader>
Jul 29 14:36:46 user nova-compute[70924]:   </os>
Jul 29 14:36:46 user nova-compute[70924]:   <cpu>
Jul 29 14:36:46 user nova-compute[70924]:     <mode name='host-passthrough' supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='hostPassthroughMigratable'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>on</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>off</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </mode>
Jul 29 14:36:46 user nova-compute[70924]:     <mode name='maximum' supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='maximumMigratable'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>on</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>off</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </mode>
Jul 29 14:36:46 user nova-compute[70924]:     <mode name='host-model' supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <vendor>Intel</vendor>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='ss'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='vmx'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='pcid'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='hypervisor'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='arat'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='tsc_adjust'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='umip'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='md-clear'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='stibp'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='arch-capabilities'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='ssbd'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='invtsc'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='ibpb'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='ibrs'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='amd-stibp'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='amd-ssbd'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='rsba'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='pschange-mc-no'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='disable' name='erms'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='disable' name='xsaveopt'/>
Jul 29 14:36:46 user nova-compute[70924]:     </mode>
Jul 29 14:36:46 user nova-compute[70924]:     <mode name='custom' supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>qemu64</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>qemu32</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>phenom</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>pentium3</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>pentium2</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>pentium</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>n270</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>kvm64</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>kvm32</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>coreduo</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>core2duo</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>athlon</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>Westmere-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>Westmere</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Snowridge</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Skylake-Server</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Skylake-Client</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>SandyBridge</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>Penryn</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Opteron_G5</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Opteron_G4</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Opteron_G3</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Opteron_G2</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>Opteron_G1</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>Nehalem</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>IvyBridge</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Icelake-Server</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Haswell-noTSX</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Haswell-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Haswell</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>EPYC-Rome</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>EPYC-Milan</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>EPYC-IBPB</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>EPYC</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Dhyana</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Cooperlake</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>Conroe</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Cascadelake-Server</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Broadwell-noTSX</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Broadwell-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Broadwell</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>486</model>
Jul 29 14:36:46 user nova-compute[70924]:     </mode>
Jul 29 14:36:46 user nova-compute[70924]:   </cpu>
Jul 29 14:36:46 user nova-compute[70924]:   <memoryBacking supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:     <enum name='sourceType'>
Jul 29 14:36:46 user nova-compute[70924]:       <value>file</value>
Jul 29 14:36:46 user nova-compute[70924]:       <value>anonymous</value>
Jul 29 14:36:46 user nova-compute[70924]:       <value>memfd</value>
Jul 29 14:36:46 user nova-compute[70924]:     </enum>
Jul 29 14:36:46 user nova-compute[70924]:   </memoryBacking>
Jul 29 14:36:46 user nova-compute[70924]:   <devices>
Jul 29 14:36:46 user nova-compute[70924]:     <disk supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='diskDevice'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>disk</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>cdrom</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>floppy</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>lun</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='bus'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>fdc</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>scsi</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtio</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>usb</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>sata</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='model'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtio</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtio-transitional</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtio-non-transitional</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </disk>
Jul 29 14:36:46 user nova-compute[70924]:     <graphics supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='type'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>sdl</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>vnc</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>spice</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>egl-headless</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </graphics>
Jul 29 14:36:46 user nova-compute[70924]:     <video supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='modelType'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>vga</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>cirrus</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>vmvga</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>qxl</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtio</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>none</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>bochs</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>ramfb</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </video>
Jul 29 14:36:46 user nova-compute[70924]:     <hostdev supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='mode'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>subsystem</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='startupPolicy'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>default</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>mandatory</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>requisite</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>optional</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='subsysType'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>usb</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>pci</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>scsi</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='capsType'/>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='pciBackend'/>
Jul 29 14:36:46 user nova-compute[70924]:     </hostdev>
Jul 29 14:36:46 user nova-compute[70924]:     <rng supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='model'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtio</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtio-transitional</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtio-non-transitional</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='backendModel'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>random</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>egd</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>builtin</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </rng>
Jul 29 14:36:46 user nova-compute[70924]:     <filesystem supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='driverType'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>path</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>handle</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtiofs</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </filesystem>
Jul 29 14:36:46 user nova-compute[70924]:     <tpm supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='model'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>tpm-tis</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>tpm-crb</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='backendModel'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>passthrough</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>emulator</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </tpm>
Jul 29 14:36:46 user nova-compute[70924]:   </devices>
Jul 29 14:36:46 user nova-compute[70924]:   <features>
Jul 29 14:36:46 user nova-compute[70924]:     <gic supported='no'/>
Jul 29 14:36:46 user nova-compute[70924]:     <vmcoreinfo supported='yes'/>
Jul 29 14:36:46 user nova-compute[70924]:     <genid supported='yes'/>
Jul 29 14:36:46 user nova-compute[70924]:     <backingStoreInput supported='yes'/>
Jul 29 14:36:46 user nova-compute[70924]:     <backup supported='yes'/>
Jul 29 14:36:46 user nova-compute[70924]:     <sev supported='no'/>
Jul 29 14:36:46 user nova-compute[70924]:   </features>
Jul 29 14:36:46 user nova-compute[70924]: </domainCapabilities>
Jul 29 14:36:46 user nova-compute[70924]:  {{(pid=70924) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 29 14:36:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Jul 29 14:36:46 user nova-compute[70924]: <domainCapabilities>
Jul 29 14:36:46 user nova-compute[70924]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 29 14:36:46 user nova-compute[70924]:   <domain>kvm</domain>
Jul 29 14:36:46 user nova-compute[70924]:   <machine>pc-i440fx-jammy</machine>
Jul 29 14:36:46 user nova-compute[70924]:   <arch>x86_64</arch>
Jul 29 14:36:46 user nova-compute[70924]:   <vcpu max='255'/>
Jul 29 14:36:46 user nova-compute[70924]:   <iothreads supported='yes'/>
Jul 29 14:36:46 user nova-compute[70924]:   <os supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:     <enum name='firmware'>
Jul 29 14:36:46 user nova-compute[70924]:       <value>efi</value>
Jul 29 14:36:46 user nova-compute[70924]:     </enum>
Jul 29 14:36:46 user nova-compute[70924]:     <loader supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='type'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>rom</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>pflash</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='readonly'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>yes</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>no</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='secure'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>no</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </loader>
Jul 29 14:36:46 user nova-compute[70924]:   </os>
Jul 29 14:36:46 user nova-compute[70924]:   <cpu>
Jul 29 14:36:46 user nova-compute[70924]:     <mode name='host-passthrough' supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='hostPassthroughMigratable'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>on</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>off</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </mode>
Jul 29 14:36:46 user nova-compute[70924]:     <mode name='maximum' supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='maximumMigratable'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>on</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>off</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </mode>
Jul 29 14:36:46 user nova-compute[70924]:     <mode name='host-model' supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <vendor>Intel</vendor>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='ss'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='vmx'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='pcid'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='hypervisor'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='arat'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='tsc_adjust'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='umip'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='md-clear'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='stibp'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='arch-capabilities'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='ssbd'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='invtsc'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='ibpb'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='ibrs'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='amd-stibp'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='amd-ssbd'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='rsba'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='require' name='pschange-mc-no'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='disable' name='erms'/>
Jul 29 14:36:46 user nova-compute[70924]:       <feature policy='disable' name='xsaveopt'/>
Jul 29 14:36:46 user nova-compute[70924]:     </mode>
Jul 29 14:36:46 user nova-compute[70924]:     <mode name='custom' supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>qemu64</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>qemu32</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>phenom</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>pentium3</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>pentium2</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>pentium</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>n270</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>kvm64</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>kvm32</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>coreduo</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>core2duo</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>athlon</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>Westmere-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>Westmere</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Snowridge</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Skylake-Server</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Skylake-Client</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>SandyBridge</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>Penryn</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Opteron_G5</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Opteron_G4</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Opteron_G3</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Opteron_G2</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>Opteron_G1</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>Nehalem</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>IvyBridge</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Icelake-Server</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Haswell-noTSX</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Haswell-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Haswell</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>EPYC-Rome</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>EPYC-Milan</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>EPYC-IBPB</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>EPYC</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Dhyana</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Cooperlake</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>Conroe</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Cascadelake-Server</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Broadwell-noTSX</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Broadwell-IBRS</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='no'>Broadwell</model>
Jul 29 14:36:46 user nova-compute[70924]:       <model usable='yes'>486</model>
Jul 29 14:36:46 user nova-compute[70924]:     </mode>
Jul 29 14:36:46 user nova-compute[70924]:   </cpu>
Jul 29 14:36:46 user nova-compute[70924]:   <memoryBacking supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:     <enum name='sourceType'>
Jul 29 14:36:46 user nova-compute[70924]:       <value>file</value>
Jul 29 14:36:46 user nova-compute[70924]:       <value>anonymous</value>
Jul 29 14:36:46 user nova-compute[70924]:       <value>memfd</value>
Jul 29 14:36:46 user nova-compute[70924]:     </enum>
Jul 29 14:36:46 user nova-compute[70924]:   </memoryBacking>
Jul 29 14:36:46 user nova-compute[70924]:   <devices>
Jul 29 14:36:46 user nova-compute[70924]:     <disk supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='diskDevice'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>disk</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>cdrom</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>floppy</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>lun</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='bus'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>ide</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>fdc</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>scsi</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtio</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>usb</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>sata</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='model'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtio</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtio-transitional</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtio-non-transitional</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </disk>
Jul 29 14:36:46 user nova-compute[70924]:     <graphics supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='type'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>sdl</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>vnc</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>spice</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>egl-headless</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </graphics>
Jul 29 14:36:46 user nova-compute[70924]:     <video supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='modelType'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>vga</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>cirrus</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>vmvga</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>qxl</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtio</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>none</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>bochs</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>ramfb</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </video>
Jul 29 14:36:46 user nova-compute[70924]:     <hostdev supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='mode'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>subsystem</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='startupPolicy'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>default</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>mandatory</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>requisite</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>optional</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='subsysType'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>usb</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>pci</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>scsi</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='capsType'/>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='pciBackend'/>
Jul 29 14:36:46 user nova-compute[70924]:     </hostdev>
Jul 29 14:36:46 user nova-compute[70924]:     <rng supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='model'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtio</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtio-transitional</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtio-non-transitional</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='backendModel'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>random</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>egd</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>builtin</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </rng>
Jul 29 14:36:46 user nova-compute[70924]:     <filesystem supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='driverType'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>path</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>handle</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>virtiofs</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </filesystem>
Jul 29 14:36:46 user nova-compute[70924]:     <tpm supported='yes'>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='model'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>tpm-tis</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>tpm-crb</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:       <enum name='backendModel'>
Jul 29 14:36:46 user nova-compute[70924]:         <value>passthrough</value>
Jul 29 14:36:46 user nova-compute[70924]:         <value>emulator</value>
Jul 29 14:36:46 user nova-compute[70924]:       </enum>
Jul 29 14:36:46 user nova-compute[70924]:     </tpm>
Jul 29 14:36:46 user nova-compute[70924]:   </devices>
Jul 29 14:36:46 user nova-compute[70924]:   <features>
Jul 29 14:36:46 user nova-compute[70924]:     <gic supported='no'/>
Jul 29 14:36:46 user nova-compute[70924]:     <vmcoreinfo supported='yes'/>
Jul 29 14:36:46 user nova-compute[70924]:     <genid supported='yes'/>
Jul 29 14:36:46 user nova-compute[70924]:     <backingStoreInput supported='yes'/>
Jul 29 14:36:46 user nova-compute[70924]:     <backup supported='yes'/>
Jul 29 14:36:46 user nova-compute[70924]:     <sev supported='no'/>
Jul 29 14:36:46 user nova-compute[70924]:   </features>
Jul 29 14:36:46 user nova-compute[70924]: </domainCapabilities>
Jul 29 14:36:46 user nova-compute[70924]:  {{(pid=70924) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 29 14:36:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=70924) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 29 14:36:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=70924) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 29 14:36:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=70924) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 29 14:36:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=70924) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 29 14:36:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Checking secure boot support for host arch (x86_64) {{(pid=70924) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Jul 29 14:36:46 user nova-compute[70924]: INFO nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Secure Boot support detected
Jul 29 14:36:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] cpu compare xml: <cpu match="exact">
Jul 29 14:36:46 user nova-compute[70924]:   <model>Nehalem</model>
Jul 29 14:36:46 user nova-compute[70924]: </cpu>
Jul 29 14:36:46 user nova-compute[70924]:  {{(pid=70924) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Jul 29 14:36:46 user nova-compute[70924]: INFO nova.virt.node [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Generated node identity e285c8ee-f39c-4daa-8d15-3de9c4f5f832
Jul 29 14:36:46 user nova-compute[70924]: INFO nova.virt.node [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Wrote node identity e285c8ee-f39c-4daa-8d15-3de9c4f5f832 to /opt/stack/data/nova/compute_id
Jul 29 14:36:46 user nova-compute[70924]: WARNING nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Compute nodes ['e285c8ee-f39c-4daa-8d15-3de9c4f5f832'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Jul 29 14:36:46 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Jul 29 14:36:46 user nova-compute[70924]: WARNING nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Jul 29 14:36:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:36:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:36:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:36:46 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Auditing locally available compute resources for user (node: user) {{(pid=70924) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 14:36:46 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:36:46 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:36:46 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Hypervisor/Node resource view: name=user free_ram=10863MB free_disk=26.377342224121094GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=70924) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 14:36:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:36:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:36:46 user nova-compute[70924]: WARNING nova.compute.resource_tracker [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] No compute node record for user:e285c8ee-f39c-4daa-8d15-3de9c4f5f832: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host e285c8ee-f39c-4daa-8d15-3de9c4f5f832 could not be found.
Jul 29 14:36:46 user nova-compute[70924]: INFO nova.compute.resource_tracker [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Compute node record created for user:user with uuid: e285c8ee-f39c-4daa-8d15-3de9c4f5f832
Jul 29 14:36:47 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 14:36:47 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 14:36:47 user nova-compute[70924]: INFO nova.scheduler.client.report [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [req-e4c91117-205c-41d1-b6d6-2a8ac0e16adf] Created resource provider record via placement API for resource provider with UUID e285c8ee-f39c-4daa-8d15-3de9c4f5f832 and name user.
Jul 29 14:36:47 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=70924) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Jul 29 14:36:47 user nova-compute[70924]: INFO nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] kernel doesn't support AMD SEV
Jul 29 14:36:47 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Updating inventory in ProviderTree for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 29 14:36:47 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70924) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 14:36:47 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Libvirt baseline CPU <cpu>
Jul 29 14:36:47 user nova-compute[70924]:   <arch>x86_64</arch>
Jul 29 14:36:47 user nova-compute[70924]:   <model>Nehalem</model>
Jul 29 14:36:47 user nova-compute[70924]:   <vendor>Intel</vendor>
Jul 29 14:36:47 user nova-compute[70924]:   <topology sockets="6" cores="1" threads="1"/>
Jul 29 14:36:47 user nova-compute[70924]: </cpu>
Jul 29 14:36:47 user nova-compute[70924]:  {{(pid=70924) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Jul 29 14:36:47 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Updated inventory for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Jul 29 14:36:47 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Updating resource provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 generation from 0 to 1 during operation: update_inventory {{(pid=70924) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Jul 29 14:36:47 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Updating inventory in ProviderTree for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 29 14:36:47 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Updating resource provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 generation from 1 to 2 during operation: update_traits {{(pid=70924) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Jul 29 14:36:47 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Compute_service record updated for user:user {{(pid=70924) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 14:36:47 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.793s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:36:47 user nova-compute[70924]: DEBUG nova.service [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Creating RPC server for service compute {{(pid=70924) start /opt/stack/nova/nova/service.py:182}}
Jul 29 14:36:47 user nova-compute[70924]: DEBUG nova.service [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Join ServiceGroup membership for this service compute {{(pid=70924) start /opt/stack/nova/nova/service.py:199}}
Jul 29 14:36:47 user nova-compute[70924]: DEBUG nova.servicegroup.drivers.db [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=70924) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Jul 29 14:36:51 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._sync_power_states {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:36:51 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:37:38 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:37:38 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:37:38 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Starting heal instance info cache {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 14:37:38 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Rebuilding the list of instances to heal {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 29 14:37:38 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Didn't find any instances for network info cache update. {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 29 14:37:38 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:37:38 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:37:38 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:37:38 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:37:38 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:37:38 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:37:38 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70924) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 14:37:38 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:37:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:37:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:37:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:37:38 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Auditing locally available compute resources for user (node: user) {{(pid=70924) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 14:37:38 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:37:38 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:37:38 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Hypervisor/Node resource view: name=user free_ram=10277MB free_disk=26.281330108642578GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=70924) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 14:37:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:37:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:37:38 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 14:37:38 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 14:37:38 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:37:38 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:37:38 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Compute_service record updated for user:user {{(pid=70924) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 14:37:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.150s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:38:38 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:38:38 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:38:38 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:38:38 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:38:39 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:38:40 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:38:40 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Starting heal instance info cache {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 14:38:40 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Rebuilding the list of instances to heal {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 29 14:38:40 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Didn't find any instances for network info cache update. {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 29 14:38:40 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:38:40 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:38:40 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:38:40 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70924) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 14:38:40 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:38:40 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:38:40 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:38:40 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:38:40 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Auditing locally available compute resources for user (node: user) {{(pid=70924) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 14:38:40 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:38:40 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:38:40 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Hypervisor/Node resource view: name=user free_ram=10196MB free_disk=26.32647705078125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=70924) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 14:38:40 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:38:40 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:38:40 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 14:38:40 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 14:38:40 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:38:40 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:38:40 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Compute_service record updated for user:user {{(pid=70924) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 14:38:40 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.112s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:39:39 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:39:39 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:39:40 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:39:40 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:39:40 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:39:40 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70924) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 14:39:40 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:39:40 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:39:40 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:39:40 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:39:40 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Auditing locally available compute resources for user (node: user) {{(pid=70924) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 14:39:40 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:39:40 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:39:40 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Hypervisor/Node resource view: name=user free_ram=10207MB free_disk=26.10042953491211GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=70924) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 14:39:40 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:39:40 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:39:40 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 14:39:40 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 14:39:40 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:39:40 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:39:40 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Compute_service record updated for user:user {{(pid=70924) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 14:39:40 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.135s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:39:42 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:39:42 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Starting heal instance info cache {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 14:39:42 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Rebuilding the list of instances to heal {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 29 14:39:42 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Didn't find any instances for network info cache update. {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 29 14:39:42 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:39:42 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:40:39 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:40:40 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:40:40 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:40:40 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:40:40 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:40:40 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:40:40 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:40:40 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Auditing locally available compute resources for user (node: user) {{(pid=70924) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 14:40:40 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:40:40 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:40:40 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Hypervisor/Node resource view: name=user free_ram=9479MB free_disk=26.123432159423828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=70924) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 14:40:40 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:40:40 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:40:40 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 14:40:40 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 14:40:40 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:40:40 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:40:40 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Compute_service record updated for user:user {{(pid=70924) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 14:40:40 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.109s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:40:41 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:40:41 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:40:42 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:40:42 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:40:42 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70924) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 14:40:43 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:40:43 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Starting heal instance info cache {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 14:40:43 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Rebuilding the list of instances to heal {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 29 14:40:43 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Didn't find any instances for network info cache update. {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 29 14:40:43 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:40:51 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Acquiring lock "db656346-c4af-43da-9600-fd39f1b9e4dc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:40:51 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "db656346-c4af-43da-9600-fd39f1b9e4dc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:40:51 user nova-compute[70924]: DEBUG nova.compute.manager [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Starting instance... {{(pid=70924) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 14:40:52 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:40:52 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:40:52 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Acquiring lock "c7776982-40ea-4b06-b853-cfd484efba73" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:40:52 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Lock "c7776982-40ea-4b06-b853-cfd484efba73" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:40:52 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70924) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 14:40:52 user nova-compute[70924]: INFO nova.compute.claims [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Claim successful on node user
Jul 29 14:40:52 user nova-compute[70924]: DEBUG nova.compute.manager [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] [instance: c7776982-40ea-4b06-b853-cfd484efba73] Starting instance... {{(pid=70924) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 14:40:52 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:40:52 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:40:52 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:40:52 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.380s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:40:52 user nova-compute[70924]: DEBUG nova.compute.manager [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Start building networks asynchronously for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 14:40:52 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.227s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:40:52 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70924) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 14:40:52 user nova-compute[70924]: INFO nova.compute.claims [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] [instance: c7776982-40ea-4b06-b853-cfd484efba73] Claim successful on node user
Jul 29 14:40:52 user nova-compute[70924]: DEBUG nova.compute.manager [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Allocating IP information in the background. {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 14:40:52 user nova-compute[70924]: DEBUG nova.network.neutron [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] allocate_for_instance() {{(pid=70924) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 14:40:52 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 14:40:52 user nova-compute[70924]: DEBUG nova.compute.manager [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Start building block device mappings for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 14:40:52 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:40:52 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:40:52 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.334s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:40:52 user nova-compute[70924]: DEBUG nova.compute.manager [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] [instance: c7776982-40ea-4b06-b853-cfd484efba73] Start building networks asynchronously for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 14:40:52 user nova-compute[70924]: DEBUG nova.compute.manager [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Start spawning the instance on the hypervisor. {{(pid=70924) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 14:40:52 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Creating instance directory {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 14:40:52 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Creating image(s)
Jul 29 14:40:52 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Acquiring lock "/opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:40:52 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "/opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:40:52 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "/opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:40:52 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Acquiring lock "bd72453517468710f1de26b27fb0ea28688e9009" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:40:52 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:40:52 user nova-compute[70924]: DEBUG nova.compute.manager [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] [instance: c7776982-40ea-4b06-b853-cfd484efba73] Allocating IP information in the background. {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 14:40:52 user nova-compute[70924]: DEBUG nova.network.neutron [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] [instance: c7776982-40ea-4b06-b853-cfd484efba73] allocate_for_instance() {{(pid=70924) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 14:40:52 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] [instance: c7776982-40ea-4b06-b853-cfd484efba73] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 14:40:52 user nova-compute[70924]: DEBUG nova.compute.manager [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] [instance: c7776982-40ea-4b06-b853-cfd484efba73] Start building block device mappings for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 14:40:53 user nova-compute[70924]: DEBUG nova.compute.manager [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] [instance: c7776982-40ea-4b06-b853-cfd484efba73] Start spawning the instance on the hypervisor. {{(pid=70924) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 14:40:53 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] [instance: c7776982-40ea-4b06-b853-cfd484efba73] Creating instance directory {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 14:40:53 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] [instance: c7776982-40ea-4b06-b853-cfd484efba73] Creating image(s)
Jul 29 14:40:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Acquiring lock "/opt/stack/data/nova/instances/c7776982-40ea-4b06-b853-cfd484efba73/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:40:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Lock "/opt/stack/data/nova/instances/c7776982-40ea-4b06-b853-cfd484efba73/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:40:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Lock "/opt/stack/data/nova/instances/c7776982-40ea-4b06-b853-cfd484efba73/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:40:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Acquiring lock "bd72453517468710f1de26b27fb0ea28688e9009" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:40:53 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009.part --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:40:53 user nova-compute[70924]: DEBUG nova.policy [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f9c6dc46d3f5436f9ca4e07705933d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d214e40cf84df584ebdf33293b5f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70924) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 14:40:53 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009.part --force-share --output=json" returned: 0 in 0.136s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:40:53 user nova-compute[70924]: DEBUG nova.virt.images [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] 3aba2e73-6832-404b-8bd0-d0503ce82b8c was qcow2, converting to raw {{(pid=70924) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 29 14:40:53 user nova-compute[70924]: DEBUG nova.privsep.utils [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70924) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 29 14:40:53 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009.part /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009.converted {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:40:54 user nova-compute[70924]: DEBUG nova.policy [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '43582a8a85c54b5e9d16d11b12bf50d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9e5c78c1684c359cfab4e32b9c213f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70924) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 14:40:54 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009.part /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009.converted" returned: 0 in 0.145s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:40:54 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009.converted --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:40:54 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009.converted --force-share --output=json" returned: 0 in 0.151s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:40:54 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.407s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:40:54 user nova-compute[70924]: INFO oslo.privsep.daemon [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpurv5t7ti/privsep.sock']
Jul 29 14:40:54 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 1.167s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:40:54 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:40:54 user sudo[80068]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpurv5t7ti/privsep.sock
Jul 29 14:40:54 user sudo[80068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Jul 29 14:40:55 user sudo[80068]: pam_unix(sudo:session): session closed for user root
Jul 29 14:40:55 user nova-compute[70924]: INFO oslo.privsep.daemon [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Spawned new privsep daemon via rootwrap
Jul 29 14:40:55 user nova-compute[70924]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 29 14:40:55 user nova-compute[70924]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 29 14:40:55 user nova-compute[70924]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Jul 29 14:40:55 user nova-compute[70924]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 80072
Jul 29 14:40:55 user nova-compute[70924]: WARNING oslo_privsep.priv_context [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] privsep daemon already running
Jul 29 14:40:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:40:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:40:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.140s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:40:56 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Acquiring lock "bd72453517468710f1de26b27fb0ea28688e9009" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:40:56 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:40:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:40:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.163s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:40:56 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Acquiring lock "bd72453517468710f1de26b27fb0ea28688e9009" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:40:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.162s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:40:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/c7776982-40ea-4b06-b853-cfd484efba73/disk 1073741824 {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:40:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/c7776982-40ea-4b06-b853-cfd484efba73/disk 1073741824" returned: 0 in 0.048s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:40:56 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.215s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:40:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:40:56 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.193s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:40:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:40:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.126s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:40:56 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c7776982-40ea-4b06-b853-cfd484efba73/disk. size=1073741824 {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 14:40:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7776982-40ea-4b06-b853-cfd484efba73/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:40:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.141s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:40:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk 1073741824 {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:40:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk 1073741824" returned: 0 in 0.049s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:40:56 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:40:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:40:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7776982-40ea-4b06-b853-cfd484efba73/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:40:56 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Cannot resize image /opt/stack/data/nova/instances/c7776982-40ea-4b06-b853-cfd484efba73/disk to a smaller size. {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 14:40:56 user nova-compute[70924]: DEBUG nova.objects.instance [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Lazy-loading 'migration_context' on Instance uuid c7776982-40ea-4b06-b853-cfd484efba73 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:40:56 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] [instance: c7776982-40ea-4b06-b853-cfd484efba73] Created local disks {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 14:40:56 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] [instance: c7776982-40ea-4b06-b853-cfd484efba73] Ensure instance console log exists: /opt/stack/data/nova/instances/c7776982-40ea-4b06-b853-cfd484efba73/console.log {{(pid=70924) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 14:40:56 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:40:56 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:40:56 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:40:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.160s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:40:56 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Checking if we can resize image /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk. size=1073741824 {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 14:40:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:40:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:40:56 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Cannot resize image /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk to a smaller size. {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 14:40:56 user nova-compute[70924]: DEBUG nova.objects.instance [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lazy-loading 'migration_context' on Instance uuid db656346-c4af-43da-9600-fd39f1b9e4dc {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:40:56 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Created local disks {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 14:40:56 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Ensure instance console log exists: /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/console.log {{(pid=70924) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 14:40:56 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:40:56 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:40:56 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:40:57 user nova-compute[70924]: DEBUG nova.network.neutron [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] [instance: c7776982-40ea-4b06-b853-cfd484efba73] Successfully created port: 52dab4ab-4869-4263-9264-9150480c9efc {{(pid=70924) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 14:40:57 user nova-compute[70924]: DEBUG nova.network.neutron [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Successfully created port: bd091ea0-8c42-4140-aad1-617f27d2a469 {{(pid=70924) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 14:40:59 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Acquiring lock "2250b0d6-5542-4a7f-90a9-93745a776fcc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:40:59 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Lock "2250b0d6-5542-4a7f-90a9-93745a776fcc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:40:59 user nova-compute[70924]: DEBUG nova.compute.manager [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] Starting instance... {{(pid=70924) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 14:41:00 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:41:00 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:41:00 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70924) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 14:41:00 user nova-compute[70924]: INFO nova.compute.claims [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] Claim successful on node user
Jul 29 14:41:00 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:41:00 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:41:00 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.326s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:41:00 user nova-compute[70924]: DEBUG nova.compute.manager [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] Start building networks asynchronously for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 14:41:00 user nova-compute[70924]: DEBUG nova.compute.manager [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] Allocating IP information in the background. {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 14:41:00 user nova-compute[70924]: DEBUG nova.network.neutron [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] allocate_for_instance() {{(pid=70924) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 14:41:00 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Acquiring lock "f5929dcf-8594-4323-a6f5-a322aff7c881" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:41:00 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Lock "f5929dcf-8594-4323-a6f5-a322aff7c881" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:41:00 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 14:41:00 user nova-compute[70924]: DEBUG nova.compute.manager [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Starting instance... {{(pid=70924) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 14:41:00 user nova-compute[70924]: DEBUG nova.compute.manager [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] Start building block device mappings for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 14:41:00 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:41:00 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:41:00 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70924) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 14:41:00 user nova-compute[70924]: INFO nova.compute.claims [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Claim successful on node user
Jul 29 14:41:00 user nova-compute[70924]: DEBUG nova.policy [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0b744bbecccf48d1833ea4810b2af2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2394c924af4a9aaa925d116b2117ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70924) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 14:41:00 user nova-compute[70924]: DEBUG nova.compute.manager [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] Start spawning the instance on the hypervisor. {{(pid=70924) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 14:41:00 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] Creating instance directory {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 14:41:00 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] Creating image(s)
Jul 29 14:41:00 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Acquiring lock "/opt/stack/data/nova/instances/2250b0d6-5542-4a7f-90a9-93745a776fcc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:41:00 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Lock "/opt/stack/data/nova/instances/2250b0d6-5542-4a7f-90a9-93745a776fcc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:41:00 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Lock "/opt/stack/data/nova/instances/2250b0d6-5542-4a7f-90a9-93745a776fcc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:41:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:41:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.124s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:41:00 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Acquiring lock "bd72453517468710f1de26b27fb0ea28688e9009" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:41:00 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:41:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:41:00 user nova-compute[70924]: DEBUG nova.network.neutron [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] [instance: c7776982-40ea-4b06-b853-cfd484efba73] Successfully updated port: 52dab4ab-4869-4263-9264-9150480c9efc {{(pid=70924) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 14:41:00 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Acquiring lock "refresh_cache-c7776982-40ea-4b06-b853-cfd484efba73" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:41:00 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Acquired lock "refresh_cache-c7776982-40ea-4b06-b853-cfd484efba73" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:41:00 user nova-compute[70924]: DEBUG nova.network.neutron [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] [instance: c7776982-40ea-4b06-b853-cfd484efba73] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 14:41:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.141s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:41:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/2250b0d6-5542-4a7f-90a9-93745a776fcc/disk 1073741824 {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:41:01 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/2250b0d6-5542-4a7f-90a9-93745a776fcc/disk 1073741824" returned: 0 in 0.069s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:41:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.214s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:41:01 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:41:01 user nova-compute[70924]: DEBUG nova.network.neutron [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Successfully updated port: bd091ea0-8c42-4140-aad1-617f27d2a469 {{(pid=70924) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 14:41:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Acquiring lock "refresh_cache-db656346-c4af-43da-9600-fd39f1b9e4dc" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:41:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Acquired lock "refresh_cache-db656346-c4af-43da-9600-fd39f1b9e4dc" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:41:01 user nova-compute[70924]: DEBUG nova.network.neutron [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 14:41:01 user nova-compute[70924]: DEBUG nova.network.neutron [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] [instance: c7776982-40ea-4b06-b853-cfd484efba73] Instance cache missing network info. {{(pid=70924) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 14:41:01 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:41:01 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:41:01 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.138s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:41:01 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2250b0d6-5542-4a7f-90a9-93745a776fcc/disk. size=1073741824 {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 14:41:01 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2250b0d6-5542-4a7f-90a9-93745a776fcc/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:41:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.612s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:41:01 user nova-compute[70924]: DEBUG nova.compute.manager [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Start building networks asynchronously for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 14:41:01 user nova-compute[70924]: DEBUG nova.compute.manager [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Allocating IP information in the background. {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 14:41:01 user nova-compute[70924]: DEBUG nova.network.neutron [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] allocate_for_instance() {{(pid=70924) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 14:41:01 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 14:41:01 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2250b0d6-5542-4a7f-90a9-93745a776fcc/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:41:01 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Cannot resize image /opt/stack/data/nova/instances/2250b0d6-5542-4a7f-90a9-93745a776fcc/disk to a smaller size. {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 14:41:01 user nova-compute[70924]: DEBUG nova.objects.instance [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Lazy-loading 'migration_context' on Instance uuid 2250b0d6-5542-4a7f-90a9-93745a776fcc {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:41:01 user nova-compute[70924]: DEBUG nova.compute.manager [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Start building block device mappings for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 14:41:01 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] Created local disks {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 14:41:01 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] Ensure instance console log exists: /opt/stack/data/nova/instances/2250b0d6-5542-4a7f-90a9-93745a776fcc/console.log {{(pid=70924) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 14:41:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:41:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:41:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:41:01 user nova-compute[70924]: DEBUG nova.compute.manager [req-49b5369d-2fb5-40e6-b388-cd70cce11d98 req-a820d33f-ff63-4d30-9ec2-87c167e196dd service nova] [instance: c7776982-40ea-4b06-b853-cfd484efba73] Received event network-changed-52dab4ab-4869-4263-9264-9150480c9efc {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:41:01 user nova-compute[70924]: DEBUG nova.compute.manager [req-49b5369d-2fb5-40e6-b388-cd70cce11d98 req-a820d33f-ff63-4d30-9ec2-87c167e196dd service nova] [instance: c7776982-40ea-4b06-b853-cfd484efba73] Refreshing instance network info cache due to event network-changed-52dab4ab-4869-4263-9264-9150480c9efc. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:41:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-49b5369d-2fb5-40e6-b388-cd70cce11d98 req-a820d33f-ff63-4d30-9ec2-87c167e196dd service nova] Acquiring lock "refresh_cache-c7776982-40ea-4b06-b853-cfd484efba73" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:41:01 user nova-compute[70924]: DEBUG nova.network.neutron [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Instance cache missing network info. {{(pid=70924) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 14:41:01 user nova-compute[70924]: DEBUG nova.compute.manager [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Start spawning the instance on the hypervisor. {{(pid=70924) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 14:41:01 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Creating instance directory {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 14:41:01 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Creating image(s)
Jul 29 14:41:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Acquiring lock "/opt/stack/data/nova/instances/f5929dcf-8594-4323-a6f5-a322aff7c881/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:41:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Lock "/opt/stack/data/nova/instances/f5929dcf-8594-4323-a6f5-a322aff7c881/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:41:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Lock "/opt/stack/data/nova/instances/f5929dcf-8594-4323-a6f5-a322aff7c881/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:41:01 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:41:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Acquiring lock "86ecc6cb-88a8-4572-8e41-d4c5859036a6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:41:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "86ecc6cb-88a8-4572-8e41-d4c5859036a6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:41:01 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.150s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:41:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Acquiring lock "bd72453517468710f1de26b27fb0ea28688e9009" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:41:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:41:01 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:41:01 user nova-compute[70924]: DEBUG nova.policy [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd93ef8af16ed4907897254f0ef7dc4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2ac23ab8cd48b390fa2047c1fd0e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70924) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 14:41:01 user nova-compute[70924]: DEBUG nova.compute.manager [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Starting instance... {{(pid=70924) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 14:41:01 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.134s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:41:01 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/f5929dcf-8594-4323-a6f5-a322aff7c881/disk 1073741824 {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:41:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:41:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:41:01 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70924) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 14:41:01 user nova-compute[70924]: INFO nova.compute.claims [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Claim successful on node user
Jul 29 14:41:01 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/f5929dcf-8594-4323-a6f5-a322aff7c881/disk 1073741824" returned: 0 in 0.051s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:41:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.187s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:41:01 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.161s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f5929dcf-8594-4323-a6f5-a322aff7c881/disk. size=1073741824 {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5929dcf-8594-4323-a6f5-a322aff7c881/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5929dcf-8594-4323-a6f5-a322aff7c881/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Cannot resize image /opt/stack/data/nova/instances/f5929dcf-8594-4323-a6f5-a322aff7c881/disk to a smaller size. {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG nova.objects.instance [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Lazy-loading 'migration_context' on Instance uuid f5929dcf-8594-4323-a6f5-a322aff7c881 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Created local disks {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Ensure instance console log exists: /opt/stack/data/nova/instances/f5929dcf-8594-4323-a6f5-a322aff7c881/console.log {{(pid=70924) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG nova.network.neutron [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] [instance: c7776982-40ea-4b06-b853-cfd484efba73] Updating instance_info_cache with network_info: [{"id": "52dab4ab-4869-4263-9264-9150480c9efc", "address": "fa:16:3e:d3:cc:2f", "network": {"id": "f29c4a92-4276-4a57-b109-2f0718fe96bd", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-899695892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73d214e40cf84df584ebdf33293b5f98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52dab4ab-48", "ovs_interfaceid": "52dab4ab-4869-4263-9264-9150480c9efc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG nova.network.neutron [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Updating instance_info_cache with network_info: [{"id": "bd091ea0-8c42-4140-aad1-617f27d2a469", "address": "fa:16:3e:53:1d:70", "network": {"id": "d5876e18-e2af-45c2-aab5-2d0d552ebfe4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2035085552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9e5c78c1684c359cfab4e32b9c213f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd091ea0-8c", "ovs_interfaceid": "bd091ea0-8c42-4140-aad1-617f27d2a469", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Releasing lock "refresh_cache-c7776982-40ea-4b06-b853-cfd484efba73" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG nova.compute.manager [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] [instance: c7776982-40ea-4b06-b853-cfd484efba73] Instance network_info: |[{"id": "52dab4ab-4869-4263-9264-9150480c9efc", "address": "fa:16:3e:d3:cc:2f", "network": {"id": "f29c4a92-4276-4a57-b109-2f0718fe96bd", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-899695892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73d214e40cf84df584ebdf33293b5f98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52dab4ab-48", "ovs_interfaceid": "52dab4ab-4869-4263-9264-9150480c9efc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-49b5369d-2fb5-40e6-b388-cd70cce11d98 req-a820d33f-ff63-4d30-9ec2-87c167e196dd service nova] Acquired lock "refresh_cache-c7776982-40ea-4b06-b853-cfd484efba73" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG nova.network.neutron [req-49b5369d-2fb5-40e6-b388-cd70cce11d98 req-a820d33f-ff63-4d30-9ec2-87c167e196dd service nova] [instance: c7776982-40ea-4b06-b853-cfd484efba73] Refreshing network info cache for port 52dab4ab-4869-4263-9264-9150480c9efc {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] [instance: c7776982-40ea-4b06-b853-cfd484efba73] Start _get_guest_xml network_info=[{"id": "52dab4ab-4869-4263-9264-9150480c9efc", "address": "fa:16:3e:d3:cc:2f", "network": {"id": "f29c4a92-4276-4a57-b109-2f0718fe96bd", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-899695892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73d214e40cf84df584ebdf33293b5f98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52dab4ab-48", "ovs_interfaceid": "52dab4ab-4869-4263-9264-9150480c9efc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '3aba2e73-6832-404b-8bd0-d0503ce82b8c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Releasing lock "refresh_cache-db656346-c4af-43da-9600-fd39f1b9e4dc" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG nova.compute.manager [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Instance network_info: |[{"id": "bd091ea0-8c42-4140-aad1-617f27d2a469", "address": "fa:16:3e:53:1d:70", "network": {"id": "d5876e18-e2af-45c2-aab5-2d0d552ebfe4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2035085552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9e5c78c1684c359cfab4e32b9c213f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd091ea0-8c", "ovs_interfaceid": "bd091ea0-8c42-4140-aad1-617f27d2a469", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.460s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG nova.compute.manager [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Start building networks asynchronously for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Start _get_guest_xml network_info=[{"id": "bd091ea0-8c42-4140-aad1-617f27d2a469", "address": "fa:16:3e:53:1d:70", "network": {"id": "d5876e18-e2af-45c2-aab5-2d0d552ebfe4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2035085552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9e5c78c1684c359cfab4e32b9c213f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd091ea0-8c", "ovs_interfaceid": "bd091ea0-8c42-4140-aad1-617f27d2a469", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '3aba2e73-6832-404b-8bd0-d0503ce82b8c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 14:41:02 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:41:02 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:41:02 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:41:02 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:41:02 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] CPU controller missing on host. {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] CPU controller missing on host. {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] CPU controller found on host. {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70924) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T14:36:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Flavor limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Image limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Flavor pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Image pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Got 1 possible topologies {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG nova.privsep.utils [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70924) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:40:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-679123143',display_name='tempest-DeleteServersTestJSON-server-679123143',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-679123143',id=2,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73d214e40cf84df584ebdf33293b5f98',ramdisk_id='',reservation_id='r-pi8frpfv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1415676599',owner_user_name='tempest-DeleteServersTestJSON-1415676599-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:40:53Z,user_data=None,user_id='f9c6dc46d3f5436f9ca4e07705933d5e',uuid=c7776982-40ea-4b06-b853-cfd484efba73,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "52dab4ab-4869-4263-9264-9150480c9efc", "address": "fa:16:3e:d3:cc:2f", "network": {"id": "f29c4a92-4276-4a57-b109-2f0718fe96bd", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-899695892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73d214e40cf84df584ebdf33293b5f98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52dab4ab-48", "ovs_interfaceid": "52dab4ab-4869-4263-9264-9150480c9efc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Converting VIF {"id": "52dab4ab-4869-4263-9264-9150480c9efc", "address": "fa:16:3e:d3:cc:2f", "network": {"id": "f29c4a92-4276-4a57-b109-2f0718fe96bd", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-899695892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73d214e40cf84df584ebdf33293b5f98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52dab4ab-48", "ovs_interfaceid": "52dab4ab-4869-4263-9264-9150480c9efc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:cc:2f,bridge_name='br-int',has_traffic_filtering=True,id=52dab4ab-4869-4263-9264-9150480c9efc,network=Network(f29c4a92-4276-4a57-b109-2f0718fe96bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52dab4ab-48') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG nova.objects.instance [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Lazy-loading 'pci_devices' on Instance uuid c7776982-40ea-4b06-b853-cfd484efba73 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] CPU controller found on host. {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70924) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T14:36:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Flavor limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Image limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Flavor pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Image pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Got 1 possible topologies {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:40:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-35032769',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-35032769',id=1,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a9e5c78c1684c359cfab4e32b9c213f',ramdisk_id='',reservation_id='r-3y2md6ak',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2089253815',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:40:53Z,user_data=None,user_id='43582a8a85c54b5e9d16d11b12bf50d4',uuid=db656346-c4af-43da-9600-fd39f1b9e4dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd091ea0-8c42-4140-aad1-617f27d2a469", "address": "fa:16:3e:53:1d:70", "network": {"id": "d5876e18-e2af-45c2-aab5-2d0d552ebfe4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2035085552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9e5c78c1684c359cfab4e32b9c213f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd091ea0-8c", "ovs_interfaceid": "bd091ea0-8c42-4140-aad1-617f27d2a469", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Converting VIF {"id": "bd091ea0-8c42-4140-aad1-617f27d2a469", "address": "fa:16:3e:53:1d:70", "network": {"id": "d5876e18-e2af-45c2-aab5-2d0d552ebfe4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2035085552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9e5c78c1684c359cfab4e32b9c213f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd091ea0-8c", "ovs_interfaceid": "bd091ea0-8c42-4140-aad1-617f27d2a469", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:1d:70,bridge_name='br-int',has_traffic_filtering=True,id=bd091ea0-8c42-4140-aad1-617f27d2a469,network=Network(d5876e18-e2af-45c2-aab5-2d0d552ebfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd091ea0-8c') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG nova.objects.instance [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lazy-loading 'pci_devices' on Instance uuid db656346-c4af-43da-9600-fd39f1b9e4dc {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG nova.compute.manager [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Allocating IP information in the background. {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG nova.network.neutron [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] allocate_for_instance() {{(pid=70924) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] [instance: c7776982-40ea-4b06-b853-cfd484efba73] End _get_guest_xml xml=<domain type="kvm">
Jul 29 14:41:02 user nova-compute[70924]:   <uuid>c7776982-40ea-4b06-b853-cfd484efba73</uuid>
Jul 29 14:41:02 user nova-compute[70924]:   <name>instance-00000002</name>
Jul 29 14:41:02 user nova-compute[70924]:   <memory>524288</memory>
Jul 29 14:41:02 user nova-compute[70924]:   <vcpu>1</vcpu>
Jul 29 14:41:02 user nova-compute[70924]:   <metadata>
Jul 29 14:41:02 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 14:41:02 user nova-compute[70924]:       <nova:package version="0.0.0"/>
Jul 29 14:41:02 user nova-compute[70924]:       <nova:name>tempest-DeleteServersTestJSON-server-679123143</nova:name>
Jul 29 14:41:02 user nova-compute[70924]:       <nova:creationTime>2023-07-29 14:41:02</nova:creationTime>
Jul 29 14:41:02 user nova-compute[70924]:       <nova:flavor name="m1.tiny">
Jul 29 14:41:02 user nova-compute[70924]:         <nova:memory>512</nova:memory>
Jul 29 14:41:02 user nova-compute[70924]:         <nova:disk>1</nova:disk>
Jul 29 14:41:02 user nova-compute[70924]:         <nova:swap>0</nova:swap>
Jul 29 14:41:02 user nova-compute[70924]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 14:41:02 user nova-compute[70924]:         <nova:vcpus>1</nova:vcpus>
Jul 29 14:41:02 user nova-compute[70924]:       </nova:flavor>
Jul 29 14:41:02 user nova-compute[70924]:       <nova:owner>
Jul 29 14:41:02 user nova-compute[70924]:         <nova:user uuid="f9c6dc46d3f5436f9ca4e07705933d5e">tempest-DeleteServersTestJSON-1415676599-project-member</nova:user>
Jul 29 14:41:02 user nova-compute[70924]:         <nova:project uuid="73d214e40cf84df584ebdf33293b5f98">tempest-DeleteServersTestJSON-1415676599</nova:project>
Jul 29 14:41:02 user nova-compute[70924]:       </nova:owner>
Jul 29 14:41:02 user nova-compute[70924]:       <nova:root type="image" uuid="3aba2e73-6832-404b-8bd0-d0503ce82b8c"/>
Jul 29 14:41:02 user nova-compute[70924]:       <nova:ports>
Jul 29 14:41:02 user nova-compute[70924]:         <nova:port uuid="52dab4ab-4869-4263-9264-9150480c9efc">
Jul 29 14:41:02 user nova-compute[70924]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 29 14:41:02 user nova-compute[70924]:         </nova:port>
Jul 29 14:41:02 user nova-compute[70924]:       </nova:ports>
Jul 29 14:41:02 user nova-compute[70924]:     </nova:instance>
Jul 29 14:41:02 user nova-compute[70924]:   </metadata>
Jul 29 14:41:02 user nova-compute[70924]:   <sysinfo type="smbios">
Jul 29 14:41:02 user nova-compute[70924]:     <system>
Jul 29 14:41:02 user nova-compute[70924]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 14:41:02 user nova-compute[70924]:       <entry name="product">OpenStack Nova</entry>
Jul 29 14:41:02 user nova-compute[70924]:       <entry name="version">0.0.0</entry>
Jul 29 14:41:02 user nova-compute[70924]:       <entry name="serial">c7776982-40ea-4b06-b853-cfd484efba73</entry>
Jul 29 14:41:02 user nova-compute[70924]:       <entry name="uuid">c7776982-40ea-4b06-b853-cfd484efba73</entry>
Jul 29 14:41:02 user nova-compute[70924]:       <entry name="family">Virtual Machine</entry>
Jul 29 14:41:02 user nova-compute[70924]:     </system>
Jul 29 14:41:02 user nova-compute[70924]:   </sysinfo>
Jul 29 14:41:02 user nova-compute[70924]:   <os>
Jul 29 14:41:02 user nova-compute[70924]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 14:41:02 user nova-compute[70924]:     <boot dev="hd"/>
Jul 29 14:41:02 user nova-compute[70924]:     <smbios mode="sysinfo"/>
Jul 29 14:41:02 user nova-compute[70924]:   </os>
Jul 29 14:41:02 user nova-compute[70924]:   <features>
Jul 29 14:41:02 user nova-compute[70924]:     <acpi/>
Jul 29 14:41:02 user nova-compute[70924]:     <apic/>
Jul 29 14:41:02 user nova-compute[70924]:     <vmcoreinfo/>
Jul 29 14:41:02 user nova-compute[70924]:   </features>
Jul 29 14:41:02 user nova-compute[70924]:   <clock offset="utc">
Jul 29 14:41:02 user nova-compute[70924]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 14:41:02 user nova-compute[70924]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 14:41:02 user nova-compute[70924]:     <timer name="hpet" present="no"/>
Jul 29 14:41:02 user nova-compute[70924]:   </clock>
Jul 29 14:41:02 user nova-compute[70924]:   <cpu mode="custom" match="exact">
Jul 29 14:41:02 user nova-compute[70924]:     <model>Nehalem</model>
Jul 29 14:41:02 user nova-compute[70924]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 14:41:02 user nova-compute[70924]:   </cpu>
Jul 29 14:41:02 user nova-compute[70924]:   <devices>
Jul 29 14:41:02 user nova-compute[70924]:     <disk type="file" device="disk">
Jul 29 14:41:02 user nova-compute[70924]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 14:41:02 user nova-compute[70924]:       <source file="/opt/stack/data/nova/instances/c7776982-40ea-4b06-b853-cfd484efba73/disk"/>
Jul 29 14:41:02 user nova-compute[70924]:       <target dev="vda" bus="virtio"/>
Jul 29 14:41:02 user nova-compute[70924]:     </disk>
Jul 29 14:41:02 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 14:41:02 user nova-compute[70924]:       <mac address="fa:16:3e:d3:cc:2f"/>
Jul 29 14:41:02 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:41:02 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 14:41:02 user nova-compute[70924]:       <target dev="tap52dab4ab-48"/>
Jul 29 14:41:02 user nova-compute[70924]:     </interface>
Jul 29 14:41:02 user nova-compute[70924]:     <serial type="pty">
Jul 29 14:41:02 user nova-compute[70924]:       <log file="/opt/stack/data/nova/instances/c7776982-40ea-4b06-b853-cfd484efba73/console.log" append="off"/>
Jul 29 14:41:02 user nova-compute[70924]:     </serial>
Jul 29 14:41:02 user nova-compute[70924]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 14:41:02 user nova-compute[70924]:     <video>
Jul 29 14:41:02 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:41:02 user nova-compute[70924]:     </video>
Jul 29 14:41:02 user nova-compute[70924]:     <rng model="virtio">
Jul 29 14:41:02 user nova-compute[70924]:       <backend model="random">/dev/urandom</backend>
Jul 29 14:41:02 user nova-compute[70924]:     </rng>
Jul 29 14:41:02 user nova-compute[70924]:     <controller type="usb" index="0" model="none"/>
Jul 29 14:41:02 user nova-compute[70924]:     <memballoon model="virtio">
Jul 29 14:41:02 user nova-compute[70924]:       <stats period="10"/>
Jul 29 14:41:02 user nova-compute[70924]:     </memballoon>
Jul 29 14:41:02 user nova-compute[70924]:   </devices>
Jul 29 14:41:02 user nova-compute[70924]: </domain>
Jul 29 14:41:02 user nova-compute[70924]:  {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:40:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-679123143',display_name='tempest-DeleteServersTestJSON-server-679123143',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-679123143',id=2,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73d214e40cf84df584ebdf33293b5f98',ramdisk_id='',reservation_id='r-pi8frpfv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1415676599',owner_user_name='tempest-DeleteServersTestJSON-1415676599-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:40:53Z,user_data=None,user_id='f9c6dc46d3f5436f9ca4e07705933d5e',uuid=c7776982-40ea-4b06-b853-cfd484efba73,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "52dab4ab-4869-4263-9264-9150480c9efc", "address": "fa:16:3e:d3:cc:2f", "network": {"id": "f29c4a92-4276-4a57-b109-2f0718fe96bd", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-899695892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73d214e40cf84df584ebdf33293b5f98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52dab4ab-48", "ovs_interfaceid": "52dab4ab-4869-4263-9264-9150480c9efc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Converting VIF {"id": "52dab4ab-4869-4263-9264-9150480c9efc", "address": "fa:16:3e:d3:cc:2f", "network": {"id": "f29c4a92-4276-4a57-b109-2f0718fe96bd", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-899695892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73d214e40cf84df584ebdf33293b5f98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52dab4ab-48", "ovs_interfaceid": "52dab4ab-4869-4263-9264-9150480c9efc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:cc:2f,bridge_name='br-int',has_traffic_filtering=True,id=52dab4ab-4869-4263-9264-9150480c9efc,network=Network(f29c4a92-4276-4a57-b109-2f0718fe96bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52dab4ab-48') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG os_vif [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:cc:2f,bridge_name='br-int',has_traffic_filtering=True,id=52dab4ab-4869-4263-9264-9150480c9efc,network=Network(f29c4a92-4276-4a57-b109-2f0718fe96bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52dab4ab-48') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG nova.network.neutron [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] Successfully created port: 72829b2d-d54b-4792-bb99-ea15bf5149a6 {{(pid=70924) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] End _get_guest_xml xml=<domain type="kvm">
Jul 29 14:41:02 user nova-compute[70924]:   <uuid>db656346-c4af-43da-9600-fd39f1b9e4dc</uuid>
Jul 29 14:41:02 user nova-compute[70924]:   <name>instance-00000001</name>
Jul 29 14:41:02 user nova-compute[70924]:   <memory>524288</memory>
Jul 29 14:41:02 user nova-compute[70924]:   <vcpu>1</vcpu>
Jul 29 14:41:02 user nova-compute[70924]:   <metadata>
Jul 29 14:41:02 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 14:41:02 user nova-compute[70924]:       <nova:package version="0.0.0"/>
Jul 29 14:41:02 user nova-compute[70924]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-35032769</nova:name>
Jul 29 14:41:02 user nova-compute[70924]:       <nova:creationTime>2023-07-29 14:41:02</nova:creationTime>
Jul 29 14:41:02 user nova-compute[70924]:       <nova:flavor name="m1.tiny">
Jul 29 14:41:02 user nova-compute[70924]:         <nova:memory>512</nova:memory>
Jul 29 14:41:02 user nova-compute[70924]:         <nova:disk>1</nova:disk>
Jul 29 14:41:02 user nova-compute[70924]:         <nova:swap>0</nova:swap>
Jul 29 14:41:02 user nova-compute[70924]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 14:41:02 user nova-compute[70924]:         <nova:vcpus>1</nova:vcpus>
Jul 29 14:41:02 user nova-compute[70924]:       </nova:flavor>
Jul 29 14:41:02 user nova-compute[70924]:       <nova:owner>
Jul 29 14:41:02 user nova-compute[70924]:         <nova:user uuid="43582a8a85c54b5e9d16d11b12bf50d4">tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member</nova:user>
Jul 29 14:41:02 user nova-compute[70924]:         <nova:project uuid="5a9e5c78c1684c359cfab4e32b9c213f">tempest-ServerBootFromVolumeStableRescueTest-2089253815</nova:project>
Jul 29 14:41:02 user nova-compute[70924]:       </nova:owner>
Jul 29 14:41:02 user nova-compute[70924]:       <nova:root type="image" uuid="3aba2e73-6832-404b-8bd0-d0503ce82b8c"/>
Jul 29 14:41:02 user nova-compute[70924]:       <nova:ports>
Jul 29 14:41:02 user nova-compute[70924]:         <nova:port uuid="bd091ea0-8c42-4140-aad1-617f27d2a469">
Jul 29 14:41:02 user nova-compute[70924]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 29 14:41:02 user nova-compute[70924]:         </nova:port>
Jul 29 14:41:02 user nova-compute[70924]:       </nova:ports>
Jul 29 14:41:02 user nova-compute[70924]:     </nova:instance>
Jul 29 14:41:02 user nova-compute[70924]:   </metadata>
Jul 29 14:41:02 user nova-compute[70924]:   <sysinfo type="smbios">
Jul 29 14:41:02 user nova-compute[70924]:     <system>
Jul 29 14:41:02 user nova-compute[70924]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 14:41:02 user nova-compute[70924]:       <entry name="product">OpenStack Nova</entry>
Jul 29 14:41:02 user nova-compute[70924]:       <entry name="version">0.0.0</entry>
Jul 29 14:41:02 user nova-compute[70924]:       <entry name="serial">db656346-c4af-43da-9600-fd39f1b9e4dc</entry>
Jul 29 14:41:02 user nova-compute[70924]:       <entry name="uuid">db656346-c4af-43da-9600-fd39f1b9e4dc</entry>
Jul 29 14:41:02 user nova-compute[70924]:       <entry name="family">Virtual Machine</entry>
Jul 29 14:41:02 user nova-compute[70924]:     </system>
Jul 29 14:41:02 user nova-compute[70924]:   </sysinfo>
Jul 29 14:41:02 user nova-compute[70924]:   <os>
Jul 29 14:41:02 user nova-compute[70924]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 14:41:02 user nova-compute[70924]:     <boot dev="hd"/>
Jul 29 14:41:02 user nova-compute[70924]:     <smbios mode="sysinfo"/>
Jul 29 14:41:02 user nova-compute[70924]:   </os>
Jul 29 14:41:02 user nova-compute[70924]:   <features>
Jul 29 14:41:02 user nova-compute[70924]:     <acpi/>
Jul 29 14:41:02 user nova-compute[70924]:     <apic/>
Jul 29 14:41:02 user nova-compute[70924]:     <vmcoreinfo/>
Jul 29 14:41:02 user nova-compute[70924]:   </features>
Jul 29 14:41:02 user nova-compute[70924]:   <clock offset="utc">
Jul 29 14:41:02 user nova-compute[70924]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 14:41:02 user nova-compute[70924]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 14:41:02 user nova-compute[70924]:     <timer name="hpet" present="no"/>
Jul 29 14:41:02 user nova-compute[70924]:   </clock>
Jul 29 14:41:02 user nova-compute[70924]:   <cpu mode="custom" match="exact">
Jul 29 14:41:02 user nova-compute[70924]:     <model>Nehalem</model>
Jul 29 14:41:02 user nova-compute[70924]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 14:41:02 user nova-compute[70924]:   </cpu>
Jul 29 14:41:02 user nova-compute[70924]:   <devices>
Jul 29 14:41:02 user nova-compute[70924]:     <disk type="file" device="disk">
Jul 29 14:41:02 user nova-compute[70924]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 14:41:02 user nova-compute[70924]:       <source file="/opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk"/>
Jul 29 14:41:02 user nova-compute[70924]:       <target dev="vda" bus="virtio"/>
Jul 29 14:41:02 user nova-compute[70924]:     </disk>
Jul 29 14:41:02 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 14:41:02 user nova-compute[70924]:       <mac address="fa:16:3e:53:1d:70"/>
Jul 29 14:41:02 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:41:02 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 14:41:02 user nova-compute[70924]:       <target dev="tapbd091ea0-8c"/>
Jul 29 14:41:02 user nova-compute[70924]:     </interface>
Jul 29 14:41:02 user nova-compute[70924]:     <serial type="pty">
Jul 29 14:41:02 user nova-compute[70924]:       <log file="/opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/console.log" append="off"/>
Jul 29 14:41:02 user nova-compute[70924]:     </serial>
Jul 29 14:41:02 user nova-compute[70924]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 14:41:02 user nova-compute[70924]:     <video>
Jul 29 14:41:02 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:41:02 user nova-compute[70924]:     </video>
Jul 29 14:41:02 user nova-compute[70924]:     <rng model="virtio">
Jul 29 14:41:02 user nova-compute[70924]:       <backend model="random">/dev/urandom</backend>
Jul 29 14:41:02 user nova-compute[70924]:     </rng>
Jul 29 14:41:02 user nova-compute[70924]:     <controller type="usb" index="0" model="none"/>
Jul 29 14:41:02 user nova-compute[70924]:     <memballoon model="virtio">
Jul 29 14:41:02 user nova-compute[70924]:       <stats period="10"/>
Jul 29 14:41:02 user nova-compute[70924]:     </memballoon>
Jul 29 14:41:02 user nova-compute[70924]:   </devices>
Jul 29 14:41:02 user nova-compute[70924]: </domain>
Jul 29 14:41:02 user nova-compute[70924]:  {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:40:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-35032769',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-35032769',id=1,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a9e5c78c1684c359cfab4e32b9c213f',ramdisk_id='',reservation_id='r-3y2md6ak',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2089253815',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:40:53Z,user_data=None,user_id='43582a8a85c54b5e9d16d11b12bf50d4',uuid=db656346-c4af-43da-9600-fd39f1b9e4dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd091ea0-8c42-4140-aad1-617f27d2a469", "address": "fa:16:3e:53:1d:70", "network": {"id": "d5876e18-e2af-45c2-aab5-2d0d552ebfe4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2035085552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9e5c78c1684c359cfab4e32b9c213f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd091ea0-8c", "ovs_interfaceid": "bd091ea0-8c42-4140-aad1-617f27d2a469", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Converting VIF {"id": "bd091ea0-8c42-4140-aad1-617f27d2a469", "address": "fa:16:3e:53:1d:70", "network": {"id": "d5876e18-e2af-45c2-aab5-2d0d552ebfe4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2035085552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9e5c78c1684c359cfab4e32b9c213f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd091ea0-8c", "ovs_interfaceid": "bd091ea0-8c42-4140-aad1-617f27d2a469", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:1d:70,bridge_name='br-int',has_traffic_filtering=True,id=bd091ea0-8c42-4140-aad1-617f27d2a469,network=Network(d5876e18-e2af-45c2-aab5-2d0d552ebfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd091ea0-8c') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG os_vif [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:1d:70,bridge_name='br-int',has_traffic_filtering=True,id=bd091ea0-8c42-4140-aad1-617f27d2a469,network=Network(d5876e18-e2af-45c2-aab5-2d0d552ebfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd091ea0-8c') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Created schema index Interface.name {{(pid=70924) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Created schema index Port.name {{(pid=70924) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Created schema index Bridge.name {{(pid=70924) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=70924) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [POLLIN] on fd 25 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] tcp:127.0.0.1:6640: entering BACKOFF {{(pid=70924) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] schema index <ovs.db.idl.IdlTable object at 0x7feedc4eccd0>.name already exists {{(pid=70924) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:102}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] schema index <ovs.db.idl.IdlTable object at 0x7feedc4fb490>.name already exists {{(pid=70924) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:102}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] schema index <ovs.db.idl.IdlTable object at 0x7feedc4f9750>.name already exists {{(pid=70924) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:102}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] [POLLOUT] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70924) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 14:41:02 user nova-compute[70924]: INFO oslo.privsep.daemon [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmprlt2ogwi/privsep.sock']
Jul 29 14:41:02 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 14:41:02 user sudo[80142]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmprlt2ogwi/privsep.sock
Jul 29 14:41:02 user sudo[80142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Jul 29 14:41:02 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 14:41:02 user nova-compute[70924]: DEBUG nova.compute.manager [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Start building block device mappings for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG nova.compute.manager [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Start spawning the instance on the hypervisor. {{(pid=70924) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Creating instance directory {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 14:41:02 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Creating image(s)
Jul 29 14:41:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Acquiring lock "/opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "/opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "/opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:41:02 user nova-compute[70924]: DEBUG nova.policy [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '55b9032bef2d4d3586dc5d18cdc1ee55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33d01ba458f466b99b6bc5bba88d8c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70924) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 14:41:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.134s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:41:03 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Acquiring lock "bd72453517468710f1de26b27fb0ea28688e9009" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:41:03 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:41:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:41:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.141s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:41:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk 1073741824 {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:41:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk 1073741824" returned: 0 in 0.128s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:41:03 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:41:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:41:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.147s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:41:03 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Checking if we can resize image /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk. size=1073741824 {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 14:41:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:41:03 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:41:03 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Cannot resize image /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk to a smaller size. {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 14:41:03 user nova-compute[70924]: DEBUG nova.objects.instance [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lazy-loading 'migration_context' on Instance uuid 86ecc6cb-88a8-4572-8e41-d4c5859036a6 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:41:03 user nova-compute[70924]: DEBUG nova.compute.manager [req-03ec3e19-d5c2-4d3b-a185-3fb6eccb3407 req-460cd169-3fdb-48e1-9f09-4a07919d4236 service nova] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Received event network-changed-bd091ea0-8c42-4140-aad1-617f27d2a469 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:41:03 user nova-compute[70924]: DEBUG nova.compute.manager [req-03ec3e19-d5c2-4d3b-a185-3fb6eccb3407 req-460cd169-3fdb-48e1-9f09-4a07919d4236 service nova] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Refreshing instance network info cache due to event network-changed-bd091ea0-8c42-4140-aad1-617f27d2a469. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:41:03 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-03ec3e19-d5c2-4d3b-a185-3fb6eccb3407 req-460cd169-3fdb-48e1-9f09-4a07919d4236 service nova] Acquiring lock "refresh_cache-db656346-c4af-43da-9600-fd39f1b9e4dc" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:41:03 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-03ec3e19-d5c2-4d3b-a185-3fb6eccb3407 req-460cd169-3fdb-48e1-9f09-4a07919d4236 service nova] Acquired lock "refresh_cache-db656346-c4af-43da-9600-fd39f1b9e4dc" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:41:03 user nova-compute[70924]: DEBUG nova.network.neutron [req-03ec3e19-d5c2-4d3b-a185-3fb6eccb3407 req-460cd169-3fdb-48e1-9f09-4a07919d4236 service nova] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Refreshing network info cache for port bd091ea0-8c42-4140-aad1-617f27d2a469 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:41:03 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Created local disks {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 14:41:03 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Ensure instance console log exists: /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/console.log {{(pid=70924) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 14:41:03 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:41:03 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:41:03 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:41:03 user nova-compute[70924]: DEBUG nova.network.neutron [req-49b5369d-2fb5-40e6-b388-cd70cce11d98 req-a820d33f-ff63-4d30-9ec2-87c167e196dd service nova] [instance: c7776982-40ea-4b06-b853-cfd484efba73] Updated VIF entry in instance network info cache for port 52dab4ab-4869-4263-9264-9150480c9efc. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:41:03 user nova-compute[70924]: DEBUG nova.network.neutron [req-49b5369d-2fb5-40e6-b388-cd70cce11d98 req-a820d33f-ff63-4d30-9ec2-87c167e196dd service nova] [instance: c7776982-40ea-4b06-b853-cfd484efba73] Updating instance_info_cache with network_info: [{"id": "52dab4ab-4869-4263-9264-9150480c9efc", "address": "fa:16:3e:d3:cc:2f", "network": {"id": "f29c4a92-4276-4a57-b109-2f0718fe96bd", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-899695892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73d214e40cf84df584ebdf33293b5f98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52dab4ab-48", "ovs_interfaceid": "52dab4ab-4869-4263-9264-9150480c9efc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:41:03 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-49b5369d-2fb5-40e6-b388-cd70cce11d98 req-a820d33f-ff63-4d30-9ec2-87c167e196dd service nova] Releasing lock "refresh_cache-c7776982-40ea-4b06-b853-cfd484efba73" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:41:03 user nova-compute[70924]: DEBUG nova.network.neutron [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Successfully created port: 14b12f31-f886-4752-bac2-e4673c74ae85 {{(pid=70924) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 14:41:04 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:04 user sudo[80142]: pam_unix(sudo:session): session closed for user root
Jul 29 14:41:04 user nova-compute[70924]: INFO oslo.privsep.daemon [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Spawned new privsep daemon via rootwrap
Jul 29 14:41:04 user nova-compute[70924]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 29 14:41:04 user nova-compute[70924]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 29 14:41:04 user nova-compute[70924]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Jul 29 14:41:04 user nova-compute[70924]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 80160
Jul 29 14:41:04 user nova-compute[70924]: WARNING oslo_privsep.priv_context [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] privsep daemon already running
Jul 29 14:41:04 user nova-compute[70924]: DEBUG nova.network.neutron [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Successfully created port: 4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3 {{(pid=70924) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 14:41:04 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:04 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbd091ea0-8c, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:41:04 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbd091ea0-8c, col_values=(('external_ids', {'iface-id': 'bd091ea0-8c42-4140-aad1-617f27d2a469', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:1d:70', 'vm-uuid': 'db656346-c4af-43da-9600-fd39f1b9e4dc'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:41:04 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:04 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:41:04 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:04 user nova-compute[70924]: INFO os_vif [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:1d:70,bridge_name='br-int',has_traffic_filtering=True,id=bd091ea0-8c42-4140-aad1-617f27d2a469,network=Network(d5876e18-e2af-45c2-aab5-2d0d552ebfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd091ea0-8c')
Jul 29 14:41:04 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:04 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap52dab4ab-48, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:41:04 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap52dab4ab-48, col_values=(('external_ids', {'iface-id': '52dab4ab-4869-4263-9264-9150480c9efc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:cc:2f', 'vm-uuid': 'c7776982-40ea-4b06-b853-cfd484efba73'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:41:04 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:04 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:41:04 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:04 user nova-compute[70924]: INFO os_vif [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:cc:2f,bridge_name='br-int',has_traffic_filtering=True,id=52dab4ab-4869-4263-9264-9150480c9efc,network=Network(f29c4a92-4276-4a57-b109-2f0718fe96bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52dab4ab-48')
Jul 29 14:41:05 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:41:05 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] No VIF found with MAC fa:16:3e:53:1d:70, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:41:05 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:41:05 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] No VIF found with MAC fa:16:3e:d3:cc:2f, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:41:05 user nova-compute[70924]: DEBUG nova.network.neutron [req-03ec3e19-d5c2-4d3b-a185-3fb6eccb3407 req-460cd169-3fdb-48e1-9f09-4a07919d4236 service nova] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Updated VIF entry in instance network info cache for port bd091ea0-8c42-4140-aad1-617f27d2a469. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:41:05 user nova-compute[70924]: DEBUG nova.network.neutron [req-03ec3e19-d5c2-4d3b-a185-3fb6eccb3407 req-460cd169-3fdb-48e1-9f09-4a07919d4236 service nova] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Updating instance_info_cache with network_info: [{"id": "bd091ea0-8c42-4140-aad1-617f27d2a469", "address": "fa:16:3e:53:1d:70", "network": {"id": "d5876e18-e2af-45c2-aab5-2d0d552ebfe4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2035085552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9e5c78c1684c359cfab4e32b9c213f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd091ea0-8c", "ovs_interfaceid": "bd091ea0-8c42-4140-aad1-617f27d2a469", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:41:05 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-03ec3e19-d5c2-4d3b-a185-3fb6eccb3407 req-460cd169-3fdb-48e1-9f09-4a07919d4236 service nova] Releasing lock "refresh_cache-db656346-c4af-43da-9600-fd39f1b9e4dc" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:41:05 user nova-compute[70924]: DEBUG nova.network.neutron [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] Successfully updated port: 72829b2d-d54b-4792-bb99-ea15bf5149a6 {{(pid=70924) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 14:41:05 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Acquiring lock "refresh_cache-2250b0d6-5542-4a7f-90a9-93745a776fcc" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:41:05 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Acquired lock "refresh_cache-2250b0d6-5542-4a7f-90a9-93745a776fcc" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:41:05 user nova-compute[70924]: DEBUG nova.network.neutron [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 14:41:05 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:05 user nova-compute[70924]: DEBUG nova.network.neutron [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] Instance cache missing network info. {{(pid=70924) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 14:41:05 user nova-compute[70924]: DEBUG nova.compute.manager [req-e575ecb8-43a7-49e8-800a-bc04304da460 req-aff2074c-2b32-402e-b657-07ec3de2c8c3 service nova] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] Received event network-changed-72829b2d-d54b-4792-bb99-ea15bf5149a6 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:41:05 user nova-compute[70924]: DEBUG nova.compute.manager [req-e575ecb8-43a7-49e8-800a-bc04304da460 req-aff2074c-2b32-402e-b657-07ec3de2c8c3 service nova] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] Refreshing instance network info cache due to event network-changed-72829b2d-d54b-4792-bb99-ea15bf5149a6. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:41:05 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-e575ecb8-43a7-49e8-800a-bc04304da460 req-aff2074c-2b32-402e-b657-07ec3de2c8c3 service nova] Acquiring lock "refresh_cache-2250b0d6-5542-4a7f-90a9-93745a776fcc" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:41:06 user nova-compute[70924]: DEBUG nova.network.neutron [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] Updating instance_info_cache with network_info: [{"id": "72829b2d-d54b-4792-bb99-ea15bf5149a6", "address": "fa:16:3e:b7:e0:eb", "network": {"id": "b6631336-b322-45e0-99b7-5e95539aa674", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2109271400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc2394c924af4a9aaa925d116b2117ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72829b2d-d5", "ovs_interfaceid": "72829b2d-d54b-4792-bb99-ea15bf5149a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:41:06 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Releasing lock "refresh_cache-2250b0d6-5542-4a7f-90a9-93745a776fcc" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:41:06 user nova-compute[70924]: DEBUG nova.compute.manager [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] Instance network_info: |[{"id": "72829b2d-d54b-4792-bb99-ea15bf5149a6", "address": "fa:16:3e:b7:e0:eb", "network": {"id": "b6631336-b322-45e0-99b7-5e95539aa674", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2109271400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc2394c924af4a9aaa925d116b2117ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72829b2d-d5", "ovs_interfaceid": "72829b2d-d54b-4792-bb99-ea15bf5149a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 14:41:06 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-e575ecb8-43a7-49e8-800a-bc04304da460 req-aff2074c-2b32-402e-b657-07ec3de2c8c3 service nova] Acquired lock "refresh_cache-2250b0d6-5542-4a7f-90a9-93745a776fcc" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:41:06 user nova-compute[70924]: DEBUG nova.network.neutron [req-e575ecb8-43a7-49e8-800a-bc04304da460 req-aff2074c-2b32-402e-b657-07ec3de2c8c3 service nova] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] Refreshing network info cache for port 72829b2d-d54b-4792-bb99-ea15bf5149a6 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:41:06 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] Start _get_guest_xml network_info=[{"id": "72829b2d-d54b-4792-bb99-ea15bf5149a6", "address": "fa:16:3e:b7:e0:eb", "network": {"id": "b6631336-b322-45e0-99b7-5e95539aa674", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2109271400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc2394c924af4a9aaa925d116b2117ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72829b2d-d5", "ovs_interfaceid": "72829b2d-d54b-4792-bb99-ea15bf5149a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '3aba2e73-6832-404b-8bd0-d0503ce82b8c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 14:41:06 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:41:06 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:41:06 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 14:41:06 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] CPU controller missing on host. {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 14:41:06 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 14:41:06 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] CPU controller found on host. {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 14:41:06 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70924) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 14:41:06 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T14:36:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 14:41:06 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Flavor limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 14:41:06 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Image limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 14:41:06 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Flavor pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 14:41:06 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Image pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 14:41:06 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 14:41:06 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 14:41:06 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 14:41:06 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Got 1 possible topologies {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 14:41:06 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 14:41:06 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 14:41:06 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:40:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-77734653',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-77734653',id=3,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJvkNFMJOrHzNEhMPNt6g+PXKeIoQVhAmKLkP+hqyoJjCjv1XYedRIh/Q8XrDZt8SrZqXeWAbWjyzwVnHh38r8KNF01wuSEVdv2mNYVqRyrKHTZ//f8Ew8pg86ANu4Ob7Q==',key_name='tempest-keypair-248340173',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc2394c924af4a9aaa925d116b2117ae',ramdisk_id='',reservation_id='r-oqzwhxq2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1372699391',owner_user_name='tempest-ServerActionsV293TestJSON-1372699391-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:41:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b744bbecccf48d1833ea4810b2af2d0',uuid=2250b0d6-5542-4a7f-90a9-93745a776fcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72829b2d-d54b-4792-bb99-ea15bf5149a6", "address": "fa:16:3e:b7:e0:eb", "network": {"id": "b6631336-b322-45e0-99b7-5e95539aa674", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2109271400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc2394c924af4a9aaa925d116b2117ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72829b2d-d5", "ovs_interfaceid": "72829b2d-d54b-4792-bb99-ea15bf5149a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:41:06 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Converting VIF {"id": "72829b2d-d54b-4792-bb99-ea15bf5149a6", "address": "fa:16:3e:b7:e0:eb", "network": {"id": "b6631336-b322-45e0-99b7-5e95539aa674", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2109271400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc2394c924af4a9aaa925d116b2117ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72829b2d-d5", "ovs_interfaceid": "72829b2d-d54b-4792-bb99-ea15bf5149a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:41:06 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:e0:eb,bridge_name='br-int',has_traffic_filtering=True,id=72829b2d-d54b-4792-bb99-ea15bf5149a6,network=Network(b6631336-b322-45e0-99b7-5e95539aa674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72829b2d-d5') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:41:06 user nova-compute[70924]: DEBUG nova.objects.instance [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Lazy-loading 'pci_devices' on Instance uuid 2250b0d6-5542-4a7f-90a9-93745a776fcc {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:41:06 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] End _get_guest_xml xml=<domain type="kvm">
Jul 29 14:41:06 user nova-compute[70924]:   <uuid>2250b0d6-5542-4a7f-90a9-93745a776fcc</uuid>
Jul 29 14:41:06 user nova-compute[70924]:   <name>instance-00000003</name>
Jul 29 14:41:06 user nova-compute[70924]:   <memory>524288</memory>
Jul 29 14:41:06 user nova-compute[70924]:   <vcpu>1</vcpu>
Jul 29 14:41:06 user nova-compute[70924]:   <metadata>
Jul 29 14:41:06 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 14:41:06 user nova-compute[70924]:       <nova:package version="0.0.0"/>
Jul 29 14:41:06 user nova-compute[70924]:       <nova:name>tempest-ServerActionsV293TestJSON-server-77734653</nova:name>
Jul 29 14:41:06 user nova-compute[70924]:       <nova:creationTime>2023-07-29 14:41:06</nova:creationTime>
Jul 29 14:41:06 user nova-compute[70924]:       <nova:flavor name="m1.tiny">
Jul 29 14:41:06 user nova-compute[70924]:         <nova:memory>512</nova:memory>
Jul 29 14:41:06 user nova-compute[70924]:         <nova:disk>1</nova:disk>
Jul 29 14:41:06 user nova-compute[70924]:         <nova:swap>0</nova:swap>
Jul 29 14:41:06 user nova-compute[70924]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 14:41:06 user nova-compute[70924]:         <nova:vcpus>1</nova:vcpus>
Jul 29 14:41:06 user nova-compute[70924]:       </nova:flavor>
Jul 29 14:41:06 user nova-compute[70924]:       <nova:owner>
Jul 29 14:41:06 user nova-compute[70924]:         <nova:user uuid="0b744bbecccf48d1833ea4810b2af2d0">tempest-ServerActionsV293TestJSON-1372699391-project-member</nova:user>
Jul 29 14:41:06 user nova-compute[70924]:         <nova:project uuid="fc2394c924af4a9aaa925d116b2117ae">tempest-ServerActionsV293TestJSON-1372699391</nova:project>
Jul 29 14:41:06 user nova-compute[70924]:       </nova:owner>
Jul 29 14:41:06 user nova-compute[70924]:       <nova:root type="image" uuid="3aba2e73-6832-404b-8bd0-d0503ce82b8c"/>
Jul 29 14:41:06 user nova-compute[70924]:       <nova:ports>
Jul 29 14:41:06 user nova-compute[70924]:         <nova:port uuid="72829b2d-d54b-4792-bb99-ea15bf5149a6">
Jul 29 14:41:06 user nova-compute[70924]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 29 14:41:06 user nova-compute[70924]:         </nova:port>
Jul 29 14:41:06 user nova-compute[70924]:       </nova:ports>
Jul 29 14:41:06 user nova-compute[70924]:     </nova:instance>
Jul 29 14:41:06 user nova-compute[70924]:   </metadata>
Jul 29 14:41:06 user nova-compute[70924]:   <sysinfo type="smbios">
Jul 29 14:41:06 user nova-compute[70924]:     <system>
Jul 29 14:41:06 user nova-compute[70924]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 14:41:06 user nova-compute[70924]:       <entry name="product">OpenStack Nova</entry>
Jul 29 14:41:06 user nova-compute[70924]:       <entry name="version">0.0.0</entry>
Jul 29 14:41:06 user nova-compute[70924]:       <entry name="serial">2250b0d6-5542-4a7f-90a9-93745a776fcc</entry>
Jul 29 14:41:06 user nova-compute[70924]:       <entry name="uuid">2250b0d6-5542-4a7f-90a9-93745a776fcc</entry>
Jul 29 14:41:06 user nova-compute[70924]:       <entry name="family">Virtual Machine</entry>
Jul 29 14:41:06 user nova-compute[70924]:     </system>
Jul 29 14:41:06 user nova-compute[70924]:   </sysinfo>
Jul 29 14:41:06 user nova-compute[70924]:   <os>
Jul 29 14:41:06 user nova-compute[70924]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 14:41:06 user nova-compute[70924]:     <boot dev="hd"/>
Jul 29 14:41:06 user nova-compute[70924]:     <smbios mode="sysinfo"/>
Jul 29 14:41:06 user nova-compute[70924]:   </os>
Jul 29 14:41:06 user nova-compute[70924]:   <features>
Jul 29 14:41:06 user nova-compute[70924]:     <acpi/>
Jul 29 14:41:06 user nova-compute[70924]:     <apic/>
Jul 29 14:41:06 user nova-compute[70924]:     <vmcoreinfo/>
Jul 29 14:41:06 user nova-compute[70924]:   </features>
Jul 29 14:41:06 user nova-compute[70924]:   <clock offset="utc">
Jul 29 14:41:06 user nova-compute[70924]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 14:41:06 user nova-compute[70924]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 14:41:06 user nova-compute[70924]:     <timer name="hpet" present="no"/>
Jul 29 14:41:06 user nova-compute[70924]:   </clock>
Jul 29 14:41:06 user nova-compute[70924]:   <cpu mode="custom" match="exact">
Jul 29 14:41:06 user nova-compute[70924]:     <model>Nehalem</model>
Jul 29 14:41:06 user nova-compute[70924]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 14:41:06 user nova-compute[70924]:   </cpu>
Jul 29 14:41:06 user nova-compute[70924]:   <devices>
Jul 29 14:41:06 user nova-compute[70924]:     <disk type="file" device="disk">
Jul 29 14:41:06 user nova-compute[70924]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 14:41:06 user nova-compute[70924]:       <source file="/opt/stack/data/nova/instances/2250b0d6-5542-4a7f-90a9-93745a776fcc/disk"/>
Jul 29 14:41:06 user nova-compute[70924]:       <target dev="vda" bus="virtio"/>
Jul 29 14:41:06 user nova-compute[70924]:     </disk>
Jul 29 14:41:06 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 14:41:06 user nova-compute[70924]:       <mac address="fa:16:3e:b7:e0:eb"/>
Jul 29 14:41:06 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:41:06 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 14:41:06 user nova-compute[70924]:       <target dev="tap72829b2d-d5"/>
Jul 29 14:41:06 user nova-compute[70924]:     </interface>
Jul 29 14:41:06 user nova-compute[70924]:     <serial type="pty">
Jul 29 14:41:06 user nova-compute[70924]:       <log file="/opt/stack/data/nova/instances/2250b0d6-5542-4a7f-90a9-93745a776fcc/console.log" append="off"/>
Jul 29 14:41:06 user nova-compute[70924]:     </serial>
Jul 29 14:41:06 user nova-compute[70924]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 14:41:06 user nova-compute[70924]:     <video>
Jul 29 14:41:06 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:41:06 user nova-compute[70924]:     </video>
Jul 29 14:41:06 user nova-compute[70924]:     <rng model="virtio">
Jul 29 14:41:06 user nova-compute[70924]:       <backend model="random">/dev/urandom</backend>
Jul 29 14:41:06 user nova-compute[70924]:     </rng>
Jul 29 14:41:06 user nova-compute[70924]:     <controller type="usb" index="0" model="none"/>
Jul 29 14:41:06 user nova-compute[70924]:     <memballoon model="virtio">
Jul 29 14:41:06 user nova-compute[70924]:       <stats period="10"/>
Jul 29 14:41:06 user nova-compute[70924]:     </memballoon>
Jul 29 14:41:06 user nova-compute[70924]:   </devices>
Jul 29 14:41:06 user nova-compute[70924]: </domain>
Jul 29 14:41:06 user nova-compute[70924]:  {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 14:41:06 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:40:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-77734653',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-77734653',id=3,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJvkNFMJOrHzNEhMPNt6g+PXKeIoQVhAmKLkP+hqyoJjCjv1XYedRIh/Q8XrDZt8SrZqXeWAbWjyzwVnHh38r8KNF01wuSEVdv2mNYVqRyrKHTZ//f8Ew8pg86ANu4Ob7Q==',key_name='tempest-keypair-248340173',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc2394c924af4a9aaa925d116b2117ae',ramdisk_id='',reservation_id='r-oqzwhxq2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1372699391',owner_user_name='tempest-ServerActionsV293TestJSON-1372699391-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:41:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b744bbecccf48d1833ea4810b2af2d0',uuid=2250b0d6-5542-4a7f-90a9-93745a776fcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72829b2d-d54b-4792-bb99-ea15bf5149a6", "address": "fa:16:3e:b7:e0:eb", "network": {"id": "b6631336-b322-45e0-99b7-5e95539aa674", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2109271400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc2394c924af4a9aaa925d116b2117ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72829b2d-d5", "ovs_interfaceid": "72829b2d-d54b-4792-bb99-ea15bf5149a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 14:41:06 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Converting VIF {"id": "72829b2d-d54b-4792-bb99-ea15bf5149a6", "address": "fa:16:3e:b7:e0:eb", "network": {"id": "b6631336-b322-45e0-99b7-5e95539aa674", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2109271400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc2394c924af4a9aaa925d116b2117ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72829b2d-d5", "ovs_interfaceid": "72829b2d-d54b-4792-bb99-ea15bf5149a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:41:06 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:e0:eb,bridge_name='br-int',has_traffic_filtering=True,id=72829b2d-d54b-4792-bb99-ea15bf5149a6,network=Network(b6631336-b322-45e0-99b7-5e95539aa674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72829b2d-d5') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:41:06 user nova-compute[70924]: DEBUG os_vif [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:e0:eb,bridge_name='br-int',has_traffic_filtering=True,id=72829b2d-d54b-4792-bb99-ea15bf5149a6,network=Network(b6631336-b322-45e0-99b7-5e95539aa674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72829b2d-d5') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 14:41:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:41:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 14:41:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap72829b2d-d5, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:41:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap72829b2d-d5, col_values=(('external_ids', {'iface-id': '72829b2d-d54b-4792-bb99-ea15bf5149a6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:e0:eb', 'vm-uuid': '2250b0d6-5542-4a7f-90a9-93745a776fcc'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:41:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:41:07 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:07 user nova-compute[70924]: INFO os_vif [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:e0:eb,bridge_name='br-int',has_traffic_filtering=True,id=72829b2d-d54b-4792-bb99-ea15bf5149a6,network=Network(b6631336-b322-45e0-99b7-5e95539aa674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72829b2d-d5')
Jul 29 14:41:07 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:41:07 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] No VIF found with MAC fa:16:3e:b7:e0:eb, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:41:07 user nova-compute[70924]: DEBUG nova.network.neutron [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Successfully updated port: 14b12f31-f886-4752-bac2-e4673c74ae85 {{(pid=70924) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 14:41:07 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:07 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Acquiring lock "refresh_cache-f5929dcf-8594-4323-a6f5-a322aff7c881" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:41:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Acquired lock "refresh_cache-f5929dcf-8594-4323-a6f5-a322aff7c881" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:41:07 user nova-compute[70924]: DEBUG nova.network.neutron [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 14:41:07 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:07 user nova-compute[70924]: DEBUG nova.network.neutron [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Instance cache missing network info. {{(pid=70924) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 14:41:07 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:08 user nova-compute[70924]: DEBUG nova.compute.manager [req-d045f4a6-1adf-45a0-8a1f-20adbd03120e req-5c25e98e-8a8a-4e32-bf13-6791a04add02 service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Received event network-changed-14b12f31-f886-4752-bac2-e4673c74ae85 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:41:08 user nova-compute[70924]: DEBUG nova.compute.manager [req-d045f4a6-1adf-45a0-8a1f-20adbd03120e req-5c25e98e-8a8a-4e32-bf13-6791a04add02 service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Refreshing instance network info cache due to event network-changed-14b12f31-f886-4752-bac2-e4673c74ae85. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:41:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-d045f4a6-1adf-45a0-8a1f-20adbd03120e req-5c25e98e-8a8a-4e32-bf13-6791a04add02 service nova] Acquiring lock "refresh_cache-f5929dcf-8594-4323-a6f5-a322aff7c881" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:41:08 user nova-compute[70924]: DEBUG nova.network.neutron [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Successfully updated port: 4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3 {{(pid=70924) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 14:41:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Acquiring lock "refresh_cache-86ecc6cb-88a8-4572-8e41-d4c5859036a6" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:41:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Acquired lock "refresh_cache-86ecc6cb-88a8-4572-8e41-d4c5859036a6" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:41:08 user nova-compute[70924]: DEBUG nova.network.neutron [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 14:41:08 user nova-compute[70924]: DEBUG nova.network.neutron [req-e575ecb8-43a7-49e8-800a-bc04304da460 req-aff2074c-2b32-402e-b657-07ec3de2c8c3 service nova] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] Updated VIF entry in instance network info cache for port 72829b2d-d54b-4792-bb99-ea15bf5149a6. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:41:08 user nova-compute[70924]: DEBUG nova.network.neutron [req-e575ecb8-43a7-49e8-800a-bc04304da460 req-aff2074c-2b32-402e-b657-07ec3de2c8c3 service nova] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] Updating instance_info_cache with network_info: [{"id": "72829b2d-d54b-4792-bb99-ea15bf5149a6", "address": "fa:16:3e:b7:e0:eb", "network": {"id": "b6631336-b322-45e0-99b7-5e95539aa674", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2109271400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc2394c924af4a9aaa925d116b2117ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72829b2d-d5", "ovs_interfaceid": "72829b2d-d54b-4792-bb99-ea15bf5149a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:41:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-e575ecb8-43a7-49e8-800a-bc04304da460 req-aff2074c-2b32-402e-b657-07ec3de2c8c3 service nova] Releasing lock "refresh_cache-2250b0d6-5542-4a7f-90a9-93745a776fcc" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:41:08 user nova-compute[70924]: DEBUG nova.compute.manager [req-f4a61aab-cc1e-44b2-905d-bc9bc304ce4e req-a6ba6aca-a2bb-491c-8fc1-20a97c09aaf2 service nova] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Received event network-changed-4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:41:08 user nova-compute[70924]: DEBUG nova.compute.manager [req-f4a61aab-cc1e-44b2-905d-bc9bc304ce4e req-a6ba6aca-a2bb-491c-8fc1-20a97c09aaf2 service nova] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Refreshing instance network info cache due to event network-changed-4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:41:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-f4a61aab-cc1e-44b2-905d-bc9bc304ce4e req-a6ba6aca-a2bb-491c-8fc1-20a97c09aaf2 service nova] Acquiring lock "refresh_cache-86ecc6cb-88a8-4572-8e41-d4c5859036a6" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:41:08 user nova-compute[70924]: DEBUG nova.network.neutron [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Updating instance_info_cache with network_info: [{"id": "14b12f31-f886-4752-bac2-e4673c74ae85", "address": "fa:16:3e:0b:f1:80", "network": {"id": "4a3c2dab-e462-4e17-a2a3-f07747a26bbe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1820325619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b2ac23ab8cd48b390fa2047c1fd0e3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14b12f31-f8", "ovs_interfaceid": "14b12f31-f886-4752-bac2-e4673c74ae85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:41:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Releasing lock "refresh_cache-f5929dcf-8594-4323-a6f5-a322aff7c881" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:41:08 user nova-compute[70924]: DEBUG nova.compute.manager [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Instance network_info: |[{"id": "14b12f31-f886-4752-bac2-e4673c74ae85", "address": "fa:16:3e:0b:f1:80", "network": {"id": "4a3c2dab-e462-4e17-a2a3-f07747a26bbe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1820325619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b2ac23ab8cd48b390fa2047c1fd0e3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14b12f31-f8", "ovs_interfaceid": "14b12f31-f886-4752-bac2-e4673c74ae85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 14:41:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-d045f4a6-1adf-45a0-8a1f-20adbd03120e req-5c25e98e-8a8a-4e32-bf13-6791a04add02 service nova] Acquired lock "refresh_cache-f5929dcf-8594-4323-a6f5-a322aff7c881" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:41:08 user nova-compute[70924]: DEBUG nova.network.neutron [req-d045f4a6-1adf-45a0-8a1f-20adbd03120e req-5c25e98e-8a8a-4e32-bf13-6791a04add02 service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Refreshing network info cache for port 14b12f31-f886-4752-bac2-e4673c74ae85 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:41:08 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Start _get_guest_xml network_info=[{"id": "14b12f31-f886-4752-bac2-e4673c74ae85", "address": "fa:16:3e:0b:f1:80", "network": {"id": "4a3c2dab-e462-4e17-a2a3-f07747a26bbe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1820325619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b2ac23ab8cd48b390fa2047c1fd0e3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14b12f31-f8", "ovs_interfaceid": "14b12f31-f886-4752-bac2-e4673c74ae85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '3aba2e73-6832-404b-8bd0-d0503ce82b8c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 14:41:08 user nova-compute[70924]: DEBUG nova.network.neutron [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Instance cache missing network info. {{(pid=70924) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 14:41:08 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:41:08 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:41:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:08 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 14:41:08 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] CPU controller missing on host. {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 14:41:08 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 14:41:08 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] CPU controller found on host. {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 14:41:08 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70924) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 14:41:08 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T14:36:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 14:41:08 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Flavor limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 14:41:08 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Image limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 14:41:08 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Flavor pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 14:41:08 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Image pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 14:41:08 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 14:41:08 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 14:41:08 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 14:41:08 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Got 1 possible topologies {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 14:41:08 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 14:41:08 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 14:41:08 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:40:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1109941832',display_name='tempest-ServerStableDeviceRescueTest-server-1109941832',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1109941832',id=4,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDbdP6qGTfEYwkvD4KR81+NGcmQ5kesde3Do7g0iEjKlNSihoatuFiO0botBQ2I+jEu+EJEYmwNNO9AuJw1Z33NLdKhJ+GqI2KS8DPqodG22nTbacKe8+28M7qz7hHEmA==',key_name='tempest-keypair-1327088183',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b2ac23ab8cd48b390fa2047c1fd0e3a',ramdisk_id='',reservation_id='r-uz3xh7j4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1945714992',owner_user_name='tempest-ServerStableDeviceRescueTest-1945714992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:41:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d93ef8af16ed4907897254f0ef7dc4f8',uuid=f5929dcf-8594-4323-a6f5-a322aff7c881,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "14b12f31-f886-4752-bac2-e4673c74ae85", "address": "fa:16:3e:0b:f1:80", "network": {"id": "4a3c2dab-e462-4e17-a2a3-f07747a26bbe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1820325619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b2ac23ab8cd48b390fa2047c1fd0e3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14b12f31-f8", "ovs_interfaceid": "14b12f31-f886-4752-bac2-e4673c74ae85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:41:08 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Converting VIF {"id": "14b12f31-f886-4752-bac2-e4673c74ae85", "address": "fa:16:3e:0b:f1:80", "network": {"id": "4a3c2dab-e462-4e17-a2a3-f07747a26bbe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1820325619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b2ac23ab8cd48b390fa2047c1fd0e3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14b12f31-f8", "ovs_interfaceid": "14b12f31-f886-4752-bac2-e4673c74ae85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:41:08 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:f1:80,bridge_name='br-int',has_traffic_filtering=True,id=14b12f31-f886-4752-bac2-e4673c74ae85,network=Network(4a3c2dab-e462-4e17-a2a3-f07747a26bbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14b12f31-f8') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:41:08 user nova-compute[70924]: DEBUG nova.objects.instance [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Lazy-loading 'pci_devices' on Instance uuid f5929dcf-8594-4323-a6f5-a322aff7c881 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:41:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:08 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] End _get_guest_xml xml=<domain type="kvm">
Jul 29 14:41:08 user nova-compute[70924]:   <uuid>f5929dcf-8594-4323-a6f5-a322aff7c881</uuid>
Jul 29 14:41:08 user nova-compute[70924]:   <name>instance-00000004</name>
Jul 29 14:41:08 user nova-compute[70924]:   <memory>524288</memory>
Jul 29 14:41:08 user nova-compute[70924]:   <vcpu>1</vcpu>
Jul 29 14:41:08 user nova-compute[70924]:   <metadata>
Jul 29 14:41:08 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 14:41:08 user nova-compute[70924]:       <nova:package version="0.0.0"/>
Jul 29 14:41:08 user nova-compute[70924]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1109941832</nova:name>
Jul 29 14:41:08 user nova-compute[70924]:       <nova:creationTime>2023-07-29 14:41:08</nova:creationTime>
Jul 29 14:41:08 user nova-compute[70924]:       <nova:flavor name="m1.tiny">
Jul 29 14:41:08 user nova-compute[70924]:         <nova:memory>512</nova:memory>
Jul 29 14:41:08 user nova-compute[70924]:         <nova:disk>1</nova:disk>
Jul 29 14:41:08 user nova-compute[70924]:         <nova:swap>0</nova:swap>
Jul 29 14:41:08 user nova-compute[70924]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 14:41:08 user nova-compute[70924]:         <nova:vcpus>1</nova:vcpus>
Jul 29 14:41:08 user nova-compute[70924]:       </nova:flavor>
Jul 29 14:41:08 user nova-compute[70924]:       <nova:owner>
Jul 29 14:41:08 user nova-compute[70924]:         <nova:user uuid="d93ef8af16ed4907897254f0ef7dc4f8">tempest-ServerStableDeviceRescueTest-1945714992-project-member</nova:user>
Jul 29 14:41:08 user nova-compute[70924]:         <nova:project uuid="7b2ac23ab8cd48b390fa2047c1fd0e3a">tempest-ServerStableDeviceRescueTest-1945714992</nova:project>
Jul 29 14:41:08 user nova-compute[70924]:       </nova:owner>
Jul 29 14:41:08 user nova-compute[70924]:       <nova:root type="image" uuid="3aba2e73-6832-404b-8bd0-d0503ce82b8c"/>
Jul 29 14:41:08 user nova-compute[70924]:       <nova:ports>
Jul 29 14:41:08 user nova-compute[70924]:         <nova:port uuid="14b12f31-f886-4752-bac2-e4673c74ae85">
Jul 29 14:41:08 user nova-compute[70924]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 29 14:41:08 user nova-compute[70924]:         </nova:port>
Jul 29 14:41:08 user nova-compute[70924]:       </nova:ports>
Jul 29 14:41:08 user nova-compute[70924]:     </nova:instance>
Jul 29 14:41:08 user nova-compute[70924]:   </metadata>
Jul 29 14:41:08 user nova-compute[70924]:   <sysinfo type="smbios">
Jul 29 14:41:08 user nova-compute[70924]:     <system>
Jul 29 14:41:08 user nova-compute[70924]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 14:41:08 user nova-compute[70924]:       <entry name="product">OpenStack Nova</entry>
Jul 29 14:41:08 user nova-compute[70924]:       <entry name="version">0.0.0</entry>
Jul 29 14:41:08 user nova-compute[70924]:       <entry name="serial">f5929dcf-8594-4323-a6f5-a322aff7c881</entry>
Jul 29 14:41:08 user nova-compute[70924]:       <entry name="uuid">f5929dcf-8594-4323-a6f5-a322aff7c881</entry>
Jul 29 14:41:08 user nova-compute[70924]:       <entry name="family">Virtual Machine</entry>
Jul 29 14:41:08 user nova-compute[70924]:     </system>
Jul 29 14:41:08 user nova-compute[70924]:   </sysinfo>
Jul 29 14:41:08 user nova-compute[70924]:   <os>
Jul 29 14:41:08 user nova-compute[70924]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 14:41:08 user nova-compute[70924]:     <boot dev="hd"/>
Jul 29 14:41:08 user nova-compute[70924]:     <smbios mode="sysinfo"/>
Jul 29 14:41:08 user nova-compute[70924]:   </os>
Jul 29 14:41:08 user nova-compute[70924]:   <features>
Jul 29 14:41:08 user nova-compute[70924]:     <acpi/>
Jul 29 14:41:08 user nova-compute[70924]:     <apic/>
Jul 29 14:41:08 user nova-compute[70924]:     <vmcoreinfo/>
Jul 29 14:41:08 user nova-compute[70924]:   </features>
Jul 29 14:41:08 user nova-compute[70924]:   <clock offset="utc">
Jul 29 14:41:08 user nova-compute[70924]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 14:41:08 user nova-compute[70924]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 14:41:08 user nova-compute[70924]:     <timer name="hpet" present="no"/>
Jul 29 14:41:08 user nova-compute[70924]:   </clock>
Jul 29 14:41:08 user nova-compute[70924]:   <cpu mode="custom" match="exact">
Jul 29 14:41:08 user nova-compute[70924]:     <model>Nehalem</model>
Jul 29 14:41:08 user nova-compute[70924]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 14:41:08 user nova-compute[70924]:   </cpu>
Jul 29 14:41:08 user nova-compute[70924]:   <devices>
Jul 29 14:41:08 user nova-compute[70924]:     <disk type="file" device="disk">
Jul 29 14:41:08 user nova-compute[70924]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 14:41:08 user nova-compute[70924]:       <source file="/opt/stack/data/nova/instances/f5929dcf-8594-4323-a6f5-a322aff7c881/disk"/>
Jul 29 14:41:08 user nova-compute[70924]:       <target dev="vda" bus="virtio"/>
Jul 29 14:41:08 user nova-compute[70924]:     </disk>
Jul 29 14:41:08 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 14:41:08 user nova-compute[70924]:       <mac address="fa:16:3e:0b:f1:80"/>
Jul 29 14:41:08 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:41:08 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 14:41:08 user nova-compute[70924]:       <target dev="tap14b12f31-f8"/>
Jul 29 14:41:08 user nova-compute[70924]:     </interface>
Jul 29 14:41:08 user nova-compute[70924]:     <serial type="pty">
Jul 29 14:41:08 user nova-compute[70924]:       <log file="/opt/stack/data/nova/instances/f5929dcf-8594-4323-a6f5-a322aff7c881/console.log" append="off"/>
Jul 29 14:41:08 user nova-compute[70924]:     </serial>
Jul 29 14:41:08 user nova-compute[70924]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 14:41:08 user nova-compute[70924]:     <video>
Jul 29 14:41:08 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:41:08 user nova-compute[70924]:     </video>
Jul 29 14:41:08 user nova-compute[70924]:     <rng model="virtio">
Jul 29 14:41:08 user nova-compute[70924]:       <backend model="random">/dev/urandom</backend>
Jul 29 14:41:08 user nova-compute[70924]:     </rng>
Jul 29 14:41:08 user nova-compute[70924]:     <controller type="usb" index="0" model="none"/>
Jul 29 14:41:08 user nova-compute[70924]:     <memballoon model="virtio">
Jul 29 14:41:08 user nova-compute[70924]:       <stats period="10"/>
Jul 29 14:41:08 user nova-compute[70924]:     </memballoon>
Jul 29 14:41:08 user nova-compute[70924]:   </devices>
Jul 29 14:41:08 user nova-compute[70924]: </domain>
Jul 29 14:41:08 user nova-compute[70924]:  {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 14:41:08 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:40:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1109941832',display_name='tempest-ServerStableDeviceRescueTest-server-1109941832',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1109941832',id=4,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDbdP6qGTfEYwkvD4KR81+NGcmQ5kesde3Do7g0iEjKlNSihoatuFiO0botBQ2I+jEu+EJEYmwNNO9AuJw1Z33NLdKhJ+GqI2KS8DPqodG22nTbacKe8+28M7qz7hHEmA==',key_name='tempest-keypair-1327088183',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b2ac23ab8cd48b390fa2047c1fd0e3a',ramdisk_id='',reservation_id='r-uz3xh7j4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1945714992',owner_user_name='tempest-ServerStableDeviceRescueTest-1945714992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:41:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d93ef8af16ed4907897254f0ef7dc4f8',uuid=f5929dcf-8594-4323-a6f5-a322aff7c881,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "14b12f31-f886-4752-bac2-e4673c74ae85", "address": "fa:16:3e:0b:f1:80", "network": {"id": "4a3c2dab-e462-4e17-a2a3-f07747a26bbe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1820325619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b2ac23ab8cd48b390fa2047c1fd0e3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14b12f31-f8", "ovs_interfaceid": "14b12f31-f886-4752-bac2-e4673c74ae85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 14:41:08 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Converting VIF {"id": "14b12f31-f886-4752-bac2-e4673c74ae85", "address": "fa:16:3e:0b:f1:80", "network": {"id": "4a3c2dab-e462-4e17-a2a3-f07747a26bbe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1820325619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b2ac23ab8cd48b390fa2047c1fd0e3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14b12f31-f8", "ovs_interfaceid": "14b12f31-f886-4752-bac2-e4673c74ae85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:41:08 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:f1:80,bridge_name='br-int',has_traffic_filtering=True,id=14b12f31-f886-4752-bac2-e4673c74ae85,network=Network(4a3c2dab-e462-4e17-a2a3-f07747a26bbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14b12f31-f8') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:41:08 user nova-compute[70924]: DEBUG os_vif [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:f1:80,bridge_name='br-int',has_traffic_filtering=True,id=14b12f31-f886-4752-bac2-e4673c74ae85,network=Network(4a3c2dab-e462-4e17-a2a3-f07747a26bbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14b12f31-f8') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 14:41:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:41:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 14:41:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap14b12f31-f8, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:41:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap14b12f31-f8, col_values=(('external_ids', {'iface-id': '14b12f31-f886-4752-bac2-e4673c74ae85', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:f1:80', 'vm-uuid': 'f5929dcf-8594-4323-a6f5-a322aff7c881'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:41:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:41:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:08 user nova-compute[70924]: INFO os_vif [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:f1:80,bridge_name='br-int',has_traffic_filtering=True,id=14b12f31-f886-4752-bac2-e4673c74ae85,network=Network(4a3c2dab-e462-4e17-a2a3-f07747a26bbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14b12f31-f8')
Jul 29 14:41:08 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:41:08 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] No VIF found with MAC fa:16:3e:0b:f1:80, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:41:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:09 user nova-compute[70924]: DEBUG nova.network.neutron [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Updating instance_info_cache with network_info: [{"id": "4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3", "address": "fa:16:3e:d6:b6:d3", "network": {"id": "55c18d07-a341-4678-9d1c-2dff057a9b1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1092921088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b33d01ba458f466b99b6bc5bba88d8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cd05bcc-ca", "ovs_interfaceid": "4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:41:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Releasing lock "refresh_cache-86ecc6cb-88a8-4572-8e41-d4c5859036a6" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:41:09 user nova-compute[70924]: DEBUG nova.compute.manager [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Instance network_info: |[{"id": "4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3", "address": "fa:16:3e:d6:b6:d3", "network": {"id": "55c18d07-a341-4678-9d1c-2dff057a9b1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1092921088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b33d01ba458f466b99b6bc5bba88d8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cd05bcc-ca", "ovs_interfaceid": "4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 14:41:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-f4a61aab-cc1e-44b2-905d-bc9bc304ce4e req-a6ba6aca-a2bb-491c-8fc1-20a97c09aaf2 service nova] Acquired lock "refresh_cache-86ecc6cb-88a8-4572-8e41-d4c5859036a6" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:41:09 user nova-compute[70924]: DEBUG nova.network.neutron [req-f4a61aab-cc1e-44b2-905d-bc9bc304ce4e req-a6ba6aca-a2bb-491c-8fc1-20a97c09aaf2 service nova] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Refreshing network info cache for port 4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:41:09 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Start _get_guest_xml network_info=[{"id": "4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3", "address": "fa:16:3e:d6:b6:d3", "network": {"id": "55c18d07-a341-4678-9d1c-2dff057a9b1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1092921088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b33d01ba458f466b99b6bc5bba88d8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cd05bcc-ca", "ovs_interfaceid": "4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '3aba2e73-6832-404b-8bd0-d0503ce82b8c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 14:41:09 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:41:09 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:41:09 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 14:41:09 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] CPU controller missing on host. {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 14:41:09 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 14:41:09 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] CPU controller found on host. {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 14:41:09 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70924) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 14:41:09 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T14:36:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 14:41:09 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Flavor limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 14:41:09 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Image limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 14:41:09 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Flavor pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 14:41:09 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Image pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 14:41:09 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 14:41:09 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 14:41:09 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 14:41:09 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Got 1 possible topologies {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 14:41:09 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 14:41:09 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 14:41:09 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:41:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2046651584',display_name='tempest-ServerActionsTestOtherA-server-2046651584',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2046651584',id=5,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfg71Q+cjedfRarcbIler9POuKvX/jsQII2ANgknh6qTEvuHJAE8T34RCDfGUcAvd9SbwZCzhWP8ikNDBjVZKRBIySMsLhBLIX0hKsMOAV+S3aIT6/Yawicov1EmjAkDw==',key_name='tempest-keypair-1866871140',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b33d01ba458f466b99b6bc5bba88d8c0',ramdisk_id='',reservation_id='r-uso70bui',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-166265056',owner_user_name='tempest-ServerActionsTestOtherA-166265056-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:41:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55b9032bef2d4d3586dc5d18cdc1ee55',uuid=86ecc6cb-88a8-4572-8e41-d4c5859036a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3", "address": "fa:16:3e:d6:b6:d3", "network": {"id": "55c18d07-a341-4678-9d1c-2dff057a9b1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1092921088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b33d01ba458f466b99b6bc5bba88d8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cd05bcc-ca", "ovs_interfaceid": "4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:41:09 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Converting VIF {"id": "4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3", "address": "fa:16:3e:d6:b6:d3", "network": {"id": "55c18d07-a341-4678-9d1c-2dff057a9b1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1092921088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b33d01ba458f466b99b6bc5bba88d8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cd05bcc-ca", "ovs_interfaceid": "4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:41:09 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:b6:d3,bridge_name='br-int',has_traffic_filtering=True,id=4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3,network=Network(55c18d07-a341-4678-9d1c-2dff057a9b1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cd05bcc-ca') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:41:09 user nova-compute[70924]: DEBUG nova.objects.instance [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lazy-loading 'pci_devices' on Instance uuid 86ecc6cb-88a8-4572-8e41-d4c5859036a6 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:41:09 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] End _get_guest_xml xml=<domain type="kvm">
Jul 29 14:41:09 user nova-compute[70924]:   <uuid>86ecc6cb-88a8-4572-8e41-d4c5859036a6</uuid>
Jul 29 14:41:09 user nova-compute[70924]:   <name>instance-00000005</name>
Jul 29 14:41:09 user nova-compute[70924]:   <memory>524288</memory>
Jul 29 14:41:09 user nova-compute[70924]:   <vcpu>1</vcpu>
Jul 29 14:41:09 user nova-compute[70924]:   <metadata>
Jul 29 14:41:09 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 14:41:09 user nova-compute[70924]:       <nova:package version="0.0.0"/>
Jul 29 14:41:09 user nova-compute[70924]:       <nova:name>tempest-ServerActionsTestOtherA-server-2046651584</nova:name>
Jul 29 14:41:09 user nova-compute[70924]:       <nova:creationTime>2023-07-29 14:41:09</nova:creationTime>
Jul 29 14:41:09 user nova-compute[70924]:       <nova:flavor name="m1.tiny">
Jul 29 14:41:09 user nova-compute[70924]:         <nova:memory>512</nova:memory>
Jul 29 14:41:09 user nova-compute[70924]:         <nova:disk>1</nova:disk>
Jul 29 14:41:09 user nova-compute[70924]:         <nova:swap>0</nova:swap>
Jul 29 14:41:09 user nova-compute[70924]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 14:41:09 user nova-compute[70924]:         <nova:vcpus>1</nova:vcpus>
Jul 29 14:41:09 user nova-compute[70924]:       </nova:flavor>
Jul 29 14:41:09 user nova-compute[70924]:       <nova:owner>
Jul 29 14:41:09 user nova-compute[70924]:         <nova:user uuid="55b9032bef2d4d3586dc5d18cdc1ee55">tempest-ServerActionsTestOtherA-166265056-project-member</nova:user>
Jul 29 14:41:09 user nova-compute[70924]:         <nova:project uuid="b33d01ba458f466b99b6bc5bba88d8c0">tempest-ServerActionsTestOtherA-166265056</nova:project>
Jul 29 14:41:09 user nova-compute[70924]:       </nova:owner>
Jul 29 14:41:09 user nova-compute[70924]:       <nova:root type="image" uuid="3aba2e73-6832-404b-8bd0-d0503ce82b8c"/>
Jul 29 14:41:09 user nova-compute[70924]:       <nova:ports>
Jul 29 14:41:09 user nova-compute[70924]:         <nova:port uuid="4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3">
Jul 29 14:41:09 user nova-compute[70924]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 29 14:41:09 user nova-compute[70924]:         </nova:port>
Jul 29 14:41:09 user nova-compute[70924]:       </nova:ports>
Jul 29 14:41:09 user nova-compute[70924]:     </nova:instance>
Jul 29 14:41:09 user nova-compute[70924]:   </metadata>
Jul 29 14:41:09 user nova-compute[70924]:   <sysinfo type="smbios">
Jul 29 14:41:09 user nova-compute[70924]:     <system>
Jul 29 14:41:09 user nova-compute[70924]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 14:41:09 user nova-compute[70924]:       <entry name="product">OpenStack Nova</entry>
Jul 29 14:41:09 user nova-compute[70924]:       <entry name="version">0.0.0</entry>
Jul 29 14:41:09 user nova-compute[70924]:       <entry name="serial">86ecc6cb-88a8-4572-8e41-d4c5859036a6</entry>
Jul 29 14:41:09 user nova-compute[70924]:       <entry name="uuid">86ecc6cb-88a8-4572-8e41-d4c5859036a6</entry>
Jul 29 14:41:09 user nova-compute[70924]:       <entry name="family">Virtual Machine</entry>
Jul 29 14:41:09 user nova-compute[70924]:     </system>
Jul 29 14:41:09 user nova-compute[70924]:   </sysinfo>
Jul 29 14:41:09 user nova-compute[70924]:   <os>
Jul 29 14:41:09 user nova-compute[70924]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 14:41:09 user nova-compute[70924]:     <boot dev="hd"/>
Jul 29 14:41:09 user nova-compute[70924]:     <smbios mode="sysinfo"/>
Jul 29 14:41:09 user nova-compute[70924]:   </os>
Jul 29 14:41:09 user nova-compute[70924]:   <features>
Jul 29 14:41:09 user nova-compute[70924]:     <acpi/>
Jul 29 14:41:09 user nova-compute[70924]:     <apic/>
Jul 29 14:41:09 user nova-compute[70924]:     <vmcoreinfo/>
Jul 29 14:41:09 user nova-compute[70924]:   </features>
Jul 29 14:41:09 user nova-compute[70924]:   <clock offset="utc">
Jul 29 14:41:09 user nova-compute[70924]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 14:41:09 user nova-compute[70924]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 14:41:09 user nova-compute[70924]:     <timer name="hpet" present="no"/>
Jul 29 14:41:09 user nova-compute[70924]:   </clock>
Jul 29 14:41:09 user nova-compute[70924]:   <cpu mode="custom" match="exact">
Jul 29 14:41:09 user nova-compute[70924]:     <model>Nehalem</model>
Jul 29 14:41:09 user nova-compute[70924]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 14:41:09 user nova-compute[70924]:   </cpu>
Jul 29 14:41:09 user nova-compute[70924]:   <devices>
Jul 29 14:41:09 user nova-compute[70924]:     <disk type="file" device="disk">
Jul 29 14:41:09 user nova-compute[70924]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 14:41:09 user nova-compute[70924]:       <source file="/opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk"/>
Jul 29 14:41:09 user nova-compute[70924]:       <target dev="vda" bus="virtio"/>
Jul 29 14:41:09 user nova-compute[70924]:     </disk>
Jul 29 14:41:09 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 14:41:09 user nova-compute[70924]:       <mac address="fa:16:3e:d6:b6:d3"/>
Jul 29 14:41:09 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:41:09 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 14:41:09 user nova-compute[70924]:       <target dev="tap4cd05bcc-ca"/>
Jul 29 14:41:09 user nova-compute[70924]:     </interface>
Jul 29 14:41:09 user nova-compute[70924]:     <serial type="pty">
Jul 29 14:41:09 user nova-compute[70924]:       <log file="/opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/console.log" append="off"/>
Jul 29 14:41:09 user nova-compute[70924]:     </serial>
Jul 29 14:41:09 user nova-compute[70924]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 14:41:09 user nova-compute[70924]:     <video>
Jul 29 14:41:09 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:41:09 user nova-compute[70924]:     </video>
Jul 29 14:41:09 user nova-compute[70924]:     <rng model="virtio">
Jul 29 14:41:09 user nova-compute[70924]:       <backend model="random">/dev/urandom</backend>
Jul 29 14:41:09 user nova-compute[70924]:     </rng>
Jul 29 14:41:09 user nova-compute[70924]:     <controller type="usb" index="0" model="none"/>
Jul 29 14:41:09 user nova-compute[70924]:     <memballoon model="virtio">
Jul 29 14:41:09 user nova-compute[70924]:       <stats period="10"/>
Jul 29 14:41:09 user nova-compute[70924]:     </memballoon>
Jul 29 14:41:09 user nova-compute[70924]:   </devices>
Jul 29 14:41:09 user nova-compute[70924]: </domain>
Jul 29 14:41:09 user nova-compute[70924]:  {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 14:41:09 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:41:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2046651584',display_name='tempest-ServerActionsTestOtherA-server-2046651584',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2046651584',id=5,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfg71Q+cjedfRarcbIler9POuKvX/jsQII2ANgknh6qTEvuHJAE8T34RCDfGUcAvd9SbwZCzhWP8ikNDBjVZKRBIySMsLhBLIX0hKsMOAV+S3aIT6/Yawicov1EmjAkDw==',key_name='tempest-keypair-1866871140',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b33d01ba458f466b99b6bc5bba88d8c0',ramdisk_id='',reservation_id='r-uso70bui',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-166265056',owner_user_name='tempest-ServerActionsTestOtherA-166265056-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:41:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55b9032bef2d4d3586dc5d18cdc1ee55',uuid=86ecc6cb-88a8-4572-8e41-d4c5859036a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3", "address": "fa:16:3e:d6:b6:d3", "network": {"id": "55c18d07-a341-4678-9d1c-2dff057a9b1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1092921088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b33d01ba458f466b99b6bc5bba88d8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cd05bcc-ca", "ovs_interfaceid": "4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 14:41:09 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Converting VIF {"id": "4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3", "address": "fa:16:3e:d6:b6:d3", "network": {"id": "55c18d07-a341-4678-9d1c-2dff057a9b1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1092921088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b33d01ba458f466b99b6bc5bba88d8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cd05bcc-ca", "ovs_interfaceid": "4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:41:09 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:b6:d3,bridge_name='br-int',has_traffic_filtering=True,id=4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3,network=Network(55c18d07-a341-4678-9d1c-2dff057a9b1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cd05bcc-ca') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:41:09 user nova-compute[70924]: DEBUG os_vif [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:b6:d3,bridge_name='br-int',has_traffic_filtering=True,id=4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3,network=Network(55c18d07-a341-4678-9d1c-2dff057a9b1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cd05bcc-ca') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 14:41:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:41:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 14:41:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4cd05bcc-ca, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:41:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4cd05bcc-ca, col_values=(('external_ids', {'iface-id': '4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:b6:d3', 'vm-uuid': '86ecc6cb-88a8-4572-8e41-d4c5859036a6'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:41:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:41:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:09 user nova-compute[70924]: INFO os_vif [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:b6:d3,bridge_name='br-int',has_traffic_filtering=True,id=4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3,network=Network(55c18d07-a341-4678-9d1c-2dff057a9b1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cd05bcc-ca')
Jul 29 14:41:09 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:41:09 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] No VIF found with MAC fa:16:3e:d6:b6:d3, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:41:09 user nova-compute[70924]: DEBUG nova.network.neutron [req-d045f4a6-1adf-45a0-8a1f-20adbd03120e req-5c25e98e-8a8a-4e32-bf13-6791a04add02 service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Updated VIF entry in instance network info cache for port 14b12f31-f886-4752-bac2-e4673c74ae85. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:41:09 user nova-compute[70924]: DEBUG nova.network.neutron [req-d045f4a6-1adf-45a0-8a1f-20adbd03120e req-5c25e98e-8a8a-4e32-bf13-6791a04add02 service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Updating instance_info_cache with network_info: [{"id": "14b12f31-f886-4752-bac2-e4673c74ae85", "address": "fa:16:3e:0b:f1:80", "network": {"id": "4a3c2dab-e462-4e17-a2a3-f07747a26bbe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1820325619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b2ac23ab8cd48b390fa2047c1fd0e3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14b12f31-f8", "ovs_interfaceid": "14b12f31-f886-4752-bac2-e4673c74ae85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:41:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-d045f4a6-1adf-45a0-8a1f-20adbd03120e req-5c25e98e-8a8a-4e32-bf13-6791a04add02 service nova] Releasing lock "refresh_cache-f5929dcf-8594-4323-a6f5-a322aff7c881" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:41:10 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:10 user nova-compute[70924]: DEBUG nova.compute.manager [req-4cd93758-7b42-41f4-95cd-6ab80ef12c76 req-99608095-67c9-446c-b44a-a3952f5b85df service nova] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Received event network-vif-plugged-bd091ea0-8c42-4140-aad1-617f27d2a469 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:41:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-4cd93758-7b42-41f4-95cd-6ab80ef12c76 req-99608095-67c9-446c-b44a-a3952f5b85df service nova] Acquiring lock "db656346-c4af-43da-9600-fd39f1b9e4dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:41:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-4cd93758-7b42-41f4-95cd-6ab80ef12c76 req-99608095-67c9-446c-b44a-a3952f5b85df service nova] Lock "db656346-c4af-43da-9600-fd39f1b9e4dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:41:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-4cd93758-7b42-41f4-95cd-6ab80ef12c76 req-99608095-67c9-446c-b44a-a3952f5b85df service nova] Lock "db656346-c4af-43da-9600-fd39f1b9e4dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:41:10 user nova-compute[70924]: DEBUG nova.compute.manager [req-4cd93758-7b42-41f4-95cd-6ab80ef12c76 req-99608095-67c9-446c-b44a-a3952f5b85df service nova] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] No waiting events found dispatching network-vif-plugged-bd091ea0-8c42-4140-aad1-617f27d2a469 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:41:10 user nova-compute[70924]: WARNING nova.compute.manager [req-4cd93758-7b42-41f4-95cd-6ab80ef12c76 req-99608095-67c9-446c-b44a-a3952f5b85df service nova] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Received unexpected event network-vif-plugged-bd091ea0-8c42-4140-aad1-617f27d2a469 for instance with vm_state building and task_state spawning.
Jul 29 14:41:11 user nova-compute[70924]: DEBUG nova.network.neutron [req-f4a61aab-cc1e-44b2-905d-bc9bc304ce4e req-a6ba6aca-a2bb-491c-8fc1-20a97c09aaf2 service nova] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Updated VIF entry in instance network info cache for port 4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:41:11 user nova-compute[70924]: DEBUG nova.network.neutron [req-f4a61aab-cc1e-44b2-905d-bc9bc304ce4e req-a6ba6aca-a2bb-491c-8fc1-20a97c09aaf2 service nova] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Updating instance_info_cache with network_info: [{"id": "4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3", "address": "fa:16:3e:d6:b6:d3", "network": {"id": "55c18d07-a341-4678-9d1c-2dff057a9b1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1092921088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b33d01ba458f466b99b6bc5bba88d8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cd05bcc-ca", "ovs_interfaceid": "4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:41:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-f4a61aab-cc1e-44b2-905d-bc9bc304ce4e req-a6ba6aca-a2bb-491c-8fc1-20a97c09aaf2 service nova] Releasing lock "refresh_cache-86ecc6cb-88a8-4572-8e41-d4c5859036a6" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:41:11 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:11 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690641671.8137157, db656346-c4af-43da-9600-fd39f1b9e4dc => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:41:11 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] VM Resumed (Lifecycle Event)
Jul 29 14:41:11 user nova-compute[70924]: DEBUG nova.compute.manager [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Instance event wait completed in 0 seconds for  {{(pid=70924) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 14:41:11 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Guest created on hypervisor {{(pid=70924) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 14:41:11 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Instance spawned successfully.
Jul 29 14:41:11 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 14:41:11 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Found default for hw_cdrom_bus of ide {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:41:11 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Found default for hw_disk_bus of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:41:11 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Found default for hw_input_bus of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:41:11 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Found default for hw_pointer_model of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:41:11 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Found default for hw_video_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:41:11 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Found default for hw_vif_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:41:11 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:41:11 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:41:11 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:41:11 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690641671.8199406, db656346-c4af-43da-9600-fd39f1b9e4dc => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:41:11 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] VM Started (Lifecycle Event)
Jul 29 14:41:11 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:41:12 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:41:12 user nova-compute[70924]: INFO nova.compute.manager [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Took 19.17 seconds to spawn the instance on the hypervisor.
Jul 29 14:41:12 user nova-compute[70924]: DEBUG nova.compute.manager [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:41:12 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:41:12 user nova-compute[70924]: INFO nova.compute.manager [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Took 20.15 seconds to build instance.
Jul 29 14:41:12 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:12 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:12 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:12 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-feb80031-2258-42a1-95be-5cfe3067b7c8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "db656346-c4af-43da-9600-fd39f1b9e4dc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.554s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:41:12 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:12 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:12 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:12 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:12 user nova-compute[70924]: DEBUG nova.compute.manager [req-3d495f78-55c2-4711-a168-4a9df0f62151 req-5b005347-afbe-421c-a0bd-20b438251422 service nova] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Received event network-vif-plugged-bd091ea0-8c42-4140-aad1-617f27d2a469 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:41:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-3d495f78-55c2-4711-a168-4a9df0f62151 req-5b005347-afbe-421c-a0bd-20b438251422 service nova] Acquiring lock "db656346-c4af-43da-9600-fd39f1b9e4dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:41:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-3d495f78-55c2-4711-a168-4a9df0f62151 req-5b005347-afbe-421c-a0bd-20b438251422 service nova] Lock "db656346-c4af-43da-9600-fd39f1b9e4dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:41:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-3d495f78-55c2-4711-a168-4a9df0f62151 req-5b005347-afbe-421c-a0bd-20b438251422 service nova] Lock "db656346-c4af-43da-9600-fd39f1b9e4dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:41:12 user nova-compute[70924]: DEBUG nova.compute.manager [req-3d495f78-55c2-4711-a168-4a9df0f62151 req-5b005347-afbe-421c-a0bd-20b438251422 service nova] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] No waiting events found dispatching network-vif-plugged-bd091ea0-8c42-4140-aad1-617f27d2a469 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:41:12 user nova-compute[70924]: WARNING nova.compute.manager [req-3d495f78-55c2-4711-a168-4a9df0f62151 req-5b005347-afbe-421c-a0bd-20b438251422 service nova] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Received unexpected event network-vif-plugged-bd091ea0-8c42-4140-aad1-617f27d2a469 for instance with vm_state active and task_state None.
Jul 29 14:41:12 user nova-compute[70924]: DEBUG nova.compute.manager [req-3d495f78-55c2-4711-a168-4a9df0f62151 req-5b005347-afbe-421c-a0bd-20b438251422 service nova] [instance: c7776982-40ea-4b06-b853-cfd484efba73] Received event network-vif-plugged-52dab4ab-4869-4263-9264-9150480c9efc {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:41:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-3d495f78-55c2-4711-a168-4a9df0f62151 req-5b005347-afbe-421c-a0bd-20b438251422 service nova] Acquiring lock "c7776982-40ea-4b06-b853-cfd484efba73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:41:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-3d495f78-55c2-4711-a168-4a9df0f62151 req-5b005347-afbe-421c-a0bd-20b438251422 service nova] Lock "c7776982-40ea-4b06-b853-cfd484efba73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:41:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-3d495f78-55c2-4711-a168-4a9df0f62151 req-5b005347-afbe-421c-a0bd-20b438251422 service nova] Lock "c7776982-40ea-4b06-b853-cfd484efba73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:41:12 user nova-compute[70924]: DEBUG nova.compute.manager [req-3d495f78-55c2-4711-a168-4a9df0f62151 req-5b005347-afbe-421c-a0bd-20b438251422 service nova] [instance: c7776982-40ea-4b06-b853-cfd484efba73] No waiting events found dispatching network-vif-plugged-52dab4ab-4869-4263-9264-9150480c9efc {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:41:12 user nova-compute[70924]: WARNING nova.compute.manager [req-3d495f78-55c2-4711-a168-4a9df0f62151 req-5b005347-afbe-421c-a0bd-20b438251422 service nova] [instance: c7776982-40ea-4b06-b853-cfd484efba73] Received unexpected event network-vif-plugged-52dab4ab-4869-4263-9264-9150480c9efc for instance with vm_state building and task_state spawning.
Jul 29 14:41:13 user nova-compute[70924]: DEBUG nova.compute.manager [req-e0f0905a-439b-464b-8a20-d7e508a9c54e req-22d43f3b-839d-4ca4-b3f5-aaca81188177 service nova] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Received event network-vif-plugged-4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:41:13 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-e0f0905a-439b-464b-8a20-d7e508a9c54e req-22d43f3b-839d-4ca4-b3f5-aaca81188177 service nova] Acquiring lock "86ecc6cb-88a8-4572-8e41-d4c5859036a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:41:13 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-e0f0905a-439b-464b-8a20-d7e508a9c54e req-22d43f3b-839d-4ca4-b3f5-aaca81188177 service nova] Lock "86ecc6cb-88a8-4572-8e41-d4c5859036a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:41:13 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-e0f0905a-439b-464b-8a20-d7e508a9c54e req-22d43f3b-839d-4ca4-b3f5-aaca81188177 service nova] Lock "86ecc6cb-88a8-4572-8e41-d4c5859036a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:41:13 user nova-compute[70924]: DEBUG nova.compute.manager [req-e0f0905a-439b-464b-8a20-d7e508a9c54e req-22d43f3b-839d-4ca4-b3f5-aaca81188177 service nova] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] No waiting events found dispatching network-vif-plugged-4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:41:13 user nova-compute[70924]: WARNING nova.compute.manager [req-e0f0905a-439b-464b-8a20-d7e508a9c54e req-22d43f3b-839d-4ca4-b3f5-aaca81188177 service nova] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Received unexpected event network-vif-plugged-4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3 for instance with vm_state building and task_state spawning.
Jul 29 14:41:14 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:14 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:14 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:14 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:14 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:14 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:14 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690641674.975674, 2250b0d6-5542-4a7f-90a9-93745a776fcc => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:41:14 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] VM Resumed (Lifecycle Event)
Jul 29 14:41:14 user nova-compute[70924]: DEBUG nova.compute.manager [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] Instance event wait completed in 0 seconds for  {{(pid=70924) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 14:41:14 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] Guest created on hypervisor {{(pid=70924) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 14:41:14 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:15 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] Instance spawned successfully.
Jul 29 14:41:15 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 14:41:15 user nova-compute[70924]: DEBUG nova.compute.manager [req-d25c82ac-05ad-4d29-ab45-85ab13763ac0 req-9868ba87-e676-4fa4-ba25-4120433358b9 service nova] [instance: c7776982-40ea-4b06-b853-cfd484efba73] Received event network-vif-plugged-52dab4ab-4869-4263-9264-9150480c9efc {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:41:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-d25c82ac-05ad-4d29-ab45-85ab13763ac0 req-9868ba87-e676-4fa4-ba25-4120433358b9 service nova] Acquiring lock "c7776982-40ea-4b06-b853-cfd484efba73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:41:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-d25c82ac-05ad-4d29-ab45-85ab13763ac0 req-9868ba87-e676-4fa4-ba25-4120433358b9 service nova] Lock "c7776982-40ea-4b06-b853-cfd484efba73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:41:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-d25c82ac-05ad-4d29-ab45-85ab13763ac0 req-9868ba87-e676-4fa4-ba25-4120433358b9 service nova] Lock "c7776982-40ea-4b06-b853-cfd484efba73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:41:15 user nova-compute[70924]: DEBUG nova.compute.manager [req-d25c82ac-05ad-4d29-ab45-85ab13763ac0 req-9868ba87-e676-4fa4-ba25-4120433358b9 service nova] [instance: c7776982-40ea-4b06-b853-cfd484efba73] No waiting events found dispatching network-vif-plugged-52dab4ab-4869-4263-9264-9150480c9efc {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:41:15 user nova-compute[70924]: WARNING nova.compute.manager [req-d25c82ac-05ad-4d29-ab45-85ab13763ac0 req-9868ba87-e676-4fa4-ba25-4120433358b9 service nova] [instance: c7776982-40ea-4b06-b853-cfd484efba73] Received unexpected event network-vif-plugged-52dab4ab-4869-4263-9264-9150480c9efc for instance with vm_state building and task_state spawning.
Jul 29 14:41:15 user nova-compute[70924]: DEBUG nova.compute.manager [req-d25c82ac-05ad-4d29-ab45-85ab13763ac0 req-9868ba87-e676-4fa4-ba25-4120433358b9 service nova] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] Received event network-vif-plugged-72829b2d-d54b-4792-bb99-ea15bf5149a6 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:41:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-d25c82ac-05ad-4d29-ab45-85ab13763ac0 req-9868ba87-e676-4fa4-ba25-4120433358b9 service nova] Acquiring lock "2250b0d6-5542-4a7f-90a9-93745a776fcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:41:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-d25c82ac-05ad-4d29-ab45-85ab13763ac0 req-9868ba87-e676-4fa4-ba25-4120433358b9 service nova] Lock "2250b0d6-5542-4a7f-90a9-93745a776fcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:41:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-d25c82ac-05ad-4d29-ab45-85ab13763ac0 req-9868ba87-e676-4fa4-ba25-4120433358b9 service nova] Lock "2250b0d6-5542-4a7f-90a9-93745a776fcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:41:15 user nova-compute[70924]: DEBUG nova.compute.manager [req-d25c82ac-05ad-4d29-ab45-85ab13763ac0 req-9868ba87-e676-4fa4-ba25-4120433358b9 service nova] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] No waiting events found dispatching network-vif-plugged-72829b2d-d54b-4792-bb99-ea15bf5149a6 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:41:15 user nova-compute[70924]: WARNING nova.compute.manager [req-d25c82ac-05ad-4d29-ab45-85ab13763ac0 req-9868ba87-e676-4fa4-ba25-4120433358b9 service nova] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] Received unexpected event network-vif-plugged-72829b2d-d54b-4792-bb99-ea15bf5149a6 for instance with vm_state building and task_state spawning.
Jul 29 14:41:15 user nova-compute[70924]: DEBUG nova.compute.manager [req-d25c82ac-05ad-4d29-ab45-85ab13763ac0 req-9868ba87-e676-4fa4-ba25-4120433358b9 service nova] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] Received event network-vif-plugged-72829b2d-d54b-4792-bb99-ea15bf5149a6 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:41:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-d25c82ac-05ad-4d29-ab45-85ab13763ac0 req-9868ba87-e676-4fa4-ba25-4120433358b9 service nova] Acquiring lock "2250b0d6-5542-4a7f-90a9-93745a776fcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:41:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-d25c82ac-05ad-4d29-ab45-85ab13763ac0 req-9868ba87-e676-4fa4-ba25-4120433358b9 service nova] Lock "2250b0d6-5542-4a7f-90a9-93745a776fcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:41:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-d25c82ac-05ad-4d29-ab45-85ab13763ac0 req-9868ba87-e676-4fa4-ba25-4120433358b9 service nova] Lock "2250b0d6-5542-4a7f-90a9-93745a776fcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:41:15 user nova-compute[70924]: DEBUG nova.compute.manager [req-d25c82ac-05ad-4d29-ab45-85ab13763ac0 req-9868ba87-e676-4fa4-ba25-4120433358b9 service nova] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] No waiting events found dispatching network-vif-plugged-72829b2d-d54b-4792-bb99-ea15bf5149a6 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:41:15 user nova-compute[70924]: WARNING nova.compute.manager [req-d25c82ac-05ad-4d29-ab45-85ab13763ac0 req-9868ba87-e676-4fa4-ba25-4120433358b9 service nova] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] Received unexpected event network-vif-plugged-72829b2d-d54b-4792-bb99-ea15bf5149a6 for instance with vm_state building and task_state spawning.
Jul 29 14:41:15 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:41:15 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] Found default for hw_cdrom_bus of ide {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:41:15 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] Found default for hw_disk_bus of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:41:15 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] Found default for hw_input_bus of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:41:15 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] Found default for hw_pointer_model of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:41:15 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] Found default for hw_video_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:41:15 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] Found default for hw_vif_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:41:15 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:41:15 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:41:15 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690641674.9945276, 2250b0d6-5542-4a7f-90a9-93745a776fcc => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:41:15 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] VM Started (Lifecycle Event)
Jul 29 14:41:15 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:41:15 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:41:15 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:41:15 user nova-compute[70924]: INFO nova.compute.manager [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] Took 14.80 seconds to spawn the instance on the hypervisor.
Jul 29 14:41:15 user nova-compute[70924]: DEBUG nova.compute.manager [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:41:15 user nova-compute[70924]: INFO nova.compute.manager [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] Took 15.72 seconds to build instance.
Jul 29 14:41:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5930ea01-3cb4-4097-927e-65ab5cd20fd1 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Lock "2250b0d6-5542-4a7f-90a9-93745a776fcc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.868s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:41:15 user nova-compute[70924]: DEBUG nova.compute.manager [req-78c71e80-c77e-4336-a2a4-e57c02b265dc req-2b8c4801-753b-4db6-8444-8d668fe1aa92 service nova] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Received event network-vif-plugged-4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:41:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-78c71e80-c77e-4336-a2a4-e57c02b265dc req-2b8c4801-753b-4db6-8444-8d668fe1aa92 service nova] Acquiring lock "86ecc6cb-88a8-4572-8e41-d4c5859036a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:41:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-78c71e80-c77e-4336-a2a4-e57c02b265dc req-2b8c4801-753b-4db6-8444-8d668fe1aa92 service nova] Lock "86ecc6cb-88a8-4572-8e41-d4c5859036a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:41:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-78c71e80-c77e-4336-a2a4-e57c02b265dc req-2b8c4801-753b-4db6-8444-8d668fe1aa92 service nova] Lock "86ecc6cb-88a8-4572-8e41-d4c5859036a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:41:15 user nova-compute[70924]: DEBUG nova.compute.manager [req-78c71e80-c77e-4336-a2a4-e57c02b265dc req-2b8c4801-753b-4db6-8444-8d668fe1aa92 service nova] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] No waiting events found dispatching network-vif-plugged-4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:41:15 user nova-compute[70924]: WARNING nova.compute.manager [req-78c71e80-c77e-4336-a2a4-e57c02b265dc req-2b8c4801-753b-4db6-8444-8d668fe1aa92 service nova] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Received unexpected event network-vif-plugged-4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3 for instance with vm_state building and task_state spawning.
Jul 29 14:41:16 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690641676.0651896, c7776982-40ea-4b06-b853-cfd484efba73 => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:41:16 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: c7776982-40ea-4b06-b853-cfd484efba73] VM Resumed (Lifecycle Event)
Jul 29 14:41:16 user nova-compute[70924]: DEBUG nova.compute.manager [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] [instance: c7776982-40ea-4b06-b853-cfd484efba73] Instance event wait completed in 0 seconds for  {{(pid=70924) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 14:41:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] [instance: c7776982-40ea-4b06-b853-cfd484efba73] Guest created on hypervisor {{(pid=70924) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 14:41:16 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: c7776982-40ea-4b06-b853-cfd484efba73] Instance spawned successfully.
Jul 29 14:41:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] [instance: c7776982-40ea-4b06-b853-cfd484efba73] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 14:41:16 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: c7776982-40ea-4b06-b853-cfd484efba73] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:41:16 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: c7776982-40ea-4b06-b853-cfd484efba73] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:41:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] [instance: c7776982-40ea-4b06-b853-cfd484efba73] Found default for hw_cdrom_bus of ide {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:41:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] [instance: c7776982-40ea-4b06-b853-cfd484efba73] Found default for hw_disk_bus of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:41:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] [instance: c7776982-40ea-4b06-b853-cfd484efba73] Found default for hw_input_bus of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:41:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] [instance: c7776982-40ea-4b06-b853-cfd484efba73] Found default for hw_pointer_model of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:41:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] [instance: c7776982-40ea-4b06-b853-cfd484efba73] Found default for hw_video_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:41:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] [instance: c7776982-40ea-4b06-b853-cfd484efba73] Found default for hw_vif_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:41:16 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: c7776982-40ea-4b06-b853-cfd484efba73] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:41:16 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690641676.0690763, c7776982-40ea-4b06-b853-cfd484efba73 => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:41:16 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: c7776982-40ea-4b06-b853-cfd484efba73] VM Started (Lifecycle Event)
Jul 29 14:41:16 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: c7776982-40ea-4b06-b853-cfd484efba73] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:41:16 user nova-compute[70924]: DEBUG nova.compute.manager [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Instance event wait completed in 0 seconds for  {{(pid=70924) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 14:41:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Guest created on hypervisor {{(pid=70924) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 14:41:16 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: c7776982-40ea-4b06-b853-cfd484efba73] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:41:16 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Instance spawned successfully.
Jul 29 14:41:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 14:41:16 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: c7776982-40ea-4b06-b853-cfd484efba73] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:41:16 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690641676.2762065, 86ecc6cb-88a8-4572-8e41-d4c5859036a6 => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:41:16 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] VM Resumed (Lifecycle Event)
Jul 29 14:41:16 user nova-compute[70924]: INFO nova.compute.manager [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] [instance: c7776982-40ea-4b06-b853-cfd484efba73] Took 23.25 seconds to spawn the instance on the hypervisor.
Jul 29 14:41:16 user nova-compute[70924]: DEBUG nova.compute.manager [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] [instance: c7776982-40ea-4b06-b853-cfd484efba73] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:41:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Found default for hw_cdrom_bus of ide {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:41:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Found default for hw_disk_bus of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:41:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Found default for hw_input_bus of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:41:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Found default for hw_pointer_model of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:41:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Found default for hw_video_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:41:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Found default for hw_vif_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:41:16 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:41:16 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:16 user nova-compute[70924]: DEBUG nova.compute.manager [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Instance event wait completed in 0 seconds for  {{(pid=70924) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 14:41:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Guest created on hypervisor {{(pid=70924) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 14:41:16 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:16 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:41:16 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Instance spawned successfully.
Jul 29 14:41:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 14:41:16 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:41:16 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690641676.2764525, 86ecc6cb-88a8-4572-8e41-d4c5859036a6 => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:41:16 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] VM Started (Lifecycle Event)
Jul 29 14:41:16 user nova-compute[70924]: INFO nova.compute.manager [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] [instance: c7776982-40ea-4b06-b853-cfd484efba73] Took 24.39 seconds to build instance.
Jul 29 14:41:16 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:41:16 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:41:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-cf8fb963-44b1-4943-a90b-52ff75623622 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Lock "c7776982-40ea-4b06-b853-cfd484efba73" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.586s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:41:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Found default for hw_cdrom_bus of ide {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:41:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Found default for hw_disk_bus of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:41:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Found default for hw_input_bus of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:41:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Found default for hw_pointer_model of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:41:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Found default for hw_video_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:41:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Found default for hw_vif_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:41:16 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:41:16 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690641676.457073, f5929dcf-8594-4323-a6f5-a322aff7c881 => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:41:16 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] VM Resumed (Lifecycle Event)
Jul 29 14:41:16 user nova-compute[70924]: INFO nova.compute.manager [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Took 14.06 seconds to spawn the instance on the hypervisor.
Jul 29 14:41:16 user nova-compute[70924]: DEBUG nova.compute.manager [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:41:17 user nova-compute[70924]: INFO nova.compute.manager [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Took 15.51 seconds to spawn the instance on the hypervisor.
Jul 29 14:41:17 user nova-compute[70924]: DEBUG nova.compute.manager [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:41:17 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:41:17 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:41:17 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:41:17 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690641676.4662275, f5929dcf-8594-4323-a6f5-a322aff7c881 => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:41:17 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] VM Started (Lifecycle Event)
Jul 29 14:41:17 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:41:17 user nova-compute[70924]: INFO nova.compute.manager [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Took 15.40 seconds to build instance.
Jul 29 14:41:17 user nova-compute[70924]: INFO nova.compute.manager [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Took 16.66 seconds to build instance.
Jul 29 14:41:17 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:41:17 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9a6b3c7b-7129-488d-af27-8064d9b65596 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "86ecc6cb-88a8-4572-8e41-d4c5859036a6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.564s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:41:17 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-6dfcc5c0-fd0c-4eed-b569-fb526b9ee260 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Lock "f5929dcf-8594-4323-a6f5-a322aff7c881" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.789s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:41:17 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:17 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:17 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:18 user nova-compute[70924]: DEBUG nova.compute.manager [req-3c1f65fd-304c-464e-b11c-769dda350c26 req-7d9e5528-9bca-47e6-bdeb-44066e5199e8 service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Received event network-vif-plugged-14b12f31-f886-4752-bac2-e4673c74ae85 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:41:18 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-3c1f65fd-304c-464e-b11c-769dda350c26 req-7d9e5528-9bca-47e6-bdeb-44066e5199e8 service nova] Acquiring lock "f5929dcf-8594-4323-a6f5-a322aff7c881-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:41:18 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-3c1f65fd-304c-464e-b11c-769dda350c26 req-7d9e5528-9bca-47e6-bdeb-44066e5199e8 service nova] Lock "f5929dcf-8594-4323-a6f5-a322aff7c881-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:41:18 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-3c1f65fd-304c-464e-b11c-769dda350c26 req-7d9e5528-9bca-47e6-bdeb-44066e5199e8 service nova] Lock "f5929dcf-8594-4323-a6f5-a322aff7c881-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:41:18 user nova-compute[70924]: DEBUG nova.compute.manager [req-3c1f65fd-304c-464e-b11c-769dda350c26 req-7d9e5528-9bca-47e6-bdeb-44066e5199e8 service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] No waiting events found dispatching network-vif-plugged-14b12f31-f886-4752-bac2-e4673c74ae85 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:41:18 user nova-compute[70924]: WARNING nova.compute.manager [req-3c1f65fd-304c-464e-b11c-769dda350c26 req-7d9e5528-9bca-47e6-bdeb-44066e5199e8 service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Received unexpected event network-vif-plugged-14b12f31-f886-4752-bac2-e4673c74ae85 for instance with vm_state active and task_state None.
Jul 29 14:41:19 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:19 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:19 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:19 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:20 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:20 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:20 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:20 user nova-compute[70924]: DEBUG nova.compute.manager [req-e1f87054-5720-4175-9aef-5d701e2bcc97 req-376ecd26-1cd2-46b3-ba04-e66732afccc0 service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Received event network-vif-plugged-14b12f31-f886-4752-bac2-e4673c74ae85 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:41:20 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-e1f87054-5720-4175-9aef-5d701e2bcc97 req-376ecd26-1cd2-46b3-ba04-e66732afccc0 service nova] Acquiring lock "f5929dcf-8594-4323-a6f5-a322aff7c881-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:41:20 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-e1f87054-5720-4175-9aef-5d701e2bcc97 req-376ecd26-1cd2-46b3-ba04-e66732afccc0 service nova] Lock "f5929dcf-8594-4323-a6f5-a322aff7c881-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:41:20 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-e1f87054-5720-4175-9aef-5d701e2bcc97 req-376ecd26-1cd2-46b3-ba04-e66732afccc0 service nova] Lock "f5929dcf-8594-4323-a6f5-a322aff7c881-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:41:20 user nova-compute[70924]: DEBUG nova.compute.manager [req-e1f87054-5720-4175-9aef-5d701e2bcc97 req-376ecd26-1cd2-46b3-ba04-e66732afccc0 service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] No waiting events found dispatching network-vif-plugged-14b12f31-f886-4752-bac2-e4673c74ae85 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:41:20 user nova-compute[70924]: WARNING nova.compute.manager [req-e1f87054-5720-4175-9aef-5d701e2bcc97 req-376ecd26-1cd2-46b3-ba04-e66732afccc0 service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Received unexpected event network-vif-plugged-14b12f31-f886-4752-bac2-e4673c74ae85 for instance with vm_state active and task_state None.
Jul 29 14:41:20 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:20 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Acquiring lock "1ea2e4b1-5b93-42bf-b29d-ce6986135826" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:41:20 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Lock "1ea2e4b1-5b93-42bf-b29d-ce6986135826" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:41:20 user nova-compute[70924]: DEBUG nova.compute.manager [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] Starting instance... {{(pid=70924) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 14:41:21 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:41:21 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:41:21 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70924) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 14:41:21 user nova-compute[70924]: INFO nova.compute.claims [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] Claim successful on node user
Jul 29 14:41:21 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:41:21 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:41:21 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.749s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:41:21 user nova-compute[70924]: DEBUG nova.compute.manager [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] Start building networks asynchronously for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 14:41:21 user nova-compute[70924]: DEBUG nova.compute.manager [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] Allocating IP information in the background. {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 14:41:21 user nova-compute[70924]: DEBUG nova.network.neutron [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] allocate_for_instance() {{(pid=70924) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 14:41:21 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Jul 29 14:41:22 user nova-compute[70924]: DEBUG nova.compute.manager [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] Start building block device mappings for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 14:41:22 user nova-compute[70924]: DEBUG nova.policy [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3f9dd5d978dc445aa46c28d04c034276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f391a9af7f7482fbab589b087bfd74e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70924) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 14:41:22 user nova-compute[70924]: DEBUG nova.compute.manager [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] Start spawning the instance on the hypervisor. {{(pid=70924) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 14:41:22 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] Creating instance directory {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 14:41:22 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] Creating image(s)
Jul 29 14:41:22 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Acquiring lock "/opt/stack/data/nova/instances/1ea2e4b1-5b93-42bf-b29d-ce6986135826/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:41:22 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Lock "/opt/stack/data/nova/instances/1ea2e4b1-5b93-42bf-b29d-ce6986135826/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:41:22 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Lock "/opt/stack/data/nova/instances/1ea2e4b1-5b93-42bf-b29d-ce6986135826/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:41:22 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Acquiring lock "b951c8f52057d68d8167817c7f7db7055dbe020a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:41:22 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Lock "b951c8f52057d68d8167817c7f7db7055dbe020a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:41:22 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b951c8f52057d68d8167817c7f7db7055dbe020a.part --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:41:23 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Acquiring lock "00231136-233f-4a1b-88ff-b678482ca5bb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:41:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Lock "00231136-233f-4a1b-88ff-b678482ca5bb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:41:23 user nova-compute[70924]: DEBUG nova.compute.manager [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Starting instance... {{(pid=70924) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 14:41:23 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b951c8f52057d68d8167817c7f7db7055dbe020a.part --force-share --output=json" returned: 0 in 0.251s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:41:23 user nova-compute[70924]: DEBUG nova.virt.images [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] b031d1be-dfee-4761-b566-7221e37458da was qcow2, converting to raw {{(pid=70924) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 29 14:41:23 user nova-compute[70924]: DEBUG nova.privsep.utils [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70924) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 29 14:41:23 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b951c8f52057d68d8167817c7f7db7055dbe020a.part /opt/stack/data/nova/instances/_base/b951c8f52057d68d8167817c7f7db7055dbe020a.converted {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:41:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:41:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:41:23 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70924) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 14:41:23 user nova-compute[70924]: INFO nova.compute.claims [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Claim successful on node user
Jul 29 14:41:23 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b951c8f52057d68d8167817c7f7db7055dbe020a.part /opt/stack/data/nova/instances/_base/b951c8f52057d68d8167817c7f7db7055dbe020a.converted" returned: 0 in 0.328s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:41:23 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b951c8f52057d68d8167817c7f7db7055dbe020a.converted --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:41:23 user nova-compute[70924]: DEBUG nova.network.neutron [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] Successfully created port: c96a0580-3813-482c-8bcc-c95fe4fc1ca6 {{(pid=70924) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 14:41:23 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b951c8f52057d68d8167817c7f7db7055dbe020a.converted --force-share --output=json" returned: 0 in 0.245s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:41:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Lock "b951c8f52057d68d8167817c7f7db7055dbe020a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.547s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:41:23 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b951c8f52057d68d8167817c7f7db7055dbe020a --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:41:24 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b951c8f52057d68d8167817c7f7db7055dbe020a --force-share --output=json" returned: 0 in 0.240s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:41:24 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Acquiring lock "b951c8f52057d68d8167817c7f7db7055dbe020a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:41:24 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Lock "b951c8f52057d68d8167817c7f7db7055dbe020a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:41:24 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b951c8f52057d68d8167817c7f7db7055dbe020a --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:41:24 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:41:24 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:41:24 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b951c8f52057d68d8167817c7f7db7055dbe020a --force-share --output=json" returned: 0 in 0.280s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:41:24 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b951c8f52057d68d8167817c7f7db7055dbe020a,backing_fmt=raw /opt/stack/data/nova/instances/1ea2e4b1-5b93-42bf-b29d-ce6986135826/disk 1073741824 {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:41:24 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.007s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:41:24 user nova-compute[70924]: DEBUG nova.compute.manager [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Start building networks asynchronously for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 14:41:24 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b951c8f52057d68d8167817c7f7db7055dbe020a,backing_fmt=raw /opt/stack/data/nova/instances/1ea2e4b1-5b93-42bf-b29d-ce6986135826/disk 1073741824" returned: 0 in 0.087s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:41:24 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Lock "b951c8f52057d68d8167817c7f7db7055dbe020a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.371s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:41:24 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b951c8f52057d68d8167817c7f7db7055dbe020a --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:41:24 user nova-compute[70924]: DEBUG nova.compute.manager [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Allocating IP information in the background. {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 14:41:24 user nova-compute[70924]: DEBUG nova.network.neutron [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] allocate_for_instance() {{(pid=70924) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 14:41:24 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 14:41:24 user nova-compute[70924]: DEBUG nova.compute.manager [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Start building block device mappings for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 14:41:24 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b951c8f52057d68d8167817c7f7db7055dbe020a --force-share --output=json" returned: 0 in 0.198s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:41:24 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1ea2e4b1-5b93-42bf-b29d-ce6986135826/disk. size=1073741824 {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 14:41:24 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ea2e4b1-5b93-42bf-b29d-ce6986135826/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:41:24 user nova-compute[70924]: DEBUG nova.compute.manager [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Start spawning the instance on the hypervisor. {{(pid=70924) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 14:41:24 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Creating instance directory {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 14:41:24 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Creating image(s)
Jul 29 14:41:24 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Acquiring lock "/opt/stack/data/nova/instances/00231136-233f-4a1b-88ff-b678482ca5bb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:41:24 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Lock "/opt/stack/data/nova/instances/00231136-233f-4a1b-88ff-b678482ca5bb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:41:24 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Lock "/opt/stack/data/nova/instances/00231136-233f-4a1b-88ff-b678482ca5bb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:41:24 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ea2e4b1-5b93-42bf-b29d-ce6986135826/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:41:24 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Cannot resize image /opt/stack/data/nova/instances/1ea2e4b1-5b93-42bf-b29d-ce6986135826/disk to a smaller size. {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 14:41:24 user nova-compute[70924]: DEBUG nova.objects.instance [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Lazy-loading 'migration_context' on Instance uuid 1ea2e4b1-5b93-42bf-b29d-ce6986135826 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:41:24 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:41:24 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:24 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] Created local disks {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 14:41:24 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] Ensure instance console log exists: /opt/stack/data/nova/instances/1ea2e4b1-5b93-42bf-b29d-ce6986135826/console.log {{(pid=70924) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 14:41:24 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:41:24 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:41:24 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.011s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:41:24 user nova-compute[70924]: DEBUG nova.policy [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e86112b87b2d47d88ac5fb9b6fccb31c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7e4c0801264e7794b962f8856e5734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70924) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 14:41:25 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.232s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:41:25 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Acquiring lock "bd72453517468710f1de26b27fb0ea28688e9009" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:41:25 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:41:25 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:41:25 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.242s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:41:25 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/00231136-233f-4a1b-88ff-b678482ca5bb/disk 1073741824 {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:41:25 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/00231136-233f-4a1b-88ff-b678482ca5bb/disk 1073741824" returned: 0 in 0.087s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:41:25 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.338s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:41:25 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:41:25 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.169s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:41:25 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Checking if we can resize image /opt/stack/data/nova/instances/00231136-233f-4a1b-88ff-b678482ca5bb/disk. size=1073741824 {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 14:41:25 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00231136-233f-4a1b-88ff-b678482ca5bb/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:41:25 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Acquiring lock "a9549556-e9a7-4782-ade4-9d397d5323d0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:41:25 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Lock "a9549556-e9a7-4782-ade4-9d397d5323d0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:41:25 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00231136-233f-4a1b-88ff-b678482ca5bb/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:41:25 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Cannot resize image /opt/stack/data/nova/instances/00231136-233f-4a1b-88ff-b678482ca5bb/disk to a smaller size. {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 14:41:25 user nova-compute[70924]: DEBUG nova.objects.instance [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Lazy-loading 'migration_context' on Instance uuid 00231136-233f-4a1b-88ff-b678482ca5bb {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:41:25 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Created local disks {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 14:41:25 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Ensure instance console log exists: /opt/stack/data/nova/instances/00231136-233f-4a1b-88ff-b678482ca5bb/console.log {{(pid=70924) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 14:41:25 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:41:25 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:41:25 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:41:25 user nova-compute[70924]: DEBUG nova.compute.manager [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Starting instance... {{(pid=70924) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 14:41:26 user nova-compute[70924]: DEBUG nova.network.neutron [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] Successfully updated port: c96a0580-3813-482c-8bcc-c95fe4fc1ca6 {{(pid=70924) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 14:41:26 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Acquiring lock "refresh_cache-1ea2e4b1-5b93-42bf-b29d-ce6986135826" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:41:26 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Acquired lock "refresh_cache-1ea2e4b1-5b93-42bf-b29d-ce6986135826" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:41:26 user nova-compute[70924]: DEBUG nova.network.neutron [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 14:41:26 user nova-compute[70924]: DEBUG nova.compute.manager [req-3ad56e00-864c-4a53-a2fa-5d83e1191c29 req-a933698d-5017-4094-bd00-574099c1ab15 service nova] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] Received event network-changed-c96a0580-3813-482c-8bcc-c95fe4fc1ca6 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:41:26 user nova-compute[70924]: DEBUG nova.compute.manager [req-3ad56e00-864c-4a53-a2fa-5d83e1191c29 req-a933698d-5017-4094-bd00-574099c1ab15 service nova] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] Refreshing instance network info cache due to event network-changed-c96a0580-3813-482c-8bcc-c95fe4fc1ca6. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:41:26 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-3ad56e00-864c-4a53-a2fa-5d83e1191c29 req-a933698d-5017-4094-bd00-574099c1ab15 service nova] Acquiring lock "refresh_cache-1ea2e4b1-5b93-42bf-b29d-ce6986135826" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:41:26 user nova-compute[70924]: DEBUG nova.network.neutron [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] Instance cache missing network info. {{(pid=70924) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 14:41:26 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:41:26 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:41:26 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70924) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 14:41:26 user nova-compute[70924]: INFO nova.compute.claims [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Claim successful on node user
Jul 29 14:41:26 user nova-compute[70924]: DEBUG nova.network.neutron [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Successfully created port: 6b392743-3314-4d79-babc-13089e99b60b {{(pid=70924) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 14:41:26 user nova-compute[70924]: DEBUG nova.network.neutron [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] Updating instance_info_cache with network_info: [{"id": "c96a0580-3813-482c-8bcc-c95fe4fc1ca6", "address": "fa:16:3e:0f:86:7c", "network": {"id": "788ee56c-1b66-448e-9e14-51435f77396a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-395768653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f391a9af7f7482fbab589b087bfd74e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc96a0580-38", "ovs_interfaceid": "c96a0580-3813-482c-8bcc-c95fe4fc1ca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:41:26 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Releasing lock "refresh_cache-1ea2e4b1-5b93-42bf-b29d-ce6986135826" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:41:26 user nova-compute[70924]: DEBUG nova.compute.manager [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] Instance network_info: |[{"id": "c96a0580-3813-482c-8bcc-c95fe4fc1ca6", "address": "fa:16:3e:0f:86:7c", "network": {"id": "788ee56c-1b66-448e-9e14-51435f77396a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-395768653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f391a9af7f7482fbab589b087bfd74e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc96a0580-38", "ovs_interfaceid": "c96a0580-3813-482c-8bcc-c95fe4fc1ca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 14:41:26 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-3ad56e00-864c-4a53-a2fa-5d83e1191c29 req-a933698d-5017-4094-bd00-574099c1ab15 service nova] Acquired lock "refresh_cache-1ea2e4b1-5b93-42bf-b29d-ce6986135826" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:41:26 user nova-compute[70924]: DEBUG nova.network.neutron [req-3ad56e00-864c-4a53-a2fa-5d83e1191c29 req-a933698d-5017-4094-bd00-574099c1ab15 service nova] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] Refreshing network info cache for port c96a0580-3813-482c-8bcc-c95fe4fc1ca6 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:41:26 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] Start _get_guest_xml network_info=[{"id": "c96a0580-3813-482c-8bcc-c95fe4fc1ca6", "address": "fa:16:3e:0f:86:7c", "network": {"id": "788ee56c-1b66-448e-9e14-51435f77396a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-395768653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f391a9af7f7482fbab589b087bfd74e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc96a0580-38", "ovs_interfaceid": "c96a0580-3813-482c-8bcc-c95fe4fc1ca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:41:10Z,direct_url=<?>,disk_format='qcow2',id=b031d1be-dfee-4761-b566-7221e37458da,min_disk=0,min_ram=0,name='',owner='1045044cfe60471fa4621b9be0b4d423',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:41:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'device_name': '/dev/sda', 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'disk_bus': 'scsi', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': 'b031d1be-dfee-4761-b566-7221e37458da'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 14:41:26 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:41:26 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:41:26 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:41:26 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:41:26 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 14:41:26 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] CPU controller missing on host. {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 14:41:26 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 14:41:26 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] CPU controller found on host. {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 14:41:26 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70924) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 14:41:26 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T14:36:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:41:10Z,direct_url=<?>,disk_format='qcow2',id=b031d1be-dfee-4761-b566-7221e37458da,min_disk=0,min_ram=0,name='',owner='1045044cfe60471fa4621b9be0b4d423',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:41:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 14:41:26 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Flavor limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 14:41:26 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Image limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 14:41:26 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Flavor pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 14:41:26 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Image pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 14:41:26 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 14:41:26 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 14:41:26 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 14:41:26 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Got 1 possible topologies {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 14:41:26 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 14:41:26 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 14:41:26 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T14:41:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1049952611',display_name='tempest-AttachSCSIVolumeTestJSON-server-1049952611',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1049952611',id=6,image_ref='b031d1be-dfee-4761-b566-7221e37458da',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDcl0RkSJ0sJ/Fjzofpz1UI8QJAURW4xJ099n5Wqwc601hKaHSTo/A4gli4CPtj+DJejkBXBRZf+LCGoS0ojggYIn3zIGVSv2Ewc/Q8gtnE+NT/P4bsKKi9oXjz3meQvsQ==',key_name='tempest-keypair-598537827',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f391a9af7f7482fbab589b087bfd74e',ramdisk_id='',reservation_id='r-pnw755yo',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b031d1be-dfee-4761-b566-7221e37458da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-2068208795',owner_user_name='tempest-AttachSCSIVolumeTestJSON-2068208795-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:41:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f9dd5d978dc445aa46c28d04c034276',uuid=1ea2e4b1-5b93-42bf-b29d-ce6986135826,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c96a0580-3813-482c-8bcc-c95fe4fc1ca6", "address": "fa:16:3e:0f:86:7c", "network": {"id": "788ee56c-1b66-448e-9e14-51435f77396a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-395768653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f391a9af7f7482fbab589b087bfd74e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc96a0580-38", "ovs_interfaceid": "c96a0580-3813-482c-8bcc-c95fe4fc1ca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:41:26 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Converting VIF {"id": "c96a0580-3813-482c-8bcc-c95fe4fc1ca6", "address": "fa:16:3e:0f:86:7c", "network": {"id": "788ee56c-1b66-448e-9e14-51435f77396a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-395768653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f391a9af7f7482fbab589b087bfd74e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc96a0580-38", "ovs_interfaceid": "c96a0580-3813-482c-8bcc-c95fe4fc1ca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:41:26 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:86:7c,bridge_name='br-int',has_traffic_filtering=True,id=c96a0580-3813-482c-8bcc-c95fe4fc1ca6,network=Network(788ee56c-1b66-448e-9e14-51435f77396a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc96a0580-38') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:41:26 user nova-compute[70924]: DEBUG nova.objects.instance [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Lazy-loading 'pci_devices' on Instance uuid 1ea2e4b1-5b93-42bf-b29d-ce6986135826 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:41:26 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.677s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:41:26 user nova-compute[70924]: DEBUG nova.compute.manager [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Start building networks asynchronously for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 14:41:27 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] End _get_guest_xml xml=<domain type="kvm">
Jul 29 14:41:27 user nova-compute[70924]:   <uuid>1ea2e4b1-5b93-42bf-b29d-ce6986135826</uuid>
Jul 29 14:41:27 user nova-compute[70924]:   <name>instance-00000006</name>
Jul 29 14:41:27 user nova-compute[70924]:   <memory>524288</memory>
Jul 29 14:41:27 user nova-compute[70924]:   <vcpu>1</vcpu>
Jul 29 14:41:27 user nova-compute[70924]:   <metadata>
Jul 29 14:41:27 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 14:41:27 user nova-compute[70924]:       <nova:package version="0.0.0"/>
Jul 29 14:41:27 user nova-compute[70924]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1049952611</nova:name>
Jul 29 14:41:27 user nova-compute[70924]:       <nova:creationTime>2023-07-29 14:41:26</nova:creationTime>
Jul 29 14:41:27 user nova-compute[70924]:       <nova:flavor name="m1.tiny">
Jul 29 14:41:27 user nova-compute[70924]:         <nova:memory>512</nova:memory>
Jul 29 14:41:27 user nova-compute[70924]:         <nova:disk>1</nova:disk>
Jul 29 14:41:27 user nova-compute[70924]:         <nova:swap>0</nova:swap>
Jul 29 14:41:27 user nova-compute[70924]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 14:41:27 user nova-compute[70924]:         <nova:vcpus>1</nova:vcpus>
Jul 29 14:41:27 user nova-compute[70924]:       </nova:flavor>
Jul 29 14:41:27 user nova-compute[70924]:       <nova:owner>
Jul 29 14:41:27 user nova-compute[70924]:         <nova:user uuid="3f9dd5d978dc445aa46c28d04c034276">tempest-AttachSCSIVolumeTestJSON-2068208795-project-member</nova:user>
Jul 29 14:41:27 user nova-compute[70924]:         <nova:project uuid="0f391a9af7f7482fbab589b087bfd74e">tempest-AttachSCSIVolumeTestJSON-2068208795</nova:project>
Jul 29 14:41:27 user nova-compute[70924]:       </nova:owner>
Jul 29 14:41:27 user nova-compute[70924]:       <nova:root type="image" uuid="b031d1be-dfee-4761-b566-7221e37458da"/>
Jul 29 14:41:27 user nova-compute[70924]:       <nova:ports>
Jul 29 14:41:27 user nova-compute[70924]:         <nova:port uuid="c96a0580-3813-482c-8bcc-c95fe4fc1ca6">
Jul 29 14:41:27 user nova-compute[70924]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 29 14:41:27 user nova-compute[70924]:         </nova:port>
Jul 29 14:41:27 user nova-compute[70924]:       </nova:ports>
Jul 29 14:41:27 user nova-compute[70924]:     </nova:instance>
Jul 29 14:41:27 user nova-compute[70924]:   </metadata>
Jul 29 14:41:27 user nova-compute[70924]:   <sysinfo type="smbios">
Jul 29 14:41:27 user nova-compute[70924]:     <system>
Jul 29 14:41:27 user nova-compute[70924]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 14:41:27 user nova-compute[70924]:       <entry name="product">OpenStack Nova</entry>
Jul 29 14:41:27 user nova-compute[70924]:       <entry name="version">0.0.0</entry>
Jul 29 14:41:27 user nova-compute[70924]:       <entry name="serial">1ea2e4b1-5b93-42bf-b29d-ce6986135826</entry>
Jul 29 14:41:27 user nova-compute[70924]:       <entry name="uuid">1ea2e4b1-5b93-42bf-b29d-ce6986135826</entry>
Jul 29 14:41:27 user nova-compute[70924]:       <entry name="family">Virtual Machine</entry>
Jul 29 14:41:27 user nova-compute[70924]:     </system>
Jul 29 14:41:27 user nova-compute[70924]:   </sysinfo>
Jul 29 14:41:27 user nova-compute[70924]:   <os>
Jul 29 14:41:27 user nova-compute[70924]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 14:41:27 user nova-compute[70924]:     <boot dev="hd"/>
Jul 29 14:41:27 user nova-compute[70924]:     <smbios mode="sysinfo"/>
Jul 29 14:41:27 user nova-compute[70924]:   </os>
Jul 29 14:41:27 user nova-compute[70924]:   <features>
Jul 29 14:41:27 user nova-compute[70924]:     <acpi/>
Jul 29 14:41:27 user nova-compute[70924]:     <apic/>
Jul 29 14:41:27 user nova-compute[70924]:     <vmcoreinfo/>
Jul 29 14:41:27 user nova-compute[70924]:   </features>
Jul 29 14:41:27 user nova-compute[70924]:   <clock offset="utc">
Jul 29 14:41:27 user nova-compute[70924]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 14:41:27 user nova-compute[70924]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 14:41:27 user nova-compute[70924]:     <timer name="hpet" present="no"/>
Jul 29 14:41:27 user nova-compute[70924]:   </clock>
Jul 29 14:41:27 user nova-compute[70924]:   <cpu mode="custom" match="exact">
Jul 29 14:41:27 user nova-compute[70924]:     <model>Nehalem</model>
Jul 29 14:41:27 user nova-compute[70924]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 14:41:27 user nova-compute[70924]:   </cpu>
Jul 29 14:41:27 user nova-compute[70924]:   <devices>
Jul 29 14:41:27 user nova-compute[70924]:     <disk type="file" device="disk">
Jul 29 14:41:27 user nova-compute[70924]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 14:41:27 user nova-compute[70924]:       <source file="/opt/stack/data/nova/instances/1ea2e4b1-5b93-42bf-b29d-ce6986135826/disk"/>
Jul 29 14:41:27 user nova-compute[70924]:       <target dev="sda" bus="scsi"/>
Jul 29 14:41:27 user nova-compute[70924]:       <address type="drive" controller="0" unit="0"/>
Jul 29 14:41:27 user nova-compute[70924]:     </disk>
Jul 29 14:41:27 user nova-compute[70924]:     <disk type="file" device="cdrom">
Jul 29 14:41:27 user nova-compute[70924]:       <driver name="qemu" type="raw" cache="none"/>
Jul 29 14:41:27 user nova-compute[70924]:       <source file="/opt/stack/data/nova/instances/1ea2e4b1-5b93-42bf-b29d-ce6986135826/disk.config"/>
Jul 29 14:41:27 user nova-compute[70924]:       <target dev="sdb" bus="scsi"/>
Jul 29 14:41:27 user nova-compute[70924]:       <address type="drive" controller="0" unit="1"/>
Jul 29 14:41:27 user nova-compute[70924]:     </disk>
Jul 29 14:41:27 user nova-compute[70924]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Jul 29 14:41:27 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 14:41:27 user nova-compute[70924]:       <mac address="fa:16:3e:0f:86:7c"/>
Jul 29 14:41:27 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:41:27 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 14:41:27 user nova-compute[70924]:       <target dev="tapc96a0580-38"/>
Jul 29 14:41:27 user nova-compute[70924]:     </interface>
Jul 29 14:41:27 user nova-compute[70924]:     <serial type="pty">
Jul 29 14:41:27 user nova-compute[70924]:       <log file="/opt/stack/data/nova/instances/1ea2e4b1-5b93-42bf-b29d-ce6986135826/console.log" append="off"/>
Jul 29 14:41:27 user nova-compute[70924]:     </serial>
Jul 29 14:41:27 user nova-compute[70924]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 14:41:27 user nova-compute[70924]:     <video>
Jul 29 14:41:27 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:41:27 user nova-compute[70924]:     </video>
Jul 29 14:41:27 user nova-compute[70924]:     <rng model="virtio">
Jul 29 14:41:27 user nova-compute[70924]:       <backend model="random">/dev/urandom</backend>
Jul 29 14:41:27 user nova-compute[70924]:     </rng>
Jul 29 14:41:27 user nova-compute[70924]:     <controller type="usb" index="0" model="none"/>
Jul 29 14:41:27 user nova-compute[70924]:     <memballoon model="virtio">
Jul 29 14:41:27 user nova-compute[70924]:       <stats period="10"/>
Jul 29 14:41:27 user nova-compute[70924]:     </memballoon>
Jul 29 14:41:27 user nova-compute[70924]:   </devices>
Jul 29 14:41:27 user nova-compute[70924]: </domain>
Jul 29 14:41:27 user nova-compute[70924]:  {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 14:41:27 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T14:41:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1049952611',display_name='tempest-AttachSCSIVolumeTestJSON-server-1049952611',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1049952611',id=6,image_ref='b031d1be-dfee-4761-b566-7221e37458da',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDcl0RkSJ0sJ/Fjzofpz1UI8QJAURW4xJ099n5Wqwc601hKaHSTo/A4gli4CPtj+DJejkBXBRZf+LCGoS0ojggYIn3zIGVSv2Ewc/Q8gtnE+NT/P4bsKKi9oXjz3meQvsQ==',key_name='tempest-keypair-598537827',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f391a9af7f7482fbab589b087bfd74e',ramdisk_id='',reservation_id='r-pnw755yo',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b031d1be-dfee-4761-b566-7221e37458da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-2068208795',owner_user_name='tempest-AttachSCSIVolumeTestJSON-2068208795-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:41:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f9dd5d978dc445aa46c28d04c034276',uuid=1ea2e4b1-5b93-42bf-b29d-ce6986135826,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c96a0580-3813-482c-8bcc-c95fe4fc1ca6", "address": "fa:16:3e:0f:86:7c", "network": {"id": "788ee56c-1b66-448e-9e14-51435f77396a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-395768653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f391a9af7f7482fbab589b087bfd74e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc96a0580-38", "ovs_interfaceid": "c96a0580-3813-482c-8bcc-c95fe4fc1ca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 14:41:27 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Converting VIF {"id": "c96a0580-3813-482c-8bcc-c95fe4fc1ca6", "address": "fa:16:3e:0f:86:7c", "network": {"id": "788ee56c-1b66-448e-9e14-51435f77396a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-395768653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f391a9af7f7482fbab589b087bfd74e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc96a0580-38", "ovs_interfaceid": "c96a0580-3813-482c-8bcc-c95fe4fc1ca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:41:27 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:86:7c,bridge_name='br-int',has_traffic_filtering=True,id=c96a0580-3813-482c-8bcc-c95fe4fc1ca6,network=Network(788ee56c-1b66-448e-9e14-51435f77396a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc96a0580-38') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:41:27 user nova-compute[70924]: DEBUG os_vif [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:86:7c,bridge_name='br-int',has_traffic_filtering=True,id=c96a0580-3813-482c-8bcc-c95fe4fc1ca6,network=Network(788ee56c-1b66-448e-9e14-51435f77396a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc96a0580-38') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 14:41:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:41:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 14:41:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc96a0580-38, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:41:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc96a0580-38, col_values=(('external_ids', {'iface-id': 'c96a0580-3813-482c-8bcc-c95fe4fc1ca6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:86:7c', 'vm-uuid': '1ea2e4b1-5b93-42bf-b29d-ce6986135826'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:41:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:41:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:27 user nova-compute[70924]: INFO os_vif [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:86:7c,bridge_name='br-int',has_traffic_filtering=True,id=c96a0580-3813-482c-8bcc-c95fe4fc1ca6,network=Network(788ee56c-1b66-448e-9e14-51435f77396a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc96a0580-38')
Jul 29 14:41:27 user nova-compute[70924]: DEBUG nova.compute.manager [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Allocating IP information in the background. {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 14:41:27 user nova-compute[70924]: DEBUG nova.network.neutron [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] allocate_for_instance() {{(pid=70924) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 14:41:27 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] No BDM found with device name sda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:41:27 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] No BDM found with device name sdb, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:41:27 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] No VIF found with MAC fa:16:3e:0f:86:7c, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:41:27 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] Using config drive
Jul 29 14:41:27 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 14:41:27 user nova-compute[70924]: DEBUG nova.compute.manager [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Start building block device mappings for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 14:41:27 user nova-compute[70924]: DEBUG nova.policy [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5a5e9a9bfa864d5f85a3a79499019d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5512f71fe048c5936b9154c0e3126b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70924) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 14:41:27 user nova-compute[70924]: DEBUG nova.compute.manager [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Start spawning the instance on the hypervisor. {{(pid=70924) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 14:41:27 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Creating instance directory {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 14:41:27 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Creating image(s)
Jul 29 14:41:27 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Acquiring lock "/opt/stack/data/nova/instances/a9549556-e9a7-4782-ade4-9d397d5323d0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:41:27 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Lock "/opt/stack/data/nova/instances/a9549556-e9a7-4782-ade4-9d397d5323d0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:41:27 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Lock "/opt/stack/data/nova/instances/a9549556-e9a7-4782-ade4-9d397d5323d0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:41:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:41:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.217s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:41:27 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Acquiring lock "bd72453517468710f1de26b27fb0ea28688e9009" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:41:27 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:41:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:41:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.186s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:41:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/a9549556-e9a7-4782-ade4-9d397d5323d0/disk 1073741824 {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:41:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/a9549556-e9a7-4782-ade4-9d397d5323d0/disk 1073741824" returned: 0 in 0.065s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:41:27 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:41:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:41:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.194s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:41:28 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a9549556-e9a7-4782-ade4-9d397d5323d0/disk. size=1073741824 {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 14:41:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9549556-e9a7-4782-ade4-9d397d5323d0/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:41:28 user nova-compute[70924]: DEBUG nova.network.neutron [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Successfully created port: 4350e95a-3892-4c83-a407-aa696585eac6 {{(pid=70924) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 14:41:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9549556-e9a7-4782-ade4-9d397d5323d0/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:41:28 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Cannot resize image /opt/stack/data/nova/instances/a9549556-e9a7-4782-ade4-9d397d5323d0/disk to a smaller size. {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 14:41:28 user nova-compute[70924]: DEBUG nova.objects.instance [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Lazy-loading 'migration_context' on Instance uuid a9549556-e9a7-4782-ade4-9d397d5323d0 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:41:28 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Created local disks {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 14:41:28 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Ensure instance console log exists: /opt/stack/data/nova/instances/a9549556-e9a7-4782-ade4-9d397d5323d0/console.log {{(pid=70924) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 14:41:28 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:41:28 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:41:28 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:41:28 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] Creating config drive at /opt/stack/data/nova/instances/1ea2e4b1-5b93-42bf-b29d-ce6986135826/disk.config
Jul 29 14:41:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1ea2e4b1-5b93-42bf-b29d-ce6986135826/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmplz5mhmsk {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:41:28 user nova-compute[70924]: DEBUG nova.network.neutron [req-3ad56e00-864c-4a53-a2fa-5d83e1191c29 req-a933698d-5017-4094-bd00-574099c1ab15 service nova] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] Updated VIF entry in instance network info cache for port c96a0580-3813-482c-8bcc-c95fe4fc1ca6. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:41:28 user nova-compute[70924]: DEBUG nova.network.neutron [req-3ad56e00-864c-4a53-a2fa-5d83e1191c29 req-a933698d-5017-4094-bd00-574099c1ab15 service nova] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] Updating instance_info_cache with network_info: [{"id": "c96a0580-3813-482c-8bcc-c95fe4fc1ca6", "address": "fa:16:3e:0f:86:7c", "network": {"id": "788ee56c-1b66-448e-9e14-51435f77396a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-395768653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f391a9af7f7482fbab589b087bfd74e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc96a0580-38", "ovs_interfaceid": "c96a0580-3813-482c-8bcc-c95fe4fc1ca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:41:28 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-3ad56e00-864c-4a53-a2fa-5d83e1191c29 req-a933698d-5017-4094-bd00-574099c1ab15 service nova] Releasing lock "refresh_cache-1ea2e4b1-5b93-42bf-b29d-ce6986135826" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:41:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1ea2e4b1-5b93-42bf-b29d-ce6986135826/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmplz5mhmsk" returned: 0 in 0.081s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:41:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:29 user nova-compute[70924]: DEBUG nova.network.neutron [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Successfully updated port: 4350e95a-3892-4c83-a407-aa696585eac6 {{(pid=70924) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 14:41:29 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Acquiring lock "refresh_cache-a9549556-e9a7-4782-ade4-9d397d5323d0" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:41:29 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Acquired lock "refresh_cache-a9549556-e9a7-4782-ade4-9d397d5323d0" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:41:29 user nova-compute[70924]: DEBUG nova.network.neutron [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 14:41:29 user nova-compute[70924]: DEBUG nova.compute.manager [req-d86409f1-5d5a-470b-be60-dec51c30b430 req-574310c3-c806-4a05-8eaf-1c91587f042d service nova] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Received event network-changed-4350e95a-3892-4c83-a407-aa696585eac6 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:41:29 user nova-compute[70924]: DEBUG nova.compute.manager [req-d86409f1-5d5a-470b-be60-dec51c30b430 req-574310c3-c806-4a05-8eaf-1c91587f042d service nova] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Refreshing instance network info cache due to event network-changed-4350e95a-3892-4c83-a407-aa696585eac6. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:41:29 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-d86409f1-5d5a-470b-be60-dec51c30b430 req-574310c3-c806-4a05-8eaf-1c91587f042d service nova] Acquiring lock "refresh_cache-a9549556-e9a7-4782-ade4-9d397d5323d0" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:41:29 user nova-compute[70924]: DEBUG nova.network.neutron [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Instance cache missing network info. {{(pid=70924) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 14:41:29 user nova-compute[70924]: DEBUG nova.network.neutron [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Successfully updated port: 6b392743-3314-4d79-babc-13089e99b60b {{(pid=70924) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 14:41:29 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Acquiring lock "refresh_cache-00231136-233f-4a1b-88ff-b678482ca5bb" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:41:29 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Acquired lock "refresh_cache-00231136-233f-4a1b-88ff-b678482ca5bb" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:41:29 user nova-compute[70924]: DEBUG nova.network.neutron [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 14:41:29 user nova-compute[70924]: DEBUG nova.compute.manager [req-cb37b2aa-c940-4504-bca0-7527b63bd959 req-780e44d3-1953-48fb-ab32-23163e259871 service nova] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Received event network-changed-6b392743-3314-4d79-babc-13089e99b60b {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:41:29 user nova-compute[70924]: DEBUG nova.compute.manager [req-cb37b2aa-c940-4504-bca0-7527b63bd959 req-780e44d3-1953-48fb-ab32-23163e259871 service nova] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Refreshing instance network info cache due to event network-changed-6b392743-3314-4d79-babc-13089e99b60b. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:41:29 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-cb37b2aa-c940-4504-bca0-7527b63bd959 req-780e44d3-1953-48fb-ab32-23163e259871 service nova] Acquiring lock "refresh_cache-00231136-233f-4a1b-88ff-b678482ca5bb" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:41:29 user nova-compute[70924]: DEBUG nova.network.neutron [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Instance cache missing network info. {{(pid=70924) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG nova.network.neutron [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Updating instance_info_cache with network_info: [{"id": "4350e95a-3892-4c83-a407-aa696585eac6", "address": "fa:16:3e:5d:b8:2a", "network": {"id": "4ca69734-4a00-4e6b-bbad-8bc03edba586", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1313665133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f5512f71fe048c5936b9154c0e3126b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4350e95a-38", "ovs_interfaceid": "4350e95a-3892-4c83-a407-aa696585eac6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Releasing lock "refresh_cache-a9549556-e9a7-4782-ade4-9d397d5323d0" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG nova.compute.manager [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Instance network_info: |[{"id": "4350e95a-3892-4c83-a407-aa696585eac6", "address": "fa:16:3e:5d:b8:2a", "network": {"id": "4ca69734-4a00-4e6b-bbad-8bc03edba586", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1313665133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f5512f71fe048c5936b9154c0e3126b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4350e95a-38", "ovs_interfaceid": "4350e95a-3892-4c83-a407-aa696585eac6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-d86409f1-5d5a-470b-be60-dec51c30b430 req-574310c3-c806-4a05-8eaf-1c91587f042d service nova] Acquired lock "refresh_cache-a9549556-e9a7-4782-ade4-9d397d5323d0" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG nova.network.neutron [req-d86409f1-5d5a-470b-be60-dec51c30b430 req-574310c3-c806-4a05-8eaf-1c91587f042d service nova] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Refreshing network info cache for port 4350e95a-3892-4c83-a407-aa696585eac6 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Start _get_guest_xml network_info=[{"id": "4350e95a-3892-4c83-a407-aa696585eac6", "address": "fa:16:3e:5d:b8:2a", "network": {"id": "4ca69734-4a00-4e6b-bbad-8bc03edba586", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1313665133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f5512f71fe048c5936b9154c0e3126b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4350e95a-38", "ovs_interfaceid": "4350e95a-3892-4c83-a407-aa696585eac6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '3aba2e73-6832-404b-8bd0-d0503ce82b8c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 14:41:30 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:41:30 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:41:30 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] CPU controller missing on host. {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] CPU controller found on host. {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70924) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T14:36:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Flavor limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Image limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Flavor pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Image pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Got 1 possible topologies {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T14:41:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-850043246',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-850043246',id=8,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFowQgMXsn6ojeJst6U4SII3CK7C8iaLrF5WpK72LhkyBx1DR2/8ARcNjiYRGN2W6nR3e0I7GRFV8EHB/gQZBqjcYpW+ZSwmA+QfOaNLnctkqx//pbvW+SsaaXulcoKRlQ==',key_name='tempest-keypair-1737564447',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3f5512f71fe048c5936b9154c0e3126b',ramdisk_id='',reservation_id='r-2gg4afvj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-209058297',owner_user_name='tempest-TaggedAttachmentsTest-209058297-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:41:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a5e9a9bfa864d5f85a3a79499019d9b',uuid=a9549556-e9a7-4782-ade4-9d397d5323d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4350e95a-3892-4c83-a407-aa696585eac6", "address": "fa:16:3e:5d:b8:2a", "network": {"id": "4ca69734-4a00-4e6b-bbad-8bc03edba586", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1313665133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f5512f71fe048c5936b9154c0e3126b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4350e95a-38", "ovs_interfaceid": "4350e95a-3892-4c83-a407-aa696585eac6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Converting VIF {"id": "4350e95a-3892-4c83-a407-aa696585eac6", "address": "fa:16:3e:5d:b8:2a", "network": {"id": "4ca69734-4a00-4e6b-bbad-8bc03edba586", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1313665133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f5512f71fe048c5936b9154c0e3126b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4350e95a-38", "ovs_interfaceid": "4350e95a-3892-4c83-a407-aa696585eac6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:b8:2a,bridge_name='br-int',has_traffic_filtering=True,id=4350e95a-3892-4c83-a407-aa696585eac6,network=Network(4ca69734-4a00-4e6b-bbad-8bc03edba586),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4350e95a-38') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG nova.objects.instance [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Lazy-loading 'pci_devices' on Instance uuid a9549556-e9a7-4782-ade4-9d397d5323d0 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG nova.network.neutron [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Updating instance_info_cache with network_info: [{"id": "6b392743-3314-4d79-babc-13089e99b60b", "address": "fa:16:3e:fd:b3:38", "network": {"id": "40edab25-ab3a-4874-b47f-1ffa2b5452ee", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1511348766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c7e4c0801264e7794b962f8856e5734", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b392743-33", "ovs_interfaceid": "6b392743-3314-4d79-babc-13089e99b60b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] End _get_guest_xml xml=<domain type="kvm">
Jul 29 14:41:30 user nova-compute[70924]:   <uuid>a9549556-e9a7-4782-ade4-9d397d5323d0</uuid>
Jul 29 14:41:30 user nova-compute[70924]:   <name>instance-00000008</name>
Jul 29 14:41:30 user nova-compute[70924]:   <memory>524288</memory>
Jul 29 14:41:30 user nova-compute[70924]:   <vcpu>1</vcpu>
Jul 29 14:41:30 user nova-compute[70924]:   <metadata>
Jul 29 14:41:30 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 14:41:30 user nova-compute[70924]:       <nova:package version="0.0.0"/>
Jul 29 14:41:30 user nova-compute[70924]:       <nova:name>tempest-device-tagging-server-850043246</nova:name>
Jul 29 14:41:30 user nova-compute[70924]:       <nova:creationTime>2023-07-29 14:41:30</nova:creationTime>
Jul 29 14:41:30 user nova-compute[70924]:       <nova:flavor name="m1.tiny">
Jul 29 14:41:30 user nova-compute[70924]:         <nova:memory>512</nova:memory>
Jul 29 14:41:30 user nova-compute[70924]:         <nova:disk>1</nova:disk>
Jul 29 14:41:30 user nova-compute[70924]:         <nova:swap>0</nova:swap>
Jul 29 14:41:30 user nova-compute[70924]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 14:41:30 user nova-compute[70924]:         <nova:vcpus>1</nova:vcpus>
Jul 29 14:41:30 user nova-compute[70924]:       </nova:flavor>
Jul 29 14:41:30 user nova-compute[70924]:       <nova:owner>
Jul 29 14:41:30 user nova-compute[70924]:         <nova:user uuid="5a5e9a9bfa864d5f85a3a79499019d9b">tempest-TaggedAttachmentsTest-209058297-project-member</nova:user>
Jul 29 14:41:30 user nova-compute[70924]:         <nova:project uuid="3f5512f71fe048c5936b9154c0e3126b">tempest-TaggedAttachmentsTest-209058297</nova:project>
Jul 29 14:41:30 user nova-compute[70924]:       </nova:owner>
Jul 29 14:41:30 user nova-compute[70924]:       <nova:root type="image" uuid="3aba2e73-6832-404b-8bd0-d0503ce82b8c"/>
Jul 29 14:41:30 user nova-compute[70924]:       <nova:ports>
Jul 29 14:41:30 user nova-compute[70924]:         <nova:port uuid="4350e95a-3892-4c83-a407-aa696585eac6">
Jul 29 14:41:30 user nova-compute[70924]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 29 14:41:30 user nova-compute[70924]:         </nova:port>
Jul 29 14:41:30 user nova-compute[70924]:       </nova:ports>
Jul 29 14:41:30 user nova-compute[70924]:     </nova:instance>
Jul 29 14:41:30 user nova-compute[70924]:   </metadata>
Jul 29 14:41:30 user nova-compute[70924]:   <sysinfo type="smbios">
Jul 29 14:41:30 user nova-compute[70924]:     <system>
Jul 29 14:41:30 user nova-compute[70924]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 14:41:30 user nova-compute[70924]:       <entry name="product">OpenStack Nova</entry>
Jul 29 14:41:30 user nova-compute[70924]:       <entry name="version">0.0.0</entry>
Jul 29 14:41:30 user nova-compute[70924]:       <entry name="serial">a9549556-e9a7-4782-ade4-9d397d5323d0</entry>
Jul 29 14:41:30 user nova-compute[70924]:       <entry name="uuid">a9549556-e9a7-4782-ade4-9d397d5323d0</entry>
Jul 29 14:41:30 user nova-compute[70924]:       <entry name="family">Virtual Machine</entry>
Jul 29 14:41:30 user nova-compute[70924]:     </system>
Jul 29 14:41:30 user nova-compute[70924]:   </sysinfo>
Jul 29 14:41:30 user nova-compute[70924]:   <os>
Jul 29 14:41:30 user nova-compute[70924]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 14:41:30 user nova-compute[70924]:     <boot dev="hd"/>
Jul 29 14:41:30 user nova-compute[70924]:     <smbios mode="sysinfo"/>
Jul 29 14:41:30 user nova-compute[70924]:   </os>
Jul 29 14:41:30 user nova-compute[70924]:   <features>
Jul 29 14:41:30 user nova-compute[70924]:     <acpi/>
Jul 29 14:41:30 user nova-compute[70924]:     <apic/>
Jul 29 14:41:30 user nova-compute[70924]:     <vmcoreinfo/>
Jul 29 14:41:30 user nova-compute[70924]:   </features>
Jul 29 14:41:30 user nova-compute[70924]:   <clock offset="utc">
Jul 29 14:41:30 user nova-compute[70924]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 14:41:30 user nova-compute[70924]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 14:41:30 user nova-compute[70924]:     <timer name="hpet" present="no"/>
Jul 29 14:41:30 user nova-compute[70924]:   </clock>
Jul 29 14:41:30 user nova-compute[70924]:   <cpu mode="custom" match="exact">
Jul 29 14:41:30 user nova-compute[70924]:     <model>Nehalem</model>
Jul 29 14:41:30 user nova-compute[70924]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 14:41:30 user nova-compute[70924]:   </cpu>
Jul 29 14:41:30 user nova-compute[70924]:   <devices>
Jul 29 14:41:30 user nova-compute[70924]:     <disk type="file" device="disk">
Jul 29 14:41:30 user nova-compute[70924]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 14:41:30 user nova-compute[70924]:       <source file="/opt/stack/data/nova/instances/a9549556-e9a7-4782-ade4-9d397d5323d0/disk"/>
Jul 29 14:41:30 user nova-compute[70924]:       <target dev="vda" bus="virtio"/>
Jul 29 14:41:30 user nova-compute[70924]:     </disk>
Jul 29 14:41:30 user nova-compute[70924]:     <disk type="file" device="cdrom">
Jul 29 14:41:30 user nova-compute[70924]:       <driver name="qemu" type="raw" cache="none"/>
Jul 29 14:41:30 user nova-compute[70924]:       <source file="/opt/stack/data/nova/instances/a9549556-e9a7-4782-ade4-9d397d5323d0/disk.config"/>
Jul 29 14:41:30 user nova-compute[70924]:       <target dev="hda" bus="ide"/>
Jul 29 14:41:30 user nova-compute[70924]:     </disk>
Jul 29 14:41:30 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 14:41:30 user nova-compute[70924]:       <mac address="fa:16:3e:5d:b8:2a"/>
Jul 29 14:41:30 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:41:30 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 14:41:30 user nova-compute[70924]:       <target dev="tap4350e95a-38"/>
Jul 29 14:41:30 user nova-compute[70924]:     </interface>
Jul 29 14:41:30 user nova-compute[70924]:     <serial type="pty">
Jul 29 14:41:30 user nova-compute[70924]:       <log file="/opt/stack/data/nova/instances/a9549556-e9a7-4782-ade4-9d397d5323d0/console.log" append="off"/>
Jul 29 14:41:30 user nova-compute[70924]:     </serial>
Jul 29 14:41:30 user nova-compute[70924]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 14:41:30 user nova-compute[70924]:     <video>
Jul 29 14:41:30 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:41:30 user nova-compute[70924]:     </video>
Jul 29 14:41:30 user nova-compute[70924]:     <rng model="virtio">
Jul 29 14:41:30 user nova-compute[70924]:       <backend model="random">/dev/urandom</backend>
Jul 29 14:41:30 user nova-compute[70924]:     </rng>
Jul 29 14:41:30 user nova-compute[70924]:     <controller type="usb" index="0" model="none"/>
Jul 29 14:41:30 user nova-compute[70924]:     <memballoon model="virtio">
Jul 29 14:41:30 user nova-compute[70924]:       <stats period="10"/>
Jul 29 14:41:30 user nova-compute[70924]:     </memballoon>
Jul 29 14:41:30 user nova-compute[70924]:   </devices>
Jul 29 14:41:30 user nova-compute[70924]: </domain>
Jul 29 14:41:30 user nova-compute[70924]:  {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T14:41:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-850043246',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-850043246',id=8,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFowQgMXsn6ojeJst6U4SII3CK7C8iaLrF5WpK72LhkyBx1DR2/8ARcNjiYRGN2W6nR3e0I7GRFV8EHB/gQZBqjcYpW+ZSwmA+QfOaNLnctkqx//pbvW+SsaaXulcoKRlQ==',key_name='tempest-keypair-1737564447',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3f5512f71fe048c5936b9154c0e3126b',ramdisk_id='',reservation_id='r-2gg4afvj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-209058297',owner_user_name='tempest-TaggedAttachmentsTest-209058297-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:41:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a5e9a9bfa864d5f85a3a79499019d9b',uuid=a9549556-e9a7-4782-ade4-9d397d5323d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4350e95a-3892-4c83-a407-aa696585eac6", "address": "fa:16:3e:5d:b8:2a", "network": {"id": "4ca69734-4a00-4e6b-bbad-8bc03edba586", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1313665133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f5512f71fe048c5936b9154c0e3126b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4350e95a-38", "ovs_interfaceid": "4350e95a-3892-4c83-a407-aa696585eac6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Converting VIF {"id": "4350e95a-3892-4c83-a407-aa696585eac6", "address": "fa:16:3e:5d:b8:2a", "network": {"id": "4ca69734-4a00-4e6b-bbad-8bc03edba586", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1313665133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f5512f71fe048c5936b9154c0e3126b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4350e95a-38", "ovs_interfaceid": "4350e95a-3892-4c83-a407-aa696585eac6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:b8:2a,bridge_name='br-int',has_traffic_filtering=True,id=4350e95a-3892-4c83-a407-aa696585eac6,network=Network(4ca69734-4a00-4e6b-bbad-8bc03edba586),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4350e95a-38') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG os_vif [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:b8:2a,bridge_name='br-int',has_traffic_filtering=True,id=4350e95a-3892-4c83-a407-aa696585eac6,network=Network(4ca69734-4a00-4e6b-bbad-8bc03edba586),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4350e95a-38') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Releasing lock "refresh_cache-00231136-233f-4a1b-88ff-b678482ca5bb" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG nova.compute.manager [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Instance network_info: |[{"id": "6b392743-3314-4d79-babc-13089e99b60b", "address": "fa:16:3e:fd:b3:38", "network": {"id": "40edab25-ab3a-4874-b47f-1ffa2b5452ee", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1511348766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c7e4c0801264e7794b962f8856e5734", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b392743-33", "ovs_interfaceid": "6b392743-3314-4d79-babc-13089e99b60b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-cb37b2aa-c940-4504-bca0-7527b63bd959 req-780e44d3-1953-48fb-ab32-23163e259871 service nova] Acquired lock "refresh_cache-00231136-233f-4a1b-88ff-b678482ca5bb" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG nova.network.neutron [req-cb37b2aa-c940-4504-bca0-7527b63bd959 req-780e44d3-1953-48fb-ab32-23163e259871 service nova] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Refreshing network info cache for port 6b392743-3314-4d79-babc-13089e99b60b {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Start _get_guest_xml network_info=[{"id": "6b392743-3314-4d79-babc-13089e99b60b", "address": "fa:16:3e:fd:b3:38", "network": {"id": "40edab25-ab3a-4874-b47f-1ffa2b5452ee", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1511348766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c7e4c0801264e7794b962f8856e5734", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b392743-33", "ovs_interfaceid": "6b392743-3314-4d79-babc-13089e99b60b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '3aba2e73-6832-404b-8bd0-d0503ce82b8c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4350e95a-38, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4350e95a-38, col_values=(('external_ids', {'iface-id': '4350e95a-3892-4c83-a407-aa696585eac6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:b8:2a', 'vm-uuid': 'a9549556-e9a7-4782-ade4-9d397d5323d0'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:30 user nova-compute[70924]: INFO os_vif [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:b8:2a,bridge_name='br-int',has_traffic_filtering=True,id=4350e95a-3892-4c83-a407-aa696585eac6,network=Network(4ca69734-4a00-4e6b-bbad-8bc03edba586),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4350e95a-38')
Jul 29 14:41:30 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:41:30 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:41:30 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] CPU controller missing on host. {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] CPU controller found on host. {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70924) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T14:36:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Flavor limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Image limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Flavor pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Image pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Got 1 possible topologies {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:41:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-631144130',display_name='tempest-VolumesAdminNegativeTest-server-631144130',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-631144130',id=7,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIs4Y9pR3wKHwvsLi8/V+TrqrZFo3+OUUKlS+FHCZD8md801Kid7eNLdJEGPjUa1HWw1CrzVoa+ujAU9oWmDcrbr82pO93zUjdCyGpbc1On4YBgs/5g6SAg5SHpzJN0a5A==',key_name='tempest-keypair-390236111',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c7e4c0801264e7794b962f8856e5734',ramdisk_id='',reservation_id='r-0qq6nftp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-831352148',owner_user_name='tempest-VolumesAdminNegativeTest-831352148-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:41:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e86112b87b2d47d88ac5fb9b6fccb31c',uuid=00231136-233f-4a1b-88ff-b678482ca5bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b392743-3314-4d79-babc-13089e99b60b", "address": "fa:16:3e:fd:b3:38", "network": {"id": "40edab25-ab3a-4874-b47f-1ffa2b5452ee", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1511348766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c7e4c0801264e7794b962f8856e5734", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b392743-33", "ovs_interfaceid": "6b392743-3314-4d79-babc-13089e99b60b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Converting VIF {"id": "6b392743-3314-4d79-babc-13089e99b60b", "address": "fa:16:3e:fd:b3:38", "network": {"id": "40edab25-ab3a-4874-b47f-1ffa2b5452ee", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1511348766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c7e4c0801264e7794b962f8856e5734", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b392743-33", "ovs_interfaceid": "6b392743-3314-4d79-babc-13089e99b60b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:b3:38,bridge_name='br-int',has_traffic_filtering=True,id=6b392743-3314-4d79-babc-13089e99b60b,network=Network(40edab25-ab3a-4874-b47f-1ffa2b5452ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b392743-33') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG nova.objects.instance [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Lazy-loading 'pci_devices' on Instance uuid 00231136-233f-4a1b-88ff-b678482ca5bb {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] End _get_guest_xml xml=<domain type="kvm">
Jul 29 14:41:30 user nova-compute[70924]:   <uuid>00231136-233f-4a1b-88ff-b678482ca5bb</uuid>
Jul 29 14:41:30 user nova-compute[70924]:   <name>instance-00000007</name>
Jul 29 14:41:30 user nova-compute[70924]:   <memory>524288</memory>
Jul 29 14:41:30 user nova-compute[70924]:   <vcpu>1</vcpu>
Jul 29 14:41:30 user nova-compute[70924]:   <metadata>
Jul 29 14:41:30 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 14:41:30 user nova-compute[70924]:       <nova:package version="0.0.0"/>
Jul 29 14:41:30 user nova-compute[70924]:       <nova:name>tempest-VolumesAdminNegativeTest-server-631144130</nova:name>
Jul 29 14:41:30 user nova-compute[70924]:       <nova:creationTime>2023-07-29 14:41:30</nova:creationTime>
Jul 29 14:41:30 user nova-compute[70924]:       <nova:flavor name="m1.tiny">
Jul 29 14:41:30 user nova-compute[70924]:         <nova:memory>512</nova:memory>
Jul 29 14:41:30 user nova-compute[70924]:         <nova:disk>1</nova:disk>
Jul 29 14:41:30 user nova-compute[70924]:         <nova:swap>0</nova:swap>
Jul 29 14:41:30 user nova-compute[70924]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 14:41:30 user nova-compute[70924]:         <nova:vcpus>1</nova:vcpus>
Jul 29 14:41:30 user nova-compute[70924]:       </nova:flavor>
Jul 29 14:41:30 user nova-compute[70924]:       <nova:owner>
Jul 29 14:41:30 user nova-compute[70924]:         <nova:user uuid="e86112b87b2d47d88ac5fb9b6fccb31c">tempest-VolumesAdminNegativeTest-831352148-project-member</nova:user>
Jul 29 14:41:30 user nova-compute[70924]:         <nova:project uuid="4c7e4c0801264e7794b962f8856e5734">tempest-VolumesAdminNegativeTest-831352148</nova:project>
Jul 29 14:41:30 user nova-compute[70924]:       </nova:owner>
Jul 29 14:41:30 user nova-compute[70924]:       <nova:root type="image" uuid="3aba2e73-6832-404b-8bd0-d0503ce82b8c"/>
Jul 29 14:41:30 user nova-compute[70924]:       <nova:ports>
Jul 29 14:41:30 user nova-compute[70924]:         <nova:port uuid="6b392743-3314-4d79-babc-13089e99b60b">
Jul 29 14:41:30 user nova-compute[70924]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 29 14:41:30 user nova-compute[70924]:         </nova:port>
Jul 29 14:41:30 user nova-compute[70924]:       </nova:ports>
Jul 29 14:41:30 user nova-compute[70924]:     </nova:instance>
Jul 29 14:41:30 user nova-compute[70924]:   </metadata>
Jul 29 14:41:30 user nova-compute[70924]:   <sysinfo type="smbios">
Jul 29 14:41:30 user nova-compute[70924]:     <system>
Jul 29 14:41:30 user nova-compute[70924]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 14:41:30 user nova-compute[70924]:       <entry name="product">OpenStack Nova</entry>
Jul 29 14:41:30 user nova-compute[70924]:       <entry name="version">0.0.0</entry>
Jul 29 14:41:30 user nova-compute[70924]:       <entry name="serial">00231136-233f-4a1b-88ff-b678482ca5bb</entry>
Jul 29 14:41:30 user nova-compute[70924]:       <entry name="uuid">00231136-233f-4a1b-88ff-b678482ca5bb</entry>
Jul 29 14:41:30 user nova-compute[70924]:       <entry name="family">Virtual Machine</entry>
Jul 29 14:41:30 user nova-compute[70924]:     </system>
Jul 29 14:41:30 user nova-compute[70924]:   </sysinfo>
Jul 29 14:41:30 user nova-compute[70924]:   <os>
Jul 29 14:41:30 user nova-compute[70924]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 14:41:30 user nova-compute[70924]:     <boot dev="hd"/>
Jul 29 14:41:30 user nova-compute[70924]:     <smbios mode="sysinfo"/>
Jul 29 14:41:30 user nova-compute[70924]:   </os>
Jul 29 14:41:30 user nova-compute[70924]:   <features>
Jul 29 14:41:30 user nova-compute[70924]:     <acpi/>
Jul 29 14:41:30 user nova-compute[70924]:     <apic/>
Jul 29 14:41:30 user nova-compute[70924]:     <vmcoreinfo/>
Jul 29 14:41:30 user nova-compute[70924]:   </features>
Jul 29 14:41:30 user nova-compute[70924]:   <clock offset="utc">
Jul 29 14:41:30 user nova-compute[70924]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 14:41:30 user nova-compute[70924]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 14:41:30 user nova-compute[70924]:     <timer name="hpet" present="no"/>
Jul 29 14:41:30 user nova-compute[70924]:   </clock>
Jul 29 14:41:30 user nova-compute[70924]:   <cpu mode="custom" match="exact">
Jul 29 14:41:30 user nova-compute[70924]:     <model>Nehalem</model>
Jul 29 14:41:30 user nova-compute[70924]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 14:41:30 user nova-compute[70924]:   </cpu>
Jul 29 14:41:30 user nova-compute[70924]:   <devices>
Jul 29 14:41:30 user nova-compute[70924]:     <disk type="file" device="disk">
Jul 29 14:41:30 user nova-compute[70924]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 14:41:30 user nova-compute[70924]:       <source file="/opt/stack/data/nova/instances/00231136-233f-4a1b-88ff-b678482ca5bb/disk"/>
Jul 29 14:41:30 user nova-compute[70924]:       <target dev="vda" bus="virtio"/>
Jul 29 14:41:30 user nova-compute[70924]:     </disk>
Jul 29 14:41:30 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 14:41:30 user nova-compute[70924]:       <mac address="fa:16:3e:fd:b3:38"/>
Jul 29 14:41:30 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:41:30 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 14:41:30 user nova-compute[70924]:       <target dev="tap6b392743-33"/>
Jul 29 14:41:30 user nova-compute[70924]:     </interface>
Jul 29 14:41:30 user nova-compute[70924]:     <serial type="pty">
Jul 29 14:41:30 user nova-compute[70924]:       <log file="/opt/stack/data/nova/instances/00231136-233f-4a1b-88ff-b678482ca5bb/console.log" append="off"/>
Jul 29 14:41:30 user nova-compute[70924]:     </serial>
Jul 29 14:41:30 user nova-compute[70924]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 14:41:30 user nova-compute[70924]:     <video>
Jul 29 14:41:30 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:41:30 user nova-compute[70924]:     </video>
Jul 29 14:41:30 user nova-compute[70924]:     <rng model="virtio">
Jul 29 14:41:30 user nova-compute[70924]:       <backend model="random">/dev/urandom</backend>
Jul 29 14:41:30 user nova-compute[70924]:     </rng>
Jul 29 14:41:30 user nova-compute[70924]:     <controller type="usb" index="0" model="none"/>
Jul 29 14:41:30 user nova-compute[70924]:     <memballoon model="virtio">
Jul 29 14:41:30 user nova-compute[70924]:       <stats period="10"/>
Jul 29 14:41:30 user nova-compute[70924]:     </memballoon>
Jul 29 14:41:30 user nova-compute[70924]:   </devices>
Jul 29 14:41:30 user nova-compute[70924]: </domain>
Jul 29 14:41:30 user nova-compute[70924]:  {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:41:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-631144130',display_name='tempest-VolumesAdminNegativeTest-server-631144130',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-631144130',id=7,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIs4Y9pR3wKHwvsLi8/V+TrqrZFo3+OUUKlS+FHCZD8md801Kid7eNLdJEGPjUa1HWw1CrzVoa+ujAU9oWmDcrbr82pO93zUjdCyGpbc1On4YBgs/5g6SAg5SHpzJN0a5A==',key_name='tempest-keypair-390236111',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c7e4c0801264e7794b962f8856e5734',ramdisk_id='',reservation_id='r-0qq6nftp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-831352148',owner_user_name='tempest-VolumesAdminNegativeTest-831352148-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:41:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e86112b87b2d47d88ac5fb9b6fccb31c',uuid=00231136-233f-4a1b-88ff-b678482ca5bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b392743-3314-4d79-babc-13089e99b60b", "address": "fa:16:3e:fd:b3:38", "network": {"id": "40edab25-ab3a-4874-b47f-1ffa2b5452ee", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1511348766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c7e4c0801264e7794b962f8856e5734", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b392743-33", "ovs_interfaceid": "6b392743-3314-4d79-babc-13089e99b60b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Converting VIF {"id": "6b392743-3314-4d79-babc-13089e99b60b", "address": "fa:16:3e:fd:b3:38", "network": {"id": "40edab25-ab3a-4874-b47f-1ffa2b5452ee", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1511348766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c7e4c0801264e7794b962f8856e5734", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b392743-33", "ovs_interfaceid": "6b392743-3314-4d79-babc-13089e99b60b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:b3:38,bridge_name='br-int',has_traffic_filtering=True,id=6b392743-3314-4d79-babc-13089e99b60b,network=Network(40edab25-ab3a-4874-b47f-1ffa2b5452ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b392743-33') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG os_vif [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:b3:38,bridge_name='br-int',has_traffic_filtering=True,id=6b392743-3314-4d79-babc-13089e99b60b,network=Network(40edab25-ab3a-4874-b47f-1ffa2b5452ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b392743-33') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6b392743-33, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6b392743-33, col_values=(('external_ids', {'iface-id': '6b392743-3314-4d79-babc-13089e99b60b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:b3:38', 'vm-uuid': '00231136-233f-4a1b-88ff-b678482ca5bb'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] No BDM found with device name hda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] No VIF found with MAC fa:16:3e:5d:b8:2a, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:41:30 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Using config drive
Jul 29 14:41:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:30 user nova-compute[70924]: INFO os_vif [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:b3:38,bridge_name='br-int',has_traffic_filtering=True,id=6b392743-3314-4d79-babc-13089e99b60b,network=Network(40edab25-ab3a-4874-b47f-1ffa2b5452ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b392743-33')
Jul 29 14:41:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Acquiring lock "fcbb998c-2dac-47d9-985a-d5b2a15ddaa0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Lock "fcbb998c-2dac-47d9-985a-d5b2a15ddaa0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:30 user nova-compute[70924]: DEBUG nova.compute.manager [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Starting instance... {{(pid=70924) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 14:41:31 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:41:31 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] No VIF found with MAC fa:16:3e:fd:b3:38, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:41:31 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:41:31 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:41:31 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70924) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 14:41:31 user nova-compute[70924]: INFO nova.compute.claims [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Claim successful on node user
Jul 29 14:41:31 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Creating config drive at /opt/stack/data/nova/instances/a9549556-e9a7-4782-ade4-9d397d5323d0/disk.config
Jul 29 14:41:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a9549556-e9a7-4782-ade4-9d397d5323d0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp3r226f7r {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:41:31 user nova-compute[70924]: DEBUG nova.network.neutron [req-d86409f1-5d5a-470b-be60-dec51c30b430 req-574310c3-c806-4a05-8eaf-1c91587f042d service nova] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Updated VIF entry in instance network info cache for port 4350e95a-3892-4c83-a407-aa696585eac6. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:41:31 user nova-compute[70924]: DEBUG nova.network.neutron [req-d86409f1-5d5a-470b-be60-dec51c30b430 req-574310c3-c806-4a05-8eaf-1c91587f042d service nova] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Updating instance_info_cache with network_info: [{"id": "4350e95a-3892-4c83-a407-aa696585eac6", "address": "fa:16:3e:5d:b8:2a", "network": {"id": "4ca69734-4a00-4e6b-bbad-8bc03edba586", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1313665133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f5512f71fe048c5936b9154c0e3126b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4350e95a-38", "ovs_interfaceid": "4350e95a-3892-4c83-a407-aa696585eac6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:41:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a9549556-e9a7-4782-ade4-9d397d5323d0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp3r226f7r" returned: 0 in 0.138s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:41:31 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-d86409f1-5d5a-470b-be60-dec51c30b430 req-574310c3-c806-4a05-8eaf-1c91587f042d service nova] Releasing lock "refresh_cache-a9549556-e9a7-4782-ade4-9d397d5323d0" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:41:31 user nova-compute[70924]: DEBUG nova.compute.manager [req-e96886d0-1985-488a-8e86-94f6d2a837c1 req-ac53a229-9374-4691-aa69-7d3aba9259c2 service nova] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] Received event network-vif-plugged-c96a0580-3813-482c-8bcc-c95fe4fc1ca6 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:41:31 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-e96886d0-1985-488a-8e86-94f6d2a837c1 req-ac53a229-9374-4691-aa69-7d3aba9259c2 service nova] Acquiring lock "1ea2e4b1-5b93-42bf-b29d-ce6986135826-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:41:31 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-e96886d0-1985-488a-8e86-94f6d2a837c1 req-ac53a229-9374-4691-aa69-7d3aba9259c2 service nova] Lock "1ea2e4b1-5b93-42bf-b29d-ce6986135826-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:41:31 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-e96886d0-1985-488a-8e86-94f6d2a837c1 req-ac53a229-9374-4691-aa69-7d3aba9259c2 service nova] Lock "1ea2e4b1-5b93-42bf-b29d-ce6986135826-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:41:31 user nova-compute[70924]: DEBUG nova.compute.manager [req-e96886d0-1985-488a-8e86-94f6d2a837c1 req-ac53a229-9374-4691-aa69-7d3aba9259c2 service nova] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] No waiting events found dispatching network-vif-plugged-c96a0580-3813-482c-8bcc-c95fe4fc1ca6 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:41:31 user nova-compute[70924]: WARNING nova.compute.manager [req-e96886d0-1985-488a-8e86-94f6d2a837c1 req-ac53a229-9374-4691-aa69-7d3aba9259c2 service nova] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] Received unexpected event network-vif-plugged-c96a0580-3813-482c-8bcc-c95fe4fc1ca6 for instance with vm_state building and task_state spawning.
Jul 29 14:41:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:31 user nova-compute[70924]: DEBUG nova.network.neutron [req-cb37b2aa-c940-4504-bca0-7527b63bd959 req-780e44d3-1953-48fb-ab32-23163e259871 service nova] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Updated VIF entry in instance network info cache for port 6b392743-3314-4d79-babc-13089e99b60b. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:41:31 user nova-compute[70924]: DEBUG nova.network.neutron [req-cb37b2aa-c940-4504-bca0-7527b63bd959 req-780e44d3-1953-48fb-ab32-23163e259871 service nova] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Updating instance_info_cache with network_info: [{"id": "6b392743-3314-4d79-babc-13089e99b60b", "address": "fa:16:3e:fd:b3:38", "network": {"id": "40edab25-ab3a-4874-b47f-1ffa2b5452ee", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1511348766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c7e4c0801264e7794b962f8856e5734", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b392743-33", "ovs_interfaceid": "6b392743-3314-4d79-babc-13089e99b60b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:41:31 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-cb37b2aa-c940-4504-bca0-7527b63bd959 req-780e44d3-1953-48fb-ab32-23163e259871 service nova] Releasing lock "refresh_cache-00231136-233f-4a1b-88ff-b678482ca5bb" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:41:32 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:41:32 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:41:32 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.010s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:41:32 user nova-compute[70924]: DEBUG nova.compute.manager [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Start building networks asynchronously for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 14:41:32 user nova-compute[70924]: DEBUG nova.compute.manager [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Allocating IP information in the background. {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 14:41:32 user nova-compute[70924]: DEBUG nova.network.neutron [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] allocate_for_instance() {{(pid=70924) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 14:41:32 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 14:41:32 user nova-compute[70924]: DEBUG nova.compute.manager [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Start building block device mappings for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 14:41:32 user nova-compute[70924]: DEBUG nova.policy [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a2749d3895a8441c9177c99442a6657c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7350cca282f7405f9f232110869df140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70924) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 14:41:32 user nova-compute[70924]: DEBUG nova.compute.manager [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Start spawning the instance on the hypervisor. {{(pid=70924) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 14:41:32 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Creating instance directory {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 14:41:32 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Creating image(s)
Jul 29 14:41:32 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Acquiring lock "/opt/stack/data/nova/instances/fcbb998c-2dac-47d9-985a-d5b2a15ddaa0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:41:32 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Lock "/opt/stack/data/nova/instances/fcbb998c-2dac-47d9-985a-d5b2a15ddaa0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:41:32 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Lock "/opt/stack/data/nova/instances/fcbb998c-2dac-47d9-985a-d5b2a15ddaa0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:41:32 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:41:32 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:32 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.197s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:41:32 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Acquiring lock "bd72453517468710f1de26b27fb0ea28688e9009" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:41:32 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:41:32 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:41:32 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.139s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:41:32 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/fcbb998c-2dac-47d9-985a-d5b2a15ddaa0/disk 1073741824 {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:41:33 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/fcbb998c-2dac-47d9-985a-d5b2a15ddaa0/disk 1073741824" returned: 0 in 0.086s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:41:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:41:33 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:41:33 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.196s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:41:33 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fcbb998c-2dac-47d9-985a-d5b2a15ddaa0/disk. size=1073741824 {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 14:41:33 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcbb998c-2dac-47d9-985a-d5b2a15ddaa0/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:41:33 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcbb998c-2dac-47d9-985a-d5b2a15ddaa0/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:41:33 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Cannot resize image /opt/stack/data/nova/instances/fcbb998c-2dac-47d9-985a-d5b2a15ddaa0/disk to a smaller size. {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 14:41:33 user nova-compute[70924]: DEBUG nova.objects.instance [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Lazy-loading 'migration_context' on Instance uuid fcbb998c-2dac-47d9-985a-d5b2a15ddaa0 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:41:33 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Created local disks {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 14:41:33 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Ensure instance console log exists: /opt/stack/data/nova/instances/fcbb998c-2dac-47d9-985a-d5b2a15ddaa0/console.log {{(pid=70924) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 14:41:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:41:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:41:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:41:33 user nova-compute[70924]: DEBUG nova.compute.manager [req-a1de8666-385d-468e-bfdc-bd984bad651b req-b4f7eac1-ff29-4fcd-b2d9-0bd8d910bfd3 service nova] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] Received event network-vif-plugged-c96a0580-3813-482c-8bcc-c95fe4fc1ca6 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:41:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a1de8666-385d-468e-bfdc-bd984bad651b req-b4f7eac1-ff29-4fcd-b2d9-0bd8d910bfd3 service nova] Acquiring lock "1ea2e4b1-5b93-42bf-b29d-ce6986135826-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:41:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a1de8666-385d-468e-bfdc-bd984bad651b req-b4f7eac1-ff29-4fcd-b2d9-0bd8d910bfd3 service nova] Lock "1ea2e4b1-5b93-42bf-b29d-ce6986135826-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:41:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a1de8666-385d-468e-bfdc-bd984bad651b req-b4f7eac1-ff29-4fcd-b2d9-0bd8d910bfd3 service nova] Lock "1ea2e4b1-5b93-42bf-b29d-ce6986135826-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:41:33 user nova-compute[70924]: DEBUG nova.compute.manager [req-a1de8666-385d-468e-bfdc-bd984bad651b req-b4f7eac1-ff29-4fcd-b2d9-0bd8d910bfd3 service nova] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] No waiting events found dispatching network-vif-plugged-c96a0580-3813-482c-8bcc-c95fe4fc1ca6 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:41:33 user nova-compute[70924]: WARNING nova.compute.manager [req-a1de8666-385d-468e-bfdc-bd984bad651b req-b4f7eac1-ff29-4fcd-b2d9-0bd8d910bfd3 service nova] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] Received unexpected event network-vif-plugged-c96a0580-3813-482c-8bcc-c95fe4fc1ca6 for instance with vm_state building and task_state spawning.
Jul 29 14:41:34 user nova-compute[70924]: DEBUG nova.network.neutron [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Successfully created port: ef43604c-04b6-43b1-83c3-324102987873 {{(pid=70924) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 14:41:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:34 user nova-compute[70924]: DEBUG nova.compute.manager [req-b21b57cf-c976-41ec-ac05-0e089fb021bb req-7878d5f9-1f01-4ffa-bc63-dc15ed9037f6 service nova] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Received event network-vif-plugged-6b392743-3314-4d79-babc-13089e99b60b {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:41:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b21b57cf-c976-41ec-ac05-0e089fb021bb req-7878d5f9-1f01-4ffa-bc63-dc15ed9037f6 service nova] Acquiring lock "00231136-233f-4a1b-88ff-b678482ca5bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:41:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b21b57cf-c976-41ec-ac05-0e089fb021bb req-7878d5f9-1f01-4ffa-bc63-dc15ed9037f6 service nova] Lock "00231136-233f-4a1b-88ff-b678482ca5bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:41:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b21b57cf-c976-41ec-ac05-0e089fb021bb req-7878d5f9-1f01-4ffa-bc63-dc15ed9037f6 service nova] Lock "00231136-233f-4a1b-88ff-b678482ca5bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:41:34 user nova-compute[70924]: DEBUG nova.compute.manager [req-b21b57cf-c976-41ec-ac05-0e089fb021bb req-7878d5f9-1f01-4ffa-bc63-dc15ed9037f6 service nova] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] No waiting events found dispatching network-vif-plugged-6b392743-3314-4d79-babc-13089e99b60b {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:41:34 user nova-compute[70924]: WARNING nova.compute.manager [req-b21b57cf-c976-41ec-ac05-0e089fb021bb req-7878d5f9-1f01-4ffa-bc63-dc15ed9037f6 service nova] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Received unexpected event network-vif-plugged-6b392743-3314-4d79-babc-13089e99b60b for instance with vm_state building and task_state spawning.
Jul 29 14:41:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:35 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:35 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:35 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:35 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:35 user nova-compute[70924]: DEBUG nova.network.neutron [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Successfully updated port: ef43604c-04b6-43b1-83c3-324102987873 {{(pid=70924) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 14:41:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Acquiring lock "refresh_cache-fcbb998c-2dac-47d9-985a-d5b2a15ddaa0" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:41:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Acquired lock "refresh_cache-fcbb998c-2dac-47d9-985a-d5b2a15ddaa0" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:41:35 user nova-compute[70924]: DEBUG nova.network.neutron [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 14:41:35 user nova-compute[70924]: DEBUG nova.compute.manager [req-2cfcdf38-21d4-40fa-9a99-a74793306449 req-fa5163d9-753e-4ac6-86db-8b5e76afee8d service nova] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Received event network-vif-plugged-4350e95a-3892-4c83-a407-aa696585eac6 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:41:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-2cfcdf38-21d4-40fa-9a99-a74793306449 req-fa5163d9-753e-4ac6-86db-8b5e76afee8d service nova] Acquiring lock "a9549556-e9a7-4782-ade4-9d397d5323d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:41:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-2cfcdf38-21d4-40fa-9a99-a74793306449 req-fa5163d9-753e-4ac6-86db-8b5e76afee8d service nova] Lock "a9549556-e9a7-4782-ade4-9d397d5323d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:41:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-2cfcdf38-21d4-40fa-9a99-a74793306449 req-fa5163d9-753e-4ac6-86db-8b5e76afee8d service nova] Lock "a9549556-e9a7-4782-ade4-9d397d5323d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:41:35 user nova-compute[70924]: DEBUG nova.compute.manager [req-2cfcdf38-21d4-40fa-9a99-a74793306449 req-fa5163d9-753e-4ac6-86db-8b5e76afee8d service nova] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] No waiting events found dispatching network-vif-plugged-4350e95a-3892-4c83-a407-aa696585eac6 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:41:35 user nova-compute[70924]: WARNING nova.compute.manager [req-2cfcdf38-21d4-40fa-9a99-a74793306449 req-fa5163d9-753e-4ac6-86db-8b5e76afee8d service nova] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Received unexpected event network-vif-plugged-4350e95a-3892-4c83-a407-aa696585eac6 for instance with vm_state building and task_state spawning.
Jul 29 14:41:35 user nova-compute[70924]: DEBUG nova.compute.manager [req-2cfcdf38-21d4-40fa-9a99-a74793306449 req-fa5163d9-753e-4ac6-86db-8b5e76afee8d service nova] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Received event network-vif-plugged-4350e95a-3892-4c83-a407-aa696585eac6 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:41:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-2cfcdf38-21d4-40fa-9a99-a74793306449 req-fa5163d9-753e-4ac6-86db-8b5e76afee8d service nova] Acquiring lock "a9549556-e9a7-4782-ade4-9d397d5323d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:41:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-2cfcdf38-21d4-40fa-9a99-a74793306449 req-fa5163d9-753e-4ac6-86db-8b5e76afee8d service nova] Lock "a9549556-e9a7-4782-ade4-9d397d5323d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:41:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-2cfcdf38-21d4-40fa-9a99-a74793306449 req-fa5163d9-753e-4ac6-86db-8b5e76afee8d service nova] Lock "a9549556-e9a7-4782-ade4-9d397d5323d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:41:35 user nova-compute[70924]: DEBUG nova.compute.manager [req-2cfcdf38-21d4-40fa-9a99-a74793306449 req-fa5163d9-753e-4ac6-86db-8b5e76afee8d service nova] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] No waiting events found dispatching network-vif-plugged-4350e95a-3892-4c83-a407-aa696585eac6 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:41:35 user nova-compute[70924]: WARNING nova.compute.manager [req-2cfcdf38-21d4-40fa-9a99-a74793306449 req-fa5163d9-753e-4ac6-86db-8b5e76afee8d service nova] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Received unexpected event network-vif-plugged-4350e95a-3892-4c83-a407-aa696585eac6 for instance with vm_state building and task_state spawning.
Jul 29 14:41:36 user nova-compute[70924]: DEBUG nova.network.neutron [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Instance cache missing network info. {{(pid=70924) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 14:41:36 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:36 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:36 user nova-compute[70924]: DEBUG nova.network.neutron [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Updating instance_info_cache with network_info: [{"id": "ef43604c-04b6-43b1-83c3-324102987873", "address": "fa:16:3e:92:af:8a", "network": {"id": "6c9a59aa-27fd-4da3-b686-bafa34c4d807", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1260570280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7350cca282f7405f9f232110869df140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef43604c-04", "ovs_interfaceid": "ef43604c-04b6-43b1-83c3-324102987873", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:41:36 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Releasing lock "refresh_cache-fcbb998c-2dac-47d9-985a-d5b2a15ddaa0" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:41:36 user nova-compute[70924]: DEBUG nova.compute.manager [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Instance network_info: |[{"id": "ef43604c-04b6-43b1-83c3-324102987873", "address": "fa:16:3e:92:af:8a", "network": {"id": "6c9a59aa-27fd-4da3-b686-bafa34c4d807", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1260570280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7350cca282f7405f9f232110869df140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef43604c-04", "ovs_interfaceid": "ef43604c-04b6-43b1-83c3-324102987873", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 14:41:36 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Start _get_guest_xml network_info=[{"id": "ef43604c-04b6-43b1-83c3-324102987873", "address": "fa:16:3e:92:af:8a", "network": {"id": "6c9a59aa-27fd-4da3-b686-bafa34c4d807", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1260570280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7350cca282f7405f9f232110869df140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef43604c-04", "ovs_interfaceid": "ef43604c-04b6-43b1-83c3-324102987873", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '3aba2e73-6832-404b-8bd0-d0503ce82b8c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 14:41:36 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:41:36 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:41:36 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 14:41:36 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] CPU controller missing on host. {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 14:41:36 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 14:41:36 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] CPU controller found on host. {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 14:41:36 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70924) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 14:41:36 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T14:36:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 14:41:36 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Flavor limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 14:41:36 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Image limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 14:41:36 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Flavor pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 14:41:36 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Image pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 14:41:36 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 14:41:36 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 14:41:36 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 14:41:36 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Got 1 possible topologies {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 14:41:36 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 14:41:36 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 14:41:36 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:41:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-298188460',display_name='tempest-TestVolumeSwap-server-298188460',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-298188460',id=9,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIy5LMzYse1FTE5GonGcYFS2TcGVpsTizS2meMDDkzfNfMIybKkYVHNgzFvQJUkIkOpohYUlBGuDUhTNUlDCRvoXtaDUvNITaWruK4KVYMNJHhf68aSIsvABKVG3OjhnfQ==',key_name='tempest-keypair-1549902199',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7350cca282f7405f9f232110869df140',ramdisk_id='',reservation_id='r-3g33ed37',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1582539677',owner_user_name='tempest-TestVolumeSwap-1582539677-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:41:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2749d3895a8441c9177c99442a6657c',uuid=fcbb998c-2dac-47d9-985a-d5b2a15ddaa0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef43604c-04b6-43b1-83c3-324102987873", "address": "fa:16:3e:92:af:8a", "network": {"id": "6c9a59aa-27fd-4da3-b686-bafa34c4d807", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1260570280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7350cca282f7405f9f232110869df140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef43604c-04", "ovs_interfaceid": "ef43604c-04b6-43b1-83c3-324102987873", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:41:36 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Converting VIF {"id": "ef43604c-04b6-43b1-83c3-324102987873", "address": "fa:16:3e:92:af:8a", "network": {"id": "6c9a59aa-27fd-4da3-b686-bafa34c4d807", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1260570280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7350cca282f7405f9f232110869df140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef43604c-04", "ovs_interfaceid": "ef43604c-04b6-43b1-83c3-324102987873", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:41:36 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:af:8a,bridge_name='br-int',has_traffic_filtering=True,id=ef43604c-04b6-43b1-83c3-324102987873,network=Network(6c9a59aa-27fd-4da3-b686-bafa34c4d807),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef43604c-04') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:41:36 user nova-compute[70924]: DEBUG nova.objects.instance [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Lazy-loading 'pci_devices' on Instance uuid fcbb998c-2dac-47d9-985a-d5b2a15ddaa0 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:41:36 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] End _get_guest_xml xml=<domain type="kvm">
Jul 29 14:41:36 user nova-compute[70924]:   <uuid>fcbb998c-2dac-47d9-985a-d5b2a15ddaa0</uuid>
Jul 29 14:41:36 user nova-compute[70924]:   <name>instance-00000009</name>
Jul 29 14:41:36 user nova-compute[70924]:   <memory>524288</memory>
Jul 29 14:41:36 user nova-compute[70924]:   <vcpu>1</vcpu>
Jul 29 14:41:36 user nova-compute[70924]:   <metadata>
Jul 29 14:41:36 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 14:41:36 user nova-compute[70924]:       <nova:package version="0.0.0"/>
Jul 29 14:41:36 user nova-compute[70924]:       <nova:name>tempest-TestVolumeSwap-server-298188460</nova:name>
Jul 29 14:41:36 user nova-compute[70924]:       <nova:creationTime>2023-07-29 14:41:36</nova:creationTime>
Jul 29 14:41:36 user nova-compute[70924]:       <nova:flavor name="m1.tiny">
Jul 29 14:41:36 user nova-compute[70924]:         <nova:memory>512</nova:memory>
Jul 29 14:41:36 user nova-compute[70924]:         <nova:disk>1</nova:disk>
Jul 29 14:41:36 user nova-compute[70924]:         <nova:swap>0</nova:swap>
Jul 29 14:41:36 user nova-compute[70924]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 14:41:36 user nova-compute[70924]:         <nova:vcpus>1</nova:vcpus>
Jul 29 14:41:36 user nova-compute[70924]:       </nova:flavor>
Jul 29 14:41:36 user nova-compute[70924]:       <nova:owner>
Jul 29 14:41:36 user nova-compute[70924]:         <nova:user uuid="a2749d3895a8441c9177c99442a6657c">tempest-TestVolumeSwap-1582539677-project-member</nova:user>
Jul 29 14:41:36 user nova-compute[70924]:         <nova:project uuid="7350cca282f7405f9f232110869df140">tempest-TestVolumeSwap-1582539677</nova:project>
Jul 29 14:41:36 user nova-compute[70924]:       </nova:owner>
Jul 29 14:41:36 user nova-compute[70924]:       <nova:root type="image" uuid="3aba2e73-6832-404b-8bd0-d0503ce82b8c"/>
Jul 29 14:41:36 user nova-compute[70924]:       <nova:ports>
Jul 29 14:41:36 user nova-compute[70924]:         <nova:port uuid="ef43604c-04b6-43b1-83c3-324102987873">
Jul 29 14:41:36 user nova-compute[70924]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 29 14:41:36 user nova-compute[70924]:         </nova:port>
Jul 29 14:41:36 user nova-compute[70924]:       </nova:ports>
Jul 29 14:41:36 user nova-compute[70924]:     </nova:instance>
Jul 29 14:41:36 user nova-compute[70924]:   </metadata>
Jul 29 14:41:36 user nova-compute[70924]:   <sysinfo type="smbios">
Jul 29 14:41:36 user nova-compute[70924]:     <system>
Jul 29 14:41:36 user nova-compute[70924]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 14:41:36 user nova-compute[70924]:       <entry name="product">OpenStack Nova</entry>
Jul 29 14:41:36 user nova-compute[70924]:       <entry name="version">0.0.0</entry>
Jul 29 14:41:36 user nova-compute[70924]:       <entry name="serial">fcbb998c-2dac-47d9-985a-d5b2a15ddaa0</entry>
Jul 29 14:41:36 user nova-compute[70924]:       <entry name="uuid">fcbb998c-2dac-47d9-985a-d5b2a15ddaa0</entry>
Jul 29 14:41:36 user nova-compute[70924]:       <entry name="family">Virtual Machine</entry>
Jul 29 14:41:36 user nova-compute[70924]:     </system>
Jul 29 14:41:36 user nova-compute[70924]:   </sysinfo>
Jul 29 14:41:36 user nova-compute[70924]:   <os>
Jul 29 14:41:36 user nova-compute[70924]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 14:41:36 user nova-compute[70924]:     <boot dev="hd"/>
Jul 29 14:41:36 user nova-compute[70924]:     <smbios mode="sysinfo"/>
Jul 29 14:41:36 user nova-compute[70924]:   </os>
Jul 29 14:41:36 user nova-compute[70924]:   <features>
Jul 29 14:41:36 user nova-compute[70924]:     <acpi/>
Jul 29 14:41:36 user nova-compute[70924]:     <apic/>
Jul 29 14:41:36 user nova-compute[70924]:     <vmcoreinfo/>
Jul 29 14:41:36 user nova-compute[70924]:   </features>
Jul 29 14:41:36 user nova-compute[70924]:   <clock offset="utc">
Jul 29 14:41:36 user nova-compute[70924]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 14:41:36 user nova-compute[70924]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 14:41:36 user nova-compute[70924]:     <timer name="hpet" present="no"/>
Jul 29 14:41:36 user nova-compute[70924]:   </clock>
Jul 29 14:41:36 user nova-compute[70924]:   <cpu mode="custom" match="exact">
Jul 29 14:41:36 user nova-compute[70924]:     <model>Nehalem</model>
Jul 29 14:41:36 user nova-compute[70924]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 14:41:36 user nova-compute[70924]:   </cpu>
Jul 29 14:41:36 user nova-compute[70924]:   <devices>
Jul 29 14:41:36 user nova-compute[70924]:     <disk type="file" device="disk">
Jul 29 14:41:36 user nova-compute[70924]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 14:41:36 user nova-compute[70924]:       <source file="/opt/stack/data/nova/instances/fcbb998c-2dac-47d9-985a-d5b2a15ddaa0/disk"/>
Jul 29 14:41:36 user nova-compute[70924]:       <target dev="vda" bus="virtio"/>
Jul 29 14:41:36 user nova-compute[70924]:     </disk>
Jul 29 14:41:36 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 14:41:36 user nova-compute[70924]:       <mac address="fa:16:3e:92:af:8a"/>
Jul 29 14:41:36 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:41:36 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 14:41:36 user nova-compute[70924]:       <target dev="tapef43604c-04"/>
Jul 29 14:41:36 user nova-compute[70924]:     </interface>
Jul 29 14:41:36 user nova-compute[70924]:     <serial type="pty">
Jul 29 14:41:36 user nova-compute[70924]:       <log file="/opt/stack/data/nova/instances/fcbb998c-2dac-47d9-985a-d5b2a15ddaa0/console.log" append="off"/>
Jul 29 14:41:36 user nova-compute[70924]:     </serial>
Jul 29 14:41:36 user nova-compute[70924]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 14:41:36 user nova-compute[70924]:     <video>
Jul 29 14:41:36 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:41:36 user nova-compute[70924]:     </video>
Jul 29 14:41:36 user nova-compute[70924]:     <rng model="virtio">
Jul 29 14:41:36 user nova-compute[70924]:       <backend model="random">/dev/urandom</backend>
Jul 29 14:41:36 user nova-compute[70924]:     </rng>
Jul 29 14:41:36 user nova-compute[70924]:     <controller type="usb" index="0" model="none"/>
Jul 29 14:41:36 user nova-compute[70924]:     <memballoon model="virtio">
Jul 29 14:41:36 user nova-compute[70924]:       <stats period="10"/>
Jul 29 14:41:36 user nova-compute[70924]:     </memballoon>
Jul 29 14:41:36 user nova-compute[70924]:   </devices>
Jul 29 14:41:36 user nova-compute[70924]: </domain>
Jul 29 14:41:36 user nova-compute[70924]:  {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 14:41:36 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:41:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-298188460',display_name='tempest-TestVolumeSwap-server-298188460',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-298188460',id=9,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIy5LMzYse1FTE5GonGcYFS2TcGVpsTizS2meMDDkzfNfMIybKkYVHNgzFvQJUkIkOpohYUlBGuDUhTNUlDCRvoXtaDUvNITaWruK4KVYMNJHhf68aSIsvABKVG3OjhnfQ==',key_name='tempest-keypair-1549902199',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7350cca282f7405f9f232110869df140',ramdisk_id='',reservation_id='r-3g33ed37',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1582539677',owner_user_name='tempest-TestVolumeSwap-1582539677-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:41:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2749d3895a8441c9177c99442a6657c',uuid=fcbb998c-2dac-47d9-985a-d5b2a15ddaa0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef43604c-04b6-43b1-83c3-324102987873", "address": "fa:16:3e:92:af:8a", "network": {"id": "6c9a59aa-27fd-4da3-b686-bafa34c4d807", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1260570280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7350cca282f7405f9f232110869df140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef43604c-04", "ovs_interfaceid": "ef43604c-04b6-43b1-83c3-324102987873", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 14:41:36 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Converting VIF {"id": "ef43604c-04b6-43b1-83c3-324102987873", "address": "fa:16:3e:92:af:8a", "network": {"id": "6c9a59aa-27fd-4da3-b686-bafa34c4d807", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1260570280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7350cca282f7405f9f232110869df140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef43604c-04", "ovs_interfaceid": "ef43604c-04b6-43b1-83c3-324102987873", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:41:36 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:af:8a,bridge_name='br-int',has_traffic_filtering=True,id=ef43604c-04b6-43b1-83c3-324102987873,network=Network(6c9a59aa-27fd-4da3-b686-bafa34c4d807),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef43604c-04') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:41:36 user nova-compute[70924]: DEBUG os_vif [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:af:8a,bridge_name='br-int',has_traffic_filtering=True,id=ef43604c-04b6-43b1-83c3-324102987873,network=Network(6c9a59aa-27fd-4da3-b686-bafa34c4d807),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef43604c-04') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 14:41:36 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:36 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:41:36 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 14:41:36 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:36 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapef43604c-04, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:41:36 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapef43604c-04, col_values=(('external_ids', {'iface-id': 'ef43604c-04b6-43b1-83c3-324102987873', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:af:8a', 'vm-uuid': 'fcbb998c-2dac-47d9-985a-d5b2a15ddaa0'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:41:36 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:36 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:41:36 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:36 user nova-compute[70924]: INFO os_vif [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:af:8a,bridge_name='br-int',has_traffic_filtering=True,id=ef43604c-04b6-43b1-83c3-324102987873,network=Network(6c9a59aa-27fd-4da3-b686-bafa34c4d807),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef43604c-04')
Jul 29 14:41:36 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:41:36 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] No VIF found with MAC fa:16:3e:92:af:8a, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:41:36 user nova-compute[70924]: DEBUG nova.compute.manager [req-00788b39-25b7-430e-82cb-25fd9b9ad8b4 req-ffe50a6b-a89c-40ad-95f2-bfe3fefda00a service nova] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Received event network-vif-plugged-6b392743-3314-4d79-babc-13089e99b60b {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:41:36 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-00788b39-25b7-430e-82cb-25fd9b9ad8b4 req-ffe50a6b-a89c-40ad-95f2-bfe3fefda00a service nova] Acquiring lock "00231136-233f-4a1b-88ff-b678482ca5bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:41:36 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-00788b39-25b7-430e-82cb-25fd9b9ad8b4 req-ffe50a6b-a89c-40ad-95f2-bfe3fefda00a service nova] Lock "00231136-233f-4a1b-88ff-b678482ca5bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:41:36 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-00788b39-25b7-430e-82cb-25fd9b9ad8b4 req-ffe50a6b-a89c-40ad-95f2-bfe3fefda00a service nova] Lock "00231136-233f-4a1b-88ff-b678482ca5bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:41:36 user nova-compute[70924]: DEBUG nova.compute.manager [req-00788b39-25b7-430e-82cb-25fd9b9ad8b4 req-ffe50a6b-a89c-40ad-95f2-bfe3fefda00a service nova] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] No waiting events found dispatching network-vif-plugged-6b392743-3314-4d79-babc-13089e99b60b {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:41:36 user nova-compute[70924]: WARNING nova.compute.manager [req-00788b39-25b7-430e-82cb-25fd9b9ad8b4 req-ffe50a6b-a89c-40ad-95f2-bfe3fefda00a service nova] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Received unexpected event network-vif-plugged-6b392743-3314-4d79-babc-13089e99b60b for instance with vm_state building and task_state spawning.
Jul 29 14:41:37 user nova-compute[70924]: DEBUG nova.compute.manager [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] Instance event wait completed in 0 seconds for  {{(pid=70924) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 14:41:37 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] Guest created on hypervisor {{(pid=70924) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 14:41:37 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690641697.2861512, 1ea2e4b1-5b93-42bf-b29d-ce6986135826 => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:41:37 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] VM Resumed (Lifecycle Event)
Jul 29 14:41:37 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] Instance spawned successfully.
Jul 29 14:41:37 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 14:41:37 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:41:37 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] Found default for hw_input_bus of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:41:37 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] Found default for hw_pointer_model of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:41:37 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] Found default for hw_video_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:41:37 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] Found default for hw_vif_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:41:37 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:41:37 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:41:37 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690641697.2986648, 1ea2e4b1-5b93-42bf-b29d-ce6986135826 => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:41:37 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] VM Started (Lifecycle Event)
Jul 29 14:41:37 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:41:37 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:41:37 user nova-compute[70924]: INFO nova.compute.manager [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] Took 15.19 seconds to spawn the instance on the hypervisor.
Jul 29 14:41:37 user nova-compute[70924]: DEBUG nova.compute.manager [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:41:37 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:41:37 user nova-compute[70924]: INFO nova.compute.manager [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] Took 16.48 seconds to build instance.
Jul 29 14:41:37 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690641697.5669944, 00231136-233f-4a1b-88ff-b678482ca5bb => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:41:37 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] VM Resumed (Lifecycle Event)
Jul 29 14:41:37 user nova-compute[70924]: DEBUG nova.compute.manager [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Instance event wait completed in 0 seconds for  {{(pid=70924) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 14:41:37 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Guest created on hypervisor {{(pid=70924) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 14:41:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-8f6dbb95-0856-4e72-a730-aa4f748f4884 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Lock "1ea2e4b1-5b93-42bf-b29d-ce6986135826" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.699s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:41:37 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:41:37 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Instance spawned successfully.
Jul 29 14:41:37 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 14:41:37 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:41:37 user nova-compute[70924]: DEBUG nova.compute.manager [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Instance event wait completed in 0 seconds for  {{(pid=70924) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 14:41:37 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Guest created on hypervisor {{(pid=70924) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 14:41:37 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Found default for hw_cdrom_bus of ide {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:41:37 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Found default for hw_disk_bus of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:41:37 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Found default for hw_input_bus of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:41:37 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Found default for hw_pointer_model of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:41:37 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Found default for hw_video_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:41:37 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Found default for hw_vif_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:41:37 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Instance spawned successfully.
Jul 29 14:41:37 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 14:41:37 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:41:37 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690641697.5838025, 00231136-233f-4a1b-88ff-b678482ca5bb => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:41:37 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] VM Started (Lifecycle Event)
Jul 29 14:41:37 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Found default for hw_cdrom_bus of ide {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:41:37 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Found default for hw_disk_bus of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:41:37 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Found default for hw_input_bus of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:41:37 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Found default for hw_pointer_model of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:41:37 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Found default for hw_video_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:41:37 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Found default for hw_vif_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:41:37 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:41:37 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:41:37 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:41:37 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690641697.6253052, a9549556-e9a7-4782-ade4-9d397d5323d0 => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:41:37 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] VM Resumed (Lifecycle Event)
Jul 29 14:41:37 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:41:37 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:41:37 user nova-compute[70924]: INFO nova.compute.manager [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Took 12.95 seconds to spawn the instance on the hypervisor.
Jul 29 14:41:37 user nova-compute[70924]: DEBUG nova.compute.manager [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:41:37 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:41:37 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690641697.6272037, a9549556-e9a7-4782-ade4-9d397d5323d0 => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:41:37 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] VM Started (Lifecycle Event)
Jul 29 14:41:37 user nova-compute[70924]: INFO nova.compute.manager [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Took 10.49 seconds to spawn the instance on the hypervisor.
Jul 29 14:41:37 user nova-compute[70924]: DEBUG nova.compute.manager [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:41:37 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:37 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:41:37 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:41:37 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:41:37 user nova-compute[70924]: INFO nova.compute.manager [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Took 14.57 seconds to build instance.
Jul 29 14:41:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-575e0e78-1185-4231-9edd-f859001fa47f tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Lock "00231136-233f-4a1b-88ff-b678482ca5bb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.834s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:41:37 user nova-compute[70924]: INFO nova.compute.manager [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Took 11.68 seconds to build instance.
Jul 29 14:41:37 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-de5f5f75-fb3e-4ac7-a1b6-977ef6fcc6b6 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Lock "a9549556-e9a7-4782-ade4-9d397d5323d0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.108s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:41:37 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:38 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:38 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:38 user nova-compute[70924]: DEBUG nova.compute.manager [req-4cbe58d9-39c7-4907-b8bd-151425335a76 req-cfa9df7b-3b8e-4d37-814d-f4842820d64e service nova] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Received event network-changed-ef43604c-04b6-43b1-83c3-324102987873 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:41:38 user nova-compute[70924]: DEBUG nova.compute.manager [req-4cbe58d9-39c7-4907-b8bd-151425335a76 req-cfa9df7b-3b8e-4d37-814d-f4842820d64e service nova] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Refreshing instance network info cache due to event network-changed-ef43604c-04b6-43b1-83c3-324102987873. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:41:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-4cbe58d9-39c7-4907-b8bd-151425335a76 req-cfa9df7b-3b8e-4d37-814d-f4842820d64e service nova] Acquiring lock "refresh_cache-fcbb998c-2dac-47d9-985a-d5b2a15ddaa0" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:41:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-4cbe58d9-39c7-4907-b8bd-151425335a76 req-cfa9df7b-3b8e-4d37-814d-f4842820d64e service nova] Acquired lock "refresh_cache-fcbb998c-2dac-47d9-985a-d5b2a15ddaa0" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:41:38 user nova-compute[70924]: DEBUG nova.network.neutron [req-4cbe58d9-39c7-4907-b8bd-151425335a76 req-cfa9df7b-3b8e-4d37-814d-f4842820d64e service nova] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Refreshing network info cache for port ef43604c-04b6-43b1-83c3-324102987873 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:41:38 user nova-compute[70924]: DEBUG nova.compute.manager [req-50ac0ab8-63fa-4f67-aac2-aab25a4a40d8 req-7563495b-de67-4683-bec3-663a21288375 service nova] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Received event network-vif-plugged-ef43604c-04b6-43b1-83c3-324102987873 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:41:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-50ac0ab8-63fa-4f67-aac2-aab25a4a40d8 req-7563495b-de67-4683-bec3-663a21288375 service nova] Acquiring lock "fcbb998c-2dac-47d9-985a-d5b2a15ddaa0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:41:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-50ac0ab8-63fa-4f67-aac2-aab25a4a40d8 req-7563495b-de67-4683-bec3-663a21288375 service nova] Lock "fcbb998c-2dac-47d9-985a-d5b2a15ddaa0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:41:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-50ac0ab8-63fa-4f67-aac2-aab25a4a40d8 req-7563495b-de67-4683-bec3-663a21288375 service nova] Lock "fcbb998c-2dac-47d9-985a-d5b2a15ddaa0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:41:38 user nova-compute[70924]: DEBUG nova.compute.manager [req-50ac0ab8-63fa-4f67-aac2-aab25a4a40d8 req-7563495b-de67-4683-bec3-663a21288375 service nova] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] No waiting events found dispatching network-vif-plugged-ef43604c-04b6-43b1-83c3-324102987873 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:41:38 user nova-compute[70924]: WARNING nova.compute.manager [req-50ac0ab8-63fa-4f67-aac2-aab25a4a40d8 req-7563495b-de67-4683-bec3-663a21288375 service nova] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Received unexpected event network-vif-plugged-ef43604c-04b6-43b1-83c3-324102987873 for instance with vm_state building and task_state spawning.
Jul 29 14:41:38 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:41:38 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Cleaning up deleted instances {{(pid=70924) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 29 14:41:38 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] There are 0 instances to clean {{(pid=70924) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 29 14:41:38 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:41:38 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Cleaning up deleted instances with incomplete migration  {{(pid=70924) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 29 14:41:38 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:41:38 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:38 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:38 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:38 user nova-compute[70924]: DEBUG nova.network.neutron [req-4cbe58d9-39c7-4907-b8bd-151425335a76 req-cfa9df7b-3b8e-4d37-814d-f4842820d64e service nova] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Updated VIF entry in instance network info cache for port ef43604c-04b6-43b1-83c3-324102987873. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:41:38 user nova-compute[70924]: DEBUG nova.network.neutron [req-4cbe58d9-39c7-4907-b8bd-151425335a76 req-cfa9df7b-3b8e-4d37-814d-f4842820d64e service nova] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Updating instance_info_cache with network_info: [{"id": "ef43604c-04b6-43b1-83c3-324102987873", "address": "fa:16:3e:92:af:8a", "network": {"id": "6c9a59aa-27fd-4da3-b686-bafa34c4d807", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1260570280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7350cca282f7405f9f232110869df140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef43604c-04", "ovs_interfaceid": "ef43604c-04b6-43b1-83c3-324102987873", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:41:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-4cbe58d9-39c7-4907-b8bd-151425335a76 req-cfa9df7b-3b8e-4d37-814d-f4842820d64e service nova] Releasing lock "refresh_cache-fcbb998c-2dac-47d9-985a-d5b2a15ddaa0" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:41:40 user nova-compute[70924]: DEBUG nova.compute.manager [req-7fa65253-0dbb-4fa6-ab71-10c02d025e41 req-00c78cb0-03f5-48c3-adb4-24dc4128fd64 service nova] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Received event network-vif-plugged-ef43604c-04b6-43b1-83c3-324102987873 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:41:40 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-7fa65253-0dbb-4fa6-ab71-10c02d025e41 req-00c78cb0-03f5-48c3-adb4-24dc4128fd64 service nova] Acquiring lock "fcbb998c-2dac-47d9-985a-d5b2a15ddaa0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:41:40 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-7fa65253-0dbb-4fa6-ab71-10c02d025e41 req-00c78cb0-03f5-48c3-adb4-24dc4128fd64 service nova] Lock "fcbb998c-2dac-47d9-985a-d5b2a15ddaa0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:41:40 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-7fa65253-0dbb-4fa6-ab71-10c02d025e41 req-00c78cb0-03f5-48c3-adb4-24dc4128fd64 service nova] Lock "fcbb998c-2dac-47d9-985a-d5b2a15ddaa0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:41:40 user nova-compute[70924]: DEBUG nova.compute.manager [req-7fa65253-0dbb-4fa6-ab71-10c02d025e41 req-00c78cb0-03f5-48c3-adb4-24dc4128fd64 service nova] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] No waiting events found dispatching network-vif-plugged-ef43604c-04b6-43b1-83c3-324102987873 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:41:40 user nova-compute[70924]: WARNING nova.compute.manager [req-7fa65253-0dbb-4fa6-ab71-10c02d025e41 req-00c78cb0-03f5-48c3-adb4-24dc4128fd64 service nova] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Received unexpected event network-vif-plugged-ef43604c-04b6-43b1-83c3-324102987873 for instance with vm_state building and task_state spawning.
Jul 29 14:41:40 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:41:40 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:41:40 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:41:40 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:41:40 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Auditing locally available compute resources for user (node: user) {{(pid=70924) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 14:41:40 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690641700.7902482, fcbb998c-2dac-47d9-985a-d5b2a15ddaa0 => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:41:40 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] VM Resumed (Lifecycle Event)
Jul 29 14:41:40 user nova-compute[70924]: DEBUG nova.compute.manager [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Instance event wait completed in 0 seconds for  {{(pid=70924) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 14:41:40 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Guest created on hypervisor {{(pid=70924) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 14:41:40 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Instance spawned successfully.
Jul 29 14:41:40 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 14:41:40 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:41:40 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:41:40 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:41:40 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Found default for hw_cdrom_bus of ide {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:41:40 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Found default for hw_disk_bus of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:41:40 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Found default for hw_input_bus of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:41:40 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Found default for hw_pointer_model of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:41:40 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Found default for hw_video_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:41:40 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Found default for hw_vif_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:41:40 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:41:40 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690641700.7905016, fcbb998c-2dac-47d9-985a-d5b2a15ddaa0 => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:41:40 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] VM Started (Lifecycle Event)
Jul 29 14:41:40 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:41:40 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:41:41 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:41:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:41:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:41:41 user nova-compute[70924]: INFO nova.compute.manager [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Took 8.45 seconds to spawn the instance on the hypervisor.
Jul 29 14:41:41 user nova-compute[70924]: DEBUG nova.compute.manager [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:41:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:41:41 user nova-compute[70924]: INFO nova.compute.manager [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Took 10.15 seconds to build instance.
Jul 29 14:41:41 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-57b3e9c2-d642-483a-bbd1-56159dce255c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Lock "fcbb998c-2dac-47d9-985a-d5b2a15ddaa0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.348s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:41:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ea2e4b1-5b93-42bf-b29d-ce6986135826/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:41:41 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ea2e4b1-5b93-42bf-b29d-ce6986135826/disk --force-share --output=json" returned: 0 in 0.306s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:41:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ea2e4b1-5b93-42bf-b29d-ce6986135826/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:41:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ea2e4b1-5b93-42bf-b29d-ce6986135826/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:41:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcbb998c-2dac-47d9-985a-d5b2a15ddaa0/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:41:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcbb998c-2dac-47d9-985a-d5b2a15ddaa0/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:41:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcbb998c-2dac-47d9-985a-d5b2a15ddaa0/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:41:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcbb998c-2dac-47d9-985a-d5b2a15ddaa0/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:41:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:41:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:41:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:41:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:41:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7776982-40ea-4b06-b853-cfd484efba73/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:41:42 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:43 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7776982-40ea-4b06-b853-cfd484efba73/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:41:43 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7776982-40ea-4b06-b853-cfd484efba73/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:41:43 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7776982-40ea-4b06-b853-cfd484efba73/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:41:43 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5929dcf-8594-4323-a6f5-a322aff7c881/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:41:43 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5929dcf-8594-4323-a6f5-a322aff7c881/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:41:43 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5929dcf-8594-4323-a6f5-a322aff7c881/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:41:43 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5929dcf-8594-4323-a6f5-a322aff7c881/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:41:43 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00231136-233f-4a1b-88ff-b678482ca5bb/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:41:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00231136-233f-4a1b-88ff-b678482ca5bb/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:41:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00231136-233f-4a1b-88ff-b678482ca5bb/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:41:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00231136-233f-4a1b-88ff-b678482ca5bb/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:41:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2250b0d6-5542-4a7f-90a9-93745a776fcc/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:41:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2250b0d6-5542-4a7f-90a9-93745a776fcc/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:41:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2250b0d6-5542-4a7f-90a9-93745a776fcc/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:41:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2250b0d6-5542-4a7f-90a9-93745a776fcc/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:41:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9549556-e9a7-4782-ade4-9d397d5323d0/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:41:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9549556-e9a7-4782-ade4-9d397d5323d0/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:41:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9549556-e9a7-4782-ade4-9d397d5323d0/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:41:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9549556-e9a7-4782-ade4-9d397d5323d0/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:41:45 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:41:45 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:41:45 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Hypervisor/Node resource view: name=user free_ram=7652MB free_disk=25.835052490234375GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=70924) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 14:41:45 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:41:45 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:41:45 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance db656346-c4af-43da-9600-fd39f1b9e4dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:41:45 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance c7776982-40ea-4b06-b853-cfd484efba73 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:41:45 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 2250b0d6-5542-4a7f-90a9-93745a776fcc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:41:45 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance f5929dcf-8594-4323-a6f5-a322aff7c881 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:41:45 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 86ecc6cb-88a8-4572-8e41-d4c5859036a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:41:45 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 1ea2e4b1-5b93-42bf-b29d-ce6986135826 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:41:45 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 00231136-233f-4a1b-88ff-b678482ca5bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:41:45 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance a9549556-e9a7-4782-ade4-9d397d5323d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:41:45 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance fcbb998c-2dac-47d9-985a-d5b2a15ddaa0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:41:45 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 14:41:45 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 14:41:46 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:41:46 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:41:46 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:46 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Compute_service record updated for user:user {{(pid=70924) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 14:41:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.916s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:41:47 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:41:47 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:41:47 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Starting heal instance info cache {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 14:41:47 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Rebuilding the list of instances to heal {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 29 14:41:47 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "refresh_cache-db656346-c4af-43da-9600-fd39f1b9e4dc" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:41:47 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquired lock "refresh_cache-db656346-c4af-43da-9600-fd39f1b9e4dc" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:41:47 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Forcefully refreshing network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 29 14:41:47 user nova-compute[70924]: DEBUG nova.objects.instance [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lazy-loading 'info_cache' on Instance uuid db656346-c4af-43da-9600-fd39f1b9e4dc {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:41:47 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:48 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Updating instance_info_cache with network_info: [{"id": "bd091ea0-8c42-4140-aad1-617f27d2a469", "address": "fa:16:3e:53:1d:70", "network": {"id": "d5876e18-e2af-45c2-aab5-2d0d552ebfe4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2035085552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9e5c78c1684c359cfab4e32b9c213f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd091ea0-8c", "ovs_interfaceid": "bd091ea0-8c42-4140-aad1-617f27d2a469", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:41:48 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Releasing lock "refresh_cache-db656346-c4af-43da-9600-fd39f1b9e4dc" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:41:48 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Updated the network info_cache for instance {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 29 14:41:48 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:41:48 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:41:48 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:41:48 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:41:48 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:41:48 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:41:48 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70924) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 14:41:51 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:52 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:56 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:41:57 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:01 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:02 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:07 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Acquiring lock "7d71c003-6ad9-495f-ac65-083f07d65201" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:42:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Lock "7d71c003-6ad9-495f-ac65-083f07d65201" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:42:10 user nova-compute[70924]: DEBUG nova.compute.manager [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Starting instance... {{(pid=70924) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 14:42:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:42:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:42:10 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70924) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 14:42:10 user nova-compute[70924]: INFO nova.compute.claims [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Claim successful on node user
Jul 29 14:42:10 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Refreshing inventories for resource provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 29 14:42:10 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Updating ProviderTree inventory for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 29 14:42:10 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Updating inventory in ProviderTree for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 29 14:42:10 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Refreshing aggregate associations for resource provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832, aggregates: None {{(pid=70924) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 29 14:42:10 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Refreshing trait associations for resource provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832, traits: COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=70924) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 29 14:42:11 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:42:11 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:42:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.556s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:42:11 user nova-compute[70924]: DEBUG nova.compute.manager [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Start building networks asynchronously for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 14:42:11 user nova-compute[70924]: DEBUG nova.compute.manager [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Allocating IP information in the background. {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 14:42:11 user nova-compute[70924]: DEBUG nova.network.neutron [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] allocate_for_instance() {{(pid=70924) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 14:42:11 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 14:42:11 user nova-compute[70924]: DEBUG nova.compute.manager [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Start building block device mappings for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 14:42:11 user nova-compute[70924]: INFO nova.virt.block_device [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Booting with volume c7edd99e-2313-40f4-a3aa-fcab98453541 at /dev/vda
Jul 29 14:42:11 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:11 user nova-compute[70924]: DEBUG nova.policy [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0b4c56eb2047426f8e9d31f9221c49b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce898102e394a1e8458ffd6635acbd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70924) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 14:42:11 user nova-compute[70924]: DEBUG os_brick.utils [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:42:11 user nova-compute[70924]: INFO oslo.privsep.daemon [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpwzctyp7f/privsep.sock']
Jul 29 14:42:11 user sudo[81993]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpwzctyp7f/privsep.sock
Jul 29 14:42:11 user sudo[81993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Jul 29 14:42:12 user nova-compute[70924]: DEBUG nova.network.neutron [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Successfully created port: be358bcd-08a6-445b-afea-9b3335a8cac1 {{(pid=70924) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 14:42:12 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:12 user nova-compute[70924]: DEBUG nova.network.neutron [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Successfully created port: 514c7198-3395-4795-93a8-60ea475f119b {{(pid=70924) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 14:42:13 user sudo[81993]: pam_unix(sudo:session): session closed for user root
Jul 29 14:42:13 user nova-compute[70924]: INFO oslo.privsep.daemon [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Spawned new privsep daemon via rootwrap
Jul 29 14:42:13 user nova-compute[70924]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 29 14:42:13 user nova-compute[70924]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 29 14:42:13 user nova-compute[70924]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Jul 29 14:42:13 user nova-compute[70924]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 81998
Jul 29 14:42:13 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c846577-75bc-4f24-9cbb-b33704912c53]: (2,) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:42:13 user nova-compute[70924]: DEBUG nova.network.neutron [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Successfully created port: 58e714a9-1fc7-4211-b2b6-f46e985123e8 {{(pid=70924) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 14:42:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:13 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[110df903-10a6-40dc-867e-e406621413f8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f2127c4a30d9\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:42:13 user nova-compute[70924]: WARNING os_brick.initiator.connectors.nvmeof [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Jul 29 14:42:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:13 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9adacde-14e9-4d30-9331-cd636c15f623]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:42:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:13 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f198bcd0-d760-41c7-84cd-564b8e4e3a19]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:42:13 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[48cf8c18-f9f1-4fd2-a1e4-37832435c495]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:42:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Running cmd (subprocess): nvme version {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] 'nvme version' failed. Not Retrying. {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:42:13 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] nvme not present on system {{(pid=70924) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 14:42:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:42:13 user nova-compute[70924]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 14:42:13 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07db6cd-0e0e-4e8e-8592-5311a85dcb77]: (4, '') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:42:13 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70924) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 14:42:13 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 14:42:13 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] LIGHTOS: no hostnqn found. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 14:42:13 user nova-compute[70924]: DEBUG os_brick.utils [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] <== get_connector_properties: return (2006ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f2127c4a30d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:42:13 user nova-compute[70924]: DEBUG nova.virt.block_device [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Updating existing volume attachment record: fc03d6d6-774a-4d82-8efb-c4631f928e0b {{(pid=70924) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 14:42:14 user nova-compute[70924]: DEBUG nova.network.neutron [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Successfully created port: ba4b82c4-18e0-4863-b47a-139f71c45e27 {{(pid=70924) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 14:42:14 user nova-compute[70924]: DEBUG nova.network.neutron [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Successfully created port: ccee8ddb-f771-4238-aebc-0d9ef5eca6a1 {{(pid=70924) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 14:42:15 user nova-compute[70924]: DEBUG nova.network.neutron [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Successfully updated port: be358bcd-08a6-445b-afea-9b3335a8cac1 {{(pid=70924) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 14:42:15 user nova-compute[70924]: DEBUG nova.compute.manager [req-66e73984-6c91-4e5c-823a-8e7030435402 req-8f8137f4-f94e-46c7-8f19-3c3b2beaefee service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Received event network-changed-be358bcd-08a6-445b-afea-9b3335a8cac1 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:42:15 user nova-compute[70924]: DEBUG nova.compute.manager [req-66e73984-6c91-4e5c-823a-8e7030435402 req-8f8137f4-f94e-46c7-8f19-3c3b2beaefee service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Refreshing instance network info cache due to event network-changed-be358bcd-08a6-445b-afea-9b3335a8cac1. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:42:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-66e73984-6c91-4e5c-823a-8e7030435402 req-8f8137f4-f94e-46c7-8f19-3c3b2beaefee service nova] Acquiring lock "refresh_cache-7d71c003-6ad9-495f-ac65-083f07d65201" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:42:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-66e73984-6c91-4e5c-823a-8e7030435402 req-8f8137f4-f94e-46c7-8f19-3c3b2beaefee service nova] Acquired lock "refresh_cache-7d71c003-6ad9-495f-ac65-083f07d65201" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:42:15 user nova-compute[70924]: DEBUG nova.network.neutron [req-66e73984-6c91-4e5c-823a-8e7030435402 req-8f8137f4-f94e-46c7-8f19-3c3b2beaefee service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Refreshing network info cache for port be358bcd-08a6-445b-afea-9b3335a8cac1 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:42:15 user nova-compute[70924]: DEBUG nova.network.neutron [req-66e73984-6c91-4e5c-823a-8e7030435402 req-8f8137f4-f94e-46c7-8f19-3c3b2beaefee service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Instance cache missing network info. {{(pid=70924) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 14:42:16 user nova-compute[70924]: DEBUG nova.network.neutron [req-66e73984-6c91-4e5c-823a-8e7030435402 req-8f8137f4-f94e-46c7-8f19-3c3b2beaefee service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:42:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-66e73984-6c91-4e5c-823a-8e7030435402 req-8f8137f4-f94e-46c7-8f19-3c3b2beaefee service nova] Releasing lock "refresh_cache-7d71c003-6ad9-495f-ac65-083f07d65201" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:42:16 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:16 user nova-compute[70924]: DEBUG nova.network.neutron [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Successfully updated port: b47a2389-92e5-4e93-89d3-ddb36806582f {{(pid=70924) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 14:42:17 user nova-compute[70924]: DEBUG nova.network.neutron [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Successfully updated port: 0baed51f-cbf0-43db-9cbf-53bda0557b4c {{(pid=70924) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 14:42:17 user nova-compute[70924]: DEBUG nova.compute.manager [req-56a11db6-3199-43c9-9822-7fe599cc96f8 req-13b81c0d-b787-4ac6-a4a4-91b5012656c4 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Received event network-changed-b47a2389-92e5-4e93-89d3-ddb36806582f {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:42:17 user nova-compute[70924]: DEBUG nova.compute.manager [req-56a11db6-3199-43c9-9822-7fe599cc96f8 req-13b81c0d-b787-4ac6-a4a4-91b5012656c4 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Refreshing instance network info cache due to event network-changed-b47a2389-92e5-4e93-89d3-ddb36806582f. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:42:17 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-56a11db6-3199-43c9-9822-7fe599cc96f8 req-13b81c0d-b787-4ac6-a4a4-91b5012656c4 service nova] Acquiring lock "refresh_cache-7d71c003-6ad9-495f-ac65-083f07d65201" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:42:17 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-56a11db6-3199-43c9-9822-7fe599cc96f8 req-13b81c0d-b787-4ac6-a4a4-91b5012656c4 service nova] Acquired lock "refresh_cache-7d71c003-6ad9-495f-ac65-083f07d65201" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:42:17 user nova-compute[70924]: DEBUG nova.network.neutron [req-56a11db6-3199-43c9-9822-7fe599cc96f8 req-13b81c0d-b787-4ac6-a4a4-91b5012656c4 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Refreshing network info cache for port b47a2389-92e5-4e93-89d3-ddb36806582f {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:42:17 user nova-compute[70924]: DEBUG nova.network.neutron [req-56a11db6-3199-43c9-9822-7fe599cc96f8 req-13b81c0d-b787-4ac6-a4a4-91b5012656c4 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Instance cache missing network info. {{(pid=70924) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 14:42:18 user nova-compute[70924]: DEBUG nova.network.neutron [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Successfully updated port: 514c7198-3395-4795-93a8-60ea475f119b {{(pid=70924) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 14:42:18 user nova-compute[70924]: DEBUG nova.network.neutron [req-56a11db6-3199-43c9-9822-7fe599cc96f8 req-13b81c0d-b787-4ac6-a4a4-91b5012656c4 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:42:18 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-56a11db6-3199-43c9-9822-7fe599cc96f8 req-13b81c0d-b787-4ac6-a4a4-91b5012656c4 service nova] Releasing lock "refresh_cache-7d71c003-6ad9-495f-ac65-083f07d65201" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:42:18 user nova-compute[70924]: DEBUG nova.compute.manager [req-56a11db6-3199-43c9-9822-7fe599cc96f8 req-13b81c0d-b787-4ac6-a4a4-91b5012656c4 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Received event network-changed-0baed51f-cbf0-43db-9cbf-53bda0557b4c {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:42:18 user nova-compute[70924]: DEBUG nova.compute.manager [req-56a11db6-3199-43c9-9822-7fe599cc96f8 req-13b81c0d-b787-4ac6-a4a4-91b5012656c4 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Refreshing instance network info cache due to event network-changed-0baed51f-cbf0-43db-9cbf-53bda0557b4c. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:42:18 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-56a11db6-3199-43c9-9822-7fe599cc96f8 req-13b81c0d-b787-4ac6-a4a4-91b5012656c4 service nova] Acquiring lock "refresh_cache-7d71c003-6ad9-495f-ac65-083f07d65201" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:42:18 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-56a11db6-3199-43c9-9822-7fe599cc96f8 req-13b81c0d-b787-4ac6-a4a4-91b5012656c4 service nova] Acquired lock "refresh_cache-7d71c003-6ad9-495f-ac65-083f07d65201" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:42:18 user nova-compute[70924]: DEBUG nova.network.neutron [req-56a11db6-3199-43c9-9822-7fe599cc96f8 req-13b81c0d-b787-4ac6-a4a4-91b5012656c4 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Refreshing network info cache for port 0baed51f-cbf0-43db-9cbf-53bda0557b4c {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:42:18 user nova-compute[70924]: DEBUG nova.network.neutron [req-56a11db6-3199-43c9-9822-7fe599cc96f8 req-13b81c0d-b787-4ac6-a4a4-91b5012656c4 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Instance cache missing network info. {{(pid=70924) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 14:42:18 user nova-compute[70924]: DEBUG nova.network.neutron [req-56a11db6-3199-43c9-9822-7fe599cc96f8 req-13b81c0d-b787-4ac6-a4a4-91b5012656c4 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:42:18 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-56a11db6-3199-43c9-9822-7fe599cc96f8 req-13b81c0d-b787-4ac6-a4a4-91b5012656c4 service nova] Releasing lock "refresh_cache-7d71c003-6ad9-495f-ac65-083f07d65201" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:42:18 user nova-compute[70924]: DEBUG nova.network.neutron [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Successfully updated port: 58e714a9-1fc7-4211-b2b6-f46e985123e8 {{(pid=70924) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 14:42:18 user nova-compute[70924]: DEBUG nova.compute.manager [req-c083e775-eb6b-4b06-9a98-a9e9105fa11d req-376e1f41-83e7-41c6-b60a-05c858a59f0d service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Received event network-changed-58e714a9-1fc7-4211-b2b6-f46e985123e8 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:42:18 user nova-compute[70924]: DEBUG nova.compute.manager [req-c083e775-eb6b-4b06-9a98-a9e9105fa11d req-376e1f41-83e7-41c6-b60a-05c858a59f0d service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Refreshing instance network info cache due to event network-changed-58e714a9-1fc7-4211-b2b6-f46e985123e8. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:42:18 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c083e775-eb6b-4b06-9a98-a9e9105fa11d req-376e1f41-83e7-41c6-b60a-05c858a59f0d service nova] Acquiring lock "refresh_cache-7d71c003-6ad9-495f-ac65-083f07d65201" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:42:18 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c083e775-eb6b-4b06-9a98-a9e9105fa11d req-376e1f41-83e7-41c6-b60a-05c858a59f0d service nova] Acquired lock "refresh_cache-7d71c003-6ad9-495f-ac65-083f07d65201" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:42:18 user nova-compute[70924]: DEBUG nova.network.neutron [req-c083e775-eb6b-4b06-9a98-a9e9105fa11d req-376e1f41-83e7-41c6-b60a-05c858a59f0d service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Refreshing network info cache for port 58e714a9-1fc7-4211-b2b6-f46e985123e8 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:42:19 user nova-compute[70924]: DEBUG nova.network.neutron [req-c083e775-eb6b-4b06-9a98-a9e9105fa11d req-376e1f41-83e7-41c6-b60a-05c858a59f0d service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Instance cache missing network info. {{(pid=70924) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 14:42:19 user nova-compute[70924]: DEBUG nova.network.neutron [req-c083e775-eb6b-4b06-9a98-a9e9105fa11d req-376e1f41-83e7-41c6-b60a-05c858a59f0d service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:42:19 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c083e775-eb6b-4b06-9a98-a9e9105fa11d req-376e1f41-83e7-41c6-b60a-05c858a59f0d service nova] Releasing lock "refresh_cache-7d71c003-6ad9-495f-ac65-083f07d65201" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:42:19 user nova-compute[70924]: DEBUG nova.network.neutron [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Successfully updated port: ba4b82c4-18e0-4863-b47a-139f71c45e27 {{(pid=70924) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 14:42:19 user nova-compute[70924]: DEBUG nova.compute.manager [req-1a2f0af8-7f5d-4184-b9c3-c687550fdb8e req-0a6c36c7-ca1e-45ef-bf90-97910585530b service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Received event network-changed-514c7198-3395-4795-93a8-60ea475f119b {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:42:19 user nova-compute[70924]: DEBUG nova.compute.manager [req-1a2f0af8-7f5d-4184-b9c3-c687550fdb8e req-0a6c36c7-ca1e-45ef-bf90-97910585530b service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Refreshing instance network info cache due to event network-changed-514c7198-3395-4795-93a8-60ea475f119b. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:42:19 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-1a2f0af8-7f5d-4184-b9c3-c687550fdb8e req-0a6c36c7-ca1e-45ef-bf90-97910585530b service nova] Acquiring lock "refresh_cache-7d71c003-6ad9-495f-ac65-083f07d65201" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:42:19 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-1a2f0af8-7f5d-4184-b9c3-c687550fdb8e req-0a6c36c7-ca1e-45ef-bf90-97910585530b service nova] Acquired lock "refresh_cache-7d71c003-6ad9-495f-ac65-083f07d65201" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:42:19 user nova-compute[70924]: DEBUG nova.network.neutron [req-1a2f0af8-7f5d-4184-b9c3-c687550fdb8e req-0a6c36c7-ca1e-45ef-bf90-97910585530b service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Refreshing network info cache for port 514c7198-3395-4795-93a8-60ea475f119b {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:42:20 user nova-compute[70924]: DEBUG nova.network.neutron [req-1a2f0af8-7f5d-4184-b9c3-c687550fdb8e req-0a6c36c7-ca1e-45ef-bf90-97910585530b service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Instance cache missing network info. {{(pid=70924) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 14:42:20 user nova-compute[70924]: DEBUG nova.network.neutron [req-1a2f0af8-7f5d-4184-b9c3-c687550fdb8e req-0a6c36c7-ca1e-45ef-bf90-97910585530b service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:42:20 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-1a2f0af8-7f5d-4184-b9c3-c687550fdb8e req-0a6c36c7-ca1e-45ef-bf90-97910585530b service nova] Releasing lock "refresh_cache-7d71c003-6ad9-495f-ac65-083f07d65201" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:42:20 user nova-compute[70924]: DEBUG nova.network.neutron [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Successfully updated port: ccee8ddb-f771-4238-aebc-0d9ef5eca6a1 {{(pid=70924) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 14:42:20 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Acquiring lock "refresh_cache-7d71c003-6ad9-495f-ac65-083f07d65201" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:42:20 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Acquired lock "refresh_cache-7d71c003-6ad9-495f-ac65-083f07d65201" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:42:20 user nova-compute[70924]: DEBUG nova.network.neutron [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 14:42:20 user nova-compute[70924]: DEBUG nova.network.neutron [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Instance cache missing network info. {{(pid=70924) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 14:42:21 user nova-compute[70924]: DEBUG nova.compute.manager [req-fb82219b-587d-46a4-a05c-750a6e8edf86 req-3998da5a-1a17-46d6-9506-39702dc429c0 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Received event network-changed-ba4b82c4-18e0-4863-b47a-139f71c45e27 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:42:21 user nova-compute[70924]: DEBUG nova.compute.manager [req-fb82219b-587d-46a4-a05c-750a6e8edf86 req-3998da5a-1a17-46d6-9506-39702dc429c0 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Refreshing instance network info cache due to event network-changed-ba4b82c4-18e0-4863-b47a-139f71c45e27. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:42:21 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-fb82219b-587d-46a4-a05c-750a6e8edf86 req-3998da5a-1a17-46d6-9506-39702dc429c0 service nova] Acquiring lock "refresh_cache-7d71c003-6ad9-495f-ac65-083f07d65201" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:42:21 user nova-compute[70924]: INFO nova.virt.block_device [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Booting with volume 6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 at /dev/vdb
Jul 29 14:42:21 user nova-compute[70924]: DEBUG os_brick.utils [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:42:21 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:21 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:21 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[867a32c5-4335-47fe-b815-2723f5bd8f66]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f2127c4a30d9\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:42:21 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:21 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:21 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[45bde1f4-921d-42e8-b33a-f4afffcbadb7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:42:21 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:21 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:21 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[95326697-698c-46d8-a57f-a70310cd221c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:42:21 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d39b584d-7490-41e0-82c9-870440a40fe2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:42:21 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Running cmd (subprocess): nvme version {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:21 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] 'nvme version' failed. Not Retrying. {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:42:21 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] nvme not present on system {{(pid=70924) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 14:42:21 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:21 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:42:21 user nova-compute[70924]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 14:42:21 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09cf5db-985e-40df-8812-736db0d3dea8]: (4, '') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:42:21 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70924) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 14:42:21 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 14:42:21 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] LIGHTOS: no hostnqn found. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 14:42:21 user nova-compute[70924]: DEBUG os_brick.utils [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f2127c4a30d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:42:21 user nova-compute[70924]: DEBUG nova.virt.block_device [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Updating existing volume attachment record: 87106ffe-1dbf-40e4-aff6-7caf254f3aaf {{(pid=70924) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 14:42:21 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:23 user nova-compute[70924]: DEBUG nova.network.neutron [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Updating instance_info_cache with network_info: [{"id": "be358bcd-08a6-445b-afea-9b3335a8cac1", "address": "fa:16:3e:57:8e:35", "network": {"id": "7fce894f-cc4f-4e5d-8bc2-c046161b14d8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1405783563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe358bcd-08", "ovs_interfaceid": "be358bcd-08a6-445b-afea-9b3335a8cac1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b47a2389-92e5-4e93-89d3-ddb36806582f", "address": "fa:16:3e:87:c2:cc", "network": {"id": "b18952cf-830d-47b0-920f-467ad6e971f1", "bridge": "br-int", "label": "tempest-device-tagging-net1-724382461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb47a2389-92", "ovs_interfaceid": "b47a2389-92e5-4e93-89d3-ddb36806582f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0baed51f-cbf0-43db-9cbf-53bda0557b4c", "address": "fa:16:3e:fc:ca:c0", "network": {"id": "b18952cf-830d-47b0-920f-467ad6e971f1", "bridge": "br-int", "label": "tempest-device-tagging-net1-724382461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0baed51f-cb", "ovs_interfaceid": "0baed51f-cbf0-43db-9cbf-53bda0557b4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "514c7198-3395-4795-93a8-60ea475f119b", "address": "fa:16:3e:57:7c:0d", "network": {"id": "b18952cf-830d-47b0-920f-467ad6e971f1", "bridge": "br-int", "label": "tempest-device-tagging-net1-724382461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap514c7198-33", "ovs_interfaceid": "514c7198-3395-4795-93a8-60ea475f119b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "58e714a9-1fc7-4211-b2b6-f46e985123e8", "address": "fa:16:3e:63:6b:c0", "network": {"id": "b18952cf-830d-47b0-920f-467ad6e971f1", "bridge": "br-int", "label": "tempest-device-tagging-net1-724382461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58e714a9-1f", "ovs_interfaceid": "58e714a9-1fc7-4211-b2b6-f46e985123e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ba4b82c4-18e0-4863-b47a-139f71c45e27", "address": "fa:16:3e:77:64:39", "network": {"id": "2f6d769a-c90b-4a51-a6a7-93fab40860a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-972817671", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4b82c4-18", "ovs_interfaceid": "ba4b82c4-18e0-4863-b47a-139f71c45e27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ccee8ddb-f771-4238-aebc-0d9ef5eca6a1", "address": "fa:16:3e:76:86:8f", "network": {"id": "2f6d769a-c90b-4a51-a6a7-93fab40860a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-972817671", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccee8ddb-f7", "ovs_interfaceid": "ccee8ddb-f771-4238-aebc-0d9ef5eca6a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:42:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Releasing lock "refresh_cache-7d71c003-6ad9-495f-ac65-083f07d65201" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:42:23 user nova-compute[70924]: DEBUG nova.compute.manager [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Instance network_info: |[{"id": "be358bcd-08a6-445b-afea-9b3335a8cac1", "address": "fa:16:3e:57:8e:35", "network": {"id": "7fce894f-cc4f-4e5d-8bc2-c046161b14d8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1405783563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe358bcd-08", "ovs_interfaceid": "be358bcd-08a6-445b-afea-9b3335a8cac1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b47a2389-92e5-4e93-89d3-ddb36806582f", "address": "fa:16:3e:87:c2:cc", "network": {"id": "b18952cf-830d-47b0-920f-467ad6e971f1", "bridge": "br-int", "label": "tempest-device-tagging-net1-724382461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb47a2389-92", "ovs_interfaceid": "b47a2389-92e5-4e93-89d3-ddb36806582f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0baed51f-cbf0-43db-9cbf-53bda0557b4c", "address": "fa:16:3e:fc:ca:c0", "network": {"id": "b18952cf-830d-47b0-920f-467ad6e971f1", "bridge": "br-int", "label": "tempest-device-tagging-net1-724382461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0baed51f-cb", "ovs_interfaceid": "0baed51f-cbf0-43db-9cbf-53bda0557b4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "514c7198-3395-4795-93a8-60ea475f119b", "address": "fa:16:3e:57:7c:0d", "network": {"id": "b18952cf-830d-47b0-920f-467ad6e971f1", "bridge": "br-int", "label": "tempest-device-tagging-net1-724382461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap514c7198-33", "ovs_interfaceid": "514c7198-3395-4795-93a8-60ea475f119b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "58e714a9-1fc7-4211-b2b6-f46e985123e8", "address": "fa:16:3e:63:6b:c0", "network": {"id": "b18952cf-830d-47b0-920f-467ad6e971f1", "bridge": "br-int", "label": "tempest-device-tagging-net1-724382461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58e714a9-1f", "ovs_interfaceid": "58e714a9-1fc7-4211-b2b6-f46e985123e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ba4b82c4-18e0-4863-b47a-139f71c45e27", "address": "fa:16:3e:77:64:39", "network": {"id": "2f6d769a-c90b-4a51-a6a7-93fab40860a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-972817671", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4b82c4-18", "ovs_interfaceid": "ba4b82c4-18e0-4863-b47a-139f71c45e27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ccee8ddb-f771-4238-aebc-0d9ef5eca6a1", "address": "fa:16:3e:76:86:8f", "network": {"id": "2f6d769a-c90b-4a51-a6a7-93fab40860a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-972817671", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccee8ddb-f7", "ovs_interfaceid": "ccee8ddb-f771-4238-aebc-0d9ef5eca6a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 14:42:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-fb82219b-587d-46a4-a05c-750a6e8edf86 req-3998da5a-1a17-46d6-9506-39702dc429c0 service nova] Acquired lock "refresh_cache-7d71c003-6ad9-495f-ac65-083f07d65201" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:42:23 user nova-compute[70924]: DEBUG nova.network.neutron [req-fb82219b-587d-46a4-a05c-750a6e8edf86 req-3998da5a-1a17-46d6-9506-39702dc429c0 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Refreshing network info cache for port ba4b82c4-18e0-4863-b47a-139f71c45e27 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:42:23 user nova-compute[70924]: DEBUG nova.network.neutron [req-fb82219b-587d-46a4-a05c-750a6e8edf86 req-3998da5a-1a17-46d6-9506-39702dc429c0 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Updated VIF entry in instance network info cache for port ba4b82c4-18e0-4863-b47a-139f71c45e27. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:42:23 user nova-compute[70924]: DEBUG nova.network.neutron [req-fb82219b-587d-46a4-a05c-750a6e8edf86 req-3998da5a-1a17-46d6-9506-39702dc429c0 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Updating instance_info_cache with network_info: [{"id": "be358bcd-08a6-445b-afea-9b3335a8cac1", "address": "fa:16:3e:57:8e:35", "network": {"id": "7fce894f-cc4f-4e5d-8bc2-c046161b14d8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1405783563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe358bcd-08", "ovs_interfaceid": "be358bcd-08a6-445b-afea-9b3335a8cac1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b47a2389-92e5-4e93-89d3-ddb36806582f", "address": "fa:16:3e:87:c2:cc", "network": {"id": "b18952cf-830d-47b0-920f-467ad6e971f1", "bridge": "br-int", "label": "tempest-device-tagging-net1-724382461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb47a2389-92", "ovs_interfaceid": "b47a2389-92e5-4e93-89d3-ddb36806582f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0baed51f-cbf0-43db-9cbf-53bda0557b4c", "address": "fa:16:3e:fc:ca:c0", "network": {"id": "b18952cf-830d-47b0-920f-467ad6e971f1", "bridge": "br-int", "label": "tempest-device-tagging-net1-724382461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0baed51f-cb", "ovs_interfaceid": "0baed51f-cbf0-43db-9cbf-53bda0557b4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "514c7198-3395-4795-93a8-60ea475f119b", "address": "fa:16:3e:57:7c:0d", "network": {"id": "b18952cf-830d-47b0-920f-467ad6e971f1", "bridge": "br-int", "label": "tempest-device-tagging-net1-724382461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap514c7198-33", "ovs_interfaceid": "514c7198-3395-4795-93a8-60ea475f119b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "58e714a9-1fc7-4211-b2b6-f46e985123e8", "address": "fa:16:3e:63:6b:c0", "network": {"id": "b18952cf-830d-47b0-920f-467ad6e971f1", "bridge": "br-int", "label": "tempest-device-tagging-net1-724382461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58e714a9-1f", "ovs_interfaceid": "58e714a9-1fc7-4211-b2b6-f46e985123e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ba4b82c4-18e0-4863-b47a-139f71c45e27", "address": "fa:16:3e:77:64:39", "network": {"id": "2f6d769a-c90b-4a51-a6a7-93fab40860a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-972817671", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4b82c4-18", "ovs_interfaceid": "ba4b82c4-18e0-4863-b47a-139f71c45e27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ccee8ddb-f771-4238-aebc-0d9ef5eca6a1", "address": "fa:16:3e:76:86:8f", "network": {"id": "2f6d769a-c90b-4a51-a6a7-93fab40860a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-972817671", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccee8ddb-f7", "ovs_interfaceid": "ccee8ddb-f771-4238-aebc-0d9ef5eca6a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:42:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-fb82219b-587d-46a4-a05c-750a6e8edf86 req-3998da5a-1a17-46d6-9506-39702dc429c0 service nova] Releasing lock "refresh_cache-7d71c003-6ad9-495f-ac65-083f07d65201" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:42:23 user nova-compute[70924]: DEBUG nova.compute.manager [req-fb82219b-587d-46a4-a05c-750a6e8edf86 req-3998da5a-1a17-46d6-9506-39702dc429c0 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Received event network-changed-ccee8ddb-f771-4238-aebc-0d9ef5eca6a1 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:42:23 user nova-compute[70924]: DEBUG nova.compute.manager [req-fb82219b-587d-46a4-a05c-750a6e8edf86 req-3998da5a-1a17-46d6-9506-39702dc429c0 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Refreshing instance network info cache due to event network-changed-ccee8ddb-f771-4238-aebc-0d9ef5eca6a1. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:42:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-fb82219b-587d-46a4-a05c-750a6e8edf86 req-3998da5a-1a17-46d6-9506-39702dc429c0 service nova] Acquiring lock "refresh_cache-7d71c003-6ad9-495f-ac65-083f07d65201" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:42:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-fb82219b-587d-46a4-a05c-750a6e8edf86 req-3998da5a-1a17-46d6-9506-39702dc429c0 service nova] Acquired lock "refresh_cache-7d71c003-6ad9-495f-ac65-083f07d65201" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:42:23 user nova-compute[70924]: DEBUG nova.network.neutron [req-fb82219b-587d-46a4-a05c-750a6e8edf86 req-3998da5a-1a17-46d6-9506-39702dc429c0 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Refreshing network info cache for port ccee8ddb-f771-4238-aebc-0d9ef5eca6a1 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:42:24 user nova-compute[70924]: DEBUG nova.network.neutron [req-fb82219b-587d-46a4-a05c-750a6e8edf86 req-3998da5a-1a17-46d6-9506-39702dc429c0 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Updated VIF entry in instance network info cache for port ccee8ddb-f771-4238-aebc-0d9ef5eca6a1. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:42:24 user nova-compute[70924]: DEBUG nova.network.neutron [req-fb82219b-587d-46a4-a05c-750a6e8edf86 req-3998da5a-1a17-46d6-9506-39702dc429c0 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Updating instance_info_cache with network_info: [{"id": "be358bcd-08a6-445b-afea-9b3335a8cac1", "address": "fa:16:3e:57:8e:35", "network": {"id": "7fce894f-cc4f-4e5d-8bc2-c046161b14d8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1405783563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe358bcd-08", "ovs_interfaceid": "be358bcd-08a6-445b-afea-9b3335a8cac1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b47a2389-92e5-4e93-89d3-ddb36806582f", "address": "fa:16:3e:87:c2:cc", "network": {"id": "b18952cf-830d-47b0-920f-467ad6e971f1", "bridge": "br-int", "label": "tempest-device-tagging-net1-724382461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb47a2389-92", "ovs_interfaceid": "b47a2389-92e5-4e93-89d3-ddb36806582f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0baed51f-cbf0-43db-9cbf-53bda0557b4c", "address": "fa:16:3e:fc:ca:c0", "network": {"id": "b18952cf-830d-47b0-920f-467ad6e971f1", "bridge": "br-int", "label": "tempest-device-tagging-net1-724382461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0baed51f-cb", "ovs_interfaceid": "0baed51f-cbf0-43db-9cbf-53bda0557b4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "514c7198-3395-4795-93a8-60ea475f119b", "address": "fa:16:3e:57:7c:0d", "network": {"id": "b18952cf-830d-47b0-920f-467ad6e971f1", "bridge": "br-int", "label": "tempest-device-tagging-net1-724382461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap514c7198-33", "ovs_interfaceid": "514c7198-3395-4795-93a8-60ea475f119b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "58e714a9-1fc7-4211-b2b6-f46e985123e8", "address": "fa:16:3e:63:6b:c0", "network": {"id": "b18952cf-830d-47b0-920f-467ad6e971f1", "bridge": "br-int", "label": "tempest-device-tagging-net1-724382461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58e714a9-1f", "ovs_interfaceid": "58e714a9-1fc7-4211-b2b6-f46e985123e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ba4b82c4-18e0-4863-b47a-139f71c45e27", "address": "fa:16:3e:77:64:39", "network": {"id": "2f6d769a-c90b-4a51-a6a7-93fab40860a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-972817671", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4b82c4-18", "ovs_interfaceid": "ba4b82c4-18e0-4863-b47a-139f71c45e27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ccee8ddb-f771-4238-aebc-0d9ef5eca6a1", "address": "fa:16:3e:76:86:8f", "network": {"id": "2f6d769a-c90b-4a51-a6a7-93fab40860a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-972817671", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccee8ddb-f7", "ovs_interfaceid": "ccee8ddb-f771-4238-aebc-0d9ef5eca6a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:42:24 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-fb82219b-587d-46a4-a05c-750a6e8edf86 req-3998da5a-1a17-46d6-9506-39702dc429c0 service nova] Releasing lock "refresh_cache-7d71c003-6ad9-495f-ac65-083f07d65201" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:42:26 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:28 user nova-compute[70924]: INFO nova.virt.block_device [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Booting with volume 0c50b760-62ce-4a33-b930-6421814feeac at /dev/vdc
Jul 29 14:42:28 user nova-compute[70924]: DEBUG os_brick.utils [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:42:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:28 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[378dccfa-f131-482f-af37-65236e969c90]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f2127c4a30d9\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:42:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:28 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb181605-9aa3-4313-8637-658a74754213]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:42:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:29 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e01be9-d442-45c0-be7f-464c7830496a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:42:29 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[8917cad8-be6f-485a-8fa0-4d8506c18ff8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:42:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Running cmd (subprocess): nvme version {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] 'nvme version' failed. Not Retrying. {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:42:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] nvme not present on system {{(pid=70924) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 14:42:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:42:29 user nova-compute[70924]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 14:42:29 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[283c4b93-898b-490d-bb97-125d7aaf45c5]: (4, '') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:42:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70924) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 14:42:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 14:42:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] LIGHTOS: no hostnqn found. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 14:42:29 user nova-compute[70924]: DEBUG os_brick.utils [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f2127c4a30d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:42:29 user nova-compute[70924]: DEBUG nova.virt.block_device [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Updating existing volume attachment record: b3646a40-7f13-4936-ab9b-a9c1c83de1d6 {{(pid=70924) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 14:42:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:42:36 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:42:38 user nova-compute[70924]: DEBUG nova.compute.manager [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Start spawning the instance on the hypervisor. {{(pid=70924) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 14:42:38 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Creating instance directory {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 14:42:38 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Creating image(s)
Jul 29 14:42:38 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Did not create local disks {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 29 14:42:38 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Ensure instance console log exists: /opt/stack/data/nova/instances/7d71c003-6ad9-495f-ac65-083f07d65201/console.log {{(pid=70924) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 14:42:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:42:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:42:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:42:38 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Start _get_guest_xml network_info=[{"id": "be358bcd-08a6-445b-afea-9b3335a8cac1", "address": "fa:16:3e:57:8e:35", "network": {"id": "7fce894f-cc4f-4e5d-8bc2-c046161b14d8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1405783563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe358bcd-08", "ovs_interfaceid": "be358bcd-08a6-445b-afea-9b3335a8cac1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b47a2389-92e5-4e93-89d3-ddb36806582f", "address": "fa:16:3e:87:c2:cc", "network": {"id": "b18952cf-830d-47b0-920f-467ad6e971f1", "bridge": "br-int", "label": "tempest-device-tagging-net1-724382461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb47a2389-92", "ovs_interfaceid": "b47a2389-92e5-4e93-89d3-ddb36806582f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0baed51f-cbf0-43db-9cbf-53bda0557b4c", "address": "fa:16:3e:fc:ca:c0", "network": {"id": "b18952cf-830d-47b0-920f-467ad6e971f1", "bridge": "br-int", "label": "tempest-device-tagging-net1-724382461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0baed51f-cb", "ovs_interfaceid": "0baed51f-cbf0-43db-9cbf-53bda0557b4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "514c7198-3395-4795-93a8-60ea475f119b", "address": "fa:16:3e:57:7c:0d", "network": {"id": "b18952cf-830d-47b0-920f-467ad6e971f1", "bridge": "br-int", "label": "tempest-device-tagging-net1-724382461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap514c7198-33", "ovs_interfaceid": "514c7198-3395-4795-93a8-60ea475f119b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "58e714a9-1fc7-4211-b2b6-f46e985123e8", "address": "fa:16:3e:63:6b:c0", "network": {"id": "b18952cf-830d-47b0-920f-467ad6e971f1", "bridge": "br-int", "label": "tempest-device-tagging-net1-724382461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58e714a9-1f", "ovs_interfaceid": "58e714a9-1fc7-4211-b2b6-f46e985123e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ba4b82c4-18e0-4863-b47a-139f71c45e27", "address": "fa:16:3e:77:64:39", "network": {"id": "2f6d769a-c90b-4a51-a6a7-93fab40860a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-972817671", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4b82c4-18", "ovs_interfaceid": "ba4b82c4-18e0-4863-b47a-139f71c45e27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ccee8ddb-f771-4238-aebc-0d9ef5eca6a1", "address": "fa:16:3e:76:86:8f", "network": {"id": "2f6d769a-c90b-4a51-a6a7-93fab40860a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-972817671", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccee8ddb-f7", "ovs_interfaceid": "ccee8ddb-f771-4238-aebc-0d9ef5eca6a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FWyUOZqc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7d71c003-6ad9-495f-ac65-083f07d65201', 'attached_at': '', 'detached_at': '', 'volume_id': 'c7edd99e-2313-40f4-a3aa-fcab98453541', 'serial': 'c7edd99e-2313-40f4-a3aa-fcab98453541'}, 'attachment_id': 'fc03d6d6-774a-4d82-8efb-c4631f928e0b', 'volume_type': None}, {'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'boot_index': 1, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WwczfotS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7d71c003-6ad9-495f-ac65-083f07d65201', 'attached_at': '', 'detached_at': '', 'volume_id': '6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6', 'serial': '6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6'}, 'attachment_id': '87106ffe-1dbf-40e4-aff6-7caf254f3aaf', 'volume_type': None}, {'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdc', 'boot_index': 2, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jNaxkriI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7d71c003-6ad9-495f-ac65-083f07d65201', 'attached_at': '', 'detached_at': '', 'volume_id': '0c50b760-62ce-4a33-b930-6421814feeac', 'serial': '0c50b760-62ce-4a33-b930-6421814feeac'}, 'attachment_id': 'b3646a40-7f13-4936-ab9b-a9c1c83de1d6', 'volume_type': None} {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 14:42:38 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:42:38 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:42:38 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 14:42:38 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] CPU controller missing on host. {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 14:42:38 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 14:42:38 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] CPU controller found on host. {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 14:42:38 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70924) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 14:42:38 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T14:36:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 14:42:38 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Flavor limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 14:42:38 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Image limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 14:42:38 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Flavor pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 14:42:38 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Image pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 14:42:38 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 14:42:38 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 14:42:38 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 14:42:38 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Got 1 possible topologies {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 14:42:38 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 14:42:38 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 14:42:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:42:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:42:38 user nova-compute[70924]: DEBUG os_brick.initiator.connector [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Factory for ISCSI on None {{(pid=70924) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Jul 29 14:42:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:42:38 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Calling os-brick to attach iSCSI Volume {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 14:42:38 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FWyUOZqc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:42:38 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:42:38 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:42:38 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:42:38 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:42:38 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:42:38 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:42:38 user nova-compute[70924]: INFO os_brick.initiator.connectors.iscsi [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 14:42:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 -p 172.16.0.220:3260 {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:38 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6eb63c-d97d-44f4-a6d0-4388c68a5d03]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:42:38 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 14:42:38 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:42:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 -p 172.16.0.220:3260 --interface default --op new {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:38 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef84c11-3bf2-4a2b-ad83-b0c8995c29d2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541] added\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:42:38 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541] added
Jul 29 14:42:38 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:42:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:38 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f2fd57-4145-4a3d-a3cd-c7150e81e792]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:42:38 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:42:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:38 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd14012f-d10e-487b-b6f2-4994d8555d6d]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:42:38 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:42:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FWyUOZqc {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:39 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FWyUOZqc" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:39 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c41a1e4-8f19-486a-9b27-18c769f3826a]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:42:39 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FWyUOZqc'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:42:39 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:39 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:39 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c3cf4c-704b-4b50-b54a-f587faf432c0]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:42:39 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:42:39 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:39 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:39 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0772e88f-ba74-4ff6-90b7-46f6a0c65226]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:42:39 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 29 14:42:39 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:42:39 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 29 14:42:39 user nova-compute[70924]:  {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:42:39 user nova-compute[70924]: WARNING os_brick.initiator.connectors.iscsi [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 29 14:42:39 user nova-compute[70924]: 
Jul 29 14:42:39 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 -p 172.16.0.220:3260 --login {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:39 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:39 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1bfe800-24d9-4e6e-8568-b5dac4bb0859]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:42:39 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541, portal: 172.16.0.220,3260]
Jul 29 14:42:39 user nova-compute[70924]: Login to [iface: default, target: iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541, portal: 172.16.0.220,3260] successful.
Jul 29 14:42:39 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:42:39 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:39 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:39 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dde92e2-c2be-432f-a8bf-54f7592ac743]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:42:39 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:42:39 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:39 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:39 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2206aa51-e5ec-48c0-9924-c6c5cf698fd4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:42:39 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)
Jul 29 14:42:39 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:42:39 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)
Jul 29 14:42:39 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:42:39 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.243s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:42:39 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Connected to 172.16.0.220:3260 {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 14:42:39 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=70924) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 14:42:39 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70924) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 14:42:39 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:39 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:39 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[076f7579-da5f-49de-a080-06242a70af2d]: (4, ('- - 0', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:42:39 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 14:42:39 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FWyUOZqc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 14:42:40 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.273s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:42:40 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] <== connect_volume: return (1275ms) {'type': 'block', 'scsi_wwn': '23963336233353964', 'path': '/dev/sdb'} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:42:40 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963336233353964', 'path': '/dev/sdb'} {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 14:42:40 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Calling os-brick to attach iSCSI Volume {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 14:42:40 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WwczfotS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:42:40 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:42:40 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:42:40 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:42:40 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:42:40 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:42:40 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:42:40 user nova-compute[70924]: INFO os_brick.initiator.connectors.iscsi [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 14:42:40 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 -p 172.16.0.220:3260 {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:40 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:40 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ae0ff3-5d71-40de-ae2e-252ebe515172]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:42:40 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 14:42:40 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:42:40 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 -p 172.16.0.220:3260 --interface default --op new {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:40 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:40 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f85b6e0-82ef-425e-9439-d5857856baaf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6] added\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:42:40 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6] added
Jul 29 14:42:40 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:42:40 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:40 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:40 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b82d8e2-e6de-4def-8f81-12ea640bec48]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:42:40 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:42:40 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:40 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:40 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8a1871-34c2-4897-b0da-1d8ffca98b16]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:42:40 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:42:40 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WwczfotS {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:40 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WwczfotS" returned: 0 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:40 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4910b1-7637-45ec-a1c6-844e0b2c3488]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:42:40 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WwczfotS'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:42:40 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:40 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:40 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9a1205-964d-469a-a86e-eb9ea5d954c9]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:42:40 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:42:40 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:40 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:40 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[187b85f5-2637-40d9-90ee-35b578ce4bd3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:42:40 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)
Jul 29 14:42:40 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:42:40 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)
Jul 29 14:42:40 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:42:40 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 -p 172.16.0.220:3260 --login {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:40 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:42:40 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:42:40 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:42:40 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:42:40 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Auditing locally available compute resources for user (node: user) {{(pid=70924) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 14:42:40 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:40 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5081e06c-282d-4a42-88a8-12554ce32b4c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:42:40 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6, portal: 172.16.0.220,3260]
Jul 29 14:42:40 user nova-compute[70924]: Login to [iface: default, target: iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6, portal: 172.16.0.220,3260] successful.
Jul 29 14:42:40 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:42:40 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:40 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:40 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[996747d7-f4aa-457c-8a20-634c68799a8d]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:42:40 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:42:40 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:40 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:40 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cfbe94f-b853-4fd1-a0fc-1ca1587d7ba6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:42:40 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)
Jul 29 14:42:40 user nova-compute[70924]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)
Jul 29 14:42:40 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:42:40 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)
Jul 29 14:42:40 user nova-compute[70924]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)
Jul 29 14:42:40 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:42:40 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:42:40 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Connected to 172.16.0.220:3260 {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 14:42:40 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=70924) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 14:42:40 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70924) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 14:42:40 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:40 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:40 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0c75d4-3815-430c-a89a-585a1db0f495]: (4, ('- - 0', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:42:40 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 14:42:40 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WwczfotS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 14:42:40 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:40 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:40 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:40 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:40 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ea2e4b1-5b93-42bf-b29d-ce6986135826/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ea2e4b1-5b93-42bf-b29d-ce6986135826/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ea2e4b1-5b93-42bf-b29d-ce6986135826/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ea2e4b1-5b93-42bf-b29d-ce6986135826/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcbb998c-2dac-47d9-985a-d5b2a15ddaa0/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcbb998c-2dac-47d9-985a-d5b2a15ddaa0/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcbb998c-2dac-47d9-985a-d5b2a15ddaa0/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcbb998c-2dac-47d9-985a-d5b2a15ddaa0/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23636373335653431', 'path': '/dev/sdc'} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23636373335653431', 'path': '/dev/sdc'} {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Calling os-brick to attach iSCSI Volume {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jNaxkriI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:42:41 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:42:41 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:42:41 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:42:41 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:42:41 user nova-compute[70924]: INFO os_brick.initiator.connectors.iscsi [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 14:42:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac -p 172.16.0.220:3260 {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba651d8-023c-4982-a067-5d9383c1c8b9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 14:42:41 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac -p 172.16.0.220:3260 --interface default --op new {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa392e53-d9ec-4864-a563-de7ea2a56d71]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac] added\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac] added
Jul 29 14:42:41 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[639334c7-6cb9-425b-a7f7-e5e8602d72a5]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbbbb54b-6182-49d4-b890-83abd42a65df]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jNaxkriI {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jNaxkriI" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c940b4d1-5763-450a-a847-05c48cff8df9]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jNaxkriI'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[583305c7-29a9-4a5b-b7d1-d40ec65e58eb]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7776982-40ea-4b06-b853-cfd484efba73/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f4430a-c4c7-4050-9fa5-1d5554ed8671]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)
Jul 29 14:42:41 user nova-compute[70924]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)
Jul 29 14:42:41 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)
Jul 29 14:42:41 user nova-compute[70924]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)
Jul 29 14:42:41 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac -p 172.16.0.220:3260 --login {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f08522-f3a5-4952-acae-5bf76d5b0aac]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac, portal: 172.16.0.220,3260]
Jul 29 14:42:41 user nova-compute[70924]: Login to [iface: default, target: iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac, portal: 172.16.0.220,3260] successful.
Jul 29 14:42:41 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8591f31-aa5a-4f05-9597-d09a91324254]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7776982-40ea-4b06-b853-cfd484efba73/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7776982-40ea-4b06-b853-cfd484efba73/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d25ae1-fe4a-4e67-a5d1-51fc7dd512c5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)
Jul 29 14:42:41 user nova-compute[70924]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)
Jul 29 14:42:41 user nova-compute[70924]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)
Jul 29 14:42:41 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)
Jul 29 14:42:41 user nova-compute[70924]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)
Jul 29 14:42:41 user nova-compute[70924]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)
Jul 29 14:42:41 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Connected to 172.16.0.220:3260 {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=70924) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70924) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb78557-db17-45b4-aa96-19e65dc8b41f]: (4, ('- - 0', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jNaxkriI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 14:42:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7776982-40ea-4b06-b853-cfd484efba73/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5929dcf-8594-4323-a6f5-a322aff7c881/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5929dcf-8594-4323-a6f5-a322aff7c881/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5929dcf-8594-4323-a6f5-a322aff7c881/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5929dcf-8594-4323-a6f5-a322aff7c881/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00231136-233f-4a1b-88ff-b678482ca5bb/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00231136-233f-4a1b-88ff-b678482ca5bb/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00231136-233f-4a1b-88ff-b678482ca5bb/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:42 user nova-compute[70924]: DEBUG nova.compute.manager [None req-f8f21b21-312f-4a80-8cbc-b0296babd9bc tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:42:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00231136-233f-4a1b-88ff-b678482ca5bb/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2250b0d6-5542-4a7f-90a9-93745a776fcc/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:42 user nova-compute[70924]: INFO nova.compute.manager [None req-f8f21b21-312f-4a80-8cbc-b0296babd9bc tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] instance snapshotting
Jul 29 14:42:42 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-f8f21b21-312f-4a80-8cbc-b0296babd9bc tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Beginning live snapshot process
Jul 29 14:42:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2250b0d6-5542-4a7f-90a9-93745a776fcc/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2250b0d6-5542-4a7f-90a9-93745a776fcc/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:42 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.383s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:42:42 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] <== connect_volume: return (1386ms) {'type': 'block', 'scsi_wwn': '26534323735366438', 'path': '/dev/sdd'} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:42:42 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26534323735366438', 'path': '/dev/sdd'} {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 14:42:42 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T14:42:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-258468828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-258468828',id=10,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8vhOVuXRjbQAFoxoAwoH8wPeKkNky0s/inopZaSY/VBTBt29RwOL3lmSODeTfAsQhH35wSIR4rsbuvFcq0Aiofsb1Txk0TNGyDZnF4CI77vmbpayOZGyAw/mvGvnUY+w==',key_name='tempest-keypair-1728574391',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ce898102e394a1e8458ffd6635acbd3',ramdisk_id='',reservation_id='r-duicp9hg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1259288934',owner_user_name='tempest-TaggedBootDevicesTest-1259288934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:42:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b4c56eb2047426f8e9d31f9221c49b2',uuid=7d71c003-6ad9-495f-ac65-083f07d65201,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be358bcd-08a6-445b-afea-9b3335a8cac1", "address": "fa:16:3e:57:8e:35", "network": {"id": "7fce894f-cc4f-4e5d-8bc2-c046161b14d8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1405783563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe358bcd-08", "ovs_interfaceid": "be358bcd-08a6-445b-afea-9b3335a8cac1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:42:42 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Converting VIF {"id": "be358bcd-08a6-445b-afea-9b3335a8cac1", "address": "fa:16:3e:57:8e:35", "network": {"id": "7fce894f-cc4f-4e5d-8bc2-c046161b14d8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1405783563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe358bcd-08", "ovs_interfaceid": "be358bcd-08a6-445b-afea-9b3335a8cac1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:42:42 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:8e:35,bridge_name='br-int',has_traffic_filtering=True,id=be358bcd-08a6-445b-afea-9b3335a8cac1,network=Network(7fce894f-cc4f-4e5d-8bc2-c046161b14d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe358bcd-08') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:42:42 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T14:42:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-258468828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-258468828',id=10,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8vhOVuXRjbQAFoxoAwoH8wPeKkNky0s/inopZaSY/VBTBt29RwOL3lmSODeTfAsQhH35wSIR4rsbuvFcq0Aiofsb1Txk0TNGyDZnF4CI77vmbpayOZGyAw/mvGvnUY+w==',key_name='tempest-keypair-1728574391',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ce898102e394a1e8458ffd6635acbd3',ramdisk_id='',reservation_id='r-duicp9hg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1259288934',owner_user_name='tempest-TaggedBootDevicesTest-1259288934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:42:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b4c56eb2047426f8e9d31f9221c49b2',uuid=7d71c003-6ad9-495f-ac65-083f07d65201,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b47a2389-92e5-4e93-89d3-ddb36806582f", "address": "fa:16:3e:87:c2:cc", "network": {"id": "b18952cf-830d-47b0-920f-467ad6e971f1", "bridge": "br-int", "label": "tempest-device-tagging-net1-724382461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb47a2389-92", "ovs_interfaceid": "b47a2389-92e5-4e93-89d3-ddb36806582f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:42:42 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Converting VIF {"id": "b47a2389-92e5-4e93-89d3-ddb36806582f", "address": "fa:16:3e:87:c2:cc", "network": {"id": "b18952cf-830d-47b0-920f-467ad6e971f1", "bridge": "br-int", "label": "tempest-device-tagging-net1-724382461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb47a2389-92", "ovs_interfaceid": "b47a2389-92e5-4e93-89d3-ddb36806582f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:42:42 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:c2:cc,bridge_name='br-int',has_traffic_filtering=True,id=b47a2389-92e5-4e93-89d3-ddb36806582f,network=Network(b18952cf-830d-47b0-920f-467ad6e971f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb47a2389-92') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:42:42 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T14:42:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-258468828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-258468828',id=10,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8vhOVuXRjbQAFoxoAwoH8wPeKkNky0s/inopZaSY/VBTBt29RwOL3lmSODeTfAsQhH35wSIR4rsbuvFcq0Aiofsb1Txk0TNGyDZnF4CI77vmbpayOZGyAw/mvGvnUY+w==',key_name='tempest-keypair-1728574391',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ce898102e394a1e8458ffd6635acbd3',ramdisk_id='',reservation_id='r-duicp9hg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1259288934',owner_user_name='tempest-TaggedBootDevicesTest-1259288934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:42:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b4c56eb2047426f8e9d31f9221c49b2',uuid=7d71c003-6ad9-495f-ac65-083f07d65201,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0baed51f-cbf0-43db-9cbf-53bda0557b4c", "address": "fa:16:3e:fc:ca:c0", "network": {"id": "b18952cf-830d-47b0-920f-467ad6e971f1", "bridge": "br-int", "label": "tempest-device-tagging-net1-724382461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0baed51f-cb", "ovs_interfaceid": "0baed51f-cbf0-43db-9cbf-53bda0557b4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:42:42 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Converting VIF {"id": "0baed51f-cbf0-43db-9cbf-53bda0557b4c", "address": "fa:16:3e:fc:ca:c0", "network": {"id": "b18952cf-830d-47b0-920f-467ad6e971f1", "bridge": "br-int", "label": "tempest-device-tagging-net1-724382461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0baed51f-cb", "ovs_interfaceid": "0baed51f-cbf0-43db-9cbf-53bda0557b4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:42:42 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:ca:c0,bridge_name='br-int',has_traffic_filtering=True,id=0baed51f-cbf0-43db-9cbf-53bda0557b4c,network=Network(b18952cf-830d-47b0-920f-467ad6e971f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0baed51f-cb') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:42:42 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T14:42:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-258468828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-258468828',id=10,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8vhOVuXRjbQAFoxoAwoH8wPeKkNky0s/inopZaSY/VBTBt29RwOL3lmSODeTfAsQhH35wSIR4rsbuvFcq0Aiofsb1Txk0TNGyDZnF4CI77vmbpayOZGyAw/mvGvnUY+w==',key_name='tempest-keypair-1728574391',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ce898102e394a1e8458ffd6635acbd3',ramdisk_id='',reservation_id='r-duicp9hg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1259288934',owner_user_name='tempest-TaggedBootDevicesTest-1259288934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:42:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b4c56eb2047426f8e9d31f9221c49b2',uuid=7d71c003-6ad9-495f-ac65-083f07d65201,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "514c7198-3395-4795-93a8-60ea475f119b", "address": "fa:16:3e:57:7c:0d", "network": {"id": "b18952cf-830d-47b0-920f-467ad6e971f1", "bridge": "br-int", "label": "tempest-device-tagging-net1-724382461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap514c7198-33", "ovs_interfaceid": "514c7198-3395-4795-93a8-60ea475f119b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:42:42 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Converting VIF {"id": "514c7198-3395-4795-93a8-60ea475f119b", "address": "fa:16:3e:57:7c:0d", "network": {"id": "b18952cf-830d-47b0-920f-467ad6e971f1", "bridge": "br-int", "label": "tempest-device-tagging-net1-724382461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap514c7198-33", "ovs_interfaceid": "514c7198-3395-4795-93a8-60ea475f119b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:42:42 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:7c:0d,bridge_name='br-int',has_traffic_filtering=True,id=514c7198-3395-4795-93a8-60ea475f119b,network=Network(b18952cf-830d-47b0-920f-467ad6e971f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap514c7198-33') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:42:42 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T14:42:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-258468828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-258468828',id=10,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8vhOVuXRjbQAFoxoAwoH8wPeKkNky0s/inopZaSY/VBTBt29RwOL3lmSODeTfAsQhH35wSIR4rsbuvFcq0Aiofsb1Txk0TNGyDZnF4CI77vmbpayOZGyAw/mvGvnUY+w==',key_name='tempest-keypair-1728574391',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ce898102e394a1e8458ffd6635acbd3',ramdisk_id='',reservation_id='r-duicp9hg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1259288934',owner_user_name='tempest-TaggedBootDevicesTest-1259288934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:42:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b4c56eb2047426f8e9d31f9221c49b2',uuid=7d71c003-6ad9-495f-ac65-083f07d65201,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58e714a9-1fc7-4211-b2b6-f46e985123e8", "address": "fa:16:3e:63:6b:c0", "network": {"id": "b18952cf-830d-47b0-920f-467ad6e971f1", "bridge": "br-int", "label": "tempest-device-tagging-net1-724382461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58e714a9-1f", "ovs_interfaceid": "58e714a9-1fc7-4211-b2b6-f46e985123e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:42:42 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Converting VIF {"id": "58e714a9-1fc7-4211-b2b6-f46e985123e8", "address": "fa:16:3e:63:6b:c0", "network": {"id": "b18952cf-830d-47b0-920f-467ad6e971f1", "bridge": "br-int", "label": "tempest-device-tagging-net1-724382461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58e714a9-1f", "ovs_interfaceid": "58e714a9-1fc7-4211-b2b6-f46e985123e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:42:42 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:6b:c0,bridge_name='br-int',has_traffic_filtering=True,id=58e714a9-1fc7-4211-b2b6-f46e985123e8,network=Network(b18952cf-830d-47b0-920f-467ad6e971f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58e714a9-1f') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:42:42 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T14:42:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-258468828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-258468828',id=10,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8vhOVuXRjbQAFoxoAwoH8wPeKkNky0s/inopZaSY/VBTBt29RwOL3lmSODeTfAsQhH35wSIR4rsbuvFcq0Aiofsb1Txk0TNGyDZnF4CI77vmbpayOZGyAw/mvGvnUY+w==',key_name='tempest-keypair-1728574391',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ce898102e394a1e8458ffd6635acbd3',ramdisk_id='',reservation_id='r-duicp9hg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1259288934',owner_user_name='tempest-TaggedBootDevicesTest-1259288934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:42:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b4c56eb2047426f8e9d31f9221c49b2',uuid=7d71c003-6ad9-495f-ac65-083f07d65201,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba4b82c4-18e0-4863-b47a-139f71c45e27", "address": "fa:16:3e:77:64:39", "network": {"id": "2f6d769a-c90b-4a51-a6a7-93fab40860a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-972817671", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4b82c4-18", "ovs_interfaceid": "ba4b82c4-18e0-4863-b47a-139f71c45e27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:42:42 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Converting VIF {"id": "ba4b82c4-18e0-4863-b47a-139f71c45e27", "address": "fa:16:3e:77:64:39", "network": {"id": "2f6d769a-c90b-4a51-a6a7-93fab40860a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-972817671", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4b82c4-18", "ovs_interfaceid": "ba4b82c4-18e0-4863-b47a-139f71c45e27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:42:42 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:64:39,bridge_name='br-int',has_traffic_filtering=True,id=ba4b82c4-18e0-4863-b47a-139f71c45e27,network=Network(2f6d769a-c90b-4a51-a6a7-93fab40860a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4b82c4-18') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:42:42 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T14:42:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-258468828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-258468828',id=10,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8vhOVuXRjbQAFoxoAwoH8wPeKkNky0s/inopZaSY/VBTBt29RwOL3lmSODeTfAsQhH35wSIR4rsbuvFcq0Aiofsb1Txk0TNGyDZnF4CI77vmbpayOZGyAw/mvGvnUY+w==',key_name='tempest-keypair-1728574391',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ce898102e394a1e8458ffd6635acbd3',ramdisk_id='',reservation_id='r-duicp9hg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1259288934',owner_user_name='tempest-TaggedBootDevicesTest-1259288934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:42:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b4c56eb2047426f8e9d31f9221c49b2',uuid=7d71c003-6ad9-495f-ac65-083f07d65201,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ccee8ddb-f771-4238-aebc-0d9ef5eca6a1", "address": "fa:16:3e:76:86:8f", "network": {"id": "2f6d769a-c90b-4a51-a6a7-93fab40860a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-972817671", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccee8ddb-f7", "ovs_interfaceid": "ccee8ddb-f771-4238-aebc-0d9ef5eca6a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:42:42 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Converting VIF {"id": "ccee8ddb-f771-4238-aebc-0d9ef5eca6a1", "address": "fa:16:3e:76:86:8f", "network": {"id": "2f6d769a-c90b-4a51-a6a7-93fab40860a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-972817671", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccee8ddb-f7", "ovs_interfaceid": "ccee8ddb-f771-4238-aebc-0d9ef5eca6a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:42:42 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:86:8f,bridge_name='br-int',has_traffic_filtering=True,id=ccee8ddb-f771-4238-aebc-0d9ef5eca6a1,network=Network(2f6d769a-c90b-4a51-a6a7-93fab40860a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccee8ddb-f7') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:42:42 user nova-compute[70924]: DEBUG nova.objects.instance [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Lazy-loading 'pci_devices' on Instance uuid 7d71c003-6ad9-495f-ac65-083f07d65201 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:42:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2250b0d6-5542-4a7f-90a9-93745a776fcc/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-f8f21b21-312f-4a80-8cbc-b0296babd9bc tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json -f qcow2 {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] End _get_guest_xml xml=<domain type="kvm">
Jul 29 14:42:43 user nova-compute[70924]:   <uuid>7d71c003-6ad9-495f-ac65-083f07d65201</uuid>
Jul 29 14:42:43 user nova-compute[70924]:   <name>instance-0000000a</name>
Jul 29 14:42:43 user nova-compute[70924]:   <memory>524288</memory>
Jul 29 14:42:43 user nova-compute[70924]:   <vcpu>1</vcpu>
Jul 29 14:42:43 user nova-compute[70924]:   <metadata>
Jul 29 14:42:43 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 14:42:43 user nova-compute[70924]:       <nova:package version="0.0.0"/>
Jul 29 14:42:43 user nova-compute[70924]:       <nova:name>tempest-device-tagging-server-258468828</nova:name>
Jul 29 14:42:43 user nova-compute[70924]:       <nova:creationTime>2023-07-29 14:42:38</nova:creationTime>
Jul 29 14:42:43 user nova-compute[70924]:       <nova:flavor name="m1.tiny">
Jul 29 14:42:43 user nova-compute[70924]:         <nova:memory>512</nova:memory>
Jul 29 14:42:43 user nova-compute[70924]:         <nova:disk>1</nova:disk>
Jul 29 14:42:43 user nova-compute[70924]:         <nova:swap>0</nova:swap>
Jul 29 14:42:43 user nova-compute[70924]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 14:42:43 user nova-compute[70924]:         <nova:vcpus>1</nova:vcpus>
Jul 29 14:42:43 user nova-compute[70924]:       </nova:flavor>
Jul 29 14:42:43 user nova-compute[70924]:       <nova:owner>
Jul 29 14:42:43 user nova-compute[70924]:         <nova:user uuid="0b4c56eb2047426f8e9d31f9221c49b2">tempest-TaggedBootDevicesTest-1259288934-project-member</nova:user>
Jul 29 14:42:43 user nova-compute[70924]:         <nova:project uuid="5ce898102e394a1e8458ffd6635acbd3">tempest-TaggedBootDevicesTest-1259288934</nova:project>
Jul 29 14:42:43 user nova-compute[70924]:       </nova:owner>
Jul 29 14:42:43 user nova-compute[70924]:       <nova:root type="image" uuid="3aba2e73-6832-404b-8bd0-d0503ce82b8c"/>
Jul 29 14:42:43 user nova-compute[70924]:       <nova:ports>
Jul 29 14:42:43 user nova-compute[70924]:         <nova:port uuid="be358bcd-08a6-445b-afea-9b3335a8cac1">
Jul 29 14:42:43 user nova-compute[70924]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 29 14:42:43 user nova-compute[70924]:         </nova:port>
Jul 29 14:42:43 user nova-compute[70924]:         <nova:port uuid="b47a2389-92e5-4e93-89d3-ddb36806582f">
Jul 29 14:42:43 user nova-compute[70924]:           <nova:ip type="fixed" address="10.1.1.158" ipVersion="4"/>
Jul 29 14:42:43 user nova-compute[70924]:         </nova:port>
Jul 29 14:42:43 user nova-compute[70924]:         <nova:port uuid="0baed51f-cbf0-43db-9cbf-53bda0557b4c">
Jul 29 14:42:43 user nova-compute[70924]:           <nova:ip type="fixed" address="10.1.1.203" ipVersion="4"/>
Jul 29 14:42:43 user nova-compute[70924]:         </nova:port>
Jul 29 14:42:43 user nova-compute[70924]:         <nova:port uuid="514c7198-3395-4795-93a8-60ea475f119b">
Jul 29 14:42:43 user nova-compute[70924]:           <nova:ip type="fixed" address="10.1.1.216" ipVersion="4"/>
Jul 29 14:42:43 user nova-compute[70924]:         </nova:port>
Jul 29 14:42:43 user nova-compute[70924]:         <nova:port uuid="58e714a9-1fc7-4211-b2b6-f46e985123e8">
Jul 29 14:42:43 user nova-compute[70924]:           <nova:ip type="fixed" address="10.1.1.234" ipVersion="4"/>
Jul 29 14:42:43 user nova-compute[70924]:         </nova:port>
Jul 29 14:42:43 user nova-compute[70924]:         <nova:port uuid="ba4b82c4-18e0-4863-b47a-139f71c45e27">
Jul 29 14:42:43 user nova-compute[70924]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Jul 29 14:42:43 user nova-compute[70924]:         </nova:port>
Jul 29 14:42:43 user nova-compute[70924]:         <nova:port uuid="ccee8ddb-f771-4238-aebc-0d9ef5eca6a1">
Jul 29 14:42:43 user nova-compute[70924]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Jul 29 14:42:43 user nova-compute[70924]:         </nova:port>
Jul 29 14:42:43 user nova-compute[70924]:       </nova:ports>
Jul 29 14:42:43 user nova-compute[70924]:     </nova:instance>
Jul 29 14:42:43 user nova-compute[70924]:   </metadata>
Jul 29 14:42:43 user nova-compute[70924]:   <sysinfo type="smbios">
Jul 29 14:42:43 user nova-compute[70924]:     <system>
Jul 29 14:42:43 user nova-compute[70924]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 14:42:43 user nova-compute[70924]:       <entry name="product">OpenStack Nova</entry>
Jul 29 14:42:43 user nova-compute[70924]:       <entry name="version">0.0.0</entry>
Jul 29 14:42:43 user nova-compute[70924]:       <entry name="serial">7d71c003-6ad9-495f-ac65-083f07d65201</entry>
Jul 29 14:42:43 user nova-compute[70924]:       <entry name="uuid">7d71c003-6ad9-495f-ac65-083f07d65201</entry>
Jul 29 14:42:43 user nova-compute[70924]:       <entry name="family">Virtual Machine</entry>
Jul 29 14:42:43 user nova-compute[70924]:     </system>
Jul 29 14:42:43 user nova-compute[70924]:   </sysinfo>
Jul 29 14:42:43 user nova-compute[70924]:   <os>
Jul 29 14:42:43 user nova-compute[70924]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 14:42:43 user nova-compute[70924]:     <boot dev="hd"/>
Jul 29 14:42:43 user nova-compute[70924]:     <smbios mode="sysinfo"/>
Jul 29 14:42:43 user nova-compute[70924]:   </os>
Jul 29 14:42:43 user nova-compute[70924]:   <features>
Jul 29 14:42:43 user nova-compute[70924]:     <acpi/>
Jul 29 14:42:43 user nova-compute[70924]:     <apic/>
Jul 29 14:42:43 user nova-compute[70924]:     <vmcoreinfo/>
Jul 29 14:42:43 user nova-compute[70924]:   </features>
Jul 29 14:42:43 user nova-compute[70924]:   <clock offset="utc">
Jul 29 14:42:43 user nova-compute[70924]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 14:42:43 user nova-compute[70924]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 14:42:43 user nova-compute[70924]:     <timer name="hpet" present="no"/>
Jul 29 14:42:43 user nova-compute[70924]:   </clock>
Jul 29 14:42:43 user nova-compute[70924]:   <cpu mode="custom" match="exact">
Jul 29 14:42:43 user nova-compute[70924]:     <model>Nehalem</model>
Jul 29 14:42:43 user nova-compute[70924]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 14:42:43 user nova-compute[70924]:   </cpu>
Jul 29 14:42:43 user nova-compute[70924]:   <devices>
Jul 29 14:42:43 user nova-compute[70924]:     <disk type="file" device="cdrom">
Jul 29 14:42:43 user nova-compute[70924]:       <driver name="qemu" type="raw" cache="none"/>
Jul 29 14:42:43 user nova-compute[70924]:       <source file="/opt/stack/data/nova/instances/7d71c003-6ad9-495f-ac65-083f07d65201/disk.config"/>
Jul 29 14:42:43 user nova-compute[70924]:       <target dev="hda" bus="ide"/>
Jul 29 14:42:43 user nova-compute[70924]:     </disk>
Jul 29 14:42:43 user nova-compute[70924]:     <disk type="block" device="disk">
Jul 29 14:42:43 user nova-compute[70924]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:42:43 user nova-compute[70924]:       <source dev="/dev/sdb"/>
Jul 29 14:42:43 user nova-compute[70924]:       <target dev="vda" bus="virtio"/>
Jul 29 14:42:43 user nova-compute[70924]:       <serial>c7edd99e-2313-40f4-a3aa-fcab98453541</serial>
Jul 29 14:42:43 user nova-compute[70924]:     </disk>
Jul 29 14:42:43 user nova-compute[70924]:     <disk type="block" device="disk">
Jul 29 14:42:43 user nova-compute[70924]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:42:43 user nova-compute[70924]:       <source dev="/dev/sdc"/>
Jul 29 14:42:43 user nova-compute[70924]:       <target dev="vdb" bus="virtio"/>
Jul 29 14:42:43 user nova-compute[70924]:       <serial>6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6</serial>
Jul 29 14:42:43 user nova-compute[70924]:     </disk>
Jul 29 14:42:43 user nova-compute[70924]:     <disk type="block" device="disk">
Jul 29 14:42:43 user nova-compute[70924]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:42:43 user nova-compute[70924]:       <source dev="/dev/sdd"/>
Jul 29 14:42:43 user nova-compute[70924]:       <target dev="vdc" bus="virtio"/>
Jul 29 14:42:43 user nova-compute[70924]:       <serial>0c50b760-62ce-4a33-b930-6421814feeac</serial>
Jul 29 14:42:43 user nova-compute[70924]:     </disk>
Jul 29 14:42:43 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 14:42:43 user nova-compute[70924]:       <mac address="fa:16:3e:57:8e:35"/>
Jul 29 14:42:43 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:42:43 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 14:42:43 user nova-compute[70924]:       <target dev="tapbe358bcd-08"/>
Jul 29 14:42:43 user nova-compute[70924]:     </interface>
Jul 29 14:42:43 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 14:42:43 user nova-compute[70924]:       <mac address="fa:16:3e:87:c2:cc"/>
Jul 29 14:42:43 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:42:43 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 14:42:43 user nova-compute[70924]:       <target dev="tapb47a2389-92"/>
Jul 29 14:42:43 user nova-compute[70924]:     </interface>
Jul 29 14:42:43 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 14:42:43 user nova-compute[70924]:       <mac address="fa:16:3e:fc:ca:c0"/>
Jul 29 14:42:43 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:42:43 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 14:42:43 user nova-compute[70924]:       <target dev="tap0baed51f-cb"/>
Jul 29 14:42:43 user nova-compute[70924]:     </interface>
Jul 29 14:42:43 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 14:42:43 user nova-compute[70924]:       <mac address="fa:16:3e:57:7c:0d"/>
Jul 29 14:42:43 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:42:43 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 14:42:43 user nova-compute[70924]:       <target dev="tap514c7198-33"/>
Jul 29 14:42:43 user nova-compute[70924]:     </interface>
Jul 29 14:42:43 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 14:42:43 user nova-compute[70924]:       <mac address="fa:16:3e:63:6b:c0"/>
Jul 29 14:42:43 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:42:43 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 14:42:43 user nova-compute[70924]:       <target dev="tap58e714a9-1f"/>
Jul 29 14:42:43 user nova-compute[70924]:     </interface>
Jul 29 14:42:43 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 14:42:43 user nova-compute[70924]:       <mac address="fa:16:3e:77:64:39"/>
Jul 29 14:42:43 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:42:43 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 14:42:43 user nova-compute[70924]:       <target dev="tapba4b82c4-18"/>
Jul 29 14:42:43 user nova-compute[70924]:     </interface>
Jul 29 14:42:43 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 14:42:43 user nova-compute[70924]:       <mac address="fa:16:3e:76:86:8f"/>
Jul 29 14:42:43 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:42:43 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 14:42:43 user nova-compute[70924]:       <target dev="tapccee8ddb-f7"/>
Jul 29 14:42:43 user nova-compute[70924]:     </interface>
Jul 29 14:42:43 user nova-compute[70924]:     <serial type="pty">
Jul 29 14:42:43 user nova-compute[70924]:       <log file="/opt/stack/data/nova/instances/7d71c003-6ad9-495f-ac65-083f07d65201/console.log" append="off"/>
Jul 29 14:42:43 user nova-compute[70924]:     </serial>
Jul 29 14:42:43 user nova-compute[70924]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 14:42:43 user nova-compute[70924]:     <video>
Jul 29 14:42:43 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:42:43 user nova-compute[70924]:     </video>
Jul 29 14:42:43 user nova-compute[70924]:     <rng model="virtio">
Jul 29 14:42:43 user nova-compute[70924]:       <backend model="random">/dev/urandom</backend>
Jul 29 14:42:43 user nova-compute[70924]:     </rng>
Jul 29 14:42:43 user nova-compute[70924]:     <controller type="usb" index="0" model="none"/>
Jul 29 14:42:43 user nova-compute[70924]:     <memballoon model="virtio">
Jul 29 14:42:43 user nova-compute[70924]:       <stats period="10"/>
Jul 29 14:42:43 user nova-compute[70924]:     </memballoon>
Jul 29 14:42:43 user nova-compute[70924]:   </devices>
Jul 29 14:42:43 user nova-compute[70924]: </domain>
Jul 29 14:42:43 user nova-compute[70924]:  {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T14:42:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-258468828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-258468828',id=10,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8vhOVuXRjbQAFoxoAwoH8wPeKkNky0s/inopZaSY/VBTBt29RwOL3lmSODeTfAsQhH35wSIR4rsbuvFcq0Aiofsb1Txk0TNGyDZnF4CI77vmbpayOZGyAw/mvGvnUY+w==',key_name='tempest-keypair-1728574391',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ce898102e394a1e8458ffd6635acbd3',ramdisk_id='',reservation_id='r-duicp9hg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1259288934',owner_user_name='tempest-TaggedBootDevicesTest-1259288934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:42:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b4c56eb2047426f8e9d31f9221c49b2',uuid=7d71c003-6ad9-495f-ac65-083f07d65201,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be358bcd-08a6-445b-afea-9b3335a8cac1", "address": "fa:16:3e:57:8e:35", "network": {"id": "7fce894f-cc4f-4e5d-8bc2-c046161b14d8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1405783563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe358bcd-08", "ovs_interfaceid": "be358bcd-08a6-445b-afea-9b3335a8cac1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Converting VIF {"id": "be358bcd-08a6-445b-afea-9b3335a8cac1", "address": "fa:16:3e:57:8e:35", "network": {"id": "7fce894f-cc4f-4e5d-8bc2-c046161b14d8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1405783563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe358bcd-08", "ovs_interfaceid": "be358bcd-08a6-445b-afea-9b3335a8cac1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:8e:35,bridge_name='br-int',has_traffic_filtering=True,id=be358bcd-08a6-445b-afea-9b3335a8cac1,network=Network(7fce894f-cc4f-4e5d-8bc2-c046161b14d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe358bcd-08') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG os_vif [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:8e:35,bridge_name='br-int',has_traffic_filtering=True,id=be358bcd-08a6-445b-afea-9b3335a8cac1,network=Network(7fce894f-cc4f-4e5d-8bc2-c046161b14d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe358bcd-08') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9549556-e9a7-4782-ade4-9d397d5323d0/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbe358bcd-08, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbe358bcd-08, col_values=(('external_ids', {'iface-id': 'be358bcd-08a6-445b-afea-9b3335a8cac1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:8e:35', 'vm-uuid': '7d71c003-6ad9-495f-ac65-083f07d65201'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:43 user nova-compute[70924]: INFO os_vif [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:8e:35,bridge_name='br-int',has_traffic_filtering=True,id=be358bcd-08a6-445b-afea-9b3335a8cac1,network=Network(7fce894f-cc4f-4e5d-8bc2-c046161b14d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe358bcd-08')
Jul 29 14:42:43 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T14:42:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-258468828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-258468828',id=10,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8vhOVuXRjbQAFoxoAwoH8wPeKkNky0s/inopZaSY/VBTBt29RwOL3lmSODeTfAsQhH35wSIR4rsbuvFcq0Aiofsb1Txk0TNGyDZnF4CI77vmbpayOZGyAw/mvGvnUY+w==',key_name='tempest-keypair-1728574391',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ce898102e394a1e8458ffd6635acbd3',ramdisk_id='',reservation_id='r-duicp9hg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1259288934',owner_user_name='tempest-TaggedBootDevicesTest-1259288934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:42:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b4c56eb2047426f8e9d31f9221c49b2',uuid=7d71c003-6ad9-495f-ac65-083f07d65201,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b47a2389-92e5-4e93-89d3-ddb36806582f", "address": "fa:16:3e:87:c2:cc", "network": {"id": "b18952cf-830d-47b0-920f-467ad6e971f1", "bridge": "br-int", "label": "tempest-device-tagging-net1-724382461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb47a2389-92", "ovs_interfaceid": "b47a2389-92e5-4e93-89d3-ddb36806582f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Converting VIF {"id": "b47a2389-92e5-4e93-89d3-ddb36806582f", "address": "fa:16:3e:87:c2:cc", "network": {"id": "b18952cf-830d-47b0-920f-467ad6e971f1", "bridge": "br-int", "label": "tempest-device-tagging-net1-724382461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb47a2389-92", "ovs_interfaceid": "b47a2389-92e5-4e93-89d3-ddb36806582f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:c2:cc,bridge_name='br-int',has_traffic_filtering=True,id=b47a2389-92e5-4e93-89d3-ddb36806582f,network=Network(b18952cf-830d-47b0-920f-467ad6e971f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb47a2389-92') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG os_vif [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:c2:cc,bridge_name='br-int',has_traffic_filtering=True,id=b47a2389-92e5-4e93-89d3-ddb36806582f,network=Network(b18952cf-830d-47b0-920f-467ad6e971f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb47a2389-92') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb47a2389-92, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb47a2389-92, col_values=(('external_ids', {'iface-id': 'b47a2389-92e5-4e93-89d3-ddb36806582f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:c2:cc', 'vm-uuid': '7d71c003-6ad9-495f-ac65-083f07d65201'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-f8f21b21-312f-4a80-8cbc-b0296babd9bc tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json -f qcow2" returned: 0 in 0.154s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-f8f21b21-312f-4a80-8cbc-b0296babd9bc tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json -f qcow2 {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:43 user nova-compute[70924]: INFO os_vif [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:c2:cc,bridge_name='br-int',has_traffic_filtering=True,id=b47a2389-92e5-4e93-89d3-ddb36806582f,network=Network(b18952cf-830d-47b0-920f-467ad6e971f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb47a2389-92')
Jul 29 14:42:43 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T14:42:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-258468828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-258468828',id=10,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8vhOVuXRjbQAFoxoAwoH8wPeKkNky0s/inopZaSY/VBTBt29RwOL3lmSODeTfAsQhH35wSIR4rsbuvFcq0Aiofsb1Txk0TNGyDZnF4CI77vmbpayOZGyAw/mvGvnUY+w==',key_name='tempest-keypair-1728574391',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ce898102e394a1e8458ffd6635acbd3',ramdisk_id='',reservation_id='r-duicp9hg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1259288934',owner_user_name='tempest-TaggedBootDevicesTest-1259288934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:42:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b4c56eb2047426f8e9d31f9221c49b2',uuid=7d71c003-6ad9-495f-ac65-083f07d65201,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0baed51f-cbf0-43db-9cbf-53bda0557b4c", "address": "fa:16:3e:fc:ca:c0", "network": {"id": "b18952cf-830d-47b0-920f-467ad6e971f1", "bridge": "br-int", "label": "tempest-device-tagging-net1-724382461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0baed51f-cb", "ovs_interfaceid": "0baed51f-cbf0-43db-9cbf-53bda0557b4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Converting VIF {"id": "0baed51f-cbf0-43db-9cbf-53bda0557b4c", "address": "fa:16:3e:fc:ca:c0", "network": {"id": "b18952cf-830d-47b0-920f-467ad6e971f1", "bridge": "br-int", "label": "tempest-device-tagging-net1-724382461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0baed51f-cb", "ovs_interfaceid": "0baed51f-cbf0-43db-9cbf-53bda0557b4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:ca:c0,bridge_name='br-int',has_traffic_filtering=True,id=0baed51f-cbf0-43db-9cbf-53bda0557b4c,network=Network(b18952cf-830d-47b0-920f-467ad6e971f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0baed51f-cb') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG os_vif [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:ca:c0,bridge_name='br-int',has_traffic_filtering=True,id=0baed51f-cbf0-43db-9cbf-53bda0557b4c,network=Network(b18952cf-830d-47b0-920f-467ad6e971f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0baed51f-cb') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9549556-e9a7-4782-ade4-9d397d5323d0/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9549556-e9a7-4782-ade4-9d397d5323d0/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0baed51f-cb, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0baed51f-cb, col_values=(('external_ids', {'iface-id': '0baed51f-cbf0-43db-9cbf-53bda0557b4c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:ca:c0', 'vm-uuid': '7d71c003-6ad9-495f-ac65-083f07d65201'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:43 user nova-compute[70924]: INFO os_vif [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:ca:c0,bridge_name='br-int',has_traffic_filtering=True,id=0baed51f-cbf0-43db-9cbf-53bda0557b4c,network=Network(b18952cf-830d-47b0-920f-467ad6e971f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0baed51f-cb')
Jul 29 14:42:43 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T14:42:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-258468828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-258468828',id=10,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8vhOVuXRjbQAFoxoAwoH8wPeKkNky0s/inopZaSY/VBTBt29RwOL3lmSODeTfAsQhH35wSIR4rsbuvFcq0Aiofsb1Txk0TNGyDZnF4CI77vmbpayOZGyAw/mvGvnUY+w==',key_name='tempest-keypair-1728574391',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ce898102e394a1e8458ffd6635acbd3',ramdisk_id='',reservation_id='r-duicp9hg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1259288934',owner_user_name='tempest-TaggedBootDevicesTest-1259288934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:42:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b4c56eb2047426f8e9d31f9221c49b2',uuid=7d71c003-6ad9-495f-ac65-083f07d65201,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "514c7198-3395-4795-93a8-60ea475f119b", "address": "fa:16:3e:57:7c:0d", "network": {"id": "b18952cf-830d-47b0-920f-467ad6e971f1", "bridge": "br-int", "label": "tempest-device-tagging-net1-724382461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap514c7198-33", "ovs_interfaceid": "514c7198-3395-4795-93a8-60ea475f119b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Converting VIF {"id": "514c7198-3395-4795-93a8-60ea475f119b", "address": "fa:16:3e:57:7c:0d", "network": {"id": "b18952cf-830d-47b0-920f-467ad6e971f1", "bridge": "br-int", "label": "tempest-device-tagging-net1-724382461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap514c7198-33", "ovs_interfaceid": "514c7198-3395-4795-93a8-60ea475f119b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:7c:0d,bridge_name='br-int',has_traffic_filtering=True,id=514c7198-3395-4795-93a8-60ea475f119b,network=Network(b18952cf-830d-47b0-920f-467ad6e971f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap514c7198-33') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG os_vif [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:7c:0d,bridge_name='br-int',has_traffic_filtering=True,id=514c7198-3395-4795-93a8-60ea475f119b,network=Network(b18952cf-830d-47b0-920f-467ad6e971f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap514c7198-33') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-f8f21b21-312f-4a80-8cbc-b0296babd9bc tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json -f qcow2" returned: 0 in 0.149s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-f8f21b21-312f-4a80-8cbc-b0296babd9bc tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap514c7198-33, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap514c7198-33, col_values=(('external_ids', {'iface-id': '514c7198-3395-4795-93a8-60ea475f119b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:7c:0d', 'vm-uuid': '7d71c003-6ad9-495f-ac65-083f07d65201'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9549556-e9a7-4782-ade4-9d397d5323d0/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:43 user nova-compute[70924]: INFO os_vif [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:7c:0d,bridge_name='br-int',has_traffic_filtering=True,id=514c7198-3395-4795-93a8-60ea475f119b,network=Network(b18952cf-830d-47b0-920f-467ad6e971f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap514c7198-33')
Jul 29 14:42:43 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T14:42:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-258468828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-258468828',id=10,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8vhOVuXRjbQAFoxoAwoH8wPeKkNky0s/inopZaSY/VBTBt29RwOL3lmSODeTfAsQhH35wSIR4rsbuvFcq0Aiofsb1Txk0TNGyDZnF4CI77vmbpayOZGyAw/mvGvnUY+w==',key_name='tempest-keypair-1728574391',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ce898102e394a1e8458ffd6635acbd3',ramdisk_id='',reservation_id='r-duicp9hg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1259288934',owner_user_name='tempest-TaggedBootDevicesTest-1259288934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:42:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b4c56eb2047426f8e9d31f9221c49b2',uuid=7d71c003-6ad9-495f-ac65-083f07d65201,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58e714a9-1fc7-4211-b2b6-f46e985123e8", "address": "fa:16:3e:63:6b:c0", "network": {"id": "b18952cf-830d-47b0-920f-467ad6e971f1", "bridge": "br-int", "label": "tempest-device-tagging-net1-724382461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58e714a9-1f", "ovs_interfaceid": "58e714a9-1fc7-4211-b2b6-f46e985123e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Converting VIF {"id": "58e714a9-1fc7-4211-b2b6-f46e985123e8", "address": "fa:16:3e:63:6b:c0", "network": {"id": "b18952cf-830d-47b0-920f-467ad6e971f1", "bridge": "br-int", "label": "tempest-device-tagging-net1-724382461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58e714a9-1f", "ovs_interfaceid": "58e714a9-1fc7-4211-b2b6-f46e985123e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:6b:c0,bridge_name='br-int',has_traffic_filtering=True,id=58e714a9-1fc7-4211-b2b6-f46e985123e8,network=Network(b18952cf-830d-47b0-920f-467ad6e971f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58e714a9-1f') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG os_vif [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:6b:c0,bridge_name='br-int',has_traffic_filtering=True,id=58e714a9-1fc7-4211-b2b6-f46e985123e8,network=Network(b18952cf-830d-47b0-920f-467ad6e971f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58e714a9-1f') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-f8f21b21-312f-4a80-8cbc-b0296babd9bc tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.551s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap58e714a9-1f, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap58e714a9-1f, col_values=(('external_ids', {'iface-id': '58e714a9-1fc7-4211-b2b6-f46e985123e8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:6b:c0', 'vm-uuid': '7d71c003-6ad9-495f-ac65-083f07d65201'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-f8f21b21-312f-4a80-8cbc-b0296babd9bc tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpsz38ytik/276100f7c99f4cca9ea90371b5102d33.delta 1073741824 {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-f8f21b21-312f-4a80-8cbc-b0296babd9bc tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpsz38ytik/276100f7c99f4cca9ea90371b5102d33.delta 1073741824" returned: 0 in 0.052s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:43 user nova-compute[70924]: INFO os_vif [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:6b:c0,bridge_name='br-int',has_traffic_filtering=True,id=58e714a9-1fc7-4211-b2b6-f46e985123e8,network=Network(b18952cf-830d-47b0-920f-467ad6e971f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58e714a9-1f')
Jul 29 14:42:43 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T14:42:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-258468828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-258468828',id=10,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8vhOVuXRjbQAFoxoAwoH8wPeKkNky0s/inopZaSY/VBTBt29RwOL3lmSODeTfAsQhH35wSIR4rsbuvFcq0Aiofsb1Txk0TNGyDZnF4CI77vmbpayOZGyAw/mvGvnUY+w==',key_name='tempest-keypair-1728574391',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ce898102e394a1e8458ffd6635acbd3',ramdisk_id='',reservation_id='r-duicp9hg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1259288934',owner_user_name='tempest-TaggedBootDevicesTest-1259288934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:42:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b4c56eb2047426f8e9d31f9221c49b2',uuid=7d71c003-6ad9-495f-ac65-083f07d65201,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba4b82c4-18e0-4863-b47a-139f71c45e27", "address": "fa:16:3e:77:64:39", "network": {"id": "2f6d769a-c90b-4a51-a6a7-93fab40860a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-972817671", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4b82c4-18", "ovs_interfaceid": "ba4b82c4-18e0-4863-b47a-139f71c45e27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Converting VIF {"id": "ba4b82c4-18e0-4863-b47a-139f71c45e27", "address": "fa:16:3e:77:64:39", "network": {"id": "2f6d769a-c90b-4a51-a6a7-93fab40860a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-972817671", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4b82c4-18", "ovs_interfaceid": "ba4b82c4-18e0-4863-b47a-139f71c45e27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:64:39,bridge_name='br-int',has_traffic_filtering=True,id=ba4b82c4-18e0-4863-b47a-139f71c45e27,network=Network(2f6d769a-c90b-4a51-a6a7-93fab40860a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4b82c4-18') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG os_vif [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:64:39,bridge_name='br-int',has_traffic_filtering=True,id=ba4b82c4-18e0-4863-b47a-139f71c45e27,network=Network(2f6d769a-c90b-4a51-a6a7-93fab40860a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4b82c4-18') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 14:42:43 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-f8f21b21-312f-4a80-8cbc-b0296babd9bc tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 29 14:42:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 14:42:43 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:42:43 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:42:43 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Hypervisor/Node resource view: name=user free_ram=7004MB free_disk=25.73025894165039GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70924) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-f8f21b21-312f-4a80-8cbc-b0296babd9bc tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Checking UEFI support for host arch (x86_64) {{(pid=70924) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Jul 29 14:42:43 user nova-compute[70924]: INFO nova.virt.libvirt.host [None req-f8f21b21-312f-4a80-8cbc-b0296babd9bc tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] UEFI support detected
Jul 29 14:42:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapba4b82c4-18, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapba4b82c4-18, col_values=(('external_ids', {'iface-id': 'ba4b82c4-18e0-4863-b47a-139f71c45e27', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:64:39', 'vm-uuid': '7d71c003-6ad9-495f-ac65-083f07d65201'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:43 user nova-compute[70924]: INFO os_vif [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:64:39,bridge_name='br-int',has_traffic_filtering=True,id=ba4b82c4-18e0-4863-b47a-139f71c45e27,network=Network(2f6d769a-c90b-4a51-a6a7-93fab40860a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4b82c4-18')
Jul 29 14:42:43 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T14:42:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-258468828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-258468828',id=10,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8vhOVuXRjbQAFoxoAwoH8wPeKkNky0s/inopZaSY/VBTBt29RwOL3lmSODeTfAsQhH35wSIR4rsbuvFcq0Aiofsb1Txk0TNGyDZnF4CI77vmbpayOZGyAw/mvGvnUY+w==',key_name='tempest-keypair-1728574391',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ce898102e394a1e8458ffd6635acbd3',ramdisk_id='',reservation_id='r-duicp9hg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1259288934',owner_user_name='tempest-TaggedBootDevicesTest-1259288934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:42:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b4c56eb2047426f8e9d31f9221c49b2',uuid=7d71c003-6ad9-495f-ac65-083f07d65201,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ccee8ddb-f771-4238-aebc-0d9ef5eca6a1", "address": "fa:16:3e:76:86:8f", "network": {"id": "2f6d769a-c90b-4a51-a6a7-93fab40860a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-972817671", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccee8ddb-f7", "ovs_interfaceid": "ccee8ddb-f771-4238-aebc-0d9ef5eca6a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Converting VIF {"id": "ccee8ddb-f771-4238-aebc-0d9ef5eca6a1", "address": "fa:16:3e:76:86:8f", "network": {"id": "2f6d769a-c90b-4a51-a6a7-93fab40860a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-972817671", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccee8ddb-f7", "ovs_interfaceid": "ccee8ddb-f771-4238-aebc-0d9ef5eca6a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:86:8f,bridge_name='br-int',has_traffic_filtering=True,id=ccee8ddb-f771-4238-aebc-0d9ef5eca6a1,network=Network(2f6d769a-c90b-4a51-a6a7-93fab40860a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccee8ddb-f7') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG os_vif [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:86:8f,bridge_name='br-int',has_traffic_filtering=True,id=ccee8ddb-f771-4238-aebc-0d9ef5eca6a1,network=Network(2f6d769a-c90b-4a51-a6a7-93fab40860a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccee8ddb-f7') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapccee8ddb-f7, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:42:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapccee8ddb-f7, col_values=(('external_ids', {'iface-id': 'ccee8ddb-f771-4238-aebc-0d9ef5eca6a1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:86:8f', 'vm-uuid': '7d71c003-6ad9-495f-ac65-083f07d65201'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:42:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:42:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:44 user nova-compute[70924]: INFO os_vif [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:86:8f,bridge_name='br-int',has_traffic_filtering=True,id=ccee8ddb-f771-4238-aebc-0d9ef5eca6a1,network=Network(2f6d769a-c90b-4a51-a6a7-93fab40860a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccee8ddb-f7')
Jul 29 14:42:44 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance db656346-c4af-43da-9600-fd39f1b9e4dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:42:44 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance c7776982-40ea-4b06-b853-cfd484efba73 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:42:44 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 2250b0d6-5542-4a7f-90a9-93745a776fcc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:42:44 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance f5929dcf-8594-4323-a6f5-a322aff7c881 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:42:44 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 86ecc6cb-88a8-4572-8e41-d4c5859036a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:42:44 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 1ea2e4b1-5b93-42bf-b29d-ce6986135826 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:42:44 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 00231136-233f-4a1b-88ff-b678482ca5bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:42:44 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance a9549556-e9a7-4782-ade4-9d397d5323d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:42:44 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance fcbb998c-2dac-47d9-985a-d5b2a15ddaa0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:42:44 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 7d71c003-6ad9-495f-ac65-083f07d65201 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:42:44 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 14:42:44 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 14:42:44 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] No BDM found with device name hda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:42:44 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] No BDM found with device name vdc, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:42:44 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] No VIF found with MAC fa:16:3e:57:8e:35, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:42:44 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] No VIF found with MAC fa:16:3e:63:6b:c0, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:42:44 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Using config drive
Jul 29 14:42:44 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Creating config drive at /opt/stack/data/nova/instances/7d71c003-6ad9-495f-ac65-083f07d65201/disk.config
Jul 29 14:42:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7d71c003-6ad9-495f-ac65-083f07d65201/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpepfxuc88 {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7d71c003-6ad9-495f-ac65-083f07d65201/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpepfxuc88" returned: 0 in 0.056s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:44 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:42:44 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:42:44 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Compute_service record updated for user:user {{(pid=70924) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 14:42:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.663s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:42:44 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-f8f21b21-312f-4a80-8cbc-b0296babd9bc tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] COPY block job progress, current cursor: 65536 final cursor: 75563008 {{(pid=70924) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 29 14:42:45 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-f8f21b21-312f-4a80-8cbc-b0296babd9bc tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=70924) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 29 14:42:45 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-f8f21b21-312f-4a80-8cbc-b0296babd9bc tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 29 14:42:45 user nova-compute[70924]: DEBUG nova.privsep.utils [None req-f8f21b21-312f-4a80-8cbc-b0296babd9bc tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70924) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 29 14:42:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-f8f21b21-312f-4a80-8cbc-b0296babd9bc tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpsz38ytik/276100f7c99f4cca9ea90371b5102d33.delta /opt/stack/data/nova/instances/snapshots/tmpsz38ytik/276100f7c99f4cca9ea90371b5102d33 {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:46 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:46 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-58fa085e-46a2-47a6-95be-e241eadb1c09 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Acquiring lock "c7776982-40ea-4b06-b853-cfd484efba73" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:42:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-58fa085e-46a2-47a6-95be-e241eadb1c09 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Lock "c7776982-40ea-4b06-b853-cfd484efba73" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:42:46 user nova-compute[70924]: DEBUG nova.objects.instance [None req-58fa085e-46a2-47a6-95be-e241eadb1c09 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Lazy-loading 'flavor' on Instance uuid c7776982-40ea-4b06-b853-cfd484efba73 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:42:46 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:46 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:46 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-f8f21b21-312f-4a80-8cbc-b0296babd9bc tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpsz38ytik/276100f7c99f4cca9ea90371b5102d33.delta /opt/stack/data/nova/instances/snapshots/tmpsz38ytik/276100f7c99f4cca9ea90371b5102d33" returned: 0 in 0.643s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:46 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-f8f21b21-312f-4a80-8cbc-b0296babd9bc tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Snapshot extracted, beginning image upload
Jul 29 14:42:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-58fa085e-46a2-47a6-95be-e241eadb1c09 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Lock "c7776982-40ea-4b06-b853-cfd484efba73" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.283s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:42:46 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:46 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:42:46 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:42:46 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:42:46 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Starting heal instance info cache {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 14:42:46 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "refresh_cache-c7776982-40ea-4b06-b853-cfd484efba73" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:42:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquired lock "refresh_cache-c7776982-40ea-4b06-b853-cfd484efba73" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:42:46 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: c7776982-40ea-4b06-b853-cfd484efba73] Forcefully refreshing network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 29 14:42:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-58fa085e-46a2-47a6-95be-e241eadb1c09 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Acquiring lock "c7776982-40ea-4b06-b853-cfd484efba73" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:42:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-58fa085e-46a2-47a6-95be-e241eadb1c09 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Lock "c7776982-40ea-4b06-b853-cfd484efba73" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:42:46 user nova-compute[70924]: INFO nova.compute.manager [None req-58fa085e-46a2-47a6-95be-e241eadb1c09 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] [instance: c7776982-40ea-4b06-b853-cfd484efba73] Attaching volume 731c97fa-8483-474e-a792-ec6140b812d2 to /dev/vdb
Jul 29 14:42:46 user nova-compute[70924]: DEBUG os_brick.utils [None req-58fa085e-46a2-47a6-95be-e241eadb1c09 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:42:46 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:46 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:46 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8384c9-55fd-43c9-a8e0-0f2ea528097d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f2127c4a30d9\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:42:46 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:46 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:46 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c0b1dc1-4c2f-4ee5-9002-de29e829e99e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:42:46 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:47 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:47 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:47 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dadfcd8-03e8-4def-b966-6815dd24bc04]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:42:47 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:47 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e23c4bc-08ca-4a75-b5ae-bf395e79f908]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:42:47 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-58fa085e-46a2-47a6-95be-e241eadb1c09 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Running cmd (subprocess): nvme version {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:47 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-58fa085e-46a2-47a6-95be-e241eadb1c09 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] 'nvme version' failed. Not Retrying. {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:42:47 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.nvmeof [None req-58fa085e-46a2-47a6-95be-e241eadb1c09 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] nvme not present on system {{(pid=70924) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 14:42:47 user nova-compute[70924]: DEBUG nova.compute.manager [req-af319200-700c-4251-bf59-220f5d3037d1 req-3165c455-93e9-4934-913d-ef9f986efa64 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Received event network-vif-plugged-be358bcd-08a6-445b-afea-9b3335a8cac1 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:42:47 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-af319200-700c-4251-bf59-220f5d3037d1 req-3165c455-93e9-4934-913d-ef9f986efa64 service nova] Acquiring lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:42:47 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-af319200-700c-4251-bf59-220f5d3037d1 req-3165c455-93e9-4934-913d-ef9f986efa64 service nova] Lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:42:47 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-af319200-700c-4251-bf59-220f5d3037d1 req-3165c455-93e9-4934-913d-ef9f986efa64 service nova] Lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:42:47 user nova-compute[70924]: DEBUG nova.compute.manager [req-af319200-700c-4251-bf59-220f5d3037d1 req-3165c455-93e9-4934-913d-ef9f986efa64 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] No waiting events found dispatching network-vif-plugged-be358bcd-08a6-445b-afea-9b3335a8cac1 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:42:47 user nova-compute[70924]: WARNING nova.compute.manager [req-af319200-700c-4251-bf59-220f5d3037d1 req-3165c455-93e9-4934-913d-ef9f986efa64 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Received unexpected event network-vif-plugged-be358bcd-08a6-445b-afea-9b3335a8cac1 for instance with vm_state building and task_state spawning.
Jul 29 14:42:47 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:47 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:42:47 user nova-compute[70924]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 14:42:47 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b61c4ef-41a0-4ca9-9c71-270da1fa0f87]: (4, '') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:42:47 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:47 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-58fa085e-46a2-47a6-95be-e241eadb1c09 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70924) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 14:42:47 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-58fa085e-46a2-47a6-95be-e241eadb1c09 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 14:42:47 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-58fa085e-46a2-47a6-95be-e241eadb1c09 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] LIGHTOS: no hostnqn found. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 14:42:47 user nova-compute[70924]: DEBUG os_brick.utils [None req-58fa085e-46a2-47a6-95be-e241eadb1c09 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] <== get_connector_properties: return (207ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f2127c4a30d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:42:47 user nova-compute[70924]: DEBUG nova.virt.block_device [None req-58fa085e-46a2-47a6-95be-e241eadb1c09 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] [instance: c7776982-40ea-4b06-b853-cfd484efba73] Updating existing volume attachment record: 2da77cc0-7fa9-4133-9c8e-06130432f960 {{(pid=70924) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 14:42:47 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:47 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:47 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:47 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:47 user nova-compute[70924]: DEBUG nova.compute.manager [req-ff8ba246-a9af-4652-a824-14856dd62b52 req-ea8cbc6b-9be5-4301-9bb1-effea41580bb service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Received event network-vif-plugged-b47a2389-92e5-4e93-89d3-ddb36806582f {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:42:47 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-ff8ba246-a9af-4652-a824-14856dd62b52 req-ea8cbc6b-9be5-4301-9bb1-effea41580bb service nova] Acquiring lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:42:47 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-ff8ba246-a9af-4652-a824-14856dd62b52 req-ea8cbc6b-9be5-4301-9bb1-effea41580bb service nova] Lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:42:47 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-ff8ba246-a9af-4652-a824-14856dd62b52 req-ea8cbc6b-9be5-4301-9bb1-effea41580bb service nova] Lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:42:47 user nova-compute[70924]: DEBUG nova.compute.manager [req-ff8ba246-a9af-4652-a824-14856dd62b52 req-ea8cbc6b-9be5-4301-9bb1-effea41580bb service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] No waiting events found dispatching network-vif-plugged-b47a2389-92e5-4e93-89d3-ddb36806582f {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:42:47 user nova-compute[70924]: WARNING nova.compute.manager [req-ff8ba246-a9af-4652-a824-14856dd62b52 req-ea8cbc6b-9be5-4301-9bb1-effea41580bb service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Received unexpected event network-vif-plugged-b47a2389-92e5-4e93-89d3-ddb36806582f for instance with vm_state building and task_state spawning.
Jul 29 14:42:47 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:47 user nova-compute[70924]: DEBUG nova.compute.manager [req-de1d6ba2-9eae-452b-bc84-d286c630e212 req-620ab425-e3e6-4e8a-8649-45bc7dac8d60 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Received event network-vif-plugged-0baed51f-cbf0-43db-9cbf-53bda0557b4c {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:42:47 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-de1d6ba2-9eae-452b-bc84-d286c630e212 req-620ab425-e3e6-4e8a-8649-45bc7dac8d60 service nova] Acquiring lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:42:47 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-de1d6ba2-9eae-452b-bc84-d286c630e212 req-620ab425-e3e6-4e8a-8649-45bc7dac8d60 service nova] Lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:42:47 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-de1d6ba2-9eae-452b-bc84-d286c630e212 req-620ab425-e3e6-4e8a-8649-45bc7dac8d60 service nova] Lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:42:47 user nova-compute[70924]: DEBUG nova.compute.manager [req-de1d6ba2-9eae-452b-bc84-d286c630e212 req-620ab425-e3e6-4e8a-8649-45bc7dac8d60 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] No waiting events found dispatching network-vif-plugged-0baed51f-cbf0-43db-9cbf-53bda0557b4c {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:42:47 user nova-compute[70924]: WARNING nova.compute.manager [req-de1d6ba2-9eae-452b-bc84-d286c630e212 req-620ab425-e3e6-4e8a-8649-45bc7dac8d60 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Received unexpected event network-vif-plugged-0baed51f-cbf0-43db-9cbf-53bda0557b4c for instance with vm_state building and task_state spawning.
Jul 29 14:42:47 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:47 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:47 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:47 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:47 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:47 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:47 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:48 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: c7776982-40ea-4b06-b853-cfd484efba73] Updating instance_info_cache with network_info: [{"id": "52dab4ab-4869-4263-9264-9150480c9efc", "address": "fa:16:3e:d3:cc:2f", "network": {"id": "f29c4a92-4276-4a57-b109-2f0718fe96bd", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-899695892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73d214e40cf84df584ebdf33293b5f98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52dab4ab-48", "ovs_interfaceid": "52dab4ab-4869-4263-9264-9150480c9efc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:42:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:48 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Releasing lock "refresh_cache-c7776982-40ea-4b06-b853-cfd484efba73" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:42:48 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: c7776982-40ea-4b06-b853-cfd484efba73] Updated the network info_cache for instance {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 29 14:42:48 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:42:48 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:42:48 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:42:48 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:42:48 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:42:48 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:42:48 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70924) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 14:42:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:49 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:49 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:49 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:49 user nova-compute[70924]: DEBUG nova.compute.manager [req-27b36b75-a893-4bbf-914e-109490e9cc36 req-941a1d62-5e94-4a93-a415-1108f64b6719 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Received event network-vif-plugged-b47a2389-92e5-4e93-89d3-ddb36806582f {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:42:49 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-27b36b75-a893-4bbf-914e-109490e9cc36 req-941a1d62-5e94-4a93-a415-1108f64b6719 service nova] Acquiring lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:42:49 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-27b36b75-a893-4bbf-914e-109490e9cc36 req-941a1d62-5e94-4a93-a415-1108f64b6719 service nova] Lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:42:49 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-27b36b75-a893-4bbf-914e-109490e9cc36 req-941a1d62-5e94-4a93-a415-1108f64b6719 service nova] Lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:42:49 user nova-compute[70924]: DEBUG nova.compute.manager [req-27b36b75-a893-4bbf-914e-109490e9cc36 req-941a1d62-5e94-4a93-a415-1108f64b6719 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] No waiting events found dispatching network-vif-plugged-b47a2389-92e5-4e93-89d3-ddb36806582f {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:42:49 user nova-compute[70924]: WARNING nova.compute.manager [req-27b36b75-a893-4bbf-914e-109490e9cc36 req-941a1d62-5e94-4a93-a415-1108f64b6719 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Received unexpected event network-vif-plugged-b47a2389-92e5-4e93-89d3-ddb36806582f for instance with vm_state building and task_state spawning.
Jul 29 14:42:49 user nova-compute[70924]: DEBUG nova.compute.manager [req-27b36b75-a893-4bbf-914e-109490e9cc36 req-941a1d62-5e94-4a93-a415-1108f64b6719 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Received event network-vif-plugged-ccee8ddb-f771-4238-aebc-0d9ef5eca6a1 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:42:49 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-27b36b75-a893-4bbf-914e-109490e9cc36 req-941a1d62-5e94-4a93-a415-1108f64b6719 service nova] Acquiring lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:42:49 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-27b36b75-a893-4bbf-914e-109490e9cc36 req-941a1d62-5e94-4a93-a415-1108f64b6719 service nova] Lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:42:49 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-27b36b75-a893-4bbf-914e-109490e9cc36 req-941a1d62-5e94-4a93-a415-1108f64b6719 service nova] Lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:42:49 user nova-compute[70924]: DEBUG nova.compute.manager [req-27b36b75-a893-4bbf-914e-109490e9cc36 req-941a1d62-5e94-4a93-a415-1108f64b6719 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] No waiting events found dispatching network-vif-plugged-ccee8ddb-f771-4238-aebc-0d9ef5eca6a1 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:42:49 user nova-compute[70924]: WARNING nova.compute.manager [req-27b36b75-a893-4bbf-914e-109490e9cc36 req-941a1d62-5e94-4a93-a415-1108f64b6719 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Received unexpected event network-vif-plugged-ccee8ddb-f771-4238-aebc-0d9ef5eca6a1 for instance with vm_state building and task_state spawning.
Jul 29 14:42:49 user nova-compute[70924]: DEBUG nova.compute.manager [req-27b36b75-a893-4bbf-914e-109490e9cc36 req-941a1d62-5e94-4a93-a415-1108f64b6719 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Received event network-vif-plugged-ccee8ddb-f771-4238-aebc-0d9ef5eca6a1 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:42:49 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-27b36b75-a893-4bbf-914e-109490e9cc36 req-941a1d62-5e94-4a93-a415-1108f64b6719 service nova] Acquiring lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:42:49 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-27b36b75-a893-4bbf-914e-109490e9cc36 req-941a1d62-5e94-4a93-a415-1108f64b6719 service nova] Lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:42:49 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-27b36b75-a893-4bbf-914e-109490e9cc36 req-941a1d62-5e94-4a93-a415-1108f64b6719 service nova] Lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:42:49 user nova-compute[70924]: DEBUG nova.compute.manager [req-27b36b75-a893-4bbf-914e-109490e9cc36 req-941a1d62-5e94-4a93-a415-1108f64b6719 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] No waiting events found dispatching network-vif-plugged-ccee8ddb-f771-4238-aebc-0d9ef5eca6a1 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:42:49 user nova-compute[70924]: WARNING nova.compute.manager [req-27b36b75-a893-4bbf-914e-109490e9cc36 req-941a1d62-5e94-4a93-a415-1108f64b6719 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Received unexpected event network-vif-plugged-ccee8ddb-f771-4238-aebc-0d9ef5eca6a1 for instance with vm_state building and task_state spawning.
Jul 29 14:42:49 user nova-compute[70924]: DEBUG nova.compute.manager [req-68d1cf2c-0f31-4f26-a0d9-f7869195d1b6 req-15f4d574-1a8a-4855-b49a-511aff08a417 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Received event network-vif-plugged-be358bcd-08a6-445b-afea-9b3335a8cac1 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:42:49 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-68d1cf2c-0f31-4f26-a0d9-f7869195d1b6 req-15f4d574-1a8a-4855-b49a-511aff08a417 service nova] Acquiring lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:42:49 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-68d1cf2c-0f31-4f26-a0d9-f7869195d1b6 req-15f4d574-1a8a-4855-b49a-511aff08a417 service nova] Lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:42:49 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-68d1cf2c-0f31-4f26-a0d9-f7869195d1b6 req-15f4d574-1a8a-4855-b49a-511aff08a417 service nova] Lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:42:49 user nova-compute[70924]: DEBUG nova.compute.manager [req-68d1cf2c-0f31-4f26-a0d9-f7869195d1b6 req-15f4d574-1a8a-4855-b49a-511aff08a417 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] No waiting events found dispatching network-vif-plugged-be358bcd-08a6-445b-afea-9b3335a8cac1 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:42:49 user nova-compute[70924]: WARNING nova.compute.manager [req-68d1cf2c-0f31-4f26-a0d9-f7869195d1b6 req-15f4d574-1a8a-4855-b49a-511aff08a417 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Received unexpected event network-vif-plugged-be358bcd-08a6-445b-afea-9b3335a8cac1 for instance with vm_state building and task_state spawning.
Jul 29 14:42:49 user nova-compute[70924]: DEBUG nova.compute.manager [req-28ec9549-a669-4ffb-a942-c208da82020d req-060f8024-dfec-4780-86b5-8551d21ae983 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Received event network-vif-plugged-0baed51f-cbf0-43db-9cbf-53bda0557b4c {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:42:49 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-28ec9549-a669-4ffb-a942-c208da82020d req-060f8024-dfec-4780-86b5-8551d21ae983 service nova] Acquiring lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:42:49 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-28ec9549-a669-4ffb-a942-c208da82020d req-060f8024-dfec-4780-86b5-8551d21ae983 service nova] Lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:42:49 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-28ec9549-a669-4ffb-a942-c208da82020d req-060f8024-dfec-4780-86b5-8551d21ae983 service nova] Lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:42:49 user nova-compute[70924]: DEBUG nova.compute.manager [req-28ec9549-a669-4ffb-a942-c208da82020d req-060f8024-dfec-4780-86b5-8551d21ae983 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] No waiting events found dispatching network-vif-plugged-0baed51f-cbf0-43db-9cbf-53bda0557b4c {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:42:49 user nova-compute[70924]: WARNING nova.compute.manager [req-28ec9549-a669-4ffb-a942-c208da82020d req-060f8024-dfec-4780-86b5-8551d21ae983 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Received unexpected event network-vif-plugged-0baed51f-cbf0-43db-9cbf-53bda0557b4c for instance with vm_state building and task_state spawning.
Jul 29 14:42:49 user nova-compute[70924]: DEBUG nova.compute.manager [req-28ec9549-a669-4ffb-a942-c208da82020d req-060f8024-dfec-4780-86b5-8551d21ae983 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Received event network-vif-plugged-514c7198-3395-4795-93a8-60ea475f119b {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:42:49 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-28ec9549-a669-4ffb-a942-c208da82020d req-060f8024-dfec-4780-86b5-8551d21ae983 service nova] Acquiring lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:42:49 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-28ec9549-a669-4ffb-a942-c208da82020d req-060f8024-dfec-4780-86b5-8551d21ae983 service nova] Lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:42:49 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-28ec9549-a669-4ffb-a942-c208da82020d req-060f8024-dfec-4780-86b5-8551d21ae983 service nova] Lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:42:49 user nova-compute[70924]: DEBUG nova.compute.manager [req-28ec9549-a669-4ffb-a942-c208da82020d req-060f8024-dfec-4780-86b5-8551d21ae983 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] No waiting events found dispatching network-vif-plugged-514c7198-3395-4795-93a8-60ea475f119b {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:42:49 user nova-compute[70924]: WARNING nova.compute.manager [req-28ec9549-a669-4ffb-a942-c208da82020d req-060f8024-dfec-4780-86b5-8551d21ae983 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Received unexpected event network-vif-plugged-514c7198-3395-4795-93a8-60ea475f119b for instance with vm_state building and task_state spawning.
Jul 29 14:42:49 user nova-compute[70924]: DEBUG nova.compute.manager [req-28ec9549-a669-4ffb-a942-c208da82020d req-060f8024-dfec-4780-86b5-8551d21ae983 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Received event network-vif-plugged-514c7198-3395-4795-93a8-60ea475f119b {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:42:49 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-28ec9549-a669-4ffb-a942-c208da82020d req-060f8024-dfec-4780-86b5-8551d21ae983 service nova] Acquiring lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:42:49 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-28ec9549-a669-4ffb-a942-c208da82020d req-060f8024-dfec-4780-86b5-8551d21ae983 service nova] Lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:42:49 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-28ec9549-a669-4ffb-a942-c208da82020d req-060f8024-dfec-4780-86b5-8551d21ae983 service nova] Lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:42:49 user nova-compute[70924]: DEBUG nova.compute.manager [req-28ec9549-a669-4ffb-a942-c208da82020d req-060f8024-dfec-4780-86b5-8551d21ae983 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] No waiting events found dispatching network-vif-plugged-514c7198-3395-4795-93a8-60ea475f119b {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:42:49 user nova-compute[70924]: WARNING nova.compute.manager [req-28ec9549-a669-4ffb-a942-c208da82020d req-060f8024-dfec-4780-86b5-8551d21ae983 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Received unexpected event network-vif-plugged-514c7198-3395-4795-93a8-60ea475f119b for instance with vm_state building and task_state spawning.
Jul 29 14:42:49 user nova-compute[70924]: DEBUG nova.compute.manager [req-28ec9549-a669-4ffb-a942-c208da82020d req-060f8024-dfec-4780-86b5-8551d21ae983 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Received event network-vif-plugged-58e714a9-1fc7-4211-b2b6-f46e985123e8 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:42:49 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-28ec9549-a669-4ffb-a942-c208da82020d req-060f8024-dfec-4780-86b5-8551d21ae983 service nova] Acquiring lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:42:49 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-28ec9549-a669-4ffb-a942-c208da82020d req-060f8024-dfec-4780-86b5-8551d21ae983 service nova] Lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:42:49 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-28ec9549-a669-4ffb-a942-c208da82020d req-060f8024-dfec-4780-86b5-8551d21ae983 service nova] Lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:42:49 user nova-compute[70924]: DEBUG nova.compute.manager [req-28ec9549-a669-4ffb-a942-c208da82020d req-060f8024-dfec-4780-86b5-8551d21ae983 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] No waiting events found dispatching network-vif-plugged-58e714a9-1fc7-4211-b2b6-f46e985123e8 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:42:49 user nova-compute[70924]: WARNING nova.compute.manager [req-28ec9549-a669-4ffb-a942-c208da82020d req-060f8024-dfec-4780-86b5-8551d21ae983 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Received unexpected event network-vif-plugged-58e714a9-1fc7-4211-b2b6-f46e985123e8 for instance with vm_state building and task_state spawning.
Jul 29 14:42:49 user nova-compute[70924]: DEBUG nova.compute.manager [req-28ec9549-a669-4ffb-a942-c208da82020d req-060f8024-dfec-4780-86b5-8551d21ae983 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Received event network-vif-plugged-58e714a9-1fc7-4211-b2b6-f46e985123e8 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:42:49 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-28ec9549-a669-4ffb-a942-c208da82020d req-060f8024-dfec-4780-86b5-8551d21ae983 service nova] Acquiring lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:42:49 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-28ec9549-a669-4ffb-a942-c208da82020d req-060f8024-dfec-4780-86b5-8551d21ae983 service nova] Lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:42:49 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-28ec9549-a669-4ffb-a942-c208da82020d req-060f8024-dfec-4780-86b5-8551d21ae983 service nova] Lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:42:49 user nova-compute[70924]: DEBUG nova.compute.manager [req-28ec9549-a669-4ffb-a942-c208da82020d req-060f8024-dfec-4780-86b5-8551d21ae983 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] No waiting events found dispatching network-vif-plugged-58e714a9-1fc7-4211-b2b6-f46e985123e8 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:42:49 user nova-compute[70924]: WARNING nova.compute.manager [req-28ec9549-a669-4ffb-a942-c208da82020d req-060f8024-dfec-4780-86b5-8551d21ae983 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Received unexpected event network-vif-plugged-58e714a9-1fc7-4211-b2b6-f46e985123e8 for instance with vm_state building and task_state spawning.
Jul 29 14:42:49 user nova-compute[70924]: DEBUG nova.compute.manager [req-28ec9549-a669-4ffb-a942-c208da82020d req-060f8024-dfec-4780-86b5-8551d21ae983 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Received event network-vif-plugged-ba4b82c4-18e0-4863-b47a-139f71c45e27 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:42:49 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-28ec9549-a669-4ffb-a942-c208da82020d req-060f8024-dfec-4780-86b5-8551d21ae983 service nova] Acquiring lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:42:49 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-28ec9549-a669-4ffb-a942-c208da82020d req-060f8024-dfec-4780-86b5-8551d21ae983 service nova] Lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:42:49 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-28ec9549-a669-4ffb-a942-c208da82020d req-060f8024-dfec-4780-86b5-8551d21ae983 service nova] Lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:42:49 user nova-compute[70924]: DEBUG nova.compute.manager [req-28ec9549-a669-4ffb-a942-c208da82020d req-060f8024-dfec-4780-86b5-8551d21ae983 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] No waiting events found dispatching network-vif-plugged-ba4b82c4-18e0-4863-b47a-139f71c45e27 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:42:49 user nova-compute[70924]: WARNING nova.compute.manager [req-28ec9549-a669-4ffb-a942-c208da82020d req-060f8024-dfec-4780-86b5-8551d21ae983 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Received unexpected event network-vif-plugged-ba4b82c4-18e0-4863-b47a-139f71c45e27 for instance with vm_state building and task_state spawning.
Jul 29 14:42:50 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:50 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:50 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:50 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:50 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-f8f21b21-312f-4a80-8cbc-b0296babd9bc tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Snapshot image upload complete
Jul 29 14:42:50 user nova-compute[70924]: INFO nova.compute.manager [None req-f8f21b21-312f-4a80-8cbc-b0296babd9bc tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Took 7.52 seconds to snapshot the instance on the hypervisor.
Jul 29 14:42:50 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:50 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:51 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690641771.130258, 7d71c003-6ad9-495f-ac65-083f07d65201 => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:42:51 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] VM Resumed (Lifecycle Event)
Jul 29 14:42:51 user nova-compute[70924]: DEBUG nova.compute.manager [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Instance event wait completed in 0 seconds for  {{(pid=70924) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 14:42:51 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Guest created on hypervisor {{(pid=70924) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 14:42:51 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:42:51 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Instance spawned successfully.
Jul 29 14:42:51 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 14:42:51 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:42:51 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:42:51 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690641771.13438, 7d71c003-6ad9-495f-ac65-083f07d65201 => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:42:51 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] VM Started (Lifecycle Event)
Jul 29 14:42:51 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Found default for hw_cdrom_bus of ide {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:42:51 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Found default for hw_disk_bus of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:42:51 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Found default for hw_input_bus of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:42:51 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Found default for hw_pointer_model of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:42:51 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Found default for hw_video_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:42:51 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Found default for hw_vif_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:42:51 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:42:51 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:42:51 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:42:51 user nova-compute[70924]: INFO nova.compute.manager [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Took 12.50 seconds to spawn the instance on the hypervisor.
Jul 29 14:42:51 user nova-compute[70924]: DEBUG nova.compute.manager [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:42:51 user nova-compute[70924]: INFO nova.compute.manager [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Took 41.02 seconds to build instance.
Jul 29 14:42:51 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-f2fd824f-0351-449d-a746-38bfe1628268 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Lock "7d71c003-6ad9-495f-ac65-083f07d65201" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 41.122s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:42:51 user nova-compute[70924]: DEBUG nova.compute.manager [req-86526f70-5fea-4856-bee8-8c85b109ec6a req-d627bb59-f07d-4628-bf2e-3aedc2beae2c service nova] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] Received event network-changed-72829b2d-d54b-4792-bb99-ea15bf5149a6 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:42:51 user nova-compute[70924]: DEBUG nova.compute.manager [req-86526f70-5fea-4856-bee8-8c85b109ec6a req-d627bb59-f07d-4628-bf2e-3aedc2beae2c service nova] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] Refreshing instance network info cache due to event network-changed-72829b2d-d54b-4792-bb99-ea15bf5149a6. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:42:51 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-86526f70-5fea-4856-bee8-8c85b109ec6a req-d627bb59-f07d-4628-bf2e-3aedc2beae2c service nova] Acquiring lock "refresh_cache-2250b0d6-5542-4a7f-90a9-93745a776fcc" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:42:51 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-86526f70-5fea-4856-bee8-8c85b109ec6a req-d627bb59-f07d-4628-bf2e-3aedc2beae2c service nova] Acquired lock "refresh_cache-2250b0d6-5542-4a7f-90a9-93745a776fcc" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:42:51 user nova-compute[70924]: DEBUG nova.network.neutron [req-86526f70-5fea-4856-bee8-8c85b109ec6a req-d627bb59-f07d-4628-bf2e-3aedc2beae2c service nova] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] Refreshing network info cache for port 72829b2d-d54b-4792-bb99-ea15bf5149a6 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:42:51 user nova-compute[70924]: DEBUG nova.compute.manager [req-20141c50-f30f-49c7-9ca4-0f5094777652 req-90a2a102-a818-47d1-8101-cc10aec13f35 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Received event network-vif-plugged-ba4b82c4-18e0-4863-b47a-139f71c45e27 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:42:51 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-20141c50-f30f-49c7-9ca4-0f5094777652 req-90a2a102-a818-47d1-8101-cc10aec13f35 service nova] Acquiring lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:42:51 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-20141c50-f30f-49c7-9ca4-0f5094777652 req-90a2a102-a818-47d1-8101-cc10aec13f35 service nova] Lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:42:51 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-20141c50-f30f-49c7-9ca4-0f5094777652 req-90a2a102-a818-47d1-8101-cc10aec13f35 service nova] Lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:42:51 user nova-compute[70924]: DEBUG nova.compute.manager [req-20141c50-f30f-49c7-9ca4-0f5094777652 req-90a2a102-a818-47d1-8101-cc10aec13f35 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] No waiting events found dispatching network-vif-plugged-ba4b82c4-18e0-4863-b47a-139f71c45e27 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:42:51 user nova-compute[70924]: WARNING nova.compute.manager [req-20141c50-f30f-49c7-9ca4-0f5094777652 req-90a2a102-a818-47d1-8101-cc10aec13f35 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Received unexpected event network-vif-plugged-ba4b82c4-18e0-4863-b47a-139f71c45e27 for instance with vm_state active and task_state None.
Jul 29 14:42:52 user nova-compute[70924]: DEBUG nova.compute.manager [req-d5728232-e5ea-4ddf-836f-7ba592673da4 req-d9f467cb-63a6-40af-a746-8385b693a3e8 service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Received event network-changed-14b12f31-f886-4752-bac2-e4673c74ae85 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:42:52 user nova-compute[70924]: DEBUG nova.compute.manager [req-d5728232-e5ea-4ddf-836f-7ba592673da4 req-d9f467cb-63a6-40af-a746-8385b693a3e8 service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Refreshing instance network info cache due to event network-changed-14b12f31-f886-4752-bac2-e4673c74ae85. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:42:52 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-d5728232-e5ea-4ddf-836f-7ba592673da4 req-d9f467cb-63a6-40af-a746-8385b693a3e8 service nova] Acquiring lock "refresh_cache-f5929dcf-8594-4323-a6f5-a322aff7c881" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:42:52 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-d5728232-e5ea-4ddf-836f-7ba592673da4 req-d9f467cb-63a6-40af-a746-8385b693a3e8 service nova] Acquired lock "refresh_cache-f5929dcf-8594-4323-a6f5-a322aff7c881" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:42:52 user nova-compute[70924]: DEBUG nova.network.neutron [req-d5728232-e5ea-4ddf-836f-7ba592673da4 req-d9f467cb-63a6-40af-a746-8385b693a3e8 service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Refreshing network info cache for port 14b12f31-f886-4752-bac2-e4673c74ae85 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:42:52 user nova-compute[70924]: DEBUG nova.network.neutron [req-86526f70-5fea-4856-bee8-8c85b109ec6a req-d627bb59-f07d-4628-bf2e-3aedc2beae2c service nova] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] Updated VIF entry in instance network info cache for port 72829b2d-d54b-4792-bb99-ea15bf5149a6. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:42:52 user nova-compute[70924]: DEBUG nova.network.neutron [req-86526f70-5fea-4856-bee8-8c85b109ec6a req-d627bb59-f07d-4628-bf2e-3aedc2beae2c service nova] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] Updating instance_info_cache with network_info: [{"id": "72829b2d-d54b-4792-bb99-ea15bf5149a6", "address": "fa:16:3e:b7:e0:eb", "network": {"id": "b6631336-b322-45e0-99b7-5e95539aa674", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2109271400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc2394c924af4a9aaa925d116b2117ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72829b2d-d5", "ovs_interfaceid": "72829b2d-d54b-4792-bb99-ea15bf5149a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:42:52 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-86526f70-5fea-4856-bee8-8c85b109ec6a req-d627bb59-f07d-4628-bf2e-3aedc2beae2c service nova] Releasing lock "refresh_cache-2250b0d6-5542-4a7f-90a9-93745a776fcc" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:42:52 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:53 user nova-compute[70924]: DEBUG nova.compute.manager [req-7e9bb2e9-855e-4e05-ac3f-3b7427754070 req-01eb67fe-5d9a-4639-bef4-93d7740b3a62 service nova] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Received event network-changed-4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:42:53 user nova-compute[70924]: DEBUG nova.compute.manager [req-7e9bb2e9-855e-4e05-ac3f-3b7427754070 req-01eb67fe-5d9a-4639-bef4-93d7740b3a62 service nova] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Refreshing instance network info cache due to event network-changed-4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:42:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-7e9bb2e9-855e-4e05-ac3f-3b7427754070 req-01eb67fe-5d9a-4639-bef4-93d7740b3a62 service nova] Acquiring lock "refresh_cache-86ecc6cb-88a8-4572-8e41-d4c5859036a6" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:42:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-7e9bb2e9-855e-4e05-ac3f-3b7427754070 req-01eb67fe-5d9a-4639-bef4-93d7740b3a62 service nova] Acquired lock "refresh_cache-86ecc6cb-88a8-4572-8e41-d4c5859036a6" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:42:53 user nova-compute[70924]: DEBUG nova.network.neutron [req-7e9bb2e9-855e-4e05-ac3f-3b7427754070 req-01eb67fe-5d9a-4639-bef4-93d7740b3a62 service nova] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Refreshing network info cache for port 4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:42:53 user nova-compute[70924]: DEBUG nova.network.neutron [req-d5728232-e5ea-4ddf-836f-7ba592673da4 req-d9f467cb-63a6-40af-a746-8385b693a3e8 service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Updated VIF entry in instance network info cache for port 14b12f31-f886-4752-bac2-e4673c74ae85. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:42:53 user nova-compute[70924]: DEBUG nova.network.neutron [req-d5728232-e5ea-4ddf-836f-7ba592673da4 req-d9f467cb-63a6-40af-a746-8385b693a3e8 service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Updating instance_info_cache with network_info: [{"id": "14b12f31-f886-4752-bac2-e4673c74ae85", "address": "fa:16:3e:0b:f1:80", "network": {"id": "4a3c2dab-e462-4e17-a2a3-f07747a26bbe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1820325619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b2ac23ab8cd48b390fa2047c1fd0e3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14b12f31-f8", "ovs_interfaceid": "14b12f31-f886-4752-bac2-e4673c74ae85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:42:54 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:54 user nova-compute[70924]: DEBUG nova.compute.manager [None req-29329b43-c04d-4291-b85e-d86f2816b52c tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:42:54 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-d5728232-e5ea-4ddf-836f-7ba592673da4 req-d9f467cb-63a6-40af-a746-8385b693a3e8 service nova] Releasing lock "refresh_cache-f5929dcf-8594-4323-a6f5-a322aff7c881" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:42:54 user nova-compute[70924]: INFO nova.compute.manager [None req-29329b43-c04d-4291-b85e-d86f2816b52c tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] instance snapshotting
Jul 29 14:42:54 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-29329b43-c04d-4291-b85e-d86f2816b52c tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Beginning live snapshot process
Jul 29 14:42:54 user nova-compute[70924]: DEBUG nova.network.neutron [req-7e9bb2e9-855e-4e05-ac3f-3b7427754070 req-01eb67fe-5d9a-4639-bef4-93d7740b3a62 service nova] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Updated VIF entry in instance network info cache for port 4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:42:54 user nova-compute[70924]: DEBUG nova.network.neutron [req-7e9bb2e9-855e-4e05-ac3f-3b7427754070 req-01eb67fe-5d9a-4639-bef4-93d7740b3a62 service nova] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Updating instance_info_cache with network_info: [{"id": "4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3", "address": "fa:16:3e:d6:b6:d3", "network": {"id": "55c18d07-a341-4678-9d1c-2dff057a9b1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1092921088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b33d01ba458f466b99b6bc5bba88d8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cd05bcc-ca", "ovs_interfaceid": "4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:42:54 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-7e9bb2e9-855e-4e05-ac3f-3b7427754070 req-01eb67fe-5d9a-4639-bef4-93d7740b3a62 service nova] Releasing lock "refresh_cache-86ecc6cb-88a8-4572-8e41-d4c5859036a6" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:42:54 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-29329b43-c04d-4291-b85e-d86f2816b52c tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5929dcf-8594-4323-a6f5-a322aff7c881/disk --force-share --output=json -f qcow2 {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:54 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-29329b43-c04d-4291-b85e-d86f2816b52c tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5929dcf-8594-4323-a6f5-a322aff7c881/disk --force-share --output=json -f qcow2" returned: 0 in 0.149s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:54 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-29329b43-c04d-4291-b85e-d86f2816b52c tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5929dcf-8594-4323-a6f5-a322aff7c881/disk --force-share --output=json -f qcow2 {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:54 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-29329b43-c04d-4291-b85e-d86f2816b52c tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5929dcf-8594-4323-a6f5-a322aff7c881/disk --force-share --output=json -f qcow2" returned: 0 in 0.145s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:54 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-29329b43-c04d-4291-b85e-d86f2816b52c tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:54 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-29329b43-c04d-4291-b85e-d86f2816b52c tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.141s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:54 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-29329b43-c04d-4291-b85e-d86f2816b52c tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpmgxnbntw/a6c34d63cf984cfa80c10b88587222c0.delta 1073741824 {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-29329b43-c04d-4291-b85e-d86f2816b52c tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpmgxnbntw/a6c34d63cf984cfa80c10b88587222c0.delta 1073741824" returned: 0 in 0.052s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:55 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-29329b43-c04d-4291-b85e-d86f2816b52c tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 29 14:42:55 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-29329b43-c04d-4291-b85e-d86f2816b52c tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=70924) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 29 14:42:56 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-29329b43-c04d-4291-b85e-d86f2816b52c tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=70924) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 29 14:42:56 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-29329b43-c04d-4291-b85e-d86f2816b52c tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 29 14:42:56 user nova-compute[70924]: DEBUG nova.privsep.utils [None req-29329b43-c04d-4291-b85e-d86f2816b52c tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70924) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 29 14:42:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-29329b43-c04d-4291-b85e-d86f2816b52c tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpmgxnbntw/a6c34d63cf984cfa80c10b88587222c0.delta /opt/stack/data/nova/instances/snapshots/tmpmgxnbntw/a6c34d63cf984cfa80c10b88587222c0 {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:42:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-29329b43-c04d-4291-b85e-d86f2816b52c tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpmgxnbntw/a6c34d63cf984cfa80c10b88587222c0.delta /opt/stack/data/nova/instances/snapshots/tmpmgxnbntw/a6c34d63cf984cfa80c10b88587222c0" returned: 0 in 0.205s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:42:56 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-29329b43-c04d-4291-b85e-d86f2816b52c tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Snapshot extracted, beginning image upload
Jul 29 14:42:57 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:59 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:42:59 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-29329b43-c04d-4291-b85e-d86f2816b52c tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Snapshot image upload complete
Jul 29 14:42:59 user nova-compute[70924]: INFO nova.compute.manager [None req-29329b43-c04d-4291-b85e-d86f2816b52c tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Took 5.44 seconds to snapshot the instance on the hypervisor.
Jul 29 14:43:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Acquiring lock "9b4c76df-f74f-43b4-968f-b730cc5b0ec6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:43:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Lock "9b4c76df-f74f-43b4-968f-b730cc5b0ec6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:43:02 user nova-compute[70924]: DEBUG nova.compute.manager [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Starting instance... {{(pid=70924) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 14:43:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:43:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:43:02 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70924) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 14:43:02 user nova-compute[70924]: INFO nova.compute.claims [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Claim successful on node user
Jul 29 14:43:02 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:43:02 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:43:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.459s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:43:02 user nova-compute[70924]: DEBUG nova.compute.manager [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Start building networks asynchronously for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 14:43:02 user nova-compute[70924]: DEBUG nova.compute.manager [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Allocating IP information in the background. {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 14:43:02 user nova-compute[70924]: DEBUG nova.network.neutron [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] allocate_for_instance() {{(pid=70924) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 14:43:02 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 14:43:02 user nova-compute[70924]: DEBUG nova.compute.manager [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Start building block device mappings for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 14:43:02 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:43:02 user nova-compute[70924]: INFO nova.virt.block_device [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Booting with volume 45a218df-4554-4d68-ba78-d0232ff799b7 at /dev/vda
Jul 29 14:43:02 user nova-compute[70924]: DEBUG nova.policy [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0b744bbecccf48d1833ea4810b2af2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2394c924af4a9aaa925d116b2117ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70924) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 14:43:02 user nova-compute[70924]: DEBUG os_brick.utils [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:43:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:02 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e2a385-801c-4616-8aab-a1cb7e89f0c2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f2127c4a30d9\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:03 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[636f2b10-b68e-453a-af26-e6110536869e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:03 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[4234d136-f3b6-4057-bc87-68eb63f38ec8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:03 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c21538-2e3f-4b84-96ae-c90d86c87482]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Running cmd (subprocess): nvme version {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] 'nvme version' failed. Not Retrying. {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:43:03 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] nvme not present on system {{(pid=70924) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 14:43:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:43:03 user nova-compute[70924]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 14:43:03 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[da59abf8-0826-411b-bee1-83445f19f3c8]: (4, '') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:03 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70924) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 14:43:03 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 14:43:03 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] LIGHTOS: no hostnqn found. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 14:43:03 user nova-compute[70924]: DEBUG os_brick.utils [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f2127c4a30d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:43:03 user nova-compute[70924]: DEBUG nova.virt.block_device [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Updating existing volume attachment record: df3e3b2b-ead7-4cbc-a30a-a4b4ca86b19e {{(pid=70924) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 14:43:03 user nova-compute[70924]: DEBUG nova.network.neutron [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Successfully created port: 325110be-cad2-4b73-9044-3028f80f3d37 {{(pid=70924) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 14:43:04 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:43:04 user nova-compute[70924]: DEBUG nova.network.neutron [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Successfully updated port: 325110be-cad2-4b73-9044-3028f80f3d37 {{(pid=70924) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 14:43:04 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Acquiring lock "refresh_cache-9b4c76df-f74f-43b4-968f-b730cc5b0ec6" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:43:04 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Acquired lock "refresh_cache-9b4c76df-f74f-43b4-968f-b730cc5b0ec6" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:43:04 user nova-compute[70924]: DEBUG nova.network.neutron [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 14:43:04 user nova-compute[70924]: DEBUG nova.compute.manager [req-588abe9d-0d13-49ea-99c8-0bfbbad2a796 req-75e4ca28-fb71-4611-b6cf-34add4745493 service nova] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Received event network-changed-325110be-cad2-4b73-9044-3028f80f3d37 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:43:04 user nova-compute[70924]: DEBUG nova.compute.manager [req-588abe9d-0d13-49ea-99c8-0bfbbad2a796 req-75e4ca28-fb71-4611-b6cf-34add4745493 service nova] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Refreshing instance network info cache due to event network-changed-325110be-cad2-4b73-9044-3028f80f3d37. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:43:04 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-588abe9d-0d13-49ea-99c8-0bfbbad2a796 req-75e4ca28-fb71-4611-b6cf-34add4745493 service nova] Acquiring lock "refresh_cache-9b4c76df-f74f-43b4-968f-b730cc5b0ec6" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:43:04 user nova-compute[70924]: DEBUG nova.network.neutron [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Instance cache missing network info. {{(pid=70924) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 14:43:05 user nova-compute[70924]: DEBUG nova.network.neutron [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Updating instance_info_cache with network_info: [{"id": "325110be-cad2-4b73-9044-3028f80f3d37", "address": "fa:16:3e:68:19:c4", "network": {"id": "b6631336-b322-45e0-99b7-5e95539aa674", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2109271400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc2394c924af4a9aaa925d116b2117ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap325110be-ca", "ovs_interfaceid": "325110be-cad2-4b73-9044-3028f80f3d37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:43:05 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Releasing lock "refresh_cache-9b4c76df-f74f-43b4-968f-b730cc5b0ec6" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:43:05 user nova-compute[70924]: DEBUG nova.compute.manager [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Instance network_info: |[{"id": "325110be-cad2-4b73-9044-3028f80f3d37", "address": "fa:16:3e:68:19:c4", "network": {"id": "b6631336-b322-45e0-99b7-5e95539aa674", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2109271400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc2394c924af4a9aaa925d116b2117ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap325110be-ca", "ovs_interfaceid": "325110be-cad2-4b73-9044-3028f80f3d37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 14:43:05 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-588abe9d-0d13-49ea-99c8-0bfbbad2a796 req-75e4ca28-fb71-4611-b6cf-34add4745493 service nova] Acquired lock "refresh_cache-9b4c76df-f74f-43b4-968f-b730cc5b0ec6" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:43:05 user nova-compute[70924]: DEBUG nova.network.neutron [req-588abe9d-0d13-49ea-99c8-0bfbbad2a796 req-75e4ca28-fb71-4611-b6cf-34add4745493 service nova] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Refreshing network info cache for port 325110be-cad2-4b73-9044-3028f80f3d37 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:43:05 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58fa085e-46a2-47a6-95be-e241eadb1c09 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] [instance: c7776982-40ea-4b06-b853-cfd484efba73] Calling os-brick to attach iSCSI Volume {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 14:43:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-58fa085e-46a2-47a6-95be-e241eadb1c09 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:731c97fa-8483-474e-a792-ec6140b812d2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kadHpxKn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:43:05 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-58fa085e-46a2-47a6-95be-e241eadb1c09 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:43:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-58fa085e-46a2-47a6-95be-e241eadb1c09 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:43:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-58fa085e-46a2-47a6-95be-e241eadb1c09 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:43:05 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-58fa085e-46a2-47a6-95be-e241eadb1c09 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:43:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-58fa085e-46a2-47a6-95be-e241eadb1c09 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:731c97fa-8483-474e-a792-ec6140b812d2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:43:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-58fa085e-46a2-47a6-95be-e241eadb1c09 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:731c97fa-8483-474e-a792-ec6140b812d2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:43:05 user nova-compute[70924]: INFO os_brick.initiator.connectors.iscsi [None req-58fa085e-46a2-47a6-95be-e241eadb1c09 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 14:43:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:731c97fa-8483-474e-a792-ec6140b812d2 -p 172.16.0.220:3260 {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:731c97fa-8483-474e-a792-ec6140b812d2 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:05 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[638080a7-b09f-4740-b071-40088366772c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-58fa085e-46a2-47a6-95be-e241eadb1c09 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 14:43:05 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:43:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:731c97fa-8483-474e-a792-ec6140b812d2 -p 172.16.0.220:3260 --interface default --op new {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:731c97fa-8483-474e-a792-ec6140b812d2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:05 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba3627c-96da-4dce-83ab-ae79bc8ba3c1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:731c97fa-8483-474e-a792-ec6140b812d2] added\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-58fa085e-46a2-47a6-95be-e241eadb1c09 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:731c97fa-8483-474e-a792-ec6140b812d2] added
Jul 29 14:43:05 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:43:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:731c97fa-8483-474e-a792-ec6140b812d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:731c97fa-8483-474e-a792-ec6140b812d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:05 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d732fa87-5783-453e-8131-d097d9282ee1]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-58fa085e-46a2-47a6-95be-e241eadb1c09 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:43:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:731c97fa-8483-474e-a792-ec6140b812d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:731c97fa-8483-474e-a792-ec6140b812d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:05 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af6d7b9-d6ef-48df-93cc-2a0d30300295]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-58fa085e-46a2-47a6-95be-e241eadb1c09 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:43:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:731c97fa-8483-474e-a792-ec6140b812d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kadHpxKn {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:731c97fa-8483-474e-a792-ec6140b812d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kadHpxKn" returned: 0 in 0.023s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:05 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[11bdff37-1610-4966-86d9-88905760abde]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-58fa085e-46a2-47a6-95be-e241eadb1c09 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kadHpxKn'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:43:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:731c97fa-8483-474e-a792-ec6140b812d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:05 user nova-compute[70924]: DEBUG nova.network.neutron [req-588abe9d-0d13-49ea-99c8-0bfbbad2a796 req-75e4ca28-fb71-4611-b6cf-34add4745493 service nova] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Updated VIF entry in instance network info cache for port 325110be-cad2-4b73-9044-3028f80f3d37. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:43:05 user nova-compute[70924]: DEBUG nova.network.neutron [req-588abe9d-0d13-49ea-99c8-0bfbbad2a796 req-75e4ca28-fb71-4611-b6cf-34add4745493 service nova] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Updating instance_info_cache with network_info: [{"id": "325110be-cad2-4b73-9044-3028f80f3d37", "address": "fa:16:3e:68:19:c4", "network": {"id": "b6631336-b322-45e0-99b7-5e95539aa674", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2109271400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc2394c924af4a9aaa925d116b2117ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap325110be-ca", "ovs_interfaceid": "325110be-cad2-4b73-9044-3028f80f3d37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:43:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:731c97fa-8483-474e-a792-ec6140b812d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:05 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d8a8546-7084-40b4-bb39-6f27234251aa]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-58fa085e-46a2-47a6-95be-e241eadb1c09 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:43:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:05 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-588abe9d-0d13-49ea-99c8-0bfbbad2a796 req-75e4ca28-fb71-4611-b6cf-34add4745493 service nova] Releasing lock "refresh_cache-9b4c76df-f74f-43b4-968f-b730cc5b0ec6" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:43:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:05 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1194aa9b-dc1f-4c3b-b44e-0bd159b654ce]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-58fa085e-46a2-47a6-95be-e241eadb1c09 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)
Jul 29 14:43:05 user nova-compute[70924]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)
Jul 29 14:43:05 user nova-compute[70924]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)
Jul 29 14:43:05 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:43:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-58fa085e-46a2-47a6-95be-e241eadb1c09 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)
Jul 29 14:43:05 user nova-compute[70924]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)
Jul 29 14:43:05 user nova-compute[70924]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)
Jul 29 14:43:05 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:43:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:731c97fa-8483-474e-a792-ec6140b812d2 -p 172.16.0.220:3260 --login {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:731c97fa-8483-474e-a792-ec6140b812d2 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:05 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23f1249-0eb5-4b3e-b18a-dd2d2ac62839]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:731c97fa-8483-474e-a792-ec6140b812d2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:731c97fa-8483-474e-a792-ec6140b812d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-58fa085e-46a2-47a6-95be-e241eadb1c09 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:731c97fa-8483-474e-a792-ec6140b812d2, portal: 172.16.0.220,3260]
Jul 29 14:43:05 user nova-compute[70924]: Login to [iface: default, target: iqn.2010-10.org.openstack:731c97fa-8483-474e-a792-ec6140b812d2, portal: 172.16.0.220,3260] successful.
Jul 29 14:43:05 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:43:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:731c97fa-8483-474e-a792-ec6140b812d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:731c97fa-8483-474e-a792-ec6140b812d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:05 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7cc7bd-10db-48bb-99b3-2bef23a08ae6]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-58fa085e-46a2-47a6-95be-e241eadb1c09 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:43:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:05 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca82055-5a2b-4f9c-b8ae-b23a4c01ffa4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731c97fa-8483-474e-a792-ec6140b812d2 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-58fa085e-46a2-47a6-95be-e241eadb1c09 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)
Jul 29 14:43:05 user nova-compute[70924]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)
Jul 29 14:43:05 user nova-compute[70924]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)
Jul 29 14:43:05 user nova-compute[70924]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731c97fa-8483-474e-a792-ec6140b812d2 (non-flash)
Jul 29 14:43:05 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:43:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-58fa085e-46a2-47a6-95be-e241eadb1c09 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)
Jul 29 14:43:05 user nova-compute[70924]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)
Jul 29 14:43:05 user nova-compute[70924]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)
Jul 29 14:43:05 user nova-compute[70924]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731c97fa-8483-474e-a792-ec6140b812d2 (non-flash)
Jul 29 14:43:05 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:43:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-58fa085e-46a2-47a6-95be-e241eadb1c09 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:731c97fa-8483-474e-a792-ec6140b812d2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:43:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-58fa085e-46a2-47a6-95be-e241eadb1c09 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Connected to 172.16.0.220:3260 {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 14:43:05 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-58fa085e-46a2-47a6-95be-e241eadb1c09 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=70924) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 14:43:05 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-58fa085e-46a2-47a6-95be-e241eadb1c09 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70924) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 14:43:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:05 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e33917d-b82e-4fdf-a6d6-f980972b472a]: (4, ('- - 0', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:05 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-58fa085e-46a2-47a6-95be-e241eadb1c09 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 14:43:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-58fa085e-46a2-47a6-95be-e241eadb1c09 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kadHpxKn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 14:43:06 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-58fa085e-46a2-47a6-95be-e241eadb1c09 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:43:06 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-58fa085e-46a2-47a6-95be-e241eadb1c09 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] <== connect_volume: return (1378ms) {'type': 'block', 'scsi_wwn': '26135363632616239', 'path': '/dev/sde'} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:43:06 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58fa085e-46a2-47a6-95be-e241eadb1c09 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] [instance: c7776982-40ea-4b06-b853-cfd484efba73] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135363632616239', 'path': '/dev/sde'} {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 14:43:06 user nova-compute[70924]: DEBUG nova.objects.instance [None req-58fa085e-46a2-47a6-95be-e241eadb1c09 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Lazy-loading 'flavor' on Instance uuid c7776982-40ea-4b06-b853-cfd484efba73 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:43:06 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-58fa085e-46a2-47a6-95be-e241eadb1c09 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] attach device xml: <disk type="block" device="disk">
Jul 29 14:43:06 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:43:06 user nova-compute[70924]:   <source dev="/dev/sde"/>
Jul 29 14:43:06 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 14:43:06 user nova-compute[70924]:   <serial>731c97fa-8483-474e-a792-ec6140b812d2</serial>
Jul 29 14:43:06 user nova-compute[70924]: </disk>
Jul 29 14:43:06 user nova-compute[70924]:  {{(pid=70924) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 29 14:43:07 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-58fa085e-46a2-47a6-95be-e241eadb1c09 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:43:07 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-58fa085e-46a2-47a6-95be-e241eadb1c09 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:43:07 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-58fa085e-46a2-47a6-95be-e241eadb1c09 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] No VIF found with MAC fa:16:3e:d3:cc:2f, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:43:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-58fa085e-46a2-47a6-95be-e241eadb1c09 tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Lock "c7776982-40ea-4b06-b853-cfd484efba73" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.781s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:43:07 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:43:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a2ea0f0c-1e95-47a1-aceb-9a733163ab0d tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Acquiring lock "c7776982-40ea-4b06-b853-cfd484efba73" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:43:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a2ea0f0c-1e95-47a1-aceb-9a733163ab0d tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Lock "c7776982-40ea-4b06-b853-cfd484efba73" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:43:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a2ea0f0c-1e95-47a1-aceb-9a733163ab0d tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Acquiring lock "c7776982-40ea-4b06-b853-cfd484efba73-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:43:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a2ea0f0c-1e95-47a1-aceb-9a733163ab0d tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Lock "c7776982-40ea-4b06-b853-cfd484efba73-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:43:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a2ea0f0c-1e95-47a1-aceb-9a733163ab0d tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Lock "c7776982-40ea-4b06-b853-cfd484efba73-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:43:08 user nova-compute[70924]: INFO nova.compute.manager [None req-a2ea0f0c-1e95-47a1-aceb-9a733163ab0d tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] [instance: c7776982-40ea-4b06-b853-cfd484efba73] Terminating instance
Jul 29 14:43:08 user nova-compute[70924]: DEBUG nova.compute.manager [None req-a2ea0f0c-1e95-47a1-aceb-9a733163ab0d tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] [instance: c7776982-40ea-4b06-b853-cfd484efba73] Start destroying the instance on the hypervisor. {{(pid=70924) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 14:43:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:43:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:43:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:43:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:43:09 user nova-compute[70924]: DEBUG nova.compute.manager [req-bee55270-4199-44da-8a6c-35d331f71144 req-54907833-8c7e-40a2-8c92-8ed7e2fc6ac5 service nova] [instance: c7776982-40ea-4b06-b853-cfd484efba73] Received event network-vif-unplugged-52dab4ab-4869-4263-9264-9150480c9efc {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:43:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-bee55270-4199-44da-8a6c-35d331f71144 req-54907833-8c7e-40a2-8c92-8ed7e2fc6ac5 service nova] Acquiring lock "c7776982-40ea-4b06-b853-cfd484efba73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:43:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-bee55270-4199-44da-8a6c-35d331f71144 req-54907833-8c7e-40a2-8c92-8ed7e2fc6ac5 service nova] Lock "c7776982-40ea-4b06-b853-cfd484efba73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:43:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-bee55270-4199-44da-8a6c-35d331f71144 req-54907833-8c7e-40a2-8c92-8ed7e2fc6ac5 service nova] Lock "c7776982-40ea-4b06-b853-cfd484efba73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:43:09 user nova-compute[70924]: DEBUG nova.compute.manager [req-bee55270-4199-44da-8a6c-35d331f71144 req-54907833-8c7e-40a2-8c92-8ed7e2fc6ac5 service nova] [instance: c7776982-40ea-4b06-b853-cfd484efba73] No waiting events found dispatching network-vif-unplugged-52dab4ab-4869-4263-9264-9150480c9efc {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:43:09 user nova-compute[70924]: DEBUG nova.compute.manager [req-bee55270-4199-44da-8a6c-35d331f71144 req-54907833-8c7e-40a2-8c92-8ed7e2fc6ac5 service nova] [instance: c7776982-40ea-4b06-b853-cfd484efba73] Received event network-vif-unplugged-52dab4ab-4869-4263-9264-9150480c9efc for instance with task_state deleting. {{(pid=70924) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 14:43:09 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: c7776982-40ea-4b06-b853-cfd484efba73] Instance destroyed successfully.
Jul 29 14:43:09 user nova-compute[70924]: DEBUG nova.objects.instance [None req-a2ea0f0c-1e95-47a1-aceb-9a733163ab0d tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Lazy-loading 'resources' on Instance uuid c7776982-40ea-4b06-b853-cfd484efba73 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:43:09 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-a2ea0f0c-1e95-47a1-aceb-9a733163ab0d tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:40:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-679123143',display_name='tempest-DeleteServersTestJSON-server-679123143',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-679123143',id=2,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:41:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='73d214e40cf84df584ebdf33293b5f98',ramdisk_id='',reservation_id='r-pi8frpfv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1415676599',owner_user_name='tempest-DeleteServersTestJSON-1415676599-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:41:17Z,user_data=None,user_id='f9c6dc46d3f5436f9ca4e07705933d5e',uuid=c7776982-40ea-4b06-b853-cfd484efba73,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "52dab4ab-4869-4263-9264-9150480c9efc", "address": "fa:16:3e:d3:cc:2f", "network": {"id": "f29c4a92-4276-4a57-b109-2f0718fe96bd", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-899695892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73d214e40cf84df584ebdf33293b5f98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52dab4ab-48", "ovs_interfaceid": "52dab4ab-4869-4263-9264-9150480c9efc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 14:43:09 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-a2ea0f0c-1e95-47a1-aceb-9a733163ab0d tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Converting VIF {"id": "52dab4ab-4869-4263-9264-9150480c9efc", "address": "fa:16:3e:d3:cc:2f", "network": {"id": "f29c4a92-4276-4a57-b109-2f0718fe96bd", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-899695892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73d214e40cf84df584ebdf33293b5f98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52dab4ab-48", "ovs_interfaceid": "52dab4ab-4869-4263-9264-9150480c9efc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:43:09 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-a2ea0f0c-1e95-47a1-aceb-9a733163ab0d tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:cc:2f,bridge_name='br-int',has_traffic_filtering=True,id=52dab4ab-4869-4263-9264-9150480c9efc,network=Network(f29c4a92-4276-4a57-b109-2f0718fe96bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52dab4ab-48') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:43:09 user nova-compute[70924]: DEBUG os_vif [None req-a2ea0f0c-1e95-47a1-aceb-9a733163ab0d tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:cc:2f,bridge_name='br-int',has_traffic_filtering=True,id=52dab4ab-4869-4263-9264-9150480c9efc,network=Network(f29c4a92-4276-4a57-b109-2f0718fe96bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52dab4ab-48') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 14:43:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:43:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap52dab4ab-48, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:43:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:43:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:43:09 user nova-compute[70924]: INFO os_vif [None req-a2ea0f0c-1e95-47a1-aceb-9a733163ab0d tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:cc:2f,bridge_name='br-int',has_traffic_filtering=True,id=52dab4ab-4869-4263-9264-9150480c9efc,network=Network(f29c4a92-4276-4a57-b109-2f0718fe96bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52dab4ab-48')
Jul 29 14:43:09 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2ea0f0c-1e95-47a1-aceb-9a733163ab0d tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] [instance: c7776982-40ea-4b06-b853-cfd484efba73] calling os-brick to detach iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 14:43:09 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2ea0f0c-1e95-47a1-aceb-9a733163ab0d tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, {'target_iqns': ['iqn.2010-10.org.openstack:731c97fa-8483-474e-a792-ec6140b812d2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kadHpxKn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:43:09 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-a2ea0f0c-1e95-47a1-aceb-9a733163ab0d tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:43:09 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-a2ea0f0c-1e95-47a1-aceb-9a733163ab0d tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:43:09 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-a2ea0f0c-1e95-47a1-aceb-9a733163ab0d tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:43:09 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2ea0f0c-1e95-47a1-aceb-9a733163ab0d tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:731c97fa-8483-474e-a792-ec6140b812d2', 0)] {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 14:43:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:09 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc2693f-d7e0-4422-8fc5-0bdae54d2d97]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:731c97fa-8483-474e-a792-ec6140b812d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:09 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b898b19f-6ee8-42df-98af-78cadc26a183]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731c97fa-8483-474e-a792-ec6140b812d2 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:09 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2ea0f0c-1e95-47a1-aceb-9a733163ab0d tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)
Jul 29 14:43:09 user nova-compute[70924]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)
Jul 29 14:43:09 user nova-compute[70924]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)
Jul 29 14:43:09 user nova-compute[70924]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731c97fa-8483-474e-a792-ec6140b812d2 (non-flash)
Jul 29 14:43:09 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:43:09 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2ea0f0c-1e95-47a1-aceb-9a733163ab0d tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)
Jul 29 14:43:09 user nova-compute[70924]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)
Jul 29 14:43:09 user nova-compute[70924]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)
Jul 29 14:43:09 user nova-compute[70924]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:731c97fa-8483-474e-a792-ec6140b812d2 (non-flash)
Jul 29 14:43:09 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:43:09 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2ea0f0c-1e95-47a1-aceb-9a733163ab0d tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feedc38b400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:731c97fa-8483-474e-a792-ec6140b812d2'): ({'sde'}, set())}) {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 14:43:09 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-a2ea0f0c-1e95-47a1-aceb-9a733163ab0d tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Removing single pathed devices sde {{(pid=70924) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 14:43:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:09 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[efaae9dc-4cdc-4e11-a94e-c4dac2bb970d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:09 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd048a0-eab6-4c86-b058-b51b289bc491]: (4, ('ok\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:09 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-a2ea0f0c-1e95-47a1-aceb-9a733163ab0d tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Flushing IO for device /dev/sde {{(pid=70924) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 14:43:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:09 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d7eedf-b97d-4184-a3eb-c8bad8f70f29]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:09 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-a2ea0f0c-1e95-47a1-aceb-9a733163ab0d tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70924) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 14:43:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.152s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:10 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c5671b-3506-4394-9c9b-0b313ec853f8]: (4, ('1', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:10 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-a2ea0f0c-1e95-47a1-aceb-9a733163ab0d tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 14:43:10 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-a2ea0f0c-1e95-47a1-aceb-9a733163ab0d tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] SCSI volumes sde have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 14:43:10 user nova-compute[70924]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO3ae816c-a5662ab9972be81c', '/dev/disk/by-id/scsi-26135363632616239', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_3ae816c') {{(pid=81998) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 29 14:43:10 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[8155e3dd-3fc9-44a5-98e0-080b0eafaa6d]: (4, None) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:10 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2ea0f0c-1e95-47a1-aceb-9a733163ab0d tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:731c97fa-8483-474e-a792-ec6140b812d2')] {{(pid=70924) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 14:43:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:731c97fa-8483-474e-a792-ec6140b812d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:731c97fa-8483-474e-a792-ec6140b812d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:10 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[32485974-2b1d-421e-8a29-9d1d1693cbd8]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:10 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2ea0f0c-1e95-47a1-aceb-9a733163ab0d tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:43:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:731c97fa-8483-474e-a792-ec6140b812d2 -p 172.16.0.220:3260 --logout {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:731c97fa-8483-474e-a792-ec6140b812d2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:10 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9292fdc2-2561-497e-84d5-1fc3d83fc4e0]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:731c97fa-8483-474e-a792-ec6140b812d2, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:731c97fa-8483-474e-a792-ec6140b812d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:10 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2ea0f0c-1e95-47a1-aceb-9a733163ab0d tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:731c97fa-8483-474e-a792-ec6140b812d2, portal: 172.16.0.220,3260]
Jul 29 14:43:10 user nova-compute[70924]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:731c97fa-8483-474e-a792-ec6140b812d2, portal: 172.16.0.220,3260] successful.
Jul 29 14:43:10 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:43:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:731c97fa-8483-474e-a792-ec6140b812d2 -p 172.16.0.220:3260 --op delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:731c97fa-8483-474e-a792-ec6140b812d2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:10 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f734507-64b7-48ff-9f21-e614894a2ae1]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:10 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2ea0f0c-1e95-47a1-aceb-9a733163ab0d tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:43:10 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-a2ea0f0c-1e95-47a1-aceb-9a733163ab0d tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.420s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:43:10 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2ea0f0c-1e95-47a1-aceb-9a733163ab0d tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] <== disconnect_volume: return (422ms) None {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:43:10 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2ea0f0c-1e95-47a1-aceb-9a733163ab0d tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] [instance: c7776982-40ea-4b06-b853-cfd484efba73] Disconnected iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 14:43:10 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-a2ea0f0c-1e95-47a1-aceb-9a733163ab0d tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] [instance: c7776982-40ea-4b06-b853-cfd484efba73] Deleting instance files /opt/stack/data/nova/instances/c7776982-40ea-4b06-b853-cfd484efba73_del
Jul 29 14:43:10 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-a2ea0f0c-1e95-47a1-aceb-9a733163ab0d tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] [instance: c7776982-40ea-4b06-b853-cfd484efba73] Deletion of /opt/stack/data/nova/instances/c7776982-40ea-4b06-b853-cfd484efba73_del complete
Jul 29 14:43:10 user nova-compute[70924]: INFO nova.compute.manager [None req-a2ea0f0c-1e95-47a1-aceb-9a733163ab0d tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] [instance: c7776982-40ea-4b06-b853-cfd484efba73] Took 1.51 seconds to destroy the instance on the hypervisor.
Jul 29 14:43:10 user nova-compute[70924]: DEBUG oslo.service.loopingcall [None req-a2ea0f0c-1e95-47a1-aceb-9a733163ab0d tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70924) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 14:43:10 user nova-compute[70924]: DEBUG nova.compute.manager [-] [instance: c7776982-40ea-4b06-b853-cfd484efba73] Deallocating network for instance {{(pid=70924) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 14:43:10 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: c7776982-40ea-4b06-b853-cfd484efba73] deallocate_for_instance() {{(pid=70924) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 14:43:11 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: c7776982-40ea-4b06-b853-cfd484efba73] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:43:11 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: c7776982-40ea-4b06-b853-cfd484efba73] Took 0.80 seconds to deallocate network for instance.
Jul 29 14:43:11 user nova-compute[70924]: DEBUG nova.compute.manager [req-e108c0f3-35f2-4123-a4f9-0dd2885372f4 req-a3e68d20-7003-4f4e-ae0d-d7c89e86fb67 service nova] [instance: c7776982-40ea-4b06-b853-cfd484efba73] Received event network-vif-plugged-52dab4ab-4869-4263-9264-9150480c9efc {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:43:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-e108c0f3-35f2-4123-a4f9-0dd2885372f4 req-a3e68d20-7003-4f4e-ae0d-d7c89e86fb67 service nova] Acquiring lock "c7776982-40ea-4b06-b853-cfd484efba73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:43:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-e108c0f3-35f2-4123-a4f9-0dd2885372f4 req-a3e68d20-7003-4f4e-ae0d-d7c89e86fb67 service nova] Lock "c7776982-40ea-4b06-b853-cfd484efba73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:43:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-e108c0f3-35f2-4123-a4f9-0dd2885372f4 req-a3e68d20-7003-4f4e-ae0d-d7c89e86fb67 service nova] Lock "c7776982-40ea-4b06-b853-cfd484efba73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:43:11 user nova-compute[70924]: DEBUG nova.compute.manager [req-e108c0f3-35f2-4123-a4f9-0dd2885372f4 req-a3e68d20-7003-4f4e-ae0d-d7c89e86fb67 service nova] [instance: c7776982-40ea-4b06-b853-cfd484efba73] No waiting events found dispatching network-vif-plugged-52dab4ab-4869-4263-9264-9150480c9efc {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:43:11 user nova-compute[70924]: WARNING nova.compute.manager [req-e108c0f3-35f2-4123-a4f9-0dd2885372f4 req-a3e68d20-7003-4f4e-ae0d-d7c89e86fb67 service nova] [instance: c7776982-40ea-4b06-b853-cfd484efba73] Received unexpected event network-vif-plugged-52dab4ab-4869-4263-9264-9150480c9efc for instance with vm_state active and task_state deleting.
Jul 29 14:43:11 user nova-compute[70924]: DEBUG nova.compute.manager [req-e108c0f3-35f2-4123-a4f9-0dd2885372f4 req-a3e68d20-7003-4f4e-ae0d-d7c89e86fb67 service nova] [instance: c7776982-40ea-4b06-b853-cfd484efba73] Received event network-vif-deleted-52dab4ab-4869-4263-9264-9150480c9efc {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:43:11 user nova-compute[70924]: DEBUG nova.compute.manager [req-17fc82da-5b41-41ac-a072-8b7f22a6b335 req-80638409-96a5-4abb-ba4e-8830dd831e76 service nova] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] Received event network-changed-c96a0580-3813-482c-8bcc-c95fe4fc1ca6 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:43:11 user nova-compute[70924]: DEBUG nova.compute.manager [req-17fc82da-5b41-41ac-a072-8b7f22a6b335 req-80638409-96a5-4abb-ba4e-8830dd831e76 service nova] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] Refreshing instance network info cache due to event network-changed-c96a0580-3813-482c-8bcc-c95fe4fc1ca6. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:43:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-17fc82da-5b41-41ac-a072-8b7f22a6b335 req-80638409-96a5-4abb-ba4e-8830dd831e76 service nova] Acquiring lock "refresh_cache-1ea2e4b1-5b93-42bf-b29d-ce6986135826" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:43:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-17fc82da-5b41-41ac-a072-8b7f22a6b335 req-80638409-96a5-4abb-ba4e-8830dd831e76 service nova] Acquired lock "refresh_cache-1ea2e4b1-5b93-42bf-b29d-ce6986135826" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:43:11 user nova-compute[70924]: DEBUG nova.network.neutron [req-17fc82da-5b41-41ac-a072-8b7f22a6b335 req-80638409-96a5-4abb-ba4e-8830dd831e76 service nova] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] Refreshing network info cache for port c96a0580-3813-482c-8bcc-c95fe4fc1ca6 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:43:11 user nova-compute[70924]: DEBUG nova.compute.manager [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Start spawning the instance on the hypervisor. {{(pid=70924) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 14:43:11 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Creating instance directory {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 14:43:11 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Creating image(s)
Jul 29 14:43:11 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Did not create local disks {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 29 14:43:11 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Ensure instance console log exists: /opt/stack/data/nova/instances/9b4c76df-f74f-43b4-968f-b730cc5b0ec6/console.log {{(pid=70924) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 14:43:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:43:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:43:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:43:11 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Start _get_guest_xml network_info=[{"id": "325110be-cad2-4b73-9044-3028f80f3d37", "address": "fa:16:3e:68:19:c4", "network": {"id": "b6631336-b322-45e0-99b7-5e95539aa674", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2109271400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc2394c924af4a9aaa925d116b2117ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap325110be-ca", "ovs_interfaceid": "325110be-cad2-4b73-9044-3028f80f3d37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uNkATmgG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9b4c76df-f74f-43b4-968f-b730cc5b0ec6', 'attached_at': '', 'detached_at': '', 'volume_id': '45a218df-4554-4d68-ba78-d0232ff799b7', 'serial': '45a218df-4554-4d68-ba78-d0232ff799b7'}, 'attachment_id': 'df3e3b2b-ead7-4cbc-a30a-a4b4ca86b19e', 'volume_type': None} {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 14:43:11 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:43:11 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:43:11 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 14:43:11 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] CPU controller missing on host. {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 14:43:11 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 14:43:11 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] CPU controller found on host. {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 14:43:11 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70924) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 14:43:11 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T14:36:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 14:43:11 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Flavor limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 14:43:11 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Image limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 14:43:11 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Flavor pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 14:43:11 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Image pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 14:43:11 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 14:43:11 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 14:43:11 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 14:43:11 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Got 1 possible topologies {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 14:43:11 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 14:43:11 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 14:43:11 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Calling os-brick to attach iSCSI Volume {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 14:43:11 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uNkATmgG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:43:11 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:43:11 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:43:11 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:43:11 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:43:11 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:43:11 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:43:11 user nova-compute[70924]: INFO os_brick.initiator.connectors.iscsi [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 14:43:11 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 -p 172.16.0.220:3260 {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:11 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 -p 172.16.0.220:3260" returned: 21 in 0.030s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:11 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1bf569-add4-48a3-a729-13bd5c82c4d8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:11 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 14:43:11 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:43:11 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 -p 172.16.0.220:3260 --interface default --op new {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:11 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:11 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[304cf887-6a3a-488d-a238-205829635150]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7] added\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:11 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7] added
Jul 29 14:43:11 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:43:11 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:11 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:11 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[228b9c55-bf84-4777-a7b5-5e6e46b71db1]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:11 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:43:11 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:12 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8fd04c7-0dc9-4c52-bc87-6435548d41ea]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:12 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:43:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uNkATmgG {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uNkATmgG" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:12 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b130a43-025b-481a-a897-3fcf035b935a]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:12 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uNkATmgG'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:43:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:12 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[844caccc-6f6b-4693-873d-402dde42a234]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:12 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:43:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:12 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[16fb049a-500f-4b7d-a745-2da0d2abd6f3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:12 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)
Jul 29 14:43:12 user nova-compute[70924]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)
Jul 29 14:43:12 user nova-compute[70924]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)
Jul 29 14:43:12 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:43:12 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)
Jul 29 14:43:12 user nova-compute[70924]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)
Jul 29 14:43:12 user nova-compute[70924]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)
Jul 29 14:43:12 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:43:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 -p 172.16.0.220:3260 --login {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:12 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c70e4e0-72f5-4da5-b728-4972a87716cf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:12 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7, portal: 172.16.0.220,3260]
Jul 29 14:43:12 user nova-compute[70924]: Login to [iface: default, target: iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7, portal: 172.16.0.220,3260] successful.
Jul 29 14:43:12 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:43:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:12 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f27db8-ae7c-41dd-b1d8-f5ad6b4bc7bc]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:12 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:43:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:12 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a5d4af-2c8c-4e9f-b559-136ba9d98e1d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:12 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)
Jul 29 14:43:12 user nova-compute[70924]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)
Jul 29 14:43:12 user nova-compute[70924]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)
Jul 29 14:43:12 user nova-compute[70924]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:43:12 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:43:12 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)
Jul 29 14:43:12 user nova-compute[70924]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)
Jul 29 14:43:12 user nova-compute[70924]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)
Jul 29 14:43:12 user nova-compute[70924]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:43:12 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:43:12 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.338s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:43:12 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Connected to 172.16.0.220:3260 {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 14:43:12 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=70924) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 14:43:12 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70924) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 14:43:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.024s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:12 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb18704-6281-42f9-a32e-5834f3a43540]: (4, ('- - 0', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:12 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: None {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 14:43:12 user nova-compute[70924]: DEBUG nova.network.neutron [req-17fc82da-5b41-41ac-a072-8b7f22a6b335 req-80638409-96a5-4abb-ba4e-8830dd831e76 service nova] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] Updated VIF entry in instance network info cache for port c96a0580-3813-482c-8bcc-c95fe4fc1ca6. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:43:12 user nova-compute[70924]: DEBUG nova.network.neutron [req-17fc82da-5b41-41ac-a072-8b7f22a6b335 req-80638409-96a5-4abb-ba4e-8830dd831e76 service nova] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] Updating instance_info_cache with network_info: [{"id": "c96a0580-3813-482c-8bcc-c95fe4fc1ca6", "address": "fa:16:3e:0f:86:7c", "network": {"id": "788ee56c-1b66-448e-9e14-51435f77396a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-395768653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f391a9af7f7482fbab589b087bfd74e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc96a0580-38", "ovs_interfaceid": "c96a0580-3813-482c-8bcc-c95fe4fc1ca6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:43:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-17fc82da-5b41-41ac-a072-8b7f22a6b335 req-80638409-96a5-4abb-ba4e-8830dd831e76 service nova] Releasing lock "refresh_cache-1ea2e4b1-5b93-42bf-b29d-ce6986135826" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:43:12 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:43:13 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 14:43:13 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uNkATmgG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 14:43:13 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:43:13 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] <== connect_volume: return (1383ms) {'type': 'block', 'scsi_wwn': '23731623232393037', 'path': '/dev/sde'} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:43:13 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23731623232393037', 'path': '/dev/sde'} {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 14:43:13 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:43:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-557172459',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-557172459',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIRtdSU+MVFf8qwfTK/HOmWFsyOji10ll1mwxkAqJoexyhER2LF96x27gUwwiTyRjXgCHH8B6MegN4zey5bLI+qd4irGAGZrC8bAT7qofxp4xjUAZePgyakCsMZxbHsjfw==',key_name='tempest-keypair-1008786546',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc2394c924af4a9aaa925d116b2117ae',ramdisk_id='',reservation_id='r-8ju02t52',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1372699391',owner_user_name='tempest-ServerActionsV293TestJSON-1372699391-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:43:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b744bbecccf48d1833ea4810b2af2d0',uuid=9b4c76df-f74f-43b4-968f-b730cc5b0ec6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "325110be-cad2-4b73-9044-3028f80f3d37", "address": "fa:16:3e:68:19:c4", "network": {"id": "b6631336-b322-45e0-99b7-5e95539aa674", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2109271400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc2394c924af4a9aaa925d116b2117ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap325110be-ca", "ovs_interfaceid": "325110be-cad2-4b73-9044-3028f80f3d37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:43:13 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Converting VIF {"id": "325110be-cad2-4b73-9044-3028f80f3d37", "address": "fa:16:3e:68:19:c4", "network": {"id": "b6631336-b322-45e0-99b7-5e95539aa674", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2109271400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc2394c924af4a9aaa925d116b2117ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap325110be-ca", "ovs_interfaceid": "325110be-cad2-4b73-9044-3028f80f3d37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:43:13 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:19:c4,bridge_name='br-int',has_traffic_filtering=True,id=325110be-cad2-4b73-9044-3028f80f3d37,network=Network(b6631336-b322-45e0-99b7-5e95539aa674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap325110be-ca') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:43:13 user nova-compute[70924]: DEBUG nova.objects.instance [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Lazy-loading 'pci_devices' on Instance uuid 9b4c76df-f74f-43b4-968f-b730cc5b0ec6 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:43:13 user nova-compute[70924]: INFO nova.compute.manager [None req-a2ea0f0c-1e95-47a1-aceb-9a733163ab0d tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] [instance: c7776982-40ea-4b06-b853-cfd484efba73] Took 2.32 seconds to detach 1 volumes for instance.
Jul 29 14:43:13 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] End _get_guest_xml xml=<domain type="kvm">
Jul 29 14:43:13 user nova-compute[70924]:   <uuid>9b4c76df-f74f-43b4-968f-b730cc5b0ec6</uuid>
Jul 29 14:43:13 user nova-compute[70924]:   <name>instance-0000000b</name>
Jul 29 14:43:13 user nova-compute[70924]:   <memory>524288</memory>
Jul 29 14:43:13 user nova-compute[70924]:   <vcpu>1</vcpu>
Jul 29 14:43:13 user nova-compute[70924]:   <metadata>
Jul 29 14:43:13 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 14:43:13 user nova-compute[70924]:       <nova:package version="0.0.0"/>
Jul 29 14:43:13 user nova-compute[70924]:       <nova:name>tempest-ServerActionsV293TestJSON-server-557172459</nova:name>
Jul 29 14:43:13 user nova-compute[70924]:       <nova:creationTime>2023-07-29 14:43:11</nova:creationTime>
Jul 29 14:43:13 user nova-compute[70924]:       <nova:flavor name="m1.tiny">
Jul 29 14:43:13 user nova-compute[70924]:         <nova:memory>512</nova:memory>
Jul 29 14:43:13 user nova-compute[70924]:         <nova:disk>1</nova:disk>
Jul 29 14:43:13 user nova-compute[70924]:         <nova:swap>0</nova:swap>
Jul 29 14:43:13 user nova-compute[70924]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 14:43:13 user nova-compute[70924]:         <nova:vcpus>1</nova:vcpus>
Jul 29 14:43:13 user nova-compute[70924]:       </nova:flavor>
Jul 29 14:43:13 user nova-compute[70924]:       <nova:owner>
Jul 29 14:43:13 user nova-compute[70924]:         <nova:user uuid="0b744bbecccf48d1833ea4810b2af2d0">tempest-ServerActionsV293TestJSON-1372699391-project-member</nova:user>
Jul 29 14:43:13 user nova-compute[70924]:         <nova:project uuid="fc2394c924af4a9aaa925d116b2117ae">tempest-ServerActionsV293TestJSON-1372699391</nova:project>
Jul 29 14:43:13 user nova-compute[70924]:       </nova:owner>
Jul 29 14:43:13 user nova-compute[70924]:       <nova:ports>
Jul 29 14:43:13 user nova-compute[70924]:         <nova:port uuid="325110be-cad2-4b73-9044-3028f80f3d37">
Jul 29 14:43:13 user nova-compute[70924]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 29 14:43:13 user nova-compute[70924]:         </nova:port>
Jul 29 14:43:13 user nova-compute[70924]:       </nova:ports>
Jul 29 14:43:13 user nova-compute[70924]:     </nova:instance>
Jul 29 14:43:13 user nova-compute[70924]:   </metadata>
Jul 29 14:43:13 user nova-compute[70924]:   <sysinfo type="smbios">
Jul 29 14:43:13 user nova-compute[70924]:     <system>
Jul 29 14:43:13 user nova-compute[70924]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 14:43:13 user nova-compute[70924]:       <entry name="product">OpenStack Nova</entry>
Jul 29 14:43:13 user nova-compute[70924]:       <entry name="version">0.0.0</entry>
Jul 29 14:43:13 user nova-compute[70924]:       <entry name="serial">9b4c76df-f74f-43b4-968f-b730cc5b0ec6</entry>
Jul 29 14:43:13 user nova-compute[70924]:       <entry name="uuid">9b4c76df-f74f-43b4-968f-b730cc5b0ec6</entry>
Jul 29 14:43:13 user nova-compute[70924]:       <entry name="family">Virtual Machine</entry>
Jul 29 14:43:13 user nova-compute[70924]:     </system>
Jul 29 14:43:13 user nova-compute[70924]:   </sysinfo>
Jul 29 14:43:13 user nova-compute[70924]:   <os>
Jul 29 14:43:13 user nova-compute[70924]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 14:43:13 user nova-compute[70924]:     <boot dev="hd"/>
Jul 29 14:43:13 user nova-compute[70924]:     <smbios mode="sysinfo"/>
Jul 29 14:43:13 user nova-compute[70924]:   </os>
Jul 29 14:43:13 user nova-compute[70924]:   <features>
Jul 29 14:43:13 user nova-compute[70924]:     <acpi/>
Jul 29 14:43:13 user nova-compute[70924]:     <apic/>
Jul 29 14:43:13 user nova-compute[70924]:     <vmcoreinfo/>
Jul 29 14:43:13 user nova-compute[70924]:   </features>
Jul 29 14:43:13 user nova-compute[70924]:   <clock offset="utc">
Jul 29 14:43:13 user nova-compute[70924]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 14:43:13 user nova-compute[70924]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 14:43:13 user nova-compute[70924]:     <timer name="hpet" present="no"/>
Jul 29 14:43:13 user nova-compute[70924]:   </clock>
Jul 29 14:43:13 user nova-compute[70924]:   <cpu mode="custom" match="exact">
Jul 29 14:43:13 user nova-compute[70924]:     <model>Nehalem</model>
Jul 29 14:43:13 user nova-compute[70924]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 14:43:13 user nova-compute[70924]:   </cpu>
Jul 29 14:43:13 user nova-compute[70924]:   <devices>
Jul 29 14:43:13 user nova-compute[70924]:     <disk type="block" device="disk">
Jul 29 14:43:13 user nova-compute[70924]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:43:13 user nova-compute[70924]:       <source dev="/dev/sde"/>
Jul 29 14:43:13 user nova-compute[70924]:       <target dev="vda" bus="virtio"/>
Jul 29 14:43:13 user nova-compute[70924]:       <serial>45a218df-4554-4d68-ba78-d0232ff799b7</serial>
Jul 29 14:43:13 user nova-compute[70924]:     </disk>
Jul 29 14:43:13 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 14:43:13 user nova-compute[70924]:       <mac address="fa:16:3e:68:19:c4"/>
Jul 29 14:43:13 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:43:13 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 14:43:13 user nova-compute[70924]:       <target dev="tap325110be-ca"/>
Jul 29 14:43:13 user nova-compute[70924]:     </interface>
Jul 29 14:43:13 user nova-compute[70924]:     <serial type="pty">
Jul 29 14:43:13 user nova-compute[70924]:       <log file="/opt/stack/data/nova/instances/9b4c76df-f74f-43b4-968f-b730cc5b0ec6/console.log" append="off"/>
Jul 29 14:43:13 user nova-compute[70924]:     </serial>
Jul 29 14:43:13 user nova-compute[70924]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 14:43:13 user nova-compute[70924]:     <video>
Jul 29 14:43:13 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:43:13 user nova-compute[70924]:     </video>
Jul 29 14:43:13 user nova-compute[70924]:     <rng model="virtio">
Jul 29 14:43:13 user nova-compute[70924]:       <backend model="random">/dev/urandom</backend>
Jul 29 14:43:13 user nova-compute[70924]:     </rng>
Jul 29 14:43:13 user nova-compute[70924]:     <controller type="usb" index="0" model="none"/>
Jul 29 14:43:13 user nova-compute[70924]:     <memballoon model="virtio">
Jul 29 14:43:13 user nova-compute[70924]:       <stats period="10"/>
Jul 29 14:43:13 user nova-compute[70924]:     </memballoon>
Jul 29 14:43:13 user nova-compute[70924]:   </devices>
Jul 29 14:43:13 user nova-compute[70924]: </domain>
Jul 29 14:43:13 user nova-compute[70924]:  {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 14:43:13 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:43:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-557172459',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-557172459',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIRtdSU+MVFf8qwfTK/HOmWFsyOji10ll1mwxkAqJoexyhER2LF96x27gUwwiTyRjXgCHH8B6MegN4zey5bLI+qd4irGAGZrC8bAT7qofxp4xjUAZePgyakCsMZxbHsjfw==',key_name='tempest-keypair-1008786546',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc2394c924af4a9aaa925d116b2117ae',ramdisk_id='',reservation_id='r-8ju02t52',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1372699391',owner_user_name='tempest-ServerActionsV293TestJSON-1372699391-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:43:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b744bbecccf48d1833ea4810b2af2d0',uuid=9b4c76df-f74f-43b4-968f-b730cc5b0ec6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "325110be-cad2-4b73-9044-3028f80f3d37", "address": "fa:16:3e:68:19:c4", "network": {"id": "b6631336-b322-45e0-99b7-5e95539aa674", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2109271400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc2394c924af4a9aaa925d116b2117ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap325110be-ca", "ovs_interfaceid": "325110be-cad2-4b73-9044-3028f80f3d37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 14:43:13 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Converting VIF {"id": "325110be-cad2-4b73-9044-3028f80f3d37", "address": "fa:16:3e:68:19:c4", "network": {"id": "b6631336-b322-45e0-99b7-5e95539aa674", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2109271400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc2394c924af4a9aaa925d116b2117ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap325110be-ca", "ovs_interfaceid": "325110be-cad2-4b73-9044-3028f80f3d37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:43:13 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:19:c4,bridge_name='br-int',has_traffic_filtering=True,id=325110be-cad2-4b73-9044-3028f80f3d37,network=Network(b6631336-b322-45e0-99b7-5e95539aa674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap325110be-ca') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:43:13 user nova-compute[70924]: DEBUG os_vif [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:19:c4,bridge_name='br-int',has_traffic_filtering=True,id=325110be-cad2-4b73-9044-3028f80f3d37,network=Network(b6631336-b322-45e0-99b7-5e95539aa674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap325110be-ca') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 14:43:13 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:43:13 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:43:13 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 14:43:13 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:43:13 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap325110be-ca, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:43:13 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap325110be-ca, col_values=(('external_ids', {'iface-id': '325110be-cad2-4b73-9044-3028f80f3d37', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:19:c4', 'vm-uuid': '9b4c76df-f74f-43b4-968f-b730cc5b0ec6'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:43:13 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:43:13 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:43:13 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:43:13 user nova-compute[70924]: INFO os_vif [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:19:c4,bridge_name='br-int',has_traffic_filtering=True,id=325110be-cad2-4b73-9044-3028f80f3d37,network=Network(b6631336-b322-45e0-99b7-5e95539aa674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap325110be-ca')
Jul 29 14:43:13 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a2ea0f0c-1e95-47a1-aceb-9a733163ab0d tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:43:13 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a2ea0f0c-1e95-47a1-aceb-9a733163ab0d tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:43:13 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:43:13 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] No VIF found with MAC fa:16:3e:68:19:c4, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:43:13 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-a2ea0f0c-1e95-47a1-aceb-9a733163ab0d tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:43:13 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-a2ea0f0c-1e95-47a1-aceb-9a733163ab0d tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:43:13 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a2ea0f0c-1e95-47a1-aceb-9a733163ab0d tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.389s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:43:13 user nova-compute[70924]: INFO nova.scheduler.client.report [None req-a2ea0f0c-1e95-47a1-aceb-9a733163ab0d tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Deleted allocations for instance c7776982-40ea-4b06-b853-cfd484efba73
Jul 29 14:43:14 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a2ea0f0c-1e95-47a1-aceb-9a733163ab0d tempest-DeleteServersTestJSON-1415676599 tempest-DeleteServersTestJSON-1415676599-project-member] Lock "c7776982-40ea-4b06-b853-cfd484efba73" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.264s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:43:14 user nova-compute[70924]: DEBUG nova.compute.manager [req-3e03256c-9e6a-42b4-b412-466b050cd299 req-d413421d-f4d3-43d5-a30e-6af31eb1fc76 service nova] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Received event network-changed-6b392743-3314-4d79-babc-13089e99b60b {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:43:14 user nova-compute[70924]: DEBUG nova.compute.manager [req-3e03256c-9e6a-42b4-b412-466b050cd299 req-d413421d-f4d3-43d5-a30e-6af31eb1fc76 service nova] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Refreshing instance network info cache due to event network-changed-6b392743-3314-4d79-babc-13089e99b60b. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:43:14 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-3e03256c-9e6a-42b4-b412-466b050cd299 req-d413421d-f4d3-43d5-a30e-6af31eb1fc76 service nova] Acquiring lock "refresh_cache-00231136-233f-4a1b-88ff-b678482ca5bb" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:43:14 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-3e03256c-9e6a-42b4-b412-466b050cd299 req-d413421d-f4d3-43d5-a30e-6af31eb1fc76 service nova] Acquired lock "refresh_cache-00231136-233f-4a1b-88ff-b678482ca5bb" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:43:14 user nova-compute[70924]: DEBUG nova.network.neutron [req-3e03256c-9e6a-42b4-b412-466b050cd299 req-d413421d-f4d3-43d5-a30e-6af31eb1fc76 service nova] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Refreshing network info cache for port 6b392743-3314-4d79-babc-13089e99b60b {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:43:14 user nova-compute[70924]: DEBUG nova.network.neutron [req-3e03256c-9e6a-42b4-b412-466b050cd299 req-d413421d-f4d3-43d5-a30e-6af31eb1fc76 service nova] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Updated VIF entry in instance network info cache for port 6b392743-3314-4d79-babc-13089e99b60b. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:43:14 user nova-compute[70924]: DEBUG nova.network.neutron [req-3e03256c-9e6a-42b4-b412-466b050cd299 req-d413421d-f4d3-43d5-a30e-6af31eb1fc76 service nova] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Updating instance_info_cache with network_info: [{"id": "6b392743-3314-4d79-babc-13089e99b60b", "address": "fa:16:3e:fd:b3:38", "network": {"id": "40edab25-ab3a-4874-b47f-1ffa2b5452ee", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1511348766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c7e4c0801264e7794b962f8856e5734", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b392743-33", "ovs_interfaceid": "6b392743-3314-4d79-babc-13089e99b60b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:43:14 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-3e03256c-9e6a-42b4-b412-466b050cd299 req-d413421d-f4d3-43d5-a30e-6af31eb1fc76 service nova] Releasing lock "refresh_cache-00231136-233f-4a1b-88ff-b678482ca5bb" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:43:15 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:43:15 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:43:15 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:43:15 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:43:15 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:43:15 user nova-compute[70924]: DEBUG nova.compute.manager [req-22d990d7-22d0-4bf2-9ac4-ea9bd983173b req-39a375e0-63d2-47bb-8f98-581360a93764 service nova] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Received event network-vif-plugged-325110be-cad2-4b73-9044-3028f80f3d37 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:43:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-22d990d7-22d0-4bf2-9ac4-ea9bd983173b req-39a375e0-63d2-47bb-8f98-581360a93764 service nova] Acquiring lock "9b4c76df-f74f-43b4-968f-b730cc5b0ec6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:43:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-22d990d7-22d0-4bf2-9ac4-ea9bd983173b req-39a375e0-63d2-47bb-8f98-581360a93764 service nova] Lock "9b4c76df-f74f-43b4-968f-b730cc5b0ec6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:43:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-22d990d7-22d0-4bf2-9ac4-ea9bd983173b req-39a375e0-63d2-47bb-8f98-581360a93764 service nova] Lock "9b4c76df-f74f-43b4-968f-b730cc5b0ec6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:43:15 user nova-compute[70924]: DEBUG nova.compute.manager [req-22d990d7-22d0-4bf2-9ac4-ea9bd983173b req-39a375e0-63d2-47bb-8f98-581360a93764 service nova] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] No waiting events found dispatching network-vif-plugged-325110be-cad2-4b73-9044-3028f80f3d37 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:43:15 user nova-compute[70924]: WARNING nova.compute.manager [req-22d990d7-22d0-4bf2-9ac4-ea9bd983173b req-39a375e0-63d2-47bb-8f98-581360a93764 service nova] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Received unexpected event network-vif-plugged-325110be-cad2-4b73-9044-3028f80f3d37 for instance with vm_state building and task_state spawning.
Jul 29 14:43:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-6d2d8a94-049f-4418-af10-847e98af99cc tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Acquiring lock "1ea2e4b1-5b93-42bf-b29d-ce6986135826" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:43:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-6d2d8a94-049f-4418-af10-847e98af99cc tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Lock "1ea2e4b1-5b93-42bf-b29d-ce6986135826" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:43:15 user nova-compute[70924]: DEBUG nova.objects.instance [None req-6d2d8a94-049f-4418-af10-847e98af99cc tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Lazy-loading 'flavor' on Instance uuid 1ea2e4b1-5b93-42bf-b29d-ce6986135826 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:43:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-6d2d8a94-049f-4418-af10-847e98af99cc tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Lock "1ea2e4b1-5b93-42bf-b29d-ce6986135826" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:43:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-6d2d8a94-049f-4418-af10-847e98af99cc tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Acquiring lock "1ea2e4b1-5b93-42bf-b29d-ce6986135826" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:43:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-6d2d8a94-049f-4418-af10-847e98af99cc tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Lock "1ea2e4b1-5b93-42bf-b29d-ce6986135826" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:43:16 user nova-compute[70924]: INFO nova.compute.manager [None req-6d2d8a94-049f-4418-af10-847e98af99cc tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] Attaching volume e5ea48bd-7ebc-461c-aaf5-fd667c565974 to /dev/sdc
Jul 29 14:43:16 user nova-compute[70924]: DEBUG os_brick.utils [None req-6d2d8a94-049f-4418-af10-847e98af99cc tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:43:16 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:16 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:16 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9549af3-9ed4-4105-9d8d-52095a3a9e8c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f2127c4a30d9\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:16 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:16 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:16 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6957721-5ed8-4dbd-84ed-0ddff2caea40]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:16 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:16 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:16 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b345c8-76bf-4cf8-8f46-edd2648f4330]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:16 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f61da3-35f8-4899-bb36-dc4ea11987ae]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:16 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-6d2d8a94-049f-4418-af10-847e98af99cc tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Running cmd (subprocess): nvme version {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:16 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-6d2d8a94-049f-4418-af10-847e98af99cc tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] 'nvme version' failed. Not Retrying. {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:43:16 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6d2d8a94-049f-4418-af10-847e98af99cc tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] nvme not present on system {{(pid=70924) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 14:43:16 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:16 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:43:16 user nova-compute[70924]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 14:43:16 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[620723af-0520-42be-91aa-37053e6e87ee]: (4, '') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:16 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-6d2d8a94-049f-4418-af10-847e98af99cc tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70924) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 14:43:16 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-6d2d8a94-049f-4418-af10-847e98af99cc tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 14:43:16 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-6d2d8a94-049f-4418-af10-847e98af99cc tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] LIGHTOS: no hostnqn found. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 14:43:16 user nova-compute[70924]: DEBUG os_brick.utils [None req-6d2d8a94-049f-4418-af10-847e98af99cc tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f2127c4a30d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:43:16 user nova-compute[70924]: DEBUG nova.virt.block_device [None req-6d2d8a94-049f-4418-af10-847e98af99cc tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] Updating existing volume attachment record: 60f040f9-d2d9-4b7a-b85a-578ad12ddca4 {{(pid=70924) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 14:43:17 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690641797.4296615, 9b4c76df-f74f-43b4-968f-b730cc5b0ec6 => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:43:17 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] VM Resumed (Lifecycle Event)
Jul 29 14:43:17 user nova-compute[70924]: DEBUG nova.compute.manager [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Instance event wait completed in 0 seconds for  {{(pid=70924) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 14:43:17 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Guest created on hypervisor {{(pid=70924) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 14:43:17 user nova-compute[70924]: DEBUG nova.compute.manager [req-4fcce316-90fb-4ba4-a55b-6a5a15e02306 req-8b5be51a-f432-448d-858e-d510c4008e25 service nova] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Received event network-vif-plugged-325110be-cad2-4b73-9044-3028f80f3d37 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:43:17 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-4fcce316-90fb-4ba4-a55b-6a5a15e02306 req-8b5be51a-f432-448d-858e-d510c4008e25 service nova] Acquiring lock "9b4c76df-f74f-43b4-968f-b730cc5b0ec6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:43:17 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-4fcce316-90fb-4ba4-a55b-6a5a15e02306 req-8b5be51a-f432-448d-858e-d510c4008e25 service nova] Lock "9b4c76df-f74f-43b4-968f-b730cc5b0ec6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:43:17 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-4fcce316-90fb-4ba4-a55b-6a5a15e02306 req-8b5be51a-f432-448d-858e-d510c4008e25 service nova] Lock "9b4c76df-f74f-43b4-968f-b730cc5b0ec6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:43:17 user nova-compute[70924]: DEBUG nova.compute.manager [req-4fcce316-90fb-4ba4-a55b-6a5a15e02306 req-8b5be51a-f432-448d-858e-d510c4008e25 service nova] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] No waiting events found dispatching network-vif-plugged-325110be-cad2-4b73-9044-3028f80f3d37 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:43:17 user nova-compute[70924]: WARNING nova.compute.manager [req-4fcce316-90fb-4ba4-a55b-6a5a15e02306 req-8b5be51a-f432-448d-858e-d510c4008e25 service nova] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Received unexpected event network-vif-plugged-325110be-cad2-4b73-9044-3028f80f3d37 for instance with vm_state building and task_state spawning.
Jul 29 14:43:17 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:43:17 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Instance spawned successfully.
Jul 29 14:43:17 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 14:43:17 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:43:17 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:43:17 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690641797.433506, 9b4c76df-f74f-43b4-968f-b730cc5b0ec6 => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:43:17 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] VM Started (Lifecycle Event)
Jul 29 14:43:17 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Found default for hw_cdrom_bus of ide {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:43:17 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Found default for hw_disk_bus of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:43:17 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Found default for hw_input_bus of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:43:17 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Found default for hw_pointer_model of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:43:17 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Found default for hw_video_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:43:17 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Found default for hw_vif_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:43:17 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:43:17 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:43:17 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:43:17 user nova-compute[70924]: INFO nova.compute.manager [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Took 6.09 seconds to spawn the instance on the hypervisor.
Jul 29 14:43:17 user nova-compute[70924]: DEBUG nova.compute.manager [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:43:17 user nova-compute[70924]: DEBUG nova.compute.manager [req-cc2c5e85-f52a-4a3d-be0c-26fd2ef904f1 req-0d9cefb3-47f8-491c-a7e3-6b3c3a43c5d9 service nova] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Received event network-changed-4350e95a-3892-4c83-a407-aa696585eac6 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:43:17 user nova-compute[70924]: DEBUG nova.compute.manager [req-cc2c5e85-f52a-4a3d-be0c-26fd2ef904f1 req-0d9cefb3-47f8-491c-a7e3-6b3c3a43c5d9 service nova] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Refreshing instance network info cache due to event network-changed-4350e95a-3892-4c83-a407-aa696585eac6. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:43:17 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-cc2c5e85-f52a-4a3d-be0c-26fd2ef904f1 req-0d9cefb3-47f8-491c-a7e3-6b3c3a43c5d9 service nova] Acquiring lock "refresh_cache-a9549556-e9a7-4782-ade4-9d397d5323d0" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:43:17 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-cc2c5e85-f52a-4a3d-be0c-26fd2ef904f1 req-0d9cefb3-47f8-491c-a7e3-6b3c3a43c5d9 service nova] Acquired lock "refresh_cache-a9549556-e9a7-4782-ade4-9d397d5323d0" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:43:17 user nova-compute[70924]: DEBUG nova.network.neutron [req-cc2c5e85-f52a-4a3d-be0c-26fd2ef904f1 req-0d9cefb3-47f8-491c-a7e3-6b3c3a43c5d9 service nova] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Refreshing network info cache for port 4350e95a-3892-4c83-a407-aa696585eac6 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:43:17 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:43:17 user nova-compute[70924]: INFO nova.compute.manager [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Took 15.75 seconds to build instance.
Jul 29 14:43:18 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0dc6d4ad-53c3-4b67-af76-75cd5fb71e15 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Lock "9b4c76df-f74f-43b4-968f-b730cc5b0ec6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.867s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:43:18 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-dca8a2b5-ab18-4acd-8afd-d8d9739a16ed tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Acquiring lock "00231136-233f-4a1b-88ff-b678482ca5bb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:43:18 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-dca8a2b5-ab18-4acd-8afd-d8d9739a16ed tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Lock "00231136-233f-4a1b-88ff-b678482ca5bb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:43:18 user nova-compute[70924]: DEBUG nova.objects.instance [None req-dca8a2b5-ab18-4acd-8afd-d8d9739a16ed tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Lazy-loading 'flavor' on Instance uuid 00231136-233f-4a1b-88ff-b678482ca5bb {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:43:18 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-dca8a2b5-ab18-4acd-8afd-d8d9739a16ed tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Lock "00231136-233f-4a1b-88ff-b678482ca5bb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.096s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:43:18 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ea11e7c3-5c15-4931-9059-bb1eca8d72a0 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Acquiring lock "interface-a9549556-e9a7-4782-ade4-9d397d5323d0-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:43:18 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ea11e7c3-5c15-4931-9059-bb1eca8d72a0 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Lock "interface-a9549556-e9a7-4782-ade4-9d397d5323d0-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:43:18 user nova-compute[70924]: DEBUG nova.objects.instance [None req-ea11e7c3-5c15-4931-9059-bb1eca8d72a0 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Lazy-loading 'flavor' on Instance uuid a9549556-e9a7-4782-ade4-9d397d5323d0 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:43:18 user nova-compute[70924]: DEBUG nova.network.neutron [req-cc2c5e85-f52a-4a3d-be0c-26fd2ef904f1 req-0d9cefb3-47f8-491c-a7e3-6b3c3a43c5d9 service nova] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Updated VIF entry in instance network info cache for port 4350e95a-3892-4c83-a407-aa696585eac6. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:43:18 user nova-compute[70924]: DEBUG nova.network.neutron [req-cc2c5e85-f52a-4a3d-be0c-26fd2ef904f1 req-0d9cefb3-47f8-491c-a7e3-6b3c3a43c5d9 service nova] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Updating instance_info_cache with network_info: [{"id": "4350e95a-3892-4c83-a407-aa696585eac6", "address": "fa:16:3e:5d:b8:2a", "network": {"id": "4ca69734-4a00-4e6b-bbad-8bc03edba586", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1313665133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f5512f71fe048c5936b9154c0e3126b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4350e95a-38", "ovs_interfaceid": "4350e95a-3892-4c83-a407-aa696585eac6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:43:18 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-cc2c5e85-f52a-4a3d-be0c-26fd2ef904f1 req-0d9cefb3-47f8-491c-a7e3-6b3c3a43c5d9 service nova] Releasing lock "refresh_cache-a9549556-e9a7-4782-ade4-9d397d5323d0" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:43:18 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-dca8a2b5-ab18-4acd-8afd-d8d9739a16ed tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Acquiring lock "00231136-233f-4a1b-88ff-b678482ca5bb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:43:18 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-dca8a2b5-ab18-4acd-8afd-d8d9739a16ed tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Lock "00231136-233f-4a1b-88ff-b678482ca5bb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:43:18 user nova-compute[70924]: INFO nova.compute.manager [None req-dca8a2b5-ab18-4acd-8afd-d8d9739a16ed tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Attaching volume c72de1bc-8d39-4290-b4c7-720821b3063c to /dev/vdb
Jul 29 14:43:18 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:43:18 user nova-compute[70924]: DEBUG os_brick.utils [None req-dca8a2b5-ab18-4acd-8afd-d8d9739a16ed tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:43:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:18 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1cd2e62-b4ee-49cb-a87f-dd590c317340]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f2127c4a30d9\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:18 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e7f67a-74d3-4297-b650-72c6378461f5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:18 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[578db111-7567-4887-aebf-16746a75ebfc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:18 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc1dada-aec2-4ba3-9731-7e1852810277]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-dca8a2b5-ab18-4acd-8afd-d8d9739a16ed tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Running cmd (subprocess): nvme version {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-dca8a2b5-ab18-4acd-8afd-d8d9739a16ed tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] 'nvme version' failed. Not Retrying. {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:43:18 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dca8a2b5-ab18-4acd-8afd-d8d9739a16ed tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] nvme not present on system {{(pid=70924) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 14:43:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:43:18 user nova-compute[70924]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 14:43:18 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f520a297-1652-4f69-a909-21eac88e2541]: (4, '') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:18 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-dca8a2b5-ab18-4acd-8afd-d8d9739a16ed tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70924) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 14:43:18 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-dca8a2b5-ab18-4acd-8afd-d8d9739a16ed tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 14:43:18 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-dca8a2b5-ab18-4acd-8afd-d8d9739a16ed tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] LIGHTOS: no hostnqn found. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 14:43:18 user nova-compute[70924]: DEBUG os_brick.utils [None req-dca8a2b5-ab18-4acd-8afd-d8d9739a16ed tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f2127c4a30d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:43:18 user nova-compute[70924]: DEBUG nova.virt.block_device [None req-dca8a2b5-ab18-4acd-8afd-d8d9739a16ed tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Updating existing volume attachment record: 1138370d-51f0-49d7-b19e-cf6f4ee697de {{(pid=70924) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 14:43:19 user nova-compute[70924]: DEBUG nova.objects.instance [None req-ea11e7c3-5c15-4931-9059-bb1eca8d72a0 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Lazy-loading 'pci_requests' on Instance uuid a9549556-e9a7-4782-ade4-9d397d5323d0 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:43:19 user nova-compute[70924]: DEBUG nova.network.neutron [None req-ea11e7c3-5c15-4931-9059-bb1eca8d72a0 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] allocate_for_instance() {{(pid=70924) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 14:43:19 user nova-compute[70924]: DEBUG nova.policy [None req-ea11e7c3-5c15-4931-9059-bb1eca8d72a0 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5a5e9a9bfa864d5f85a3a79499019d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5512f71fe048c5936b9154c0e3126b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70924) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 14:43:19 user nova-compute[70924]: DEBUG nova.network.neutron [None req-ea11e7c3-5c15-4931-9059-bb1eca8d72a0 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Successfully created port: 3330a4ca-44e5-4069-9cc8-0da51c0f10d2 {{(pid=70924) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 14:43:21 user nova-compute[70924]: DEBUG nova.network.neutron [None req-ea11e7c3-5c15-4931-9059-bb1eca8d72a0 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Successfully updated port: 3330a4ca-44e5-4069-9cc8-0da51c0f10d2 {{(pid=70924) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 14:43:21 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ea11e7c3-5c15-4931-9059-bb1eca8d72a0 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Acquiring lock "refresh_cache-a9549556-e9a7-4782-ade4-9d397d5323d0" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:43:21 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ea11e7c3-5c15-4931-9059-bb1eca8d72a0 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Acquired lock "refresh_cache-a9549556-e9a7-4782-ade4-9d397d5323d0" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:43:21 user nova-compute[70924]: DEBUG nova.network.neutron [None req-ea11e7c3-5c15-4931-9059-bb1eca8d72a0 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 14:43:21 user nova-compute[70924]: DEBUG nova.compute.manager [req-8b27be30-8ebe-44f4-b3cf-3772eb1be977 req-295da323-7259-48cb-a761-6f7977eee365 service nova] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Received event network-changed-3330a4ca-44e5-4069-9cc8-0da51c0f10d2 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:43:21 user nova-compute[70924]: DEBUG nova.compute.manager [req-8b27be30-8ebe-44f4-b3cf-3772eb1be977 req-295da323-7259-48cb-a761-6f7977eee365 service nova] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Refreshing instance network info cache due to event network-changed-3330a4ca-44e5-4069-9cc8-0da51c0f10d2. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:43:21 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-8b27be30-8ebe-44f4-b3cf-3772eb1be977 req-295da323-7259-48cb-a761-6f7977eee365 service nova] Acquiring lock "refresh_cache-a9549556-e9a7-4782-ade4-9d397d5323d0" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:43:22 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a6d369fa-e05d-4aad-ab35-f18415bbd38c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Acquiring lock "fcbb998c-2dac-47d9-985a-d5b2a15ddaa0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:43:22 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a6d369fa-e05d-4aad-ab35-f18415bbd38c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Lock "fcbb998c-2dac-47d9-985a-d5b2a15ddaa0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:43:22 user nova-compute[70924]: DEBUG nova.objects.instance [None req-a6d369fa-e05d-4aad-ab35-f18415bbd38c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Lazy-loading 'flavor' on Instance uuid fcbb998c-2dac-47d9-985a-d5b2a15ddaa0 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:43:22 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a6d369fa-e05d-4aad-ab35-f18415bbd38c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Lock "fcbb998c-2dac-47d9-985a-d5b2a15ddaa0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:43:22 user nova-compute[70924]: DEBUG nova.network.neutron [None req-ea11e7c3-5c15-4931-9059-bb1eca8d72a0 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Updating instance_info_cache with network_info: [{"id": "4350e95a-3892-4c83-a407-aa696585eac6", "address": "fa:16:3e:5d:b8:2a", "network": {"id": "4ca69734-4a00-4e6b-bbad-8bc03edba586", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1313665133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f5512f71fe048c5936b9154c0e3126b", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4350e95a-38", "ovs_interfaceid": "4350e95a-3892-4c83-a407-aa696585eac6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3330a4ca-44e5-4069-9cc8-0da51c0f10d2", "address": "fa:16:3e:15:50:23", "network": {"id": "d3274b98-c5db-4936-ad6a-d97250e08d2e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1553772351", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3f5512f71fe048c5936b9154c0e3126b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3330a4ca-44", "ovs_interfaceid": "3330a4ca-44e5-4069-9cc8-0da51c0f10d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:43:22 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ea11e7c3-5c15-4931-9059-bb1eca8d72a0 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Releasing lock "refresh_cache-a9549556-e9a7-4782-ade4-9d397d5323d0" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:43:22 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-8b27be30-8ebe-44f4-b3cf-3772eb1be977 req-295da323-7259-48cb-a761-6f7977eee365 service nova] Acquired lock "refresh_cache-a9549556-e9a7-4782-ade4-9d397d5323d0" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:43:22 user nova-compute[70924]: DEBUG nova.network.neutron [req-8b27be30-8ebe-44f4-b3cf-3772eb1be977 req-295da323-7259-48cb-a761-6f7977eee365 service nova] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Refreshing network info cache for port 3330a4ca-44e5-4069-9cc8-0da51c0f10d2 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:43:22 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-ea11e7c3-5c15-4931-9059-bb1eca8d72a0 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T14:41:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-850043246',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-850043246',id=8,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFowQgMXsn6ojeJst6U4SII3CK7C8iaLrF5WpK72LhkyBx1DR2/8ARcNjiYRGN2W6nR3e0I7GRFV8EHB/gQZBqjcYpW+ZSwmA+QfOaNLnctkqx//pbvW+SsaaXulcoKRlQ==',key_name='tempest-keypair-1737564447',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:41:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3f5512f71fe048c5936b9154c0e3126b',ramdisk_id='',reservation_id='r-2gg4afvj',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-209058297',owner_user_name='tempest-TaggedAttachmentsTest-209058297-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:41:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a5e9a9bfa864d5f85a3a79499019d9b',uuid=a9549556-e9a7-4782-ade4-9d397d5323d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3330a4ca-44e5-4069-9cc8-0da51c0f10d2", "address": "fa:16:3e:15:50:23", "network": {"id": "d3274b98-c5db-4936-ad6a-d97250e08d2e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1553772351", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3f5512f71fe048c5936b9154c0e3126b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3330a4ca-44", "ovs_interfaceid": "3330a4ca-44e5-4069-9cc8-0da51c0f10d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 14:43:22 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-ea11e7c3-5c15-4931-9059-bb1eca8d72a0 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Converting VIF {"id": "3330a4ca-44e5-4069-9cc8-0da51c0f10d2", "address": "fa:16:3e:15:50:23", "network": {"id": "d3274b98-c5db-4936-ad6a-d97250e08d2e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1553772351", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3f5512f71fe048c5936b9154c0e3126b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3330a4ca-44", "ovs_interfaceid": "3330a4ca-44e5-4069-9cc8-0da51c0f10d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:43:22 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-ea11e7c3-5c15-4931-9059-bb1eca8d72a0 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:50:23,bridge_name='br-int',has_traffic_filtering=True,id=3330a4ca-44e5-4069-9cc8-0da51c0f10d2,network=Network(d3274b98-c5db-4936-ad6a-d97250e08d2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3330a4ca-44') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:43:22 user nova-compute[70924]: DEBUG os_vif [None req-ea11e7c3-5c15-4931-9059-bb1eca8d72a0 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:50:23,bridge_name='br-int',has_traffic_filtering=True,id=3330a4ca-44e5-4069-9cc8-0da51c0f10d2,network=Network(d3274b98-c5db-4936-ad6a-d97250e08d2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3330a4ca-44') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 14:43:22 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:43:22 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:43:22 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 14:43:22 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:43:22 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3330a4ca-44, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:43:22 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3330a4ca-44, col_values=(('external_ids', {'iface-id': '3330a4ca-44e5-4069-9cc8-0da51c0f10d2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:50:23', 'vm-uuid': 'a9549556-e9a7-4782-ade4-9d397d5323d0'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:43:22 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:43:22 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:43:22 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a6d369fa-e05d-4aad-ab35-f18415bbd38c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Acquiring lock "fcbb998c-2dac-47d9-985a-d5b2a15ddaa0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:43:22 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a6d369fa-e05d-4aad-ab35-f18415bbd38c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Lock "fcbb998c-2dac-47d9-985a-d5b2a15ddaa0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:43:22 user nova-compute[70924]: INFO nova.compute.manager [None req-a6d369fa-e05d-4aad-ab35-f18415bbd38c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Attaching volume 19775624-b219-4d3e-9c48-58c1b8dfb648 to /dev/vdb
Jul 29 14:43:22 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:43:22 user nova-compute[70924]: INFO os_vif [None req-ea11e7c3-5c15-4931-9059-bb1eca8d72a0 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:50:23,bridge_name='br-int',has_traffic_filtering=True,id=3330a4ca-44e5-4069-9cc8-0da51c0f10d2,network=Network(d3274b98-c5db-4936-ad6a-d97250e08d2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3330a4ca-44')
Jul 29 14:43:22 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-ea11e7c3-5c15-4931-9059-bb1eca8d72a0 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T14:41:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-850043246',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-850043246',id=8,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFowQgMXsn6ojeJst6U4SII3CK7C8iaLrF5WpK72LhkyBx1DR2/8ARcNjiYRGN2W6nR3e0I7GRFV8EHB/gQZBqjcYpW+ZSwmA+QfOaNLnctkqx//pbvW+SsaaXulcoKRlQ==',key_name='tempest-keypair-1737564447',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:41:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3f5512f71fe048c5936b9154c0e3126b',ramdisk_id='',reservation_id='r-2gg4afvj',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-209058297',owner_user_name='tempest-TaggedAttachmentsTest-209058297-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:41:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a5e9a9bfa864d5f85a3a79499019d9b',uuid=a9549556-e9a7-4782-ade4-9d397d5323d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3330a4ca-44e5-4069-9cc8-0da51c0f10d2", "address": "fa:16:3e:15:50:23", "network": {"id": "d3274b98-c5db-4936-ad6a-d97250e08d2e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1553772351", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3f5512f71fe048c5936b9154c0e3126b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3330a4ca-44", "ovs_interfaceid": "3330a4ca-44e5-4069-9cc8-0da51c0f10d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:43:22 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-ea11e7c3-5c15-4931-9059-bb1eca8d72a0 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Converting VIF {"id": "3330a4ca-44e5-4069-9cc8-0da51c0f10d2", "address": "fa:16:3e:15:50:23", "network": {"id": "d3274b98-c5db-4936-ad6a-d97250e08d2e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1553772351", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3f5512f71fe048c5936b9154c0e3126b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3330a4ca-44", "ovs_interfaceid": "3330a4ca-44e5-4069-9cc8-0da51c0f10d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:43:22 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-ea11e7c3-5c15-4931-9059-bb1eca8d72a0 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:50:23,bridge_name='br-int',has_traffic_filtering=True,id=3330a4ca-44e5-4069-9cc8-0da51c0f10d2,network=Network(d3274b98-c5db-4936-ad6a-d97250e08d2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3330a4ca-44') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:43:22 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-ea11e7c3-5c15-4931-9059-bb1eca8d72a0 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] attach device xml: <interface type="ethernet">
Jul 29 14:43:22 user nova-compute[70924]:   <mac address="fa:16:3e:15:50:23"/>
Jul 29 14:43:22 user nova-compute[70924]:   <model type="virtio"/>
Jul 29 14:43:22 user nova-compute[70924]:   <mtu size="1442"/>
Jul 29 14:43:22 user nova-compute[70924]:   <target dev="tap3330a4ca-44"/>
Jul 29 14:43:22 user nova-compute[70924]: </interface>
Jul 29 14:43:22 user nova-compute[70924]:  {{(pid=70924) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 29 14:43:22 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:43:22 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:43:22 user nova-compute[70924]: DEBUG os_brick.utils [None req-a6d369fa-e05d-4aad-ab35-f18415bbd38c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:43:22 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:22 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:22 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf5b232-e690-4096-9528-4cb88f2a34ad]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f2127c4a30d9\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:22 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:22 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:22 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f50e98-471d-4a1a-ac2a-b5e4c6c50698]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:22 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:22 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:22 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[96be0c12-8462-4e98-bdc2-055c8fe4a800]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:22 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb28a01-2e10-40e6-8387-47e410f254eb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:22 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-a6d369fa-e05d-4aad-ab35-f18415bbd38c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Running cmd (subprocess): nvme version {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:22 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-a6d369fa-e05d-4aad-ab35-f18415bbd38c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] 'nvme version' failed. Not Retrying. {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:43:22 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a6d369fa-e05d-4aad-ab35-f18415bbd38c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] nvme not present on system {{(pid=70924) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 14:43:22 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:22 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:43:22 user nova-compute[70924]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 14:43:22 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[09018539-0424-4656-82a6-6b4389797334]: (4, '') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:22 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-a6d369fa-e05d-4aad-ab35-f18415bbd38c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70924) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 14:43:22 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-a6d369fa-e05d-4aad-ab35-f18415bbd38c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 14:43:22 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-a6d369fa-e05d-4aad-ab35-f18415bbd38c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] LIGHTOS: no hostnqn found. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 14:43:22 user nova-compute[70924]: DEBUG os_brick.utils [None req-a6d369fa-e05d-4aad-ab35-f18415bbd38c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] <== get_connector_properties: return (166ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f2127c4a30d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:43:22 user nova-compute[70924]: DEBUG nova.virt.block_device [None req-a6d369fa-e05d-4aad-ab35-f18415bbd38c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Updating existing volume attachment record: 49a3d175-93c4-414d-bd40-7ac0729e0778 {{(pid=70924) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 14:43:22 user nova-compute[70924]: DEBUG nova.compute.manager [req-a0054620-373f-421a-868d-f6df728327a2 req-4ce42c68-cffa-4f22-ac67-456c42b3fa69 service nova] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Received event network-vif-plugged-3330a4ca-44e5-4069-9cc8-0da51c0f10d2 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:43:22 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a0054620-373f-421a-868d-f6df728327a2 req-4ce42c68-cffa-4f22-ac67-456c42b3fa69 service nova] Acquiring lock "a9549556-e9a7-4782-ade4-9d397d5323d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:43:22 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a0054620-373f-421a-868d-f6df728327a2 req-4ce42c68-cffa-4f22-ac67-456c42b3fa69 service nova] Lock "a9549556-e9a7-4782-ade4-9d397d5323d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:43:22 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a0054620-373f-421a-868d-f6df728327a2 req-4ce42c68-cffa-4f22-ac67-456c42b3fa69 service nova] Lock "a9549556-e9a7-4782-ade4-9d397d5323d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:43:22 user nova-compute[70924]: DEBUG nova.compute.manager [req-a0054620-373f-421a-868d-f6df728327a2 req-4ce42c68-cffa-4f22-ac67-456c42b3fa69 service nova] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] No waiting events found dispatching network-vif-plugged-3330a4ca-44e5-4069-9cc8-0da51c0f10d2 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:43:22 user nova-compute[70924]: WARNING nova.compute.manager [req-a0054620-373f-421a-868d-f6df728327a2 req-4ce42c68-cffa-4f22-ac67-456c42b3fa69 service nova] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Received unexpected event network-vif-plugged-3330a4ca-44e5-4069-9cc8-0da51c0f10d2 for instance with vm_state active and task_state None.
Jul 29 14:43:22 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:43:23 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-ea11e7c3-5c15-4931-9059-bb1eca8d72a0 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:43:23 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-ea11e7c3-5c15-4931-9059-bb1eca8d72a0 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] No BDM found with device name hda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:43:23 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-ea11e7c3-5c15-4931-9059-bb1eca8d72a0 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] No VIF found with MAC fa:16:3e:5d:b8:2a, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:43:23 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-ea11e7c3-5c15-4931-9059-bb1eca8d72a0 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 14:43:23 user nova-compute[70924]:   <nova:package version="0.0.0"/>
Jul 29 14:43:23 user nova-compute[70924]:   <nova:name>tempest-device-tagging-server-850043246</nova:name>
Jul 29 14:43:23 user nova-compute[70924]:   <nova:creationTime>2023-07-29 14:43:23</nova:creationTime>
Jul 29 14:43:23 user nova-compute[70924]:   <nova:flavor name="m1.tiny">
Jul 29 14:43:23 user nova-compute[70924]:     <nova:memory>512</nova:memory>
Jul 29 14:43:23 user nova-compute[70924]:     <nova:disk>1</nova:disk>
Jul 29 14:43:23 user nova-compute[70924]:     <nova:swap>0</nova:swap>
Jul 29 14:43:23 user nova-compute[70924]:     <nova:ephemeral>0</nova:ephemeral>
Jul 29 14:43:23 user nova-compute[70924]:     <nova:vcpus>1</nova:vcpus>
Jul 29 14:43:23 user nova-compute[70924]:   </nova:flavor>
Jul 29 14:43:23 user nova-compute[70924]:   <nova:owner>
Jul 29 14:43:23 user nova-compute[70924]:     <nova:user uuid="5a5e9a9bfa864d5f85a3a79499019d9b">tempest-TaggedAttachmentsTest-209058297-project-member</nova:user>
Jul 29 14:43:23 user nova-compute[70924]:     <nova:project uuid="3f5512f71fe048c5936b9154c0e3126b">tempest-TaggedAttachmentsTest-209058297</nova:project>
Jul 29 14:43:23 user nova-compute[70924]:   </nova:owner>
Jul 29 14:43:23 user nova-compute[70924]:   <nova:root type="image" uuid="3aba2e73-6832-404b-8bd0-d0503ce82b8c"/>
Jul 29 14:43:23 user nova-compute[70924]:   <nova:ports>
Jul 29 14:43:23 user nova-compute[70924]:     <nova:port uuid="4350e95a-3892-4c83-a407-aa696585eac6">
Jul 29 14:43:23 user nova-compute[70924]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 29 14:43:23 user nova-compute[70924]:     </nova:port>
Jul 29 14:43:23 user nova-compute[70924]:     <nova:port uuid="3330a4ca-44e5-4069-9cc8-0da51c0f10d2">
Jul 29 14:43:23 user nova-compute[70924]:       <nova:ip type="fixed" address="10.10.10.163" ipVersion="4"/>
Jul 29 14:43:23 user nova-compute[70924]:     </nova:port>
Jul 29 14:43:23 user nova-compute[70924]:   </nova:ports>
Jul 29 14:43:23 user nova-compute[70924]: </nova:instance>
Jul 29 14:43:23 user nova-compute[70924]:  {{(pid=70924) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Jul 29 14:43:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ea11e7c3-5c15-4931-9059-bb1eca8d72a0 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Lock "interface-a9549556-e9a7-4782-ade4-9d397d5323d0-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 4.863s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:43:23 user nova-compute[70924]: DEBUG nova.network.neutron [req-8b27be30-8ebe-44f4-b3cf-3772eb1be977 req-295da323-7259-48cb-a761-6f7977eee365 service nova] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Updated VIF entry in instance network info cache for port 3330a4ca-44e5-4069-9cc8-0da51c0f10d2. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:43:23 user nova-compute[70924]: DEBUG nova.network.neutron [req-8b27be30-8ebe-44f4-b3cf-3772eb1be977 req-295da323-7259-48cb-a761-6f7977eee365 service nova] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Updating instance_info_cache with network_info: [{"id": "4350e95a-3892-4c83-a407-aa696585eac6", "address": "fa:16:3e:5d:b8:2a", "network": {"id": "4ca69734-4a00-4e6b-bbad-8bc03edba586", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1313665133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f5512f71fe048c5936b9154c0e3126b", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4350e95a-38", "ovs_interfaceid": "4350e95a-3892-4c83-a407-aa696585eac6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3330a4ca-44e5-4069-9cc8-0da51c0f10d2", "address": "fa:16:3e:15:50:23", "network": {"id": "d3274b98-c5db-4936-ad6a-d97250e08d2e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1553772351", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3f5512f71fe048c5936b9154c0e3126b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3330a4ca-44", "ovs_interfaceid": "3330a4ca-44e5-4069-9cc8-0da51c0f10d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:43:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-8b27be30-8ebe-44f4-b3cf-3772eb1be977 req-295da323-7259-48cb-a761-6f7977eee365 service nova] Releasing lock "refresh_cache-a9549556-e9a7-4782-ade4-9d397d5323d0" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:43:23 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:43:23 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:43:23 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:43:23 user nova-compute[70924]: DEBUG nova.compute.manager [req-1990034a-6ea4-4877-b0c4-450397103205 req-87c5deaf-025e-4201-89ae-8a319fbdaa73 service nova] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Received event network-changed-ef43604c-04b6-43b1-83c3-324102987873 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:43:23 user nova-compute[70924]: DEBUG nova.compute.manager [req-1990034a-6ea4-4877-b0c4-450397103205 req-87c5deaf-025e-4201-89ae-8a319fbdaa73 service nova] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Refreshing instance network info cache due to event network-changed-ef43604c-04b6-43b1-83c3-324102987873. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:43:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-1990034a-6ea4-4877-b0c4-450397103205 req-87c5deaf-025e-4201-89ae-8a319fbdaa73 service nova] Acquiring lock "refresh_cache-fcbb998c-2dac-47d9-985a-d5b2a15ddaa0" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:43:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-1990034a-6ea4-4877-b0c4-450397103205 req-87c5deaf-025e-4201-89ae-8a319fbdaa73 service nova] Acquired lock "refresh_cache-fcbb998c-2dac-47d9-985a-d5b2a15ddaa0" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:43:23 user nova-compute[70924]: DEBUG nova.network.neutron [req-1990034a-6ea4-4877-b0c4-450397103205 req-87c5deaf-025e-4201-89ae-8a319fbdaa73 service nova] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Refreshing network info cache for port ef43604c-04b6-43b1-83c3-324102987873 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:43:24 user nova-compute[70924]: DEBUG nova.network.neutron [req-1990034a-6ea4-4877-b0c4-450397103205 req-87c5deaf-025e-4201-89ae-8a319fbdaa73 service nova] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Updated VIF entry in instance network info cache for port ef43604c-04b6-43b1-83c3-324102987873. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:43:24 user nova-compute[70924]: DEBUG nova.network.neutron [req-1990034a-6ea4-4877-b0c4-450397103205 req-87c5deaf-025e-4201-89ae-8a319fbdaa73 service nova] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Updating instance_info_cache with network_info: [{"id": "ef43604c-04b6-43b1-83c3-324102987873", "address": "fa:16:3e:92:af:8a", "network": {"id": "6c9a59aa-27fd-4da3-b686-bafa34c4d807", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1260570280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7350cca282f7405f9f232110869df140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef43604c-04", "ovs_interfaceid": "ef43604c-04b6-43b1-83c3-324102987873", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:43:24 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-1990034a-6ea4-4877-b0c4-450397103205 req-87c5deaf-025e-4201-89ae-8a319fbdaa73 service nova] Releasing lock "refresh_cache-fcbb998c-2dac-47d9-985a-d5b2a15ddaa0" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:43:24 user nova-compute[70924]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690641789.7441587, c7776982-40ea-4b06-b853-cfd484efba73 => Stopped> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:43:24 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: c7776982-40ea-4b06-b853-cfd484efba73] VM Stopped (Lifecycle Event)
Jul 29 14:43:24 user nova-compute[70924]: DEBUG nova.compute.manager [None req-59135839-392d-4a26-b602-e5ab7843fd1e None None] [instance: c7776982-40ea-4b06-b853-cfd484efba73] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:43:24 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d2d8a94-049f-4418-af10-847e98af99cc tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] Calling os-brick to attach iSCSI Volume {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 14:43:24 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2d8a94-049f-4418-af10-847e98af99cc tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e5ea48bd-7ebc-461c-aaf5-fd667c565974'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QNLTkiju', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:43:24 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-6d2d8a94-049f-4418-af10-847e98af99cc tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:43:24 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-6d2d8a94-049f-4418-af10-847e98af99cc tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:43:24 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-6d2d8a94-049f-4418-af10-847e98af99cc tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:43:24 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-6d2d8a94-049f-4418-af10-847e98af99cc tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:43:24 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-6d2d8a94-049f-4418-af10-847e98af99cc tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5ea48bd-7ebc-461c-aaf5-fd667c565974" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:43:24 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-6d2d8a94-049f-4418-af10-847e98af99cc tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5ea48bd-7ebc-461c-aaf5-fd667c565974" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:43:24 user nova-compute[70924]: INFO os_brick.initiator.connectors.iscsi [None req-6d2d8a94-049f-4418-af10-847e98af99cc tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 14:43:24 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5ea48bd-7ebc-461c-aaf5-fd667c565974 -p 172.16.0.220:3260 {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:24 user nova-compute[70924]: DEBUG nova.compute.manager [req-3bea5c8f-1a8a-4eb4-bee5-a87896ed048a req-613696bd-2a24-4bec-ad47-26b73a9c5426 service nova] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Received event network-vif-plugged-3330a4ca-44e5-4069-9cc8-0da51c0f10d2 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:43:24 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-3bea5c8f-1a8a-4eb4-bee5-a87896ed048a req-613696bd-2a24-4bec-ad47-26b73a9c5426 service nova] Acquiring lock "a9549556-e9a7-4782-ade4-9d397d5323d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:43:24 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-3bea5c8f-1a8a-4eb4-bee5-a87896ed048a req-613696bd-2a24-4bec-ad47-26b73a9c5426 service nova] Lock "a9549556-e9a7-4782-ade4-9d397d5323d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:43:24 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-3bea5c8f-1a8a-4eb4-bee5-a87896ed048a req-613696bd-2a24-4bec-ad47-26b73a9c5426 service nova] Lock "a9549556-e9a7-4782-ade4-9d397d5323d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:43:24 user nova-compute[70924]: DEBUG nova.compute.manager [req-3bea5c8f-1a8a-4eb4-bee5-a87896ed048a req-613696bd-2a24-4bec-ad47-26b73a9c5426 service nova] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] No waiting events found dispatching network-vif-plugged-3330a4ca-44e5-4069-9cc8-0da51c0f10d2 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:43:24 user nova-compute[70924]: WARNING nova.compute.manager [req-3bea5c8f-1a8a-4eb4-bee5-a87896ed048a req-613696bd-2a24-4bec-ad47-26b73a9c5426 service nova] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Received unexpected event network-vif-plugged-3330a4ca-44e5-4069-9cc8-0da51c0f10d2 for instance with vm_state active and task_state None.
Jul 29 14:43:24 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5ea48bd-7ebc-461c-aaf5-fd667c565974 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:24 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bbe2418-8718-4c27-81f3-ca55b3978387]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:24 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2d8a94-049f-4418-af10-847e98af99cc tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 14:43:24 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:43:24 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5ea48bd-7ebc-461c-aaf5-fd667c565974 -p 172.16.0.220:3260 --interface default --op new {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5ea48bd-7ebc-461c-aaf5-fd667c565974 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[a863e8eb-5689-4040-b790-130add764bbd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5ea48bd-7ebc-461c-aaf5-fd667c565974] added\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2d8a94-049f-4418-af10-847e98af99cc tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5ea48bd-7ebc-461c-aaf5-fd667c565974] added
Jul 29 14:43:25 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5ea48bd-7ebc-461c-aaf5-fd667c565974 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5ea48bd-7ebc-461c-aaf5-fd667c565974 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[af761f94-bc36-4a45-bdb6-73f554ac069c]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2d8a94-049f-4418-af10-847e98af99cc tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5ea48bd-7ebc-461c-aaf5-fd667c565974 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5ea48bd-7ebc-461c-aaf5-fd667c565974 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2a81ec-ad21-429d-a05b-d0819842de6c]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2d8a94-049f-4418-af10-847e98af99cc tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5ea48bd-7ebc-461c-aaf5-fd667c565974 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QNLTkiju {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-84777e67-afc6-4251-8d41-d42c28caa167 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Acquiring lock "a9549556-e9a7-4782-ade4-9d397d5323d0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-84777e67-afc6-4251-8d41-d42c28caa167 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Lock "a9549556-e9a7-4782-ade4-9d397d5323d0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5ea48bd-7ebc-461c-aaf5-fd667c565974 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QNLTkiju" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f9fbfa-a16f-4756-b54c-4026513fbf0d]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2d8a94-049f-4418-af10-847e98af99cc tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QNLTkiju'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5ea48bd-7ebc-461c-aaf5-fd667c565974 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG nova.objects.instance [None req-84777e67-afc6-4251-8d41-d42c28caa167 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Lazy-loading 'flavor' on Instance uuid a9549556-e9a7-4782-ade4-9d397d5323d0 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5ea48bd-7ebc-461c-aaf5-fd667c565974 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5894a357-b05f-4e33-a4ba-fb0d93d919bc]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2d8a94-049f-4418-af10-847e98af99cc tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d330495b-16c9-4f38-8502-a07a96ef6f15]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2d8a94-049f-4418-af10-847e98af99cc tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)
Jul 29 14:43:25 user nova-compute[70924]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)
Jul 29 14:43:25 user nova-compute[70924]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)
Jul 29 14:43:25 user nova-compute[70924]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:43:25 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2d8a94-049f-4418-af10-847e98af99cc tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)
Jul 29 14:43:25 user nova-compute[70924]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)
Jul 29 14:43:25 user nova-compute[70924]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)
Jul 29 14:43:25 user nova-compute[70924]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:43:25 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5ea48bd-7ebc-461c-aaf5-fd667c565974 -p 172.16.0.220:3260 --login {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-84777e67-afc6-4251-8d41-d42c28caa167 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Lock "a9549556-e9a7-4782-ade4-9d397d5323d0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.086s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5ea48bd-7ebc-461c-aaf5-fd667c565974 -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[35cdf1df-256e-4649-969c-33abcc273c05]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5ea48bd-7ebc-461c-aaf5-fd667c565974, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e5ea48bd-7ebc-461c-aaf5-fd667c565974, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2d8a94-049f-4418-af10-847e98af99cc tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5ea48bd-7ebc-461c-aaf5-fd667c565974, portal: 172.16.0.220,3260]
Jul 29 14:43:25 user nova-compute[70924]: Login to [iface: default, target: iqn.2010-10.org.openstack:e5ea48bd-7ebc-461c-aaf5-fd667c565974, portal: 172.16.0.220,3260] successful.
Jul 29 14:43:25 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5ea48bd-7ebc-461c-aaf5-fd667c565974 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5ea48bd-7ebc-461c-aaf5-fd667c565974 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a2a0a4-affc-4bdc-a61e-a9691392d025]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2d8a94-049f-4418-af10-847e98af99cc tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1dfbd99-6ce7-4532-9adb-dc9cd2f2270b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ea48bd-7ebc-461c-aaf5-fd667c565974 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2d8a94-049f-4418-af10-847e98af99cc tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)
Jul 29 14:43:25 user nova-compute[70924]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)
Jul 29 14:43:25 user nova-compute[70924]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)
Jul 29 14:43:25 user nova-compute[70924]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:43:25 user nova-compute[70924]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ea48bd-7ebc-461c-aaf5-fd667c565974 (non-flash)
Jul 29 14:43:25 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2d8a94-049f-4418-af10-847e98af99cc tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)
Jul 29 14:43:25 user nova-compute[70924]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)
Jul 29 14:43:25 user nova-compute[70924]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)
Jul 29 14:43:25 user nova-compute[70924]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:43:25 user nova-compute[70924]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ea48bd-7ebc-461c-aaf5-fd667c565974 (non-flash)
Jul 29 14:43:25 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-6d2d8a94-049f-4418-af10-847e98af99cc tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5ea48bd-7ebc-461c-aaf5-fd667c565974" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.355s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2d8a94-049f-4418-af10-847e98af99cc tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Connected to 172.16.0.220:3260 {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-6d2d8a94-049f-4418-af10-847e98af99cc tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=70924) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-6d2d8a94-049f-4418-af10-847e98af99cc tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=70924) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6788110-4604-4d55-9ac8-ab00d570d19c]: (4, ('- - 0', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-6d2d8a94-049f-4418-af10-847e98af99cc tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2d8a94-049f-4418-af10-847e98af99cc tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QNLTkiju', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-84777e67-afc6-4251-8d41-d42c28caa167 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Acquiring lock "a9549556-e9a7-4782-ade4-9d397d5323d0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-84777e67-afc6-4251-8d41-d42c28caa167 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Lock "a9549556-e9a7-4782-ade4-9d397d5323d0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:43:25 user nova-compute[70924]: INFO nova.compute.manager [None req-84777e67-afc6-4251-8d41-d42c28caa167 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Attaching volume 4c27701d-f280-40ca-9ea5-1f19a56c5a34 to /dev/vdb
Jul 29 14:43:25 user nova-compute[70924]: DEBUG os_brick.utils [None req-84777e67-afc6-4251-8d41-d42c28caa167 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7a5944-7808-4bb6-88c7-45577c77afd3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f2127c4a30d9\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bed9ece-3b54-4386-9784-410af78e20a9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5861477a-51b7-44a7-b26f-d898d9ce2bfd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae6ab0ab-a674-4e3d-8e38-dd3a3848566a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-84777e67-afc6-4251-8d41-d42c28caa167 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Running cmd (subprocess): nvme version {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-84777e67-afc6-4251-8d41-d42c28caa167 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] 'nvme version' failed. Not Retrying. {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.nvmeof [None req-84777e67-afc6-4251-8d41-d42c28caa167 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] nvme not present on system {{(pid=70924) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:43:25 user nova-compute[70924]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 14:43:25 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98001e8-c892-46be-8e02-254cbf7a8f58]: (4, '') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-84777e67-afc6-4251-8d41-d42c28caa167 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70924) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-84777e67-afc6-4251-8d41-d42c28caa167 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-84777e67-afc6-4251-8d41-d42c28caa167 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] LIGHTOS: no hostnqn found. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG os_brick.utils [None req-84777e67-afc6-4251-8d41-d42c28caa167 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f2127c4a30d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:43:25 user nova-compute[70924]: DEBUG nova.virt.block_device [None req-84777e67-afc6-4251-8d41-d42c28caa167 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Updating existing volume attachment record: 6e3df0df-3256-4214-8156-e1a7739710c9 {{(pid=70924) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 14:43:26 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-6d2d8a94-049f-4418-af10-847e98af99cc tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.406s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:43:26 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d2d8a94-049f-4418-af10-847e98af99cc tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] <== connect_volume: return (1408ms) {'type': 'block', 'scsi_wwn': '23735333333363937', 'path': '/dev/sdf'} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:43:26 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d2d8a94-049f-4418-af10-847e98af99cc tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23735333333363937', 'path': '/dev/sdf'} {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 14:43:26 user nova-compute[70924]: DEBUG nova.objects.instance [None req-6d2d8a94-049f-4418-af10-847e98af99cc tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Lazy-loading 'flavor' on Instance uuid 1ea2e4b1-5b93-42bf-b29d-ce6986135826 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:43:26 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-6d2d8a94-049f-4418-af10-847e98af99cc tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] attach device xml: <disk type="block" device="disk">
Jul 29 14:43:26 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:43:26 user nova-compute[70924]:   <source dev="/dev/sdf"/>
Jul 29 14:43:26 user nova-compute[70924]:   <target dev="sdc" bus="scsi"/>
Jul 29 14:43:26 user nova-compute[70924]:   <serial>e5ea48bd-7ebc-461c-aaf5-fd667c565974</serial>
Jul 29 14:43:26 user nova-compute[70924]:   <address type="drive" controller="0" unit="2"/>
Jul 29 14:43:26 user nova-compute[70924]: </disk>
Jul 29 14:43:26 user nova-compute[70924]:  {{(pid=70924) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 29 14:43:26 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-6d2d8a94-049f-4418-af10-847e98af99cc tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] No BDM found with device name sda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:43:26 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-6d2d8a94-049f-4418-af10-847e98af99cc tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] No BDM found with device name sdb, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:43:26 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-6d2d8a94-049f-4418-af10-847e98af99cc tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] No BDM found with device name sdc, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:43:26 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-6d2d8a94-049f-4418-af10-847e98af99cc tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] No VIF found with MAC fa:16:3e:0f:86:7c, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:43:27 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dca8a2b5-ab18-4acd-8afd-d8d9739a16ed tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Calling os-brick to attach iSCSI Volume {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 14:43:27 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca8a2b5-ab18-4acd-8afd-d8d9739a16ed tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c72de1bc-8d39-4290-b4c7-720821b3063c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mROgTJrP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:43:27 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-dca8a2b5-ab18-4acd-8afd-d8d9739a16ed tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:43:27 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-dca8a2b5-ab18-4acd-8afd-d8d9739a16ed tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:43:27 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-dca8a2b5-ab18-4acd-8afd-d8d9739a16ed tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:43:27 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-dca8a2b5-ab18-4acd-8afd-d8d9739a16ed tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:43:27 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-dca8a2b5-ab18-4acd-8afd-d8d9739a16ed tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c72de1bc-8d39-4290-b4c7-720821b3063c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:43:27 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-dca8a2b5-ab18-4acd-8afd-d8d9739a16ed tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c72de1bc-8d39-4290-b4c7-720821b3063c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:43:27 user nova-compute[70924]: INFO os_brick.initiator.connectors.iscsi [None req-dca8a2b5-ab18-4acd-8afd-d8d9739a16ed tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 14:43:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c72de1bc-8d39-4290-b4c7-720821b3063c -p 172.16.0.220:3260 {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c72de1bc-8d39-4290-b4c7-720821b3063c -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:27 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c452f9e-96bb-4f90-bee5-9c6179ac9104]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:27 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca8a2b5-ab18-4acd-8afd-d8d9739a16ed tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 14:43:27 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:43:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c72de1bc-8d39-4290-b4c7-720821b3063c -p 172.16.0.220:3260 --interface default --op new {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c72de1bc-8d39-4290-b4c7-720821b3063c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:27 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[624dfefc-9bdd-44bb-baa1-4d0b96c49c99]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c72de1bc-8d39-4290-b4c7-720821b3063c] added\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:27 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca8a2b5-ab18-4acd-8afd-d8d9739a16ed tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c72de1bc-8d39-4290-b4c7-720821b3063c] added
Jul 29 14:43:27 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:43:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c72de1bc-8d39-4290-b4c7-720821b3063c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c72de1bc-8d39-4290-b4c7-720821b3063c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:27 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6118f25f-3e33-4d33-96c7-a3e993b812b8]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:27 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca8a2b5-ab18-4acd-8afd-d8d9739a16ed tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:43:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c72de1bc-8d39-4290-b4c7-720821b3063c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c72de1bc-8d39-4290-b4c7-720821b3063c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:27 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2241475e-e9d0-4ed6-8796-547eebf6e98f]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:27 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca8a2b5-ab18-4acd-8afd-d8d9739a16ed tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:43:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c72de1bc-8d39-4290-b4c7-720821b3063c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mROgTJrP {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c72de1bc-8d39-4290-b4c7-720821b3063c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mROgTJrP" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:27 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6207a5f-679e-48d1-9d52-47ff79900cbf]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:27 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca8a2b5-ab18-4acd-8afd-d8d9739a16ed tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mROgTJrP'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:43:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c72de1bc-8d39-4290-b4c7-720821b3063c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c72de1bc-8d39-4290-b4c7-720821b3063c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:27 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[581fb4ff-7a2f-4308-991f-701c0c27d67c]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:27 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca8a2b5-ab18-4acd-8afd-d8d9739a16ed tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:43:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:27 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea41c0f-e2e5-4fd8-9676-68bd2bc88f59]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ea48bd-7ebc-461c-aaf5-fd667c565974 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:27 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca8a2b5-ab18-4acd-8afd-d8d9739a16ed tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)
Jul 29 14:43:27 user nova-compute[70924]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)
Jul 29 14:43:27 user nova-compute[70924]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)
Jul 29 14:43:27 user nova-compute[70924]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:43:27 user nova-compute[70924]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ea48bd-7ebc-461c-aaf5-fd667c565974 (non-flash)
Jul 29 14:43:27 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:43:27 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca8a2b5-ab18-4acd-8afd-d8d9739a16ed tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)
Jul 29 14:43:27 user nova-compute[70924]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)
Jul 29 14:43:27 user nova-compute[70924]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)
Jul 29 14:43:27 user nova-compute[70924]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:43:27 user nova-compute[70924]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ea48bd-7ebc-461c-aaf5-fd667c565974 (non-flash)
Jul 29 14:43:27 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:43:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c72de1bc-8d39-4290-b4c7-720821b3063c -p 172.16.0.220:3260 --login {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c72de1bc-8d39-4290-b4c7-720821b3063c -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:27 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea60303f-f8e6-41b1-a51f-e15520f694f9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c72de1bc-8d39-4290-b4c7-720821b3063c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c72de1bc-8d39-4290-b4c7-720821b3063c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:27 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca8a2b5-ab18-4acd-8afd-d8d9739a16ed tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c72de1bc-8d39-4290-b4c7-720821b3063c, portal: 172.16.0.220,3260]
Jul 29 14:43:27 user nova-compute[70924]: Login to [iface: default, target: iqn.2010-10.org.openstack:c72de1bc-8d39-4290-b4c7-720821b3063c, portal: 172.16.0.220,3260] successful.
Jul 29 14:43:27 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:43:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c72de1bc-8d39-4290-b4c7-720821b3063c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c72de1bc-8d39-4290-b4c7-720821b3063c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:27 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee1660f-4ddf-4d1f-a551-7ce8e332172a]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:27 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca8a2b5-ab18-4acd-8afd-d8d9739a16ed tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:43:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:27 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[96905a1c-c626-4e50-963c-0266025726c2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ea48bd-7ebc-461c-aaf5-fd667c565974 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72de1bc-8d39-4290-b4c7-720821b3063c (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:27 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca8a2b5-ab18-4acd-8afd-d8d9739a16ed tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)
Jul 29 14:43:27 user nova-compute[70924]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)
Jul 29 14:43:27 user nova-compute[70924]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)
Jul 29 14:43:27 user nova-compute[70924]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:43:27 user nova-compute[70924]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ea48bd-7ebc-461c-aaf5-fd667c565974 (non-flash)
Jul 29 14:43:27 user nova-compute[70924]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72de1bc-8d39-4290-b4c7-720821b3063c (non-flash)
Jul 29 14:43:27 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:43:27 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca8a2b5-ab18-4acd-8afd-d8d9739a16ed tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)
Jul 29 14:43:27 user nova-compute[70924]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)
Jul 29 14:43:27 user nova-compute[70924]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)
Jul 29 14:43:27 user nova-compute[70924]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:43:27 user nova-compute[70924]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ea48bd-7ebc-461c-aaf5-fd667c565974 (non-flash)
Jul 29 14:43:27 user nova-compute[70924]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72de1bc-8d39-4290-b4c7-720821b3063c (non-flash)
Jul 29 14:43:27 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:43:27 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-dca8a2b5-ab18-4acd-8afd-d8d9739a16ed tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c72de1bc-8d39-4290-b4c7-720821b3063c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:43:27 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca8a2b5-ab18-4acd-8afd-d8d9739a16ed tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Connected to 172.16.0.220:3260 {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 14:43:27 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-dca8a2b5-ab18-4acd-8afd-d8d9739a16ed tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=70924) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 14:43:27 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-dca8a2b5-ab18-4acd-8afd-d8d9739a16ed tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=70924) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 14:43:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:27 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-6d2d8a94-049f-4418-af10-847e98af99cc tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Lock "1ea2e4b1-5b93-42bf-b29d-ce6986135826" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.361s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:43:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:27 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ab0f72-53d1-4e02-8d99-9201d50805ea]: (4, ('- - 0', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:27 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-dca8a2b5-ab18-4acd-8afd-d8d9739a16ed tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 14:43:27 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca8a2b5-ab18-4acd-8afd-d8d9739a16ed tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mROgTJrP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 14:43:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:43:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:43:28 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-dca8a2b5-ab18-4acd-8afd-d8d9739a16ed tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:43:28 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca8a2b5-ab18-4acd-8afd-d8d9739a16ed tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '23935616536363532', 'path': '/dev/sdg'} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:43:28 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dca8a2b5-ab18-4acd-8afd-d8d9739a16ed tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935616536363532', 'path': '/dev/sdg'} {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 14:43:28 user nova-compute[70924]: DEBUG nova.objects.instance [None req-dca8a2b5-ab18-4acd-8afd-d8d9739a16ed tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Lazy-loading 'flavor' on Instance uuid 00231136-233f-4a1b-88ff-b678482ca5bb {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:43:28 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-dca8a2b5-ab18-4acd-8afd-d8d9739a16ed tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] attach device xml: <disk type="block" device="disk">
Jul 29 14:43:28 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:43:28 user nova-compute[70924]:   <source dev="/dev/sdg"/>
Jul 29 14:43:28 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 14:43:28 user nova-compute[70924]:   <serial>c72de1bc-8d39-4290-b4c7-720821b3063c</serial>
Jul 29 14:43:28 user nova-compute[70924]: </disk>
Jul 29 14:43:28 user nova-compute[70924]:  {{(pid=70924) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 29 14:43:28 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-dca8a2b5-ab18-4acd-8afd-d8d9739a16ed tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:43:28 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-dca8a2b5-ab18-4acd-8afd-d8d9739a16ed tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:43:28 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-dca8a2b5-ab18-4acd-8afd-d8d9739a16ed tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] No VIF found with MAC fa:16:3e:fd:b3:38, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:43:28 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-dca8a2b5-ab18-4acd-8afd-d8d9739a16ed tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Lock "00231136-233f-4a1b-88ff-b678482ca5bb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.536s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:43:29 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-d1db2bec-925b-4b4d-bfb2-107b43f2b482 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Acquiring lock "1ea2e4b1-5b93-42bf-b29d-ce6986135826" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:43:29 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-d1db2bec-925b-4b4d-bfb2-107b43f2b482 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Lock "1ea2e4b1-5b93-42bf-b29d-ce6986135826" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:43:29 user nova-compute[70924]: INFO nova.compute.manager [None req-d1db2bec-925b-4b4d-bfb2-107b43f2b482 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] Detaching volume e5ea48bd-7ebc-461c-aaf5-fd667c565974
Jul 29 14:43:29 user nova-compute[70924]: INFO nova.virt.block_device [None req-d1db2bec-925b-4b4d-bfb2-107b43f2b482 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] Attempting to driver detach volume e5ea48bd-7ebc-461c-aaf5-fd667c565974 from mountpoint /dev/sdc
Jul 29 14:43:29 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-d1db2bec-925b-4b4d-bfb2-107b43f2b482 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Attempting to detach device sdc from instance 1ea2e4b1-5b93-42bf-b29d-ce6986135826 from the persistent domain config. {{(pid=70924) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 29 14:43:29 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-d1db2bec-925b-4b4d-bfb2-107b43f2b482 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 14:43:29 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:43:29 user nova-compute[70924]:   <source dev="/dev/sdf"/>
Jul 29 14:43:29 user nova-compute[70924]:   <target dev="sdc" bus="scsi"/>
Jul 29 14:43:29 user nova-compute[70924]:   <serial>e5ea48bd-7ebc-461c-aaf5-fd667c565974</serial>
Jul 29 14:43:29 user nova-compute[70924]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Jul 29 14:43:29 user nova-compute[70924]: </disk>
Jul 29 14:43:29 user nova-compute[70924]:  {{(pid=70924) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 14:43:29 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-d1db2bec-925b-4b4d-bfb2-107b43f2b482 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Successfully detached device sdc from instance 1ea2e4b1-5b93-42bf-b29d-ce6986135826 from the persistent domain config.
Jul 29 14:43:29 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-d1db2bec-925b-4b4d-bfb2-107b43f2b482 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 1ea2e4b1-5b93-42bf-b29d-ce6986135826 from the live domain config. {{(pid=70924) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 29 14:43:29 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-d1db2bec-925b-4b4d-bfb2-107b43f2b482 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 14:43:29 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:43:29 user nova-compute[70924]:   <source dev="/dev/sdf"/>
Jul 29 14:43:29 user nova-compute[70924]:   <target dev="sdc" bus="scsi"/>
Jul 29 14:43:29 user nova-compute[70924]:   <serial>e5ea48bd-7ebc-461c-aaf5-fd667c565974</serial>
Jul 29 14:43:29 user nova-compute[70924]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Jul 29 14:43:29 user nova-compute[70924]: </disk>
Jul 29 14:43:29 user nova-compute[70924]:  {{(pid=70924) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 14:43:29 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Received event <DeviceRemovedEvent: 1690641809.76922, 1ea2e4b1-5b93-42bf-b29d-ce6986135826 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=70924) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 29 14:43:29 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-d1db2bec-925b-4b4d-bfb2-107b43f2b482 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 1ea2e4b1-5b93-42bf-b29d-ce6986135826 {{(pid=70924) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 29 14:43:29 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-d1db2bec-925b-4b4d-bfb2-107b43f2b482 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Successfully detached device sdc from instance 1ea2e4b1-5b93-42bf-b29d-ce6986135826 from the live domain config.
Jul 29 14:43:29 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1db2bec-925b-4b4d-bfb2-107b43f2b482 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] calling os-brick to detach iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 14:43:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1db2bec-925b-4b4d-bfb2-107b43f2b482 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, {'target_iqns': ['iqn.2010-10.org.openstack:e5ea48bd-7ebc-461c-aaf5-fd667c565974'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QNLTkiju', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:43:29 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-d1db2bec-925b-4b4d-bfb2-107b43f2b482 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:43:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-d1db2bec-925b-4b4d-bfb2-107b43f2b482 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:43:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-d1db2bec-925b-4b4d-bfb2-107b43f2b482 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:43:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1db2bec-925b-4b4d-bfb2-107b43f2b482 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5ea48bd-7ebc-461c-aaf5-fd667c565974', 0)] {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 14:43:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:29 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[dadbd4dc-aec7-4f47-9d48-5e4bf7470b47]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c72de1bc-8d39-4290-b4c7-720821b3063c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5ea48bd-7ebc-461c-aaf5-fd667c565974\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:29 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c334de7-d8dd-486d-8dd0-a2b252bb8ea3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ea48bd-7ebc-461c-aaf5-fd667c565974 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72de1bc-8d39-4290-b4c7-720821b3063c (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1db2bec-925b-4b4d-bfb2-107b43f2b482 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)
Jul 29 14:43:29 user nova-compute[70924]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)
Jul 29 14:43:29 user nova-compute[70924]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)
Jul 29 14:43:29 user nova-compute[70924]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:43:29 user nova-compute[70924]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ea48bd-7ebc-461c-aaf5-fd667c565974 (non-flash)
Jul 29 14:43:29 user nova-compute[70924]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72de1bc-8d39-4290-b4c7-720821b3063c (non-flash)
Jul 29 14:43:29 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:43:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1db2bec-925b-4b4d-bfb2-107b43f2b482 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)
Jul 29 14:43:29 user nova-compute[70924]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)
Jul 29 14:43:29 user nova-compute[70924]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)
Jul 29 14:43:29 user nova-compute[70924]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:43:29 user nova-compute[70924]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5ea48bd-7ebc-461c-aaf5-fd667c565974 (non-flash)
Jul 29 14:43:29 user nova-compute[70924]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72de1bc-8d39-4290-b4c7-720821b3063c (non-flash)
Jul 29 14:43:29 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:43:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1db2bec-925b-4b4d-bfb2-107b43f2b482 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feedc57e9e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5ea48bd-7ebc-461c-aaf5-fd667c565974'): ({'sdf'}, set())}) {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 14:43:29 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-d1db2bec-925b-4b4d-bfb2-107b43f2b482 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Removing single pathed devices sdf {{(pid=70924) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 14:43:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:29 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e572a68b-16d8-4d08-ad0c-b3973c673101]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:29 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd93d891-efc4-4a01-a7ee-285a09150da8]: (4, ('ok\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:29 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-d1db2bec-925b-4b4d-bfb2-107b43f2b482 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Flushing IO for device /dev/sdf {{(pid=70924) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 14:43:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:29 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[982cdaa1-324b-439e-b6ec-690908a75820]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:29 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-d1db2bec-925b-4b4d-bfb2-107b43f2b482 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=70924) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 14:43:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.042s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:29 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[88418c3f-63c5-4347-9c51-c9dac5422d85]: (4, ('1', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:29 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-d1db2bec-925b-4b4d-bfb2-107b43f2b482 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 14:43:29 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-d1db2bec-925b-4b4d-bfb2-107b43f2b482 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] SCSI volumes sdf have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 14:43:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1db2bec-925b-4b4d-bfb2-107b43f2b482 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5ea48bd-7ebc-461c-aaf5-fd667c565974')] {{(pid=70924) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 14:43:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5ea48bd-7ebc-461c-aaf5-fd667c565974 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5ea48bd-7ebc-461c-aaf5-fd667c565974 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:29 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[598653e6-884f-4eb6-94b0-12223e1fc48b]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1db2bec-925b-4b4d-bfb2-107b43f2b482 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:43:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5ea48bd-7ebc-461c-aaf5-fd667c565974 -p 172.16.0.220:3260 --logout {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:30 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5ea48bd-7ebc-461c-aaf5-fd667c565974 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:30 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f27d150-9561-4d2b-abe7-f0724a9786ab]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:e5ea48bd-7ebc-461c-aaf5-fd667c565974, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:e5ea48bd-7ebc-461c-aaf5-fd667c565974, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:30 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1db2bec-925b-4b4d-bfb2-107b43f2b482 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:e5ea48bd-7ebc-461c-aaf5-fd667c565974, portal: 172.16.0.220,3260]
Jul 29 14:43:30 user nova-compute[70924]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:e5ea48bd-7ebc-461c-aaf5-fd667c565974, portal: 172.16.0.220,3260] successful.
Jul 29 14:43:30 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:43:30 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5ea48bd-7ebc-461c-aaf5-fd667c565974 -p 172.16.0.220:3260 --op delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:30 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5ea48bd-7ebc-461c-aaf5-fd667c565974 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:30 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[8362997f-9baa-4d93-b671-e64ec878bde7]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:30 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1db2bec-925b-4b4d-bfb2-107b43f2b482 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:43:30 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-d1db2bec-925b-4b4d-bfb2-107b43f2b482 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:43:30 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1db2bec-925b-4b4d-bfb2-107b43f2b482 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] <== disconnect_volume: return (310ms) None {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:43:30 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1db2bec-925b-4b4d-bfb2-107b43f2b482 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] Disconnected iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 14:43:30 user nova-compute[70924]: DEBUG nova.objects.instance [None req-d1db2bec-925b-4b4d-bfb2-107b43f2b482 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Lazy-loading 'flavor' on Instance uuid 1ea2e4b1-5b93-42bf-b29d-ce6986135826 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:43:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-d1db2bec-925b-4b4d-bfb2-107b43f2b482 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Lock "1ea2e4b1-5b93-42bf-b29d-ce6986135826" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.704s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:43:31 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-26a1ed8a-7aff-4ef9-9966-ef9bf4251187 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Acquiring lock "00231136-233f-4a1b-88ff-b678482ca5bb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:43:31 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-26a1ed8a-7aff-4ef9-9966-ef9bf4251187 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Lock "00231136-233f-4a1b-88ff-b678482ca5bb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:43:31 user nova-compute[70924]: INFO nova.compute.manager [None req-26a1ed8a-7aff-4ef9-9966-ef9bf4251187 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Detaching volume c72de1bc-8d39-4290-b4c7-720821b3063c
Jul 29 14:43:31 user nova-compute[70924]: INFO nova.virt.block_device [None req-26a1ed8a-7aff-4ef9-9966-ef9bf4251187 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Attempting to driver detach volume c72de1bc-8d39-4290-b4c7-720821b3063c from mountpoint /dev/vdb
Jul 29 14:43:31 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-26a1ed8a-7aff-4ef9-9966-ef9bf4251187 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Attempting to detach device vdb from instance 00231136-233f-4a1b-88ff-b678482ca5bb from the persistent domain config. {{(pid=70924) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 29 14:43:31 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-26a1ed8a-7aff-4ef9-9966-ef9bf4251187 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 14:43:31 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:43:31 user nova-compute[70924]:   <source dev="/dev/sdg"/>
Jul 29 14:43:31 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 14:43:31 user nova-compute[70924]:   <serial>c72de1bc-8d39-4290-b4c7-720821b3063c</serial>
Jul 29 14:43:31 user nova-compute[70924]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 14:43:31 user nova-compute[70924]: </disk>
Jul 29 14:43:31 user nova-compute[70924]:  {{(pid=70924) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 14:43:31 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-26a1ed8a-7aff-4ef9-9966-ef9bf4251187 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Successfully detached device vdb from instance 00231136-233f-4a1b-88ff-b678482ca5bb from the persistent domain config.
Jul 29 14:43:31 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-26a1ed8a-7aff-4ef9-9966-ef9bf4251187 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 00231136-233f-4a1b-88ff-b678482ca5bb from the live domain config. {{(pid=70924) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 29 14:43:31 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-26a1ed8a-7aff-4ef9-9966-ef9bf4251187 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 14:43:31 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:43:31 user nova-compute[70924]:   <source dev="/dev/sdg"/>
Jul 29 14:43:31 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 14:43:31 user nova-compute[70924]:   <serial>c72de1bc-8d39-4290-b4c7-720821b3063c</serial>
Jul 29 14:43:31 user nova-compute[70924]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 14:43:31 user nova-compute[70924]: </disk>
Jul 29 14:43:31 user nova-compute[70924]:  {{(pid=70924) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 14:43:31 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9726828d-697b-4c8c-a6ec-80cdf57a0cf6 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Acquiring lock "1ea2e4b1-5b93-42bf-b29d-ce6986135826" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:43:31 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9726828d-697b-4c8c-a6ec-80cdf57a0cf6 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Lock "1ea2e4b1-5b93-42bf-b29d-ce6986135826" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:43:31 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9726828d-697b-4c8c-a6ec-80cdf57a0cf6 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Acquiring lock "1ea2e4b1-5b93-42bf-b29d-ce6986135826-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:43:31 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9726828d-697b-4c8c-a6ec-80cdf57a0cf6 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Lock "1ea2e4b1-5b93-42bf-b29d-ce6986135826-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:43:31 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9726828d-697b-4c8c-a6ec-80cdf57a0cf6 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Lock "1ea2e4b1-5b93-42bf-b29d-ce6986135826-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:43:31 user nova-compute[70924]: INFO nova.compute.manager [None req-9726828d-697b-4c8c-a6ec-80cdf57a0cf6 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] Terminating instance
Jul 29 14:43:31 user nova-compute[70924]: DEBUG nova.compute.manager [None req-9726828d-697b-4c8c-a6ec-80cdf57a0cf6 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] Start destroying the instance on the hypervisor. {{(pid=70924) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 14:43:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:43:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:43:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:43:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:43:31 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Received event <DeviceRemovedEvent: 1690641811.756881, 00231136-233f-4a1b-88ff-b678482ca5bb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70924) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 29 14:43:31 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-26a1ed8a-7aff-4ef9-9966-ef9bf4251187 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 00231136-233f-4a1b-88ff-b678482ca5bb {{(pid=70924) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 29 14:43:31 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-26a1ed8a-7aff-4ef9-9966-ef9bf4251187 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Successfully detached device vdb from instance 00231136-233f-4a1b-88ff-b678482ca5bb from the live domain config.
Jul 29 14:43:31 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26a1ed8a-7aff-4ef9-9966-ef9bf4251187 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] calling os-brick to detach iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 14:43:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a1ed8a-7aff-4ef9-9966-ef9bf4251187 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, {'target_iqns': ['iqn.2010-10.org.openstack:c72de1bc-8d39-4290-b4c7-720821b3063c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mROgTJrP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:43:31 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-26a1ed8a-7aff-4ef9-9966-ef9bf4251187 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:43:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-26a1ed8a-7aff-4ef9-9966-ef9bf4251187 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:43:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-26a1ed8a-7aff-4ef9-9966-ef9bf4251187 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:43:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a1ed8a-7aff-4ef9-9966-ef9bf4251187 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c72de1bc-8d39-4290-b4c7-720821b3063c', 0)] {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 14:43:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:31 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ce41c2-0efb-459a-91bd-7e9270e497f5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c72de1bc-8d39-4290-b4c7-720821b3063c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:31 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4600ee4-20f3-45b2-8777-37b8e6893070]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72de1bc-8d39-4290-b4c7-720821b3063c (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a1ed8a-7aff-4ef9-9966-ef9bf4251187 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)
Jul 29 14:43:31 user nova-compute[70924]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)
Jul 29 14:43:31 user nova-compute[70924]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)
Jul 29 14:43:31 user nova-compute[70924]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:43:31 user nova-compute[70924]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72de1bc-8d39-4290-b4c7-720821b3063c (non-flash)
Jul 29 14:43:31 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:43:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a1ed8a-7aff-4ef9-9966-ef9bf4251187 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)
Jul 29 14:43:31 user nova-compute[70924]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)
Jul 29 14:43:31 user nova-compute[70924]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)
Jul 29 14:43:31 user nova-compute[70924]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:43:31 user nova-compute[70924]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72de1bc-8d39-4290-b4c7-720821b3063c (non-flash)
Jul 29 14:43:31 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:43:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a1ed8a-7aff-4ef9-9966-ef9bf4251187 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feedc34ec20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c72de1bc-8d39-4290-b4c7-720821b3063c'): ({'sdg'}, set())}) {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 14:43:31 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-26a1ed8a-7aff-4ef9-9966-ef9bf4251187 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Removing single pathed devices sdg {{(pid=70924) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 14:43:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:31 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf61760f-7a51-446d-a37d-087a98a49623]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:31 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be87448-9df8-42d5-8b17-7e494c76d2d4]: (4, ('ok\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:31 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-26a1ed8a-7aff-4ef9-9966-ef9bf4251187 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Flushing IO for device /dev/sdg {{(pid=70924) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 14:43:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:31 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[37728165-3b16-4ec0-9ee1-0974e7391824]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:31 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-26a1ed8a-7aff-4ef9-9966-ef9bf4251187 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=70924) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 14:43:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.046s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:31 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6c1fb2-d9fc-4135-9d4e-d72052e4417f]: (4, ('1', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:31 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-26a1ed8a-7aff-4ef9-9966-ef9bf4251187 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 14:43:31 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-26a1ed8a-7aff-4ef9-9966-ef9bf4251187 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] SCSI volumes sdg have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 14:43:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a1ed8a-7aff-4ef9-9966-ef9bf4251187 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c72de1bc-8d39-4290-b4c7-720821b3063c')] {{(pid=70924) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 14:43:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c72de1bc-8d39-4290-b4c7-720821b3063c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c72de1bc-8d39-4290-b4c7-720821b3063c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:31 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8cf4f9-716c-4347-8a70-8d0a12eb8d1c]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a1ed8a-7aff-4ef9-9966-ef9bf4251187 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:43:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c72de1bc-8d39-4290-b4c7-720821b3063c -p 172.16.0.220:3260 --logout {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c72de1bc-8d39-4290-b4c7-720821b3063c -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[732120a2-f67d-4302-97db-a7b919f3a2cc]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:c72de1bc-8d39-4290-b4c7-720821b3063c, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:c72de1bc-8d39-4290-b4c7-720821b3063c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a1ed8a-7aff-4ef9-9966-ef9bf4251187 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:c72de1bc-8d39-4290-b4c7-720821b3063c, portal: 172.16.0.220,3260]
Jul 29 14:43:32 user nova-compute[70924]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:c72de1bc-8d39-4290-b4c7-720821b3063c, portal: 172.16.0.220,3260] successful.
Jul 29 14:43:32 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c72de1bc-8d39-4290-b4c7-720821b3063c -p 172.16.0.220:3260 --op delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c72de1bc-8d39-4290-b4c7-720821b3063c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c69e27-f9d0-452b-ab48-dc380e1466b5]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a1ed8a-7aff-4ef9-9966-ef9bf4251187 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-26a1ed8a-7aff-4ef9-9966-ef9bf4251187 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a1ed8a-7aff-4ef9-9966-ef9bf4251187 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] <== disconnect_volume: return (329ms) None {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26a1ed8a-7aff-4ef9-9966-ef9bf4251187 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Disconnected iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG nova.compute.manager [req-2d2bb316-3323-4d11-9db8-f6070b3a900a req-732d581a-35e8-4ac7-8c62-fa95fc84e193 service nova] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] Received event network-vif-unplugged-c96a0580-3813-482c-8bcc-c95fe4fc1ca6 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-2d2bb316-3323-4d11-9db8-f6070b3a900a req-732d581a-35e8-4ac7-8c62-fa95fc84e193 service nova] Acquiring lock "1ea2e4b1-5b93-42bf-b29d-ce6986135826-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-2d2bb316-3323-4d11-9db8-f6070b3a900a req-732d581a-35e8-4ac7-8c62-fa95fc84e193 service nova] Lock "1ea2e4b1-5b93-42bf-b29d-ce6986135826-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-2d2bb316-3323-4d11-9db8-f6070b3a900a req-732d581a-35e8-4ac7-8c62-fa95fc84e193 service nova] Lock "1ea2e4b1-5b93-42bf-b29d-ce6986135826-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG nova.compute.manager [req-2d2bb316-3323-4d11-9db8-f6070b3a900a req-732d581a-35e8-4ac7-8c62-fa95fc84e193 service nova] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] No waiting events found dispatching network-vif-unplugged-c96a0580-3813-482c-8bcc-c95fe4fc1ca6 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG nova.compute.manager [req-2d2bb316-3323-4d11-9db8-f6070b3a900a req-732d581a-35e8-4ac7-8c62-fa95fc84e193 service nova] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] Received event network-vif-unplugged-c96a0580-3813-482c-8bcc-c95fe4fc1ca6 for instance with task_state deleting. {{(pid=70924) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 14:43:32 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] Instance destroyed successfully.
Jul 29 14:43:32 user nova-compute[70924]: DEBUG nova.objects.instance [None req-9726828d-697b-4c8c-a6ec-80cdf57a0cf6 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Lazy-loading 'resources' on Instance uuid 1ea2e4b1-5b93-42bf-b29d-ce6986135826 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-9726828d-697b-4c8c-a6ec-80cdf57a0cf6 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T14:41:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1049952611',display_name='tempest-AttachSCSIVolumeTestJSON-server-1049952611',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1049952611',id=6,image_ref='b031d1be-dfee-4761-b566-7221e37458da',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDcl0RkSJ0sJ/Fjzofpz1UI8QJAURW4xJ099n5Wqwc601hKaHSTo/A4gli4CPtj+DJejkBXBRZf+LCGoS0ojggYIn3zIGVSv2Ewc/Q8gtnE+NT/P4bsKKi9oXjz3meQvsQ==',key_name='tempest-keypair-598537827',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:41:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0f391a9af7f7482fbab589b087bfd74e',ramdisk_id='',reservation_id='r-pnw755yo',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b031d1be-dfee-4761-b566-7221e37458da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-2068208795',owner_user_name='tempest-AttachSCSIVolumeTestJSON-2068208795-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:41:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f9dd5d978dc445aa46c28d04c034276',uuid=1ea2e4b1-5b93-42bf-b29d-ce6986135826,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c96a0580-3813-482c-8bcc-c95fe4fc1ca6", "address": "fa:16:3e:0f:86:7c", "network": {"id": "788ee56c-1b66-448e-9e14-51435f77396a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-395768653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f391a9af7f7482fbab589b087bfd74e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc96a0580-38", "ovs_interfaceid": "c96a0580-3813-482c-8bcc-c95fe4fc1ca6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-9726828d-697b-4c8c-a6ec-80cdf57a0cf6 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Converting VIF {"id": "c96a0580-3813-482c-8bcc-c95fe4fc1ca6", "address": "fa:16:3e:0f:86:7c", "network": {"id": "788ee56c-1b66-448e-9e14-51435f77396a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-395768653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f391a9af7f7482fbab589b087bfd74e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc96a0580-38", "ovs_interfaceid": "c96a0580-3813-482c-8bcc-c95fe4fc1ca6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-9726828d-697b-4c8c-a6ec-80cdf57a0cf6 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:86:7c,bridge_name='br-int',has_traffic_filtering=True,id=c96a0580-3813-482c-8bcc-c95fe4fc1ca6,network=Network(788ee56c-1b66-448e-9e14-51435f77396a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc96a0580-38') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG os_vif [None req-9726828d-697b-4c8c-a6ec-80cdf57a0cf6 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:86:7c,bridge_name='br-int',has_traffic_filtering=True,id=c96a0580-3813-482c-8bcc-c95fe4fc1ca6,network=Network(788ee56c-1b66-448e-9e14-51435f77396a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc96a0580-38') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc96a0580-38, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:43:32 user nova-compute[70924]: INFO os_vif [None req-9726828d-697b-4c8c-a6ec-80cdf57a0cf6 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:86:7c,bridge_name='br-int',has_traffic_filtering=True,id=c96a0580-3813-482c-8bcc-c95fe4fc1ca6,network=Network(788ee56c-1b66-448e-9e14-51435f77396a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc96a0580-38')
Jul 29 14:43:32 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-9726828d-697b-4c8c-a6ec-80cdf57a0cf6 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] Deleting instance files /opt/stack/data/nova/instances/1ea2e4b1-5b93-42bf-b29d-ce6986135826_del
Jul 29 14:43:32 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-9726828d-697b-4c8c-a6ec-80cdf57a0cf6 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] Deletion of /opt/stack/data/nova/instances/1ea2e4b1-5b93-42bf-b29d-ce6986135826_del complete
Jul 29 14:43:32 user nova-compute[70924]: INFO nova.compute.manager [None req-9726828d-697b-4c8c-a6ec-80cdf57a0cf6 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] Took 0.89 seconds to destroy the instance on the hypervisor.
Jul 29 14:43:32 user nova-compute[70924]: DEBUG oslo.service.loopingcall [None req-9726828d-697b-4c8c-a6ec-80cdf57a0cf6 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70924) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG nova.compute.manager [-] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] Deallocating network for instance {{(pid=70924) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] deallocate_for_instance() {{(pid=70924) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6d369fa-e05d-4aad-ab35-f18415bbd38c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Calling os-brick to attach iSCSI Volume {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6d369fa-e05d-4aad-ab35-f18415bbd38c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zlgQFZis', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:43:32 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-a6d369fa-e05d-4aad-ab35-f18415bbd38c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:43:32 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-a6d369fa-e05d-4aad-ab35-f18415bbd38c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-a6d369fa-e05d-4aad-ab35-f18415bbd38c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:43:32 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-a6d369fa-e05d-4aad-ab35-f18415bbd38c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:43:32 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-a6d369fa-e05d-4aad-ab35-f18415bbd38c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-a6d369fa-e05d-4aad-ab35-f18415bbd38c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:43:32 user nova-compute[70924]: INFO os_brick.initiator.connectors.iscsi [None req-a6d369fa-e05d-4aad-ab35-f18415bbd38c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 14:43:32 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 -p 172.16.0.220:3260 {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca5c941-e9dd-4090-baf1-8b0c87968b48]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6d369fa-e05d-4aad-ab35-f18415bbd38c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 14:43:32 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 -p 172.16.0.220:3260 --interface default --op new {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad48a22-e4c3-4da7-a6a2-a9645c539bcd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648] added\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6d369fa-e05d-4aad-ab35-f18415bbd38c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648] added
Jul 29 14:43:32 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f440076e-ddeb-40b1-b8c2-b74aa983cfb8]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6d369fa-e05d-4aad-ab35-f18415bbd38c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f66ef60-24a5-46dd-b008-5a7843b55659]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6d369fa-e05d-4aad-ab35-f18415bbd38c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zlgQFZis {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zlgQFZis" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a1e292-49d7-4b77-8d8c-2987c4d62570]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6d369fa-e05d-4aad-ab35-f18415bbd38c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zlgQFZis'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b15e1c-e7a4-43a2-94c5-36610fda3bf9]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6d369fa-e05d-4aad-ab35-f18415bbd38c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[906aff1e-41c7-4e15-9b0d-fe333b36da2d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6d369fa-e05d-4aad-ab35-f18415bbd38c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)
Jul 29 14:43:32 user nova-compute[70924]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)
Jul 29 14:43:32 user nova-compute[70924]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)
Jul 29 14:43:32 user nova-compute[70924]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:43:32 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6d369fa-e05d-4aad-ab35-f18415bbd38c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)
Jul 29 14:43:32 user nova-compute[70924]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)
Jul 29 14:43:32 user nova-compute[70924]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)
Jul 29 14:43:32 user nova-compute[70924]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:43:32 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 -p 172.16.0.220:3260 --login {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8cf9b9-33ff-4e2e-8aa8-38cd89b1db11]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6d369fa-e05d-4aad-ab35-f18415bbd38c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648, portal: 172.16.0.220,3260]
Jul 29 14:43:32 user nova-compute[70924]: Login to [iface: default, target: iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648, portal: 172.16.0.220,3260] successful.
Jul 29 14:43:32 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c235d51b-f084-4195-a2d5-a0b78eb1f04f]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6d369fa-e05d-4aad-ab35-f18415bbd38c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG nova.objects.instance [None req-26a1ed8a-7aff-4ef9-9966-ef9bf4251187 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Lazy-loading 'flavor' on Instance uuid 00231136-233f-4a1b-88ff-b678482ca5bb {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[924caf6a-8ac7-4a2d-b1e1-dd919c0c400e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6d369fa-e05d-4aad-ab35-f18415bbd38c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)
Jul 29 14:43:32 user nova-compute[70924]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)
Jul 29 14:43:32 user nova-compute[70924]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)
Jul 29 14:43:32 user nova-compute[70924]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:43:32 user nova-compute[70924]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 (non-flash)
Jul 29 14:43:32 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6d369fa-e05d-4aad-ab35-f18415bbd38c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)
Jul 29 14:43:32 user nova-compute[70924]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)
Jul 29 14:43:32 user nova-compute[70924]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)
Jul 29 14:43:32 user nova-compute[70924]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:43:32 user nova-compute[70924]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 (non-flash)
Jul 29 14:43:32 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-a6d369fa-e05d-4aad-ab35-f18415bbd38c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6d369fa-e05d-4aad-ab35-f18415bbd38c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Connected to 172.16.0.220:3260 {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-a6d369fa-e05d-4aad-ab35-f18415bbd38c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] HCTL ('37', '-', '-', 0) found on session 9 with lun 0 {{(pid=70924) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-a6d369fa-e05d-4aad-ab35-f18415bbd38c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=70924) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.024s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef3f67f3-ad20-4901-8553-697bff875a5d]: (4, ('- - 0', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-a6d369fa-e05d-4aad-ab35-f18415bbd38c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Searching for a device in session 9 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6d369fa-e05d-4aad-ab35-f18415bbd38c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zlgQFZis', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 14:43:32 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-26a1ed8a-7aff-4ef9-9966-ef9bf4251187 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Lock "00231136-233f-4a1b-88ff-b678482ca5bb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.831s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:43:33 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:43:33 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] Took 1.18 seconds to deallocate network for instance.
Jul 29 14:43:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9726828d-697b-4c8c-a6ec-80cdf57a0cf6 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:43:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9726828d-697b-4c8c-a6ec-80cdf57a0cf6 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:43:33 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-9726828d-697b-4c8c-a6ec-80cdf57a0cf6 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:43:33 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-9726828d-697b-4c8c-a6ec-80cdf57a0cf6 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:43:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9726828d-697b-4c8c-a6ec-80cdf57a0cf6 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.344s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:43:33 user nova-compute[70924]: INFO nova.scheduler.client.report [None req-9726828d-697b-4c8c-a6ec-80cdf57a0cf6 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Deleted allocations for instance 1ea2e4b1-5b93-42bf-b29d-ce6986135826
Jul 29 14:43:33 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-a6d369fa-e05d-4aad-ab35-f18415bbd38c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:43:33 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6d369fa-e05d-4aad-ab35-f18415bbd38c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '23261336635343832', 'path': '/dev/sdf'} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:43:33 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6d369fa-e05d-4aad-ab35-f18415bbd38c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23261336635343832', 'path': '/dev/sdf'} {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 14:43:33 user nova-compute[70924]: DEBUG nova.objects.instance [None req-a6d369fa-e05d-4aad-ab35-f18415bbd38c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Lazy-loading 'flavor' on Instance uuid fcbb998c-2dac-47d9-985a-d5b2a15ddaa0 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:43:34 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-a6d369fa-e05d-4aad-ab35-f18415bbd38c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] attach device xml: <disk type="block" device="disk">
Jul 29 14:43:34 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:43:34 user nova-compute[70924]:   <source dev="/dev/sdf"/>
Jul 29 14:43:34 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 14:43:34 user nova-compute[70924]:   <serial>19775624-b219-4d3e-9c48-58c1b8dfb648</serial>
Jul 29 14:43:34 user nova-compute[70924]: </disk>
Jul 29 14:43:34 user nova-compute[70924]:  {{(pid=70924) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 29 14:43:34 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84777e67-afc6-4251-8d41-d42c28caa167 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Calling os-brick to attach iSCSI Volume {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 14:43:34 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-84777e67-afc6-4251-8d41-d42c28caa167 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4c27701d-f280-40ca-9ea5-1f19a56c5a34'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NUxrhcaO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:43:34 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-84777e67-afc6-4251-8d41-d42c28caa167 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:43:34 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-84777e67-afc6-4251-8d41-d42c28caa167 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:43:34 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-84777e67-afc6-4251-8d41-d42c28caa167 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:43:34 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-84777e67-afc6-4251-8d41-d42c28caa167 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:43:34 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-84777e67-afc6-4251-8d41-d42c28caa167 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c27701d-f280-40ca-9ea5-1f19a56c5a34" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:43:34 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-84777e67-afc6-4251-8d41-d42c28caa167 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c27701d-f280-40ca-9ea5-1f19a56c5a34" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:43:34 user nova-compute[70924]: INFO os_brick.initiator.connectors.iscsi [None req-84777e67-afc6-4251-8d41-d42c28caa167 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 14:43:34 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c27701d-f280-40ca-9ea5-1f19a56c5a34 -p 172.16.0.220:3260 {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:34 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c27701d-f280-40ca-9ea5-1f19a56c5a34 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:34 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad83f4fe-2642-496c-b992-0eae595c1e0b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:34 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-84777e67-afc6-4251-8d41-d42c28caa167 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 14:43:34 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:43:34 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c27701d-f280-40ca-9ea5-1f19a56c5a34 -p 172.16.0.220:3260 --interface default --op new {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:34 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c27701d-f280-40ca-9ea5-1f19a56c5a34 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:34 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a17e2eb-804c-47e0-9368-301ed18757d0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c27701d-f280-40ca-9ea5-1f19a56c5a34] added\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:34 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-84777e67-afc6-4251-8d41-d42c28caa167 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c27701d-f280-40ca-9ea5-1f19a56c5a34] added
Jul 29 14:43:34 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:43:34 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c27701d-f280-40ca-9ea5-1f19a56c5a34 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9726828d-697b-4c8c-a6ec-80cdf57a0cf6 tempest-AttachSCSIVolumeTestJSON-2068208795 tempest-AttachSCSIVolumeTestJSON-2068208795-project-member] Lock "1ea2e4b1-5b93-42bf-b29d-ce6986135826" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.664s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:43:34 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c27701d-f280-40ca-9ea5-1f19a56c5a34 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:34 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c5d894f-becd-4c21-b3fa-d0f5a438c10f]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:34 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-84777e67-afc6-4251-8d41-d42c28caa167 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:43:34 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c27701d-f280-40ca-9ea5-1f19a56c5a34 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:34 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c27701d-f280-40ca-9ea5-1f19a56c5a34 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:34 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9d8f9c-0cc9-4b70-860c-1f10b00bbd62]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:34 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-84777e67-afc6-4251-8d41-d42c28caa167 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:43:34 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c27701d-f280-40ca-9ea5-1f19a56c5a34 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NUxrhcaO {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:34 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c27701d-f280-40ca-9ea5-1f19a56c5a34 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NUxrhcaO" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:34 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6178211d-f6f7-4b13-b22c-f5e0481b35c9]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:34 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-84777e67-afc6-4251-8d41-d42c28caa167 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NUxrhcaO'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:43:34 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c27701d-f280-40ca-9ea5-1f19a56c5a34 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:34 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c27701d-f280-40ca-9ea5-1f19a56c5a34 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:34 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4ab39b-11f5-4da1-bcf5-47ffd4215b58]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:34 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-84777e67-afc6-4251-8d41-d42c28caa167 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:43:34 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:34 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:34 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab8ca10-5ab4-4b61-94a0-a80ccd1589af]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:34 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-84777e67-afc6-4251-8d41-d42c28caa167 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)
Jul 29 14:43:34 user nova-compute[70924]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)
Jul 29 14:43:34 user nova-compute[70924]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)
Jul 29 14:43:34 user nova-compute[70924]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:43:34 user nova-compute[70924]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 (non-flash)
Jul 29 14:43:34 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:43:34 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-84777e67-afc6-4251-8d41-d42c28caa167 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)
Jul 29 14:43:34 user nova-compute[70924]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)
Jul 29 14:43:34 user nova-compute[70924]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)
Jul 29 14:43:34 user nova-compute[70924]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:43:34 user nova-compute[70924]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 (non-flash)
Jul 29 14:43:34 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:43:34 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c27701d-f280-40ca-9ea5-1f19a56c5a34 -p 172.16.0.220:3260 --login {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:34 user nova-compute[70924]: DEBUG nova.compute.manager [req-83df01f6-b0e3-4587-9a3e-3dd3a2553e42 req-2fc73af5-ef3f-4695-af1f-e90a3e59d294 service nova] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] Received event network-vif-plugged-c96a0580-3813-482c-8bcc-c95fe4fc1ca6 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:43:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-83df01f6-b0e3-4587-9a3e-3dd3a2553e42 req-2fc73af5-ef3f-4695-af1f-e90a3e59d294 service nova] Acquiring lock "1ea2e4b1-5b93-42bf-b29d-ce6986135826-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:43:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-83df01f6-b0e3-4587-9a3e-3dd3a2553e42 req-2fc73af5-ef3f-4695-af1f-e90a3e59d294 service nova] Lock "1ea2e4b1-5b93-42bf-b29d-ce6986135826-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:43:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-83df01f6-b0e3-4587-9a3e-3dd3a2553e42 req-2fc73af5-ef3f-4695-af1f-e90a3e59d294 service nova] Lock "1ea2e4b1-5b93-42bf-b29d-ce6986135826-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:43:34 user nova-compute[70924]: DEBUG nova.compute.manager [req-83df01f6-b0e3-4587-9a3e-3dd3a2553e42 req-2fc73af5-ef3f-4695-af1f-e90a3e59d294 service nova] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] No waiting events found dispatching network-vif-plugged-c96a0580-3813-482c-8bcc-c95fe4fc1ca6 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:43:34 user nova-compute[70924]: WARNING nova.compute.manager [req-83df01f6-b0e3-4587-9a3e-3dd3a2553e42 req-2fc73af5-ef3f-4695-af1f-e90a3e59d294 service nova] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] Received unexpected event network-vif-plugged-c96a0580-3813-482c-8bcc-c95fe4fc1ca6 for instance with vm_state deleted and task_state None.
Jul 29 14:43:34 user nova-compute[70924]: DEBUG nova.compute.manager [req-83df01f6-b0e3-4587-9a3e-3dd3a2553e42 req-2fc73af5-ef3f-4695-af1f-e90a3e59d294 service nova] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] Received event network-vif-deleted-c96a0580-3813-482c-8bcc-c95fe4fc1ca6 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:43:34 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c27701d-f280-40ca-9ea5-1f19a56c5a34 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:34 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb41652-0bae-4b51-9b5c-e7dd6750483b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c27701d-f280-40ca-9ea5-1f19a56c5a34, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4c27701d-f280-40ca-9ea5-1f19a56c5a34, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:34 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-84777e67-afc6-4251-8d41-d42c28caa167 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c27701d-f280-40ca-9ea5-1f19a56c5a34, portal: 172.16.0.220,3260]
Jul 29 14:43:34 user nova-compute[70924]: Login to [iface: default, target: iqn.2010-10.org.openstack:4c27701d-f280-40ca-9ea5-1f19a56c5a34, portal: 172.16.0.220,3260] successful.
Jul 29 14:43:34 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:43:34 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c27701d-f280-40ca-9ea5-1f19a56c5a34 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:34 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c27701d-f280-40ca-9ea5-1f19a56c5a34 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:34 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd531dc-07af-48bd-9b79-73c3bcd85452]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:34 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-84777e67-afc6-4251-8d41-d42c28caa167 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:43:34 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:34 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:34 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e9463aa-4b23-480d-919d-d85d7a16b3c4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c27701d-f280-40ca-9ea5-1f19a56c5a34 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:34 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-84777e67-afc6-4251-8d41-d42c28caa167 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c27701d-f280-40ca-9ea5-1f19a56c5a34 (non-flash)
Jul 29 14:43:34 user nova-compute[70924]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)
Jul 29 14:43:34 user nova-compute[70924]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)
Jul 29 14:43:34 user nova-compute[70924]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)
Jul 29 14:43:34 user nova-compute[70924]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:43:34 user nova-compute[70924]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 (non-flash)
Jul 29 14:43:34 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:43:34 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-84777e67-afc6-4251-8d41-d42c28caa167 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c27701d-f280-40ca-9ea5-1f19a56c5a34 (non-flash)
Jul 29 14:43:34 user nova-compute[70924]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)
Jul 29 14:43:34 user nova-compute[70924]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)
Jul 29 14:43:34 user nova-compute[70924]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)
Jul 29 14:43:34 user nova-compute[70924]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:43:34 user nova-compute[70924]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 (non-flash)
Jul 29 14:43:34 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:43:34 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-84777e67-afc6-4251-8d41-d42c28caa167 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c27701d-f280-40ca-9ea5-1f19a56c5a34" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:43:34 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-84777e67-afc6-4251-8d41-d42c28caa167 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Connected to 172.16.0.220:3260 {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 14:43:34 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-84777e67-afc6-4251-8d41-d42c28caa167 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] HCTL ('38', '-', '-', 0) found on session 10 with lun 0 {{(pid=70924) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 14:43:34 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-84777e67-afc6-4251-8d41-d42c28caa167 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=70924) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 14:43:34 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:34 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:34 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0926c0a4-2227-4205-b849-9e73fa8f9259]: (4, ('- - 0', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:34 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-84777e67-afc6-4251-8d41-d42c28caa167 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Searching for a device in session 10 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 14:43:34 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-84777e67-afc6-4251-8d41-d42c28caa167 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NUxrhcaO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 14:43:34 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-a6d369fa-e05d-4aad-ab35-f18415bbd38c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:43:34 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-a6d369fa-e05d-4aad-ab35-f18415bbd38c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:43:34 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-a6d369fa-e05d-4aad-ab35-f18415bbd38c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] No VIF found with MAC fa:16:3e:92:af:8a, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:43:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a6d369fa-e05d-4aad-ab35-f18415bbd38c tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Lock "fcbb998c-2dac-47d9-985a-d5b2a15ddaa0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.111s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:43:35 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-84777e67-afc6-4251-8d41-d42c28caa167 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:43:35 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-84777e67-afc6-4251-8d41-d42c28caa167 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '23736663465646637', 'path': '/dev/sdg'} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:43:35 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84777e67-afc6-4251-8d41-d42c28caa167 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736663465646637', 'path': '/dev/sdg'} {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 14:43:35 user nova-compute[70924]: DEBUG nova.objects.instance [None req-84777e67-afc6-4251-8d41-d42c28caa167 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Lazy-loading 'flavor' on Instance uuid a9549556-e9a7-4782-ade4-9d397d5323d0 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:43:35 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-84777e67-afc6-4251-8d41-d42c28caa167 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] attach device xml: <disk type="block" device="disk">
Jul 29 14:43:35 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:43:35 user nova-compute[70924]:   <source dev="/dev/sdg"/>
Jul 29 14:43:35 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 14:43:35 user nova-compute[70924]:   <serial>4c27701d-f280-40ca-9ea5-1f19a56c5a34</serial>
Jul 29 14:43:35 user nova-compute[70924]: </disk>
Jul 29 14:43:35 user nova-compute[70924]:  {{(pid=70924) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 29 14:43:35 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-84777e67-afc6-4251-8d41-d42c28caa167 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:43:35 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-84777e67-afc6-4251-8d41-d42c28caa167 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] No BDM found with device name hda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:43:35 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-84777e67-afc6-4251-8d41-d42c28caa167 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] No VIF found with MAC fa:16:3e:5d:b8:2a, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:43:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] Acquiring lock "fcbb998c-2dac-47d9-985a-d5b2a15ddaa0" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:43:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] Lock "fcbb998c-2dac-47d9-985a-d5b2a15ddaa0" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:43:35 user nova-compute[70924]: DEBUG os_brick.utils [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:43:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:35 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[69aae910-3dd0-4e90-85b5-a16aa9d6c320]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f2127c4a30d9\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:35 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a8b05e-136e-4c0e-b1b2-3b458b8f65ef]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:35 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f766085-5bac-4326-90c4-792b1c04b1bc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:35 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb72aba-551f-4a7d-b954-db9eb910ad0a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] Running cmd (subprocess): nvme version {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] 'nvme version' failed. Not Retrying. {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:43:35 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] nvme not present on system {{(pid=70924) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 14:43:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:43:35 user nova-compute[70924]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 14:43:35 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6be695c-02aa-4713-bdaa-7804218ab6bb]: (4, '') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:35 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70924) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 14:43:35 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 14:43:35 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] LIGHTOS: no hostnqn found. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 14:43:36 user nova-compute[70924]: DEBUG os_brick.utils [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f2127c4a30d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:43:36 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-84777e67-afc6-4251-8d41-d42c28caa167 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Lock "a9549556-e9a7-4782-ade4-9d397d5323d0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.617s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:43:36 user nova-compute[70924]: INFO nova.compute.manager [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Swapping volume 19775624-b219-4d3e-9c48-58c1b8dfb648 for 6bb60216-0d32-464f-b727-30d5918681f2
Jul 29 14:43:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1ec1d921-9fe5-46db-874b-3a336ed26905 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Acquiring lock "a9549556-e9a7-4782-ade4-9d397d5323d0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:43:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1ec1d921-9fe5-46db-874b-3a336ed26905 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Lock "a9549556-e9a7-4782-ade4-9d397d5323d0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:43:37 user nova-compute[70924]: INFO nova.compute.manager [None req-1ec1d921-9fe5-46db-874b-3a336ed26905 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Detaching volume 4c27701d-f280-40ca-9ea5-1f19a56c5a34
Jul 29 14:43:37 user nova-compute[70924]: INFO nova.virt.block_device [None req-1ec1d921-9fe5-46db-874b-3a336ed26905 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Attempting to driver detach volume 4c27701d-f280-40ca-9ea5-1f19a56c5a34 from mountpoint /dev/vdb
Jul 29 14:43:37 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-1ec1d921-9fe5-46db-874b-3a336ed26905 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Attempting to detach device vdb from instance a9549556-e9a7-4782-ade4-9d397d5323d0 from the persistent domain config. {{(pid=70924) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 29 14:43:37 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-1ec1d921-9fe5-46db-874b-3a336ed26905 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 14:43:37 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:43:37 user nova-compute[70924]:   <source dev="/dev/sdg"/>
Jul 29 14:43:37 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 14:43:37 user nova-compute[70924]:   <serial>4c27701d-f280-40ca-9ea5-1f19a56c5a34</serial>
Jul 29 14:43:37 user nova-compute[70924]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 29 14:43:37 user nova-compute[70924]: </disk>
Jul 29 14:43:37 user nova-compute[70924]:  {{(pid=70924) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 14:43:37 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-1ec1d921-9fe5-46db-874b-3a336ed26905 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Successfully detached device vdb from instance a9549556-e9a7-4782-ade4-9d397d5323d0 from the persistent domain config.
Jul 29 14:43:37 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-1ec1d921-9fe5-46db-874b-3a336ed26905 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a9549556-e9a7-4782-ade4-9d397d5323d0 from the live domain config. {{(pid=70924) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 29 14:43:37 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-1ec1d921-9fe5-46db-874b-3a336ed26905 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 14:43:37 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:43:37 user nova-compute[70924]:   <source dev="/dev/sdg"/>
Jul 29 14:43:37 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 14:43:37 user nova-compute[70924]:   <serial>4c27701d-f280-40ca-9ea5-1f19a56c5a34</serial>
Jul 29 14:43:37 user nova-compute[70924]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 29 14:43:37 user nova-compute[70924]: </disk>
Jul 29 14:43:37 user nova-compute[70924]:  {{(pid=70924) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 14:43:37 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:43:37 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Received event <DeviceRemovedEvent: 1690641817.6535814, a9549556-e9a7-4782-ade4-9d397d5323d0 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70924) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 29 14:43:37 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-1ec1d921-9fe5-46db-874b-3a336ed26905 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a9549556-e9a7-4782-ade4-9d397d5323d0 {{(pid=70924) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 29 14:43:37 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-1ec1d921-9fe5-46db-874b-3a336ed26905 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Successfully detached device vdb from instance a9549556-e9a7-4782-ade4-9d397d5323d0 from the live domain config.
Jul 29 14:43:37 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ec1d921-9fe5-46db-874b-3a336ed26905 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] calling os-brick to detach iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 14:43:37 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec1d921-9fe5-46db-874b-3a336ed26905 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, {'target_iqns': ['iqn.2010-10.org.openstack:4c27701d-f280-40ca-9ea5-1f19a56c5a34'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NUxrhcaO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:43:37 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-1ec1d921-9fe5-46db-874b-3a336ed26905 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:43:37 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-1ec1d921-9fe5-46db-874b-3a336ed26905 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:43:37 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-1ec1d921-9fe5-46db-874b-3a336ed26905 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:43:37 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec1d921-9fe5-46db-874b-3a336ed26905 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c27701d-f280-40ca-9ea5-1f19a56c5a34', 0)] {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 14:43:37 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:37 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:37 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[96139c26-4ff6-43fa-a2a1-a5b980684d52]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c27701d-f280-40ca-9ea5-1f19a56c5a34\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:37 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:37 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:37 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[25adec3b-875d-4e6b-a688-33294ca4801d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c27701d-f280-40ca-9ea5-1f19a56c5a34 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:37 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec1d921-9fe5-46db-874b-3a336ed26905 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c27701d-f280-40ca-9ea5-1f19a56c5a34 (non-flash)
Jul 29 14:43:37 user nova-compute[70924]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)
Jul 29 14:43:37 user nova-compute[70924]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)
Jul 29 14:43:37 user nova-compute[70924]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)
Jul 29 14:43:37 user nova-compute[70924]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:43:37 user nova-compute[70924]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 (non-flash)
Jul 29 14:43:37 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:43:37 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec1d921-9fe5-46db-874b-3a336ed26905 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c27701d-f280-40ca-9ea5-1f19a56c5a34 (non-flash)
Jul 29 14:43:37 user nova-compute[70924]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)
Jul 29 14:43:37 user nova-compute[70924]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)
Jul 29 14:43:37 user nova-compute[70924]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)
Jul 29 14:43:37 user nova-compute[70924]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:43:37 user nova-compute[70924]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 (non-flash)
Jul 29 14:43:37 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:43:37 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec1d921-9fe5-46db-874b-3a336ed26905 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feedc687eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c27701d-f280-40ca-9ea5-1f19a56c5a34'): ({'sdg'}, set())}) {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 14:43:37 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-1ec1d921-9fe5-46db-874b-3a336ed26905 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Removing single pathed devices sdg {{(pid=70924) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 14:43:37 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:37 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:37 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b1cae0-19d3-4fb2-b64a-d0e20a451f7c]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:37 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:37 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:37 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e10e04-5808-4921-9e6e-ed73073ca445]: (4, ('ok\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:37 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-1ec1d921-9fe5-46db-874b-3a336ed26905 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Flushing IO for device /dev/sdg {{(pid=70924) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 14:43:37 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:37 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:37 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd5d85e-5961-4602-9e6e-3384d1d07b6e]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:37 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-1ec1d921-9fe5-46db-874b-3a336ed26905 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=70924) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 14:43:37 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:37 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.039s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:37 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c67085c-bd6c-4872-b3ae-6cd1d2e1493e]: (4, ('1', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:37 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-1ec1d921-9fe5-46db-874b-3a336ed26905 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 14:43:37 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-1ec1d921-9fe5-46db-874b-3a336ed26905 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] SCSI volumes sdg have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 14:43:37 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec1d921-9fe5-46db-874b-3a336ed26905 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c27701d-f280-40ca-9ea5-1f19a56c5a34')] {{(pid=70924) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 14:43:37 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c27701d-f280-40ca-9ea5-1f19a56c5a34 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:37 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c27701d-f280-40ca-9ea5-1f19a56c5a34 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:37 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ecd917-effc-4abf-acb0-55882d4e03a5]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:37 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec1d921-9fe5-46db-874b-3a336ed26905 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:43:37 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c27701d-f280-40ca-9ea5-1f19a56c5a34 -p 172.16.0.220:3260 --logout {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:37 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:43:37 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c27701d-f280-40ca-9ea5-1f19a56c5a34 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:37 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[282ba1f4-c995-452a-b90b-435011bee7ce]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:4c27701d-f280-40ca-9ea5-1f19a56c5a34, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:4c27701d-f280-40ca-9ea5-1f19a56c5a34, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:37 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec1d921-9fe5-46db-874b-3a336ed26905 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:4c27701d-f280-40ca-9ea5-1f19a56c5a34, portal: 172.16.0.220,3260]
Jul 29 14:43:37 user nova-compute[70924]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:4c27701d-f280-40ca-9ea5-1f19a56c5a34, portal: 172.16.0.220,3260] successful.
Jul 29 14:43:37 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:43:37 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c27701d-f280-40ca-9ea5-1f19a56c5a34 -p 172.16.0.220:3260 --op delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:37 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c27701d-f280-40ca-9ea5-1f19a56c5a34 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:37 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6715f2d-772a-42ef-b4fe-df17e1d90399]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:37 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec1d921-9fe5-46db-874b-3a336ed26905 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:43:37 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-1ec1d921-9fe5-46db-874b-3a336ed26905 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:43:37 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ec1d921-9fe5-46db-874b-3a336ed26905 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] <== disconnect_volume: return (303ms) None {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:43:37 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ec1d921-9fe5-46db-874b-3a336ed26905 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Disconnected iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 14:43:38 user nova-compute[70924]: DEBUG nova.objects.instance [None req-1ec1d921-9fe5-46db-874b-3a336ed26905 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Lazy-loading 'flavor' on Instance uuid a9549556-e9a7-4782-ade4-9d397d5323d0 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:43:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1ec1d921-9fe5-46db-874b-3a336ed26905 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Lock "a9549556-e9a7-4782-ade4-9d397d5323d0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.796s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:43:39 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-cba77ef3-0ee1-49d0-aaba-28459410c539 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Acquiring lock "interface-a9549556-e9a7-4782-ade4-9d397d5323d0-3330a4ca-44e5-4069-9cc8-0da51c0f10d2" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:43:39 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-cba77ef3-0ee1-49d0-aaba-28459410c539 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Lock "interface-a9549556-e9a7-4782-ade4-9d397d5323d0-3330a4ca-44e5-4069-9cc8-0da51c0f10d2" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:43:39 user nova-compute[70924]: DEBUG nova.objects.instance [None req-cba77ef3-0ee1-49d0-aaba-28459410c539 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Lazy-loading 'flavor' on Instance uuid a9549556-e9a7-4782-ade4-9d397d5323d0 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:43:39 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-cba77ef3-0ee1-49d0-aaba-28459410c539 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T14:41:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-850043246',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-850043246',id=8,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFowQgMXsn6ojeJst6U4SII3CK7C8iaLrF5WpK72LhkyBx1DR2/8ARcNjiYRGN2W6nR3e0I7GRFV8EHB/gQZBqjcYpW+ZSwmA+QfOaNLnctkqx//pbvW+SsaaXulcoKRlQ==',key_name='tempest-keypair-1737564447',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:41:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3f5512f71fe048c5936b9154c0e3126b',ramdisk_id='',reservation_id='r-2gg4afvj',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-209058297',owner_user_name='tempest-TaggedAttachmentsTest-209058297-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:41:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a5e9a9bfa864d5f85a3a79499019d9b',uuid=a9549556-e9a7-4782-ade4-9d397d5323d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3330a4ca-44e5-4069-9cc8-0da51c0f10d2", "address": "fa:16:3e:15:50:23", "network": {"id": "d3274b98-c5db-4936-ad6a-d97250e08d2e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1553772351", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3f5512f71fe048c5936b9154c0e3126b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3330a4ca-44", "ovs_interfaceid": "3330a4ca-44e5-4069-9cc8-0da51c0f10d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:43:39 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-cba77ef3-0ee1-49d0-aaba-28459410c539 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Converting VIF {"id": "3330a4ca-44e5-4069-9cc8-0da51c0f10d2", "address": "fa:16:3e:15:50:23", "network": {"id": "d3274b98-c5db-4936-ad6a-d97250e08d2e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1553772351", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3f5512f71fe048c5936b9154c0e3126b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3330a4ca-44", "ovs_interfaceid": "3330a4ca-44e5-4069-9cc8-0da51c0f10d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:43:39 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-cba77ef3-0ee1-49d0-aaba-28459410c539 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:50:23,bridge_name='br-int',has_traffic_filtering=True,id=3330a4ca-44e5-4069-9cc8-0da51c0f10d2,network=Network(d3274b98-c5db-4936-ad6a-d97250e08d2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3330a4ca-44') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:43:39 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-cba77ef3-0ee1-49d0-aaba-28459410c539 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:15:50:23"/><model type="virtio"/><mtu size="1442"/><target dev="tap3330a4ca-44"/></interface> {{(pid=70924) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 29 14:43:39 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-cba77ef3-0ee1-49d0-aaba-28459410c539 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:15:50:23"/><model type="virtio"/><mtu size="1442"/><target dev="tap3330a4ca-44"/></interface> {{(pid=70924) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 29 14:43:39 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-cba77ef3-0ee1-49d0-aaba-28459410c539 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Attempting to detach device tap3330a4ca-44 from instance a9549556-e9a7-4782-ade4-9d397d5323d0 from the persistent domain config. {{(pid=70924) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 29 14:43:39 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-cba77ef3-0ee1-49d0-aaba-28459410c539 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] detach device xml: <interface type="ethernet">
Jul 29 14:43:39 user nova-compute[70924]:   <mac address="fa:16:3e:15:50:23"/>
Jul 29 14:43:39 user nova-compute[70924]:   <model type="virtio"/>
Jul 29 14:43:39 user nova-compute[70924]:   <mtu size="1442"/>
Jul 29 14:43:39 user nova-compute[70924]:   <target dev="tap3330a4ca-44"/>
Jul 29 14:43:39 user nova-compute[70924]: </interface>
Jul 29 14:43:39 user nova-compute[70924]:  {{(pid=70924) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 14:43:39 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-cba77ef3-0ee1-49d0-aaba-28459410c539 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:15:50:23"/><model type="virtio"/><mtu size="1442"/><target dev="tap3330a4ca-44"/></interface> {{(pid=70924) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 29 14:43:39 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-cba77ef3-0ee1-49d0-aaba-28459410c539 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:15:50:23"/><model type="virtio"/><mtu size="1442"/><target dev="tap3330a4ca-44"/></interface>not found in domain: <domain type='kvm' id='8'>
Jul 29 14:43:39 user nova-compute[70924]:   <name>instance-00000008</name>
Jul 29 14:43:39 user nova-compute[70924]:   <uuid>a9549556-e9a7-4782-ade4-9d397d5323d0</uuid>
Jul 29 14:43:39 user nova-compute[70924]:   <metadata>
Jul 29 14:43:39 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 14:43:39 user nova-compute[70924]:   <nova:package version="0.0.0"/>
Jul 29 14:43:39 user nova-compute[70924]:   <nova:name>tempest-device-tagging-server-850043246</nova:name>
Jul 29 14:43:39 user nova-compute[70924]:   <nova:creationTime>2023-07-29 14:43:23</nova:creationTime>
Jul 29 14:43:39 user nova-compute[70924]:   <nova:flavor name="m1.tiny">
Jul 29 14:43:39 user nova-compute[70924]:     <nova:memory>512</nova:memory>
Jul 29 14:43:39 user nova-compute[70924]:     <nova:disk>1</nova:disk>
Jul 29 14:43:39 user nova-compute[70924]:     <nova:swap>0</nova:swap>
Jul 29 14:43:39 user nova-compute[70924]:     <nova:ephemeral>0</nova:ephemeral>
Jul 29 14:43:39 user nova-compute[70924]:     <nova:vcpus>1</nova:vcpus>
Jul 29 14:43:39 user nova-compute[70924]:   </nova:flavor>
Jul 29 14:43:39 user nova-compute[70924]:   <nova:owner>
Jul 29 14:43:39 user nova-compute[70924]:     <nova:user uuid="5a5e9a9bfa864d5f85a3a79499019d9b">tempest-TaggedAttachmentsTest-209058297-project-member</nova:user>
Jul 29 14:43:39 user nova-compute[70924]:     <nova:project uuid="3f5512f71fe048c5936b9154c0e3126b">tempest-TaggedAttachmentsTest-209058297</nova:project>
Jul 29 14:43:39 user nova-compute[70924]:   </nova:owner>
Jul 29 14:43:39 user nova-compute[70924]:   <nova:root type="image" uuid="3aba2e73-6832-404b-8bd0-d0503ce82b8c"/>
Jul 29 14:43:39 user nova-compute[70924]:   <nova:ports>
Jul 29 14:43:39 user nova-compute[70924]:     <nova:port uuid="4350e95a-3892-4c83-a407-aa696585eac6">
Jul 29 14:43:39 user nova-compute[70924]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 29 14:43:39 user nova-compute[70924]:     </nova:port>
Jul 29 14:43:39 user nova-compute[70924]:     <nova:port uuid="3330a4ca-44e5-4069-9cc8-0da51c0f10d2">
Jul 29 14:43:39 user nova-compute[70924]:       <nova:ip type="fixed" address="10.10.10.163" ipVersion="4"/>
Jul 29 14:43:39 user nova-compute[70924]:     </nova:port>
Jul 29 14:43:39 user nova-compute[70924]:   </nova:ports>
Jul 29 14:43:39 user nova-compute[70924]: </nova:instance>
Jul 29 14:43:39 user nova-compute[70924]:   </metadata>
Jul 29 14:43:39 user nova-compute[70924]:   <memory unit='KiB'>524288</memory>
Jul 29 14:43:39 user nova-compute[70924]:   <currentMemory unit='KiB'>524288</currentMemory>
Jul 29 14:43:39 user nova-compute[70924]:   <vcpu placement='static'>1</vcpu>
Jul 29 14:43:39 user nova-compute[70924]:   <resource>
Jul 29 14:43:39 user nova-compute[70924]:     <partition>/machine</partition>
Jul 29 14:43:39 user nova-compute[70924]:   </resource>
Jul 29 14:43:39 user nova-compute[70924]:   <sysinfo type='smbios'>
Jul 29 14:43:39 user nova-compute[70924]:     <system>
Jul 29 14:43:39 user nova-compute[70924]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Jul 29 14:43:39 user nova-compute[70924]:       <entry name='product'>OpenStack Nova</entry>
Jul 29 14:43:39 user nova-compute[70924]:       <entry name='version'>0.0.0</entry>
Jul 29 14:43:39 user nova-compute[70924]:       <entry name='serial'>a9549556-e9a7-4782-ade4-9d397d5323d0</entry>
Jul 29 14:43:39 user nova-compute[70924]:       <entry name='uuid'>a9549556-e9a7-4782-ade4-9d397d5323d0</entry>
Jul 29 14:43:39 user nova-compute[70924]:       <entry name='family'>Virtual Machine</entry>
Jul 29 14:43:39 user nova-compute[70924]:     </system>
Jul 29 14:43:39 user nova-compute[70924]:   </sysinfo>
Jul 29 14:43:39 user nova-compute[70924]:   <os>
Jul 29 14:43:39 user nova-compute[70924]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Jul 29 14:43:39 user nova-compute[70924]:     <boot dev='hd'/>
Jul 29 14:43:39 user nova-compute[70924]:     <smbios mode='sysinfo'/>
Jul 29 14:43:39 user nova-compute[70924]:   </os>
Jul 29 14:43:39 user nova-compute[70924]:   <features>
Jul 29 14:43:39 user nova-compute[70924]:     <acpi/>
Jul 29 14:43:39 user nova-compute[70924]:     <apic/>
Jul 29 14:43:39 user nova-compute[70924]:     <vmcoreinfo state='on'/>
Jul 29 14:43:39 user nova-compute[70924]:   </features>
Jul 29 14:43:39 user nova-compute[70924]:   <cpu mode='custom' match='exact' check='full'>
Jul 29 14:43:39 user nova-compute[70924]:     <model fallback='forbid'>Nehalem</model>
Jul 29 14:43:39 user nova-compute[70924]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Jul 29 14:43:39 user nova-compute[70924]:     <feature policy='require' name='vme'/>
Jul 29 14:43:39 user nova-compute[70924]:     <feature policy='require' name='x2apic'/>
Jul 29 14:43:39 user nova-compute[70924]:     <feature policy='require' name='hypervisor'/>
Jul 29 14:43:39 user nova-compute[70924]:   </cpu>
Jul 29 14:43:39 user nova-compute[70924]:   <clock offset='utc'>
Jul 29 14:43:39 user nova-compute[70924]:     <timer name='pit' tickpolicy='delay'/>
Jul 29 14:43:39 user nova-compute[70924]:     <timer name='rtc' tickpolicy='catchup'/>
Jul 29 14:43:39 user nova-compute[70924]:     <timer name='hpet' present='no'/>
Jul 29 14:43:39 user nova-compute[70924]:   </clock>
Jul 29 14:43:39 user nova-compute[70924]:   <on_poweroff>destroy</on_poweroff>
Jul 29 14:43:39 user nova-compute[70924]:   <on_reboot>restart</on_reboot>
Jul 29 14:43:39 user nova-compute[70924]:   <on_crash>destroy</on_crash>
Jul 29 14:43:39 user nova-compute[70924]:   <devices>
Jul 29 14:43:39 user nova-compute[70924]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 29 14:43:39 user nova-compute[70924]:     <disk type='file' device='disk'>
Jul 29 14:43:39 user nova-compute[70924]:       <driver name='qemu' type='qcow2' cache='none'/>
Jul 29 14:43:39 user nova-compute[70924]:       <source file='/opt/stack/data/nova/instances/a9549556-e9a7-4782-ade4-9d397d5323d0/disk' index='2'/>
Jul 29 14:43:39 user nova-compute[70924]:       <backingStore type='file' index='3'>
Jul 29 14:43:39 user nova-compute[70924]:         <format type='raw'/>
Jul 29 14:43:39 user nova-compute[70924]:         <source file='/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009'/>
Jul 29 14:43:39 user nova-compute[70924]:         <backingStore/>
Jul 29 14:43:39 user nova-compute[70924]:       </backingStore>
Jul 29 14:43:39 user nova-compute[70924]:       <target dev='vda' bus='virtio'/>
Jul 29 14:43:39 user nova-compute[70924]:       <alias name='virtio-disk0'/>
Jul 29 14:43:39 user nova-compute[70924]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Jul 29 14:43:39 user nova-compute[70924]:     </disk>
Jul 29 14:43:39 user nova-compute[70924]:     <disk type='file' device='cdrom'>
Jul 29 14:43:39 user nova-compute[70924]:       <driver name='qemu' type='raw' cache='none'/>
Jul 29 14:43:39 user nova-compute[70924]:       <source file='/opt/stack/data/nova/instances/a9549556-e9a7-4782-ade4-9d397d5323d0/disk.config' index='1'/>
Jul 29 14:43:39 user nova-compute[70924]:       <backingStore/>
Jul 29 14:43:39 user nova-compute[70924]:       <target dev='hda' bus='ide'/>
Jul 29 14:43:39 user nova-compute[70924]:       <readonly/>
Jul 29 14:43:39 user nova-compute[70924]:       <alias name='ide0-0-0'/>
Jul 29 14:43:39 user nova-compute[70924]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Jul 29 14:43:39 user nova-compute[70924]:     </disk>
Jul 29 14:43:39 user nova-compute[70924]:     <controller type='usb' index='0' model='none'>
Jul 29 14:43:39 user nova-compute[70924]:       <alias name='usb'/>
Jul 29 14:43:39 user nova-compute[70924]:     </controller>
Jul 29 14:43:39 user nova-compute[70924]:     <controller type='pci' index='0' model='pci-root'>
Jul 29 14:43:39 user nova-compute[70924]:       <alias name='pci.0'/>
Jul 29 14:43:39 user nova-compute[70924]:     </controller>
Jul 29 14:43:39 user nova-compute[70924]:     <controller type='ide' index='0'>
Jul 29 14:43:39 user nova-compute[70924]:       <alias name='ide'/>
Jul 29 14:43:39 user nova-compute[70924]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Jul 29 14:43:39 user nova-compute[70924]:     </controller>
Jul 29 14:43:39 user nova-compute[70924]:     <interface type='ethernet'>
Jul 29 14:43:39 user nova-compute[70924]:       <mac address='fa:16:3e:5d:b8:2a'/>
Jul 29 14:43:39 user nova-compute[70924]:       <target dev='tap4350e95a-38'/>
Jul 29 14:43:39 user nova-compute[70924]:       <model type='virtio'/>
Jul 29 14:43:39 user nova-compute[70924]:       <mtu size='1442'/>
Jul 29 14:43:39 user nova-compute[70924]:       <alias name='net0'/>
Jul 29 14:43:39 user nova-compute[70924]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Jul 29 14:43:39 user nova-compute[70924]:     </interface>
Jul 29 14:43:39 user nova-compute[70924]:     <interface type='ethernet'>
Jul 29 14:43:39 user nova-compute[70924]:       <mac address='fa:16:3e:15:50:23'/>
Jul 29 14:43:39 user nova-compute[70924]:       <target dev='tap3330a4ca-44'/>
Jul 29 14:43:39 user nova-compute[70924]:       <model type='virtio'/>
Jul 29 14:43:39 user nova-compute[70924]:       <mtu size='1442'/>
Jul 29 14:43:39 user nova-compute[70924]:       <alias name='net1'/>
Jul 29 14:43:39 user nova-compute[70924]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Jul 29 14:43:39 user nova-compute[70924]:     </interface>
Jul 29 14:43:39 user nova-compute[70924]:     <serial type='pty'>
Jul 29 14:43:39 user nova-compute[70924]:       <source path='/dev/pts/7'/>
Jul 29 14:43:39 user nova-compute[70924]:       <log file='/opt/stack/data/nova/instances/a9549556-e9a7-4782-ade4-9d397d5323d0/console.log' append='off'/>
Jul 29 14:43:39 user nova-compute[70924]:       <target type='isa-serial' port='0'>
Jul 29 14:43:39 user nova-compute[70924]:         <model name='isa-serial'/>
Jul 29 14:43:39 user nova-compute[70924]:       </target>
Jul 29 14:43:39 user nova-compute[70924]:       <alias name='serial0'/>
Jul 29 14:43:39 user nova-compute[70924]:     </serial>
Jul 29 14:43:39 user nova-compute[70924]:     <console type='pty' tty='/dev/pts/7'>
Jul 29 14:43:39 user nova-compute[70924]:       <source path='/dev/pts/7'/>
Jul 29 14:43:39 user nova-compute[70924]:       <log file='/opt/stack/data/nova/instances/a9549556-e9a7-4782-ade4-9d397d5323d0/console.log' append='off'/>
Jul 29 14:43:39 user nova-compute[70924]:       <target type='serial' port='0'/>
Jul 29 14:43:39 user nova-compute[70924]:       <alias name='serial0'/>
Jul 29 14:43:39 user nova-compute[70924]:     </console>
Jul 29 14:43:39 user nova-compute[70924]:     <input type='mouse' bus='ps2'>
Jul 29 14:43:39 user nova-compute[70924]:       <alias name='input0'/>
Jul 29 14:43:39 user nova-compute[70924]:     </input>
Jul 29 14:43:39 user nova-compute[70924]:     <input type='keyboard' bus='ps2'>
Jul 29 14:43:39 user nova-compute[70924]:       <alias name='input1'/>
Jul 29 14:43:39 user nova-compute[70924]:     </input>
Jul 29 14:43:39 user nova-compute[70924]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Jul 29 14:43:39 user nova-compute[70924]:       <listen type='address' address='0.0.0.0'/>
Jul 29 14:43:39 user nova-compute[70924]:     </graphics>
Jul 29 14:43:39 user nova-compute[70924]:     <audio id='1' type='none'/>
Jul 29 14:43:39 user nova-compute[70924]:     <video>
Jul 29 14:43:39 user nova-compute[70924]:       <model type='virtio' heads='1' primary='yes'/>
Jul 29 14:43:39 user nova-compute[70924]:       <alias name='video0'/>
Jul 29 14:43:39 user nova-compute[70924]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Jul 29 14:43:39 user nova-compute[70924]:     </video>
Jul 29 14:43:39 user nova-compute[70924]:     <memballoon model='virtio'>
Jul 29 14:43:39 user nova-compute[70924]:       <stats period='10'/>
Jul 29 14:43:39 user nova-compute[70924]:       <alias name='balloon0'/>
Jul 29 14:43:39 user nova-compute[70924]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Jul 29 14:43:39 user nova-compute[70924]:     </memballoon>
Jul 29 14:43:39 user nova-compute[70924]:     <rng model='virtio'>
Jul 29 14:43:39 user nova-compute[70924]:       <backend model='random'>/dev/urandom</backend>
Jul 29 14:43:39 user nova-compute[70924]:       <alias name='rng0'/>
Jul 29 14:43:39 user nova-compute[70924]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Jul 29 14:43:39 user nova-compute[70924]:     </rng>
Jul 29 14:43:39 user nova-compute[70924]:   </devices>
Jul 29 14:43:39 user nova-compute[70924]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Jul 29 14:43:39 user nova-compute[70924]:     <label>libvirt-a9549556-e9a7-4782-ade4-9d397d5323d0</label>
Jul 29 14:43:39 user nova-compute[70924]:     <imagelabel>libvirt-a9549556-e9a7-4782-ade4-9d397d5323d0</imagelabel>
Jul 29 14:43:39 user nova-compute[70924]:   </seclabel>
Jul 29 14:43:39 user nova-compute[70924]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Jul 29 14:43:39 user nova-compute[70924]:     <label>+64055:+108</label>
Jul 29 14:43:39 user nova-compute[70924]:     <imagelabel>+64055:+108</imagelabel>
Jul 29 14:43:39 user nova-compute[70924]:   </seclabel>
Jul 29 14:43:39 user nova-compute[70924]: </domain>
Jul 29 14:43:39 user nova-compute[70924]:  {{(pid=70924) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Jul 29 14:43:39 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-cba77ef3-0ee1-49d0-aaba-28459410c539 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Successfully detached device tap3330a4ca-44 from instance a9549556-e9a7-4782-ade4-9d397d5323d0 from the persistent domain config.
Jul 29 14:43:39 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-cba77ef3-0ee1-49d0-aaba-28459410c539 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] (1/8): Attempting to detach device tap3330a4ca-44 with device alias net1 from instance a9549556-e9a7-4782-ade4-9d397d5323d0 from the live domain config. {{(pid=70924) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 29 14:43:39 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-cba77ef3-0ee1-49d0-aaba-28459410c539 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] detach device xml: <interface type="ethernet">
Jul 29 14:43:39 user nova-compute[70924]:   <mac address="fa:16:3e:15:50:23"/>
Jul 29 14:43:39 user nova-compute[70924]:   <model type="virtio"/>
Jul 29 14:43:39 user nova-compute[70924]:   <mtu size="1442"/>
Jul 29 14:43:39 user nova-compute[70924]:   <target dev="tap3330a4ca-44"/>
Jul 29 14:43:39 user nova-compute[70924]: </interface>
Jul 29 14:43:39 user nova-compute[70924]:  {{(pid=70924) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 14:43:40 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:43:40 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:43:40 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Received event <DeviceRemovedEvent: 1690641820.1902344, a9549556-e9a7-4782-ade4-9d397d5323d0 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70924) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 29 14:43:40 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-cba77ef3-0ee1-49d0-aaba-28459410c539 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Start waiting for the detach event from libvirt for device tap3330a4ca-44 with device alias net1 for instance a9549556-e9a7-4782-ade4-9d397d5323d0 {{(pid=70924) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 29 14:43:40 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-cba77ef3-0ee1-49d0-aaba-28459410c539 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:15:50:23"/><model type="virtio"/><mtu size="1442"/><target dev="tap3330a4ca-44"/></interface> {{(pid=70924) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 29 14:43:40 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:43:40 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-cba77ef3-0ee1-49d0-aaba-28459410c539 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:15:50:23"/><model type="virtio"/><mtu size="1442"/><target dev="tap3330a4ca-44"/></interface>not found in domain: <domain type='kvm' id='8'>
Jul 29 14:43:40 user nova-compute[70924]:   <name>instance-00000008</name>
Jul 29 14:43:40 user nova-compute[70924]:   <uuid>a9549556-e9a7-4782-ade4-9d397d5323d0</uuid>
Jul 29 14:43:40 user nova-compute[70924]:   <metadata>
Jul 29 14:43:40 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 14:43:40 user nova-compute[70924]:   <nova:package version="0.0.0"/>
Jul 29 14:43:40 user nova-compute[70924]:   <nova:name>tempest-device-tagging-server-850043246</nova:name>
Jul 29 14:43:40 user nova-compute[70924]:   <nova:creationTime>2023-07-29 14:43:23</nova:creationTime>
Jul 29 14:43:40 user nova-compute[70924]:   <nova:flavor name="m1.tiny">
Jul 29 14:43:40 user nova-compute[70924]:     <nova:memory>512</nova:memory>
Jul 29 14:43:40 user nova-compute[70924]:     <nova:disk>1</nova:disk>
Jul 29 14:43:40 user nova-compute[70924]:     <nova:swap>0</nova:swap>
Jul 29 14:43:40 user nova-compute[70924]:     <nova:ephemeral>0</nova:ephemeral>
Jul 29 14:43:40 user nova-compute[70924]:     <nova:vcpus>1</nova:vcpus>
Jul 29 14:43:40 user nova-compute[70924]:   </nova:flavor>
Jul 29 14:43:40 user nova-compute[70924]:   <nova:owner>
Jul 29 14:43:40 user nova-compute[70924]:     <nova:user uuid="5a5e9a9bfa864d5f85a3a79499019d9b">tempest-TaggedAttachmentsTest-209058297-project-member</nova:user>
Jul 29 14:43:40 user nova-compute[70924]:     <nova:project uuid="3f5512f71fe048c5936b9154c0e3126b">tempest-TaggedAttachmentsTest-209058297</nova:project>
Jul 29 14:43:40 user nova-compute[70924]:   </nova:owner>
Jul 29 14:43:40 user nova-compute[70924]:   <nova:root type="image" uuid="3aba2e73-6832-404b-8bd0-d0503ce82b8c"/>
Jul 29 14:43:40 user nova-compute[70924]:   <nova:ports>
Jul 29 14:43:40 user nova-compute[70924]:     <nova:port uuid="4350e95a-3892-4c83-a407-aa696585eac6">
Jul 29 14:43:40 user nova-compute[70924]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 29 14:43:40 user nova-compute[70924]:     </nova:port>
Jul 29 14:43:40 user nova-compute[70924]:     <nova:port uuid="3330a4ca-44e5-4069-9cc8-0da51c0f10d2">
Jul 29 14:43:40 user nova-compute[70924]:       <nova:ip type="fixed" address="10.10.10.163" ipVersion="4"/>
Jul 29 14:43:40 user nova-compute[70924]:     </nova:port>
Jul 29 14:43:40 user nova-compute[70924]:   </nova:ports>
Jul 29 14:43:40 user nova-compute[70924]: </nova:instance>
Jul 29 14:43:40 user nova-compute[70924]:   </metadata>
Jul 29 14:43:40 user nova-compute[70924]:   <memory unit='KiB'>524288</memory>
Jul 29 14:43:40 user nova-compute[70924]:   <currentMemory unit='KiB'>524288</currentMemory>
Jul 29 14:43:40 user nova-compute[70924]:   <vcpu placement='static'>1</vcpu>
Jul 29 14:43:40 user nova-compute[70924]:   <resource>
Jul 29 14:43:40 user nova-compute[70924]:     <partition>/machine</partition>
Jul 29 14:43:40 user nova-compute[70924]:   </resource>
Jul 29 14:43:40 user nova-compute[70924]:   <sysinfo type='smbios'>
Jul 29 14:43:40 user nova-compute[70924]:     <system>
Jul 29 14:43:40 user nova-compute[70924]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Jul 29 14:43:40 user nova-compute[70924]:       <entry name='product'>OpenStack Nova</entry>
Jul 29 14:43:40 user nova-compute[70924]:       <entry name='version'>0.0.0</entry>
Jul 29 14:43:40 user nova-compute[70924]:       <entry name='serial'>a9549556-e9a7-4782-ade4-9d397d5323d0</entry>
Jul 29 14:43:40 user nova-compute[70924]:       <entry name='uuid'>a9549556-e9a7-4782-ade4-9d397d5323d0</entry>
Jul 29 14:43:40 user nova-compute[70924]:       <entry name='family'>Virtual Machine</entry>
Jul 29 14:43:40 user nova-compute[70924]:     </system>
Jul 29 14:43:40 user nova-compute[70924]:   </sysinfo>
Jul 29 14:43:40 user nova-compute[70924]:   <os>
Jul 29 14:43:40 user nova-compute[70924]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Jul 29 14:43:40 user nova-compute[70924]:     <boot dev='hd'/>
Jul 29 14:43:40 user nova-compute[70924]:     <smbios mode='sysinfo'/>
Jul 29 14:43:40 user nova-compute[70924]:   </os>
Jul 29 14:43:40 user nova-compute[70924]:   <features>
Jul 29 14:43:40 user nova-compute[70924]:     <acpi/>
Jul 29 14:43:40 user nova-compute[70924]:     <apic/>
Jul 29 14:43:40 user nova-compute[70924]:     <vmcoreinfo state='on'/>
Jul 29 14:43:40 user nova-compute[70924]:   </features>
Jul 29 14:43:40 user nova-compute[70924]:   <cpu mode='custom' match='exact' check='full'>
Jul 29 14:43:40 user nova-compute[70924]:     <model fallback='forbid'>Nehalem</model>
Jul 29 14:43:40 user nova-compute[70924]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Jul 29 14:43:40 user nova-compute[70924]:     <feature policy='require' name='vme'/>
Jul 29 14:43:40 user nova-compute[70924]:     <feature policy='require' name='x2apic'/>
Jul 29 14:43:40 user nova-compute[70924]:     <feature policy='require' name='hypervisor'/>
Jul 29 14:43:40 user nova-compute[70924]:   </cpu>
Jul 29 14:43:40 user nova-compute[70924]:   <clock offset='utc'>
Jul 29 14:43:40 user nova-compute[70924]:     <timer name='pit' tickpolicy='delay'/>
Jul 29 14:43:40 user nova-compute[70924]:     <timer name='rtc' tickpolicy='catchup'/>
Jul 29 14:43:40 user nova-compute[70924]:     <timer name='hpet' present='no'/>
Jul 29 14:43:40 user nova-compute[70924]:   </clock>
Jul 29 14:43:40 user nova-compute[70924]:   <on_poweroff>destroy</on_poweroff>
Jul 29 14:43:40 user nova-compute[70924]:   <on_reboot>restart</on_reboot>
Jul 29 14:43:40 user nova-compute[70924]:   <on_crash>destroy</on_crash>
Jul 29 14:43:40 user nova-compute[70924]:   <devices>
Jul 29 14:43:40 user nova-compute[70924]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 29 14:43:40 user nova-compute[70924]:     <disk type='file' device='disk'>
Jul 29 14:43:40 user nova-compute[70924]:       <driver name='qemu' type='qcow2' cache='none'/>
Jul 29 14:43:40 user nova-compute[70924]:       <source file='/opt/stack/data/nova/instances/a9549556-e9a7-4782-ade4-9d397d5323d0/disk' index='2'/>
Jul 29 14:43:40 user nova-compute[70924]:       <backingStore type='file' index='3'>
Jul 29 14:43:40 user nova-compute[70924]:         <format type='raw'/>
Jul 29 14:43:40 user nova-compute[70924]:         <source file='/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009'/>
Jul 29 14:43:40 user nova-compute[70924]:         <backingStore/>
Jul 29 14:43:40 user nova-compute[70924]:       </backingStore>
Jul 29 14:43:40 user nova-compute[70924]:       <target dev='vda' bus='virtio'/>
Jul 29 14:43:40 user nova-compute[70924]:       <alias name='virtio-disk0'/>
Jul 29 14:43:40 user nova-compute[70924]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Jul 29 14:43:40 user nova-compute[70924]:     </disk>
Jul 29 14:43:40 user nova-compute[70924]:     <disk type='file' device='cdrom'>
Jul 29 14:43:40 user nova-compute[70924]:       <driver name='qemu' type='raw' cache='none'/>
Jul 29 14:43:40 user nova-compute[70924]:       <source file='/opt/stack/data/nova/instances/a9549556-e9a7-4782-ade4-9d397d5323d0/disk.config' index='1'/>
Jul 29 14:43:40 user nova-compute[70924]:       <backingStore/>
Jul 29 14:43:40 user nova-compute[70924]:       <target dev='hda' bus='ide'/>
Jul 29 14:43:40 user nova-compute[70924]:       <readonly/>
Jul 29 14:43:40 user nova-compute[70924]:       <alias name='ide0-0-0'/>
Jul 29 14:43:40 user nova-compute[70924]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Jul 29 14:43:40 user nova-compute[70924]:     </disk>
Jul 29 14:43:40 user nova-compute[70924]:     <controller type='usb' index='0' model='none'>
Jul 29 14:43:40 user nova-compute[70924]:       <alias name='usb'/>
Jul 29 14:43:40 user nova-compute[70924]:     </controller>
Jul 29 14:43:40 user nova-compute[70924]:     <controller type='pci' index='0' model='pci-root'>
Jul 29 14:43:40 user nova-compute[70924]:       <alias name='pci.0'/>
Jul 29 14:43:40 user nova-compute[70924]:     </controller>
Jul 29 14:43:40 user nova-compute[70924]:     <controller type='ide' index='0'>
Jul 29 14:43:40 user nova-compute[70924]:       <alias name='ide'/>
Jul 29 14:43:40 user nova-compute[70924]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Jul 29 14:43:40 user nova-compute[70924]:     </controller>
Jul 29 14:43:40 user nova-compute[70924]:     <interface type='ethernet'>
Jul 29 14:43:40 user nova-compute[70924]:       <mac address='fa:16:3e:5d:b8:2a'/>
Jul 29 14:43:40 user nova-compute[70924]:       <target dev='tap4350e95a-38'/>
Jul 29 14:43:40 user nova-compute[70924]:       <model type='virtio'/>
Jul 29 14:43:40 user nova-compute[70924]:       <mtu size='1442'/>
Jul 29 14:43:40 user nova-compute[70924]:       <alias name='net0'/>
Jul 29 14:43:40 user nova-compute[70924]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Jul 29 14:43:40 user nova-compute[70924]:     </interface>
Jul 29 14:43:40 user nova-compute[70924]:     <serial type='pty'>
Jul 29 14:43:40 user nova-compute[70924]:       <source path='/dev/pts/7'/>
Jul 29 14:43:40 user nova-compute[70924]:       <log file='/opt/stack/data/nova/instances/a9549556-e9a7-4782-ade4-9d397d5323d0/console.log' append='off'/>
Jul 29 14:43:40 user nova-compute[70924]:       <target type='isa-serial' port='0'>
Jul 29 14:43:40 user nova-compute[70924]:         <model name='isa-serial'/>
Jul 29 14:43:40 user nova-compute[70924]:       </target>
Jul 29 14:43:40 user nova-compute[70924]:       <alias name='serial0'/>
Jul 29 14:43:40 user nova-compute[70924]:     </serial>
Jul 29 14:43:40 user nova-compute[70924]:     <console type='pty' tty='/dev/pts/7'>
Jul 29 14:43:40 user nova-compute[70924]:       <source path='/dev/pts/7'/>
Jul 29 14:43:40 user nova-compute[70924]:       <log file='/opt/stack/data/nova/instances/a9549556-e9a7-4782-ade4-9d397d5323d0/console.log' append='off'/>
Jul 29 14:43:40 user nova-compute[70924]:       <target type='serial' port='0'/>
Jul 29 14:43:40 user nova-compute[70924]:       <alias name='serial0'/>
Jul 29 14:43:40 user nova-compute[70924]:     </console>
Jul 29 14:43:40 user nova-compute[70924]:     <input type='mouse' bus='ps2'>
Jul 29 14:43:40 user nova-compute[70924]:       <alias name='input0'/>
Jul 29 14:43:40 user nova-compute[70924]:     </input>
Jul 29 14:43:40 user nova-compute[70924]:     <input type='keyboard' bus='ps2'>
Jul 29 14:43:40 user nova-compute[70924]:       <alias name='input1'/>
Jul 29 14:43:40 user nova-compute[70924]:     </input>
Jul 29 14:43:40 user nova-compute[70924]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Jul 29 14:43:40 user nova-compute[70924]:       <listen type='address' address='0.0.0.0'/>
Jul 29 14:43:40 user nova-compute[70924]:     </graphics>
Jul 29 14:43:40 user nova-compute[70924]:     <audio id='1' type='none'/>
Jul 29 14:43:40 user nova-compute[70924]:     <video>
Jul 29 14:43:40 user nova-compute[70924]:       <model type='virtio' heads='1' primary='yes'/>
Jul 29 14:43:40 user nova-compute[70924]:       <alias name='video0'/>
Jul 29 14:43:40 user nova-compute[70924]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Jul 29 14:43:40 user nova-compute[70924]:     </video>
Jul 29 14:43:40 user nova-compute[70924]:     <memballoon model='virtio'>
Jul 29 14:43:40 user nova-compute[70924]:       <stats period='10'/>
Jul 29 14:43:40 user nova-compute[70924]:       <alias name='balloon0'/>
Jul 29 14:43:40 user nova-compute[70924]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Jul 29 14:43:40 user nova-compute[70924]:     </memballoon>
Jul 29 14:43:40 user nova-compute[70924]:     <rng model='virtio'>
Jul 29 14:43:40 user nova-compute[70924]:       <backend model='random'>/dev/urandom</backend>
Jul 29 14:43:40 user nova-compute[70924]:       <alias name='rng0'/>
Jul 29 14:43:40 user nova-compute[70924]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Jul 29 14:43:40 user nova-compute[70924]:     </rng>
Jul 29 14:43:40 user nova-compute[70924]:   </devices>
Jul 29 14:43:40 user nova-compute[70924]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Jul 29 14:43:40 user nova-compute[70924]:     <label>libvirt-a9549556-e9a7-4782-ade4-9d397d5323d0</label>
Jul 29 14:43:40 user nova-compute[70924]:     <imagelabel>libvirt-a9549556-e9a7-4782-ade4-9d397d5323d0</imagelabel>
Jul 29 14:43:40 user nova-compute[70924]:   </seclabel>
Jul 29 14:43:40 user nova-compute[70924]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Jul 29 14:43:40 user nova-compute[70924]:     <label>+64055:+108</label>
Jul 29 14:43:40 user nova-compute[70924]:     <imagelabel>+64055:+108</imagelabel>
Jul 29 14:43:40 user nova-compute[70924]:   </seclabel>
Jul 29 14:43:40 user nova-compute[70924]: </domain>
Jul 29 14:43:40 user nova-compute[70924]:  {{(pid=70924) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Jul 29 14:43:40 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-cba77ef3-0ee1-49d0-aaba-28459410c539 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Successfully detached device tap3330a4ca-44 from instance a9549556-e9a7-4782-ade4-9d397d5323d0 from the live domain config.
Jul 29 14:43:40 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-cba77ef3-0ee1-49d0-aaba-28459410c539 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T14:41:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-850043246',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-850043246',id=8,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFowQgMXsn6ojeJst6U4SII3CK7C8iaLrF5WpK72LhkyBx1DR2/8ARcNjiYRGN2W6nR3e0I7GRFV8EHB/gQZBqjcYpW+ZSwmA+QfOaNLnctkqx//pbvW+SsaaXulcoKRlQ==',key_name='tempest-keypair-1737564447',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:41:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3f5512f71fe048c5936b9154c0e3126b',ramdisk_id='',reservation_id='r-2gg4afvj',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-209058297',owner_user_name='tempest-TaggedAttachmentsTest-209058297-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:41:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a5e9a9bfa864d5f85a3a79499019d9b',uuid=a9549556-e9a7-4782-ade4-9d397d5323d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3330a4ca-44e5-4069-9cc8-0da51c0f10d2", "address": "fa:16:3e:15:50:23", "network": {"id": "d3274b98-c5db-4936-ad6a-d97250e08d2e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1553772351", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3f5512f71fe048c5936b9154c0e3126b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3330a4ca-44", "ovs_interfaceid": "3330a4ca-44e5-4069-9cc8-0da51c0f10d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 14:43:40 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-cba77ef3-0ee1-49d0-aaba-28459410c539 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Converting VIF {"id": "3330a4ca-44e5-4069-9cc8-0da51c0f10d2", "address": "fa:16:3e:15:50:23", "network": {"id": "d3274b98-c5db-4936-ad6a-d97250e08d2e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1553772351", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3f5512f71fe048c5936b9154c0e3126b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3330a4ca-44", "ovs_interfaceid": "3330a4ca-44e5-4069-9cc8-0da51c0f10d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:43:40 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-cba77ef3-0ee1-49d0-aaba-28459410c539 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:50:23,bridge_name='br-int',has_traffic_filtering=True,id=3330a4ca-44e5-4069-9cc8-0da51c0f10d2,network=Network(d3274b98-c5db-4936-ad6a-d97250e08d2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3330a4ca-44') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:43:40 user nova-compute[70924]: DEBUG os_vif [None req-cba77ef3-0ee1-49d0-aaba-28459410c539 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:50:23,bridge_name='br-int',has_traffic_filtering=True,id=3330a4ca-44e5-4069-9cc8-0da51c0f10d2,network=Network(d3274b98-c5db-4936-ad6a-d97250e08d2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3330a4ca-44') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 14:43:40 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:43:40 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3330a4ca-44, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:43:40 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:43:40 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:43:40 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:43:40 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:43:40 user nova-compute[70924]: INFO os_vif [None req-cba77ef3-0ee1-49d0-aaba-28459410c539 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:50:23,bridge_name='br-int',has_traffic_filtering=True,id=3330a4ca-44e5-4069-9cc8-0da51c0f10d2,network=Network(d3274b98-c5db-4936-ad6a-d97250e08d2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3330a4ca-44')
Jul 29 14:43:40 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-cba77ef3-0ee1-49d0-aaba-28459410c539 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 14:43:40 user nova-compute[70924]:   <nova:package version="0.0.0"/>
Jul 29 14:43:40 user nova-compute[70924]:   <nova:name>tempest-device-tagging-server-850043246</nova:name>
Jul 29 14:43:40 user nova-compute[70924]:   <nova:creationTime>2023-07-29 14:43:40</nova:creationTime>
Jul 29 14:43:40 user nova-compute[70924]:   <nova:flavor name="m1.tiny">
Jul 29 14:43:40 user nova-compute[70924]:     <nova:memory>512</nova:memory>
Jul 29 14:43:40 user nova-compute[70924]:     <nova:disk>1</nova:disk>
Jul 29 14:43:40 user nova-compute[70924]:     <nova:swap>0</nova:swap>
Jul 29 14:43:40 user nova-compute[70924]:     <nova:ephemeral>0</nova:ephemeral>
Jul 29 14:43:40 user nova-compute[70924]:     <nova:vcpus>1</nova:vcpus>
Jul 29 14:43:40 user nova-compute[70924]:   </nova:flavor>
Jul 29 14:43:40 user nova-compute[70924]:   <nova:owner>
Jul 29 14:43:40 user nova-compute[70924]:     <nova:user uuid="5a5e9a9bfa864d5f85a3a79499019d9b">tempest-TaggedAttachmentsTest-209058297-project-member</nova:user>
Jul 29 14:43:40 user nova-compute[70924]:     <nova:project uuid="3f5512f71fe048c5936b9154c0e3126b">tempest-TaggedAttachmentsTest-209058297</nova:project>
Jul 29 14:43:40 user nova-compute[70924]:   </nova:owner>
Jul 29 14:43:40 user nova-compute[70924]:   <nova:root type="image" uuid="3aba2e73-6832-404b-8bd0-d0503ce82b8c"/>
Jul 29 14:43:40 user nova-compute[70924]:   <nova:ports>
Jul 29 14:43:40 user nova-compute[70924]:     <nova:port uuid="4350e95a-3892-4c83-a407-aa696585eac6">
Jul 29 14:43:40 user nova-compute[70924]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 29 14:43:40 user nova-compute[70924]:     </nova:port>
Jul 29 14:43:40 user nova-compute[70924]:   </nova:ports>
Jul 29 14:43:40 user nova-compute[70924]: </nova:instance>
Jul 29 14:43:40 user nova-compute[70924]:  {{(pid=70924) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Jul 29 14:43:40 user nova-compute[70924]: DEBUG nova.compute.manager [req-4da0619b-a805-4cf6-ab63-f58e50ab0b79 req-cd26c826-c1f2-4c3a-bf36-f0eef900b633 service nova] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Received event network-vif-unplugged-3330a4ca-44e5-4069-9cc8-0da51c0f10d2 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:43:40 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-4da0619b-a805-4cf6-ab63-f58e50ab0b79 req-cd26c826-c1f2-4c3a-bf36-f0eef900b633 service nova] Acquiring lock "a9549556-e9a7-4782-ade4-9d397d5323d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:43:40 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-4da0619b-a805-4cf6-ab63-f58e50ab0b79 req-cd26c826-c1f2-4c3a-bf36-f0eef900b633 service nova] Lock "a9549556-e9a7-4782-ade4-9d397d5323d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:43:40 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-4da0619b-a805-4cf6-ab63-f58e50ab0b79 req-cd26c826-c1f2-4c3a-bf36-f0eef900b633 service nova] Lock "a9549556-e9a7-4782-ade4-9d397d5323d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:43:40 user nova-compute[70924]: DEBUG nova.compute.manager [req-4da0619b-a805-4cf6-ab63-f58e50ab0b79 req-cd26c826-c1f2-4c3a-bf36-f0eef900b633 service nova] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] No waiting events found dispatching network-vif-unplugged-3330a4ca-44e5-4069-9cc8-0da51c0f10d2 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:43:40 user nova-compute[70924]: WARNING nova.compute.manager [req-4da0619b-a805-4cf6-ab63-f58e50ab0b79 req-cd26c826-c1f2-4c3a-bf36-f0eef900b633 service nova] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Received unexpected event network-vif-unplugged-3330a4ca-44e5-4069-9cc8-0da51c0f10d2 for instance with vm_state active and task_state None.
Jul 29 14:43:40 user nova-compute[70924]: DEBUG nova.compute.manager [req-27aa72c9-60d1-402b-bf9f-a4536c678b85 req-e7ed9f7e-b23c-4156-a3c2-e6074eed73be service nova] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Received event network-vif-deleted-3330a4ca-44e5-4069-9cc8-0da51c0f10d2 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:43:40 user nova-compute[70924]: INFO nova.compute.manager [req-27aa72c9-60d1-402b-bf9f-a4536c678b85 req-e7ed9f7e-b23c-4156-a3c2-e6074eed73be service nova] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Neutron deleted interface 3330a4ca-44e5-4069-9cc8-0da51c0f10d2; detaching it from the instance and deleting it from the info cache
Jul 29 14:43:40 user nova-compute[70924]: DEBUG nova.network.neutron [req-27aa72c9-60d1-402b-bf9f-a4536c678b85 req-e7ed9f7e-b23c-4156-a3c2-e6074eed73be service nova] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Updating instance_info_cache with network_info: [{"id": "4350e95a-3892-4c83-a407-aa696585eac6", "address": "fa:16:3e:5d:b8:2a", "network": {"id": "4ca69734-4a00-4e6b-bbad-8bc03edba586", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1313665133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f5512f71fe048c5936b9154c0e3126b", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4350e95a-38", "ovs_interfaceid": "4350e95a-3892-4c83-a407-aa696585eac6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:43:40 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-cba77ef3-0ee1-49d0-aaba-28459410c539 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Acquiring lock "refresh_cache-a9549556-e9a7-4782-ade4-9d397d5323d0" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:43:40 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-cba77ef3-0ee1-49d0-aaba-28459410c539 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Acquired lock "refresh_cache-a9549556-e9a7-4782-ade4-9d397d5323d0" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:43:40 user nova-compute[70924]: DEBUG nova.network.neutron [None req-cba77ef3-0ee1-49d0-aaba-28459410c539 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 14:43:40 user nova-compute[70924]: DEBUG nova.objects.instance [req-27aa72c9-60d1-402b-bf9f-a4536c678b85 req-e7ed9f7e-b23c-4156-a3c2-e6074eed73be service nova] Lazy-loading 'system_metadata' on Instance uuid a9549556-e9a7-4782-ade4-9d397d5323d0 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:43:40 user nova-compute[70924]: DEBUG nova.objects.instance [req-27aa72c9-60d1-402b-bf9f-a4536c678b85 req-e7ed9f7e-b23c-4156-a3c2-e6074eed73be service nova] Lazy-loading 'flavor' on Instance uuid a9549556-e9a7-4782-ade4-9d397d5323d0 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:43:40 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [req-27aa72c9-60d1-402b-bf9f-a4536c678b85 req-e7ed9f7e-b23c-4156-a3c2-e6074eed73be service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T14:41:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-850043246',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-850043246',id=8,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFowQgMXsn6ojeJst6U4SII3CK7C8iaLrF5WpK72LhkyBx1DR2/8ARcNjiYRGN2W6nR3e0I7GRFV8EHB/gQZBqjcYpW+ZSwmA+QfOaNLnctkqx//pbvW+SsaaXulcoKRlQ==',key_name='tempest-keypair-1737564447',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:41:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3f5512f71fe048c5936b9154c0e3126b',ramdisk_id='',reservation_id='r-2gg4afvj',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-209058297',owner_user_name='tempest-TaggedAttachmentsTest-209058297-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:41:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a5e9a9bfa864d5f85a3a79499019d9b',uuid=a9549556-e9a7-4782-ade4-9d397d5323d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3330a4ca-44e5-4069-9cc8-0da51c0f10d2", "address": "fa:16:3e:15:50:23", "network": {"id": "d3274b98-c5db-4936-ad6a-d97250e08d2e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1553772351", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3f5512f71fe048c5936b9154c0e3126b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3330a4ca-44", "ovs_interfaceid": "3330a4ca-44e5-4069-9cc8-0da51c0f10d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:43:40 user nova-compute[70924]: DEBUG nova.network.os_vif_util [req-27aa72c9-60d1-402b-bf9f-a4536c678b85 req-e7ed9f7e-b23c-4156-a3c2-e6074eed73be service nova] Converting VIF {"id": "3330a4ca-44e5-4069-9cc8-0da51c0f10d2", "address": "fa:16:3e:15:50:23", "network": {"id": "d3274b98-c5db-4936-ad6a-d97250e08d2e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1553772351", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3f5512f71fe048c5936b9154c0e3126b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3330a4ca-44", "ovs_interfaceid": "3330a4ca-44e5-4069-9cc8-0da51c0f10d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:43:40 user nova-compute[70924]: DEBUG nova.network.os_vif_util [req-27aa72c9-60d1-402b-bf9f-a4536c678b85 req-e7ed9f7e-b23c-4156-a3c2-e6074eed73be service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:50:23,bridge_name='br-int',has_traffic_filtering=True,id=3330a4ca-44e5-4069-9cc8-0da51c0f10d2,network=Network(d3274b98-c5db-4936-ad6a-d97250e08d2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3330a4ca-44') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:43:40 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [req-27aa72c9-60d1-402b-bf9f-a4536c678b85 req-e7ed9f7e-b23c-4156-a3c2-e6074eed73be service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:15:50:23"/><model type="virtio"/><mtu size="1442"/><target dev="tap3330a4ca-44"/></interface> {{(pid=70924) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 29 14:43:40 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [req-27aa72c9-60d1-402b-bf9f-a4536c678b85 req-e7ed9f7e-b23c-4156-a3c2-e6074eed73be service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:15:50:23"/><model type="virtio"/><mtu size="1442"/><target dev="tap3330a4ca-44"/></interface>not found in domain: <domain type='kvm' id='8'>
Jul 29 14:43:40 user nova-compute[70924]:   <name>instance-00000008</name>
Jul 29 14:43:40 user nova-compute[70924]:   <uuid>a9549556-e9a7-4782-ade4-9d397d5323d0</uuid>
Jul 29 14:43:40 user nova-compute[70924]:   <metadata>
Jul 29 14:43:40 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 14:43:40 user nova-compute[70924]:   <nova:package version="0.0.0"/>
Jul 29 14:43:40 user nova-compute[70924]:   <nova:name>tempest-device-tagging-server-850043246</nova:name>
Jul 29 14:43:40 user nova-compute[70924]:   <nova:creationTime>2023-07-29 14:43:40</nova:creationTime>
Jul 29 14:43:40 user nova-compute[70924]:   <nova:flavor name="m1.tiny">
Jul 29 14:43:40 user nova-compute[70924]:     <nova:memory>512</nova:memory>
Jul 29 14:43:40 user nova-compute[70924]:     <nova:disk>1</nova:disk>
Jul 29 14:43:40 user nova-compute[70924]:     <nova:swap>0</nova:swap>
Jul 29 14:43:40 user nova-compute[70924]:     <nova:ephemeral>0</nova:ephemeral>
Jul 29 14:43:40 user nova-compute[70924]:     <nova:vcpus>1</nova:vcpus>
Jul 29 14:43:40 user nova-compute[70924]:   </nova:flavor>
Jul 29 14:43:40 user nova-compute[70924]:   <nova:owner>
Jul 29 14:43:40 user nova-compute[70924]:     <nova:user uuid="5a5e9a9bfa864d5f85a3a79499019d9b">tempest-TaggedAttachmentsTest-209058297-project-member</nova:user>
Jul 29 14:43:40 user nova-compute[70924]:     <nova:project uuid="3f5512f71fe048c5936b9154c0e3126b">tempest-TaggedAttachmentsTest-209058297</nova:project>
Jul 29 14:43:40 user nova-compute[70924]:   </nova:owner>
Jul 29 14:43:40 user nova-compute[70924]:   <nova:root type="image" uuid="3aba2e73-6832-404b-8bd0-d0503ce82b8c"/>
Jul 29 14:43:40 user nova-compute[70924]:   <nova:ports>
Jul 29 14:43:40 user nova-compute[70924]:     <nova:port uuid="4350e95a-3892-4c83-a407-aa696585eac6">
Jul 29 14:43:40 user nova-compute[70924]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 29 14:43:40 user nova-compute[70924]:     </nova:port>
Jul 29 14:43:40 user nova-compute[70924]:   </nova:ports>
Jul 29 14:43:40 user nova-compute[70924]: </nova:instance>
Jul 29 14:43:40 user nova-compute[70924]:   </metadata>
Jul 29 14:43:40 user nova-compute[70924]:   <memory unit='KiB'>524288</memory>
Jul 29 14:43:40 user nova-compute[70924]:   <currentMemory unit='KiB'>524288</currentMemory>
Jul 29 14:43:40 user nova-compute[70924]:   <vcpu placement='static'>1</vcpu>
Jul 29 14:43:40 user nova-compute[70924]:   <resource>
Jul 29 14:43:40 user nova-compute[70924]:     <partition>/machine</partition>
Jul 29 14:43:40 user nova-compute[70924]:   </resource>
Jul 29 14:43:40 user nova-compute[70924]:   <sysinfo type='smbios'>
Jul 29 14:43:40 user nova-compute[70924]:     <system>
Jul 29 14:43:40 user nova-compute[70924]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Jul 29 14:43:40 user nova-compute[70924]:       <entry name='product'>OpenStack Nova</entry>
Jul 29 14:43:40 user nova-compute[70924]:       <entry name='version'>0.0.0</entry>
Jul 29 14:43:40 user nova-compute[70924]:       <entry name='serial'>a9549556-e9a7-4782-ade4-9d397d5323d0</entry>
Jul 29 14:43:40 user nova-compute[70924]:       <entry name='uuid'>a9549556-e9a7-4782-ade4-9d397d5323d0</entry>
Jul 29 14:43:40 user nova-compute[70924]:       <entry name='family'>Virtual Machine</entry>
Jul 29 14:43:40 user nova-compute[70924]:     </system>
Jul 29 14:43:40 user nova-compute[70924]:   </sysinfo>
Jul 29 14:43:40 user nova-compute[70924]:   <os>
Jul 29 14:43:40 user nova-compute[70924]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Jul 29 14:43:40 user nova-compute[70924]:     <boot dev='hd'/>
Jul 29 14:43:40 user nova-compute[70924]:     <smbios mode='sysinfo'/>
Jul 29 14:43:40 user nova-compute[70924]:   </os>
Jul 29 14:43:40 user nova-compute[70924]:   <features>
Jul 29 14:43:40 user nova-compute[70924]:     <acpi/>
Jul 29 14:43:40 user nova-compute[70924]:     <apic/>
Jul 29 14:43:40 user nova-compute[70924]:     <vmcoreinfo state='on'/>
Jul 29 14:43:40 user nova-compute[70924]:   </features>
Jul 29 14:43:40 user nova-compute[70924]:   <cpu mode='custom' match='exact' check='full'>
Jul 29 14:43:40 user nova-compute[70924]:     <model fallback='forbid'>Nehalem</model>
Jul 29 14:43:40 user nova-compute[70924]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Jul 29 14:43:40 user nova-compute[70924]:     <feature policy='require' name='vme'/>
Jul 29 14:43:40 user nova-compute[70924]:     <feature policy='require' name='x2apic'/>
Jul 29 14:43:40 user nova-compute[70924]:     <feature policy='require' name='hypervisor'/>
Jul 29 14:43:40 user nova-compute[70924]:   </cpu>
Jul 29 14:43:40 user nova-compute[70924]:   <clock offset='utc'>
Jul 29 14:43:40 user nova-compute[70924]:     <timer name='pit' tickpolicy='delay'/>
Jul 29 14:43:40 user nova-compute[70924]:     <timer name='rtc' tickpolicy='catchup'/>
Jul 29 14:43:40 user nova-compute[70924]:     <timer name='hpet' present='no'/>
Jul 29 14:43:40 user nova-compute[70924]:   </clock>
Jul 29 14:43:40 user nova-compute[70924]:   <on_poweroff>destroy</on_poweroff>
Jul 29 14:43:40 user nova-compute[70924]:   <on_reboot>restart</on_reboot>
Jul 29 14:43:40 user nova-compute[70924]:   <on_crash>destroy</on_crash>
Jul 29 14:43:40 user nova-compute[70924]:   <devices>
Jul 29 14:43:40 user nova-compute[70924]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 29 14:43:40 user nova-compute[70924]:     <disk type='file' device='disk'>
Jul 29 14:43:40 user nova-compute[70924]:       <driver name='qemu' type='qcow2' cache='none'/>
Jul 29 14:43:40 user nova-compute[70924]:       <source file='/opt/stack/data/nova/instances/a9549556-e9a7-4782-ade4-9d397d5323d0/disk' index='2'/>
Jul 29 14:43:40 user nova-compute[70924]:       <backingStore type='file' index='3'>
Jul 29 14:43:40 user nova-compute[70924]:         <format type='raw'/>
Jul 29 14:43:40 user nova-compute[70924]:         <source file='/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009'/>
Jul 29 14:43:40 user nova-compute[70924]:         <backingStore/>
Jul 29 14:43:40 user nova-compute[70924]:       </backingStore>
Jul 29 14:43:40 user nova-compute[70924]:       <target dev='vda' bus='virtio'/>
Jul 29 14:43:40 user nova-compute[70924]:       <alias name='virtio-disk0'/>
Jul 29 14:43:40 user nova-compute[70924]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Jul 29 14:43:40 user nova-compute[70924]:     </disk>
Jul 29 14:43:40 user nova-compute[70924]:     <disk type='file' device='cdrom'>
Jul 29 14:43:40 user nova-compute[70924]:       <driver name='qemu' type='raw' cache='none'/>
Jul 29 14:43:40 user nova-compute[70924]:       <source file='/opt/stack/data/nova/instances/a9549556-e9a7-4782-ade4-9d397d5323d0/disk.config' index='1'/>
Jul 29 14:43:40 user nova-compute[70924]:       <backingStore/>
Jul 29 14:43:40 user nova-compute[70924]:       <target dev='hda' bus='ide'/>
Jul 29 14:43:40 user nova-compute[70924]:       <readonly/>
Jul 29 14:43:40 user nova-compute[70924]:       <alias name='ide0-0-0'/>
Jul 29 14:43:40 user nova-compute[70924]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Jul 29 14:43:40 user nova-compute[70924]:     </disk>
Jul 29 14:43:40 user nova-compute[70924]:     <controller type='usb' index='0' model='none'>
Jul 29 14:43:40 user nova-compute[70924]:       <alias name='usb'/>
Jul 29 14:43:40 user nova-compute[70924]:     </controller>
Jul 29 14:43:40 user nova-compute[70924]:     <controller type='pci' index='0' model='pci-root'>
Jul 29 14:43:40 user nova-compute[70924]:       <alias name='pci.0'/>
Jul 29 14:43:40 user nova-compute[70924]:     </controller>
Jul 29 14:43:40 user nova-compute[70924]:     <controller type='ide' index='0'>
Jul 29 14:43:40 user nova-compute[70924]:       <alias name='ide'/>
Jul 29 14:43:40 user nova-compute[70924]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Jul 29 14:43:40 user nova-compute[70924]:     </controller>
Jul 29 14:43:40 user nova-compute[70924]:     <interface type='ethernet'>
Jul 29 14:43:40 user nova-compute[70924]:       <mac address='fa:16:3e:5d:b8:2a'/>
Jul 29 14:43:40 user nova-compute[70924]:       <target dev='tap4350e95a-38'/>
Jul 29 14:43:40 user nova-compute[70924]:       <model type='virtio'/>
Jul 29 14:43:40 user nova-compute[70924]:       <mtu size='1442'/>
Jul 29 14:43:40 user nova-compute[70924]:       <alias name='net0'/>
Jul 29 14:43:40 user nova-compute[70924]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Jul 29 14:43:40 user nova-compute[70924]:     </interface>
Jul 29 14:43:40 user nova-compute[70924]:     <serial type='pty'>
Jul 29 14:43:40 user nova-compute[70924]:       <source path='/dev/pts/7'/>
Jul 29 14:43:40 user nova-compute[70924]:       <log file='/opt/stack/data/nova/instances/a9549556-e9a7-4782-ade4-9d397d5323d0/console.log' append='off'/>
Jul 29 14:43:40 user nova-compute[70924]:       <target type='isa-serial' port='0'>
Jul 29 14:43:40 user nova-compute[70924]:         <model name='isa-serial'/>
Jul 29 14:43:40 user nova-compute[70924]:       </target>
Jul 29 14:43:40 user nova-compute[70924]:       <alias name='serial0'/>
Jul 29 14:43:40 user nova-compute[70924]:     </serial>
Jul 29 14:43:40 user nova-compute[70924]:     <console type='pty' tty='/dev/pts/7'>
Jul 29 14:43:40 user nova-compute[70924]:       <source path='/dev/pts/7'/>
Jul 29 14:43:40 user nova-compute[70924]:       <log file='/opt/stack/data/nova/instances/a9549556-e9a7-4782-ade4-9d397d5323d0/console.log' append='off'/>
Jul 29 14:43:40 user nova-compute[70924]:       <target type='serial' port='0'/>
Jul 29 14:43:40 user nova-compute[70924]:       <alias name='serial0'/>
Jul 29 14:43:40 user nova-compute[70924]:     </console>
Jul 29 14:43:40 user nova-compute[70924]:     <input type='mouse' bus='ps2'>
Jul 29 14:43:40 user nova-compute[70924]:       <alias name='input0'/>
Jul 29 14:43:40 user nova-compute[70924]:     </input>
Jul 29 14:43:40 user nova-compute[70924]:     <input type='keyboard' bus='ps2'>
Jul 29 14:43:40 user nova-compute[70924]:       <alias name='input1'/>
Jul 29 14:43:40 user nova-compute[70924]:     </input>
Jul 29 14:43:40 user nova-compute[70924]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Jul 29 14:43:40 user nova-compute[70924]:       <listen type='address' address='0.0.0.0'/>
Jul 29 14:43:40 user nova-compute[70924]:     </graphics>
Jul 29 14:43:40 user nova-compute[70924]:     <audio id='1' type='none'/>
Jul 29 14:43:40 user nova-compute[70924]:     <video>
Jul 29 14:43:40 user nova-compute[70924]:       <model type='virtio' heads='1' primary='yes'/>
Jul 29 14:43:40 user nova-compute[70924]:       <alias name='video0'/>
Jul 29 14:43:40 user nova-compute[70924]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Jul 29 14:43:40 user nova-compute[70924]:     </video>
Jul 29 14:43:40 user nova-compute[70924]:     <memballoon model='virtio'>
Jul 29 14:43:40 user nova-compute[70924]:       <stats period='10'/>
Jul 29 14:43:40 user nova-compute[70924]:       <alias name='balloon0'/>
Jul 29 14:43:40 user nova-compute[70924]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Jul 29 14:43:40 user nova-compute[70924]:     </memballoon>
Jul 29 14:43:40 user nova-compute[70924]:     <rng model='virtio'>
Jul 29 14:43:40 user nova-compute[70924]:       <backend model='random'>/dev/urandom</backend>
Jul 29 14:43:40 user nova-compute[70924]:       <alias name='rng0'/>
Jul 29 14:43:40 user nova-compute[70924]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Jul 29 14:43:40 user nova-compute[70924]:     </rng>
Jul 29 14:43:40 user nova-compute[70924]:   </devices>
Jul 29 14:43:40 user nova-compute[70924]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Jul 29 14:43:40 user nova-compute[70924]:     <label>libvirt-a9549556-e9a7-4782-ade4-9d397d5323d0</label>
Jul 29 14:43:40 user nova-compute[70924]:     <imagelabel>libvirt-a9549556-e9a7-4782-ade4-9d397d5323d0</imagelabel>
Jul 29 14:43:40 user nova-compute[70924]:   </seclabel>
Jul 29 14:43:40 user nova-compute[70924]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Jul 29 14:43:40 user nova-compute[70924]:     <label>+64055:+108</label>
Jul 29 14:43:40 user nova-compute[70924]:     <imagelabel>+64055:+108</imagelabel>
Jul 29 14:43:40 user nova-compute[70924]:   </seclabel>
Jul 29 14:43:40 user nova-compute[70924]: </domain>
Jul 29 14:43:40 user nova-compute[70924]:  {{(pid=70924) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Jul 29 14:43:40 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [req-27aa72c9-60d1-402b-bf9f-a4536c678b85 req-e7ed9f7e-b23c-4156-a3c2-e6074eed73be service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:15:50:23"/><model type="virtio"/><mtu size="1442"/><target dev="tap3330a4ca-44"/></interface> {{(pid=70924) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 29 14:43:40 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [req-27aa72c9-60d1-402b-bf9f-a4536c678b85 req-e7ed9f7e-b23c-4156-a3c2-e6074eed73be service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:15:50:23"/><model type="virtio"/><mtu size="1442"/><target dev="tap3330a4ca-44"/></interface>not found in domain: <domain type='kvm' id='8'>
Jul 29 14:43:40 user nova-compute[70924]:   <name>instance-00000008</name>
Jul 29 14:43:40 user nova-compute[70924]:   <uuid>a9549556-e9a7-4782-ade4-9d397d5323d0</uuid>
Jul 29 14:43:40 user nova-compute[70924]:   <metadata>
Jul 29 14:43:40 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 14:43:40 user nova-compute[70924]:   <nova:package version="0.0.0"/>
Jul 29 14:43:40 user nova-compute[70924]:   <nova:name>tempest-device-tagging-server-850043246</nova:name>
Jul 29 14:43:40 user nova-compute[70924]:   <nova:creationTime>2023-07-29 14:43:40</nova:creationTime>
Jul 29 14:43:40 user nova-compute[70924]:   <nova:flavor name="m1.tiny">
Jul 29 14:43:40 user nova-compute[70924]:     <nova:memory>512</nova:memory>
Jul 29 14:43:40 user nova-compute[70924]:     <nova:disk>1</nova:disk>
Jul 29 14:43:40 user nova-compute[70924]:     <nova:swap>0</nova:swap>
Jul 29 14:43:40 user nova-compute[70924]:     <nova:ephemeral>0</nova:ephemeral>
Jul 29 14:43:40 user nova-compute[70924]:     <nova:vcpus>1</nova:vcpus>
Jul 29 14:43:40 user nova-compute[70924]:   </nova:flavor>
Jul 29 14:43:40 user nova-compute[70924]:   <nova:owner>
Jul 29 14:43:40 user nova-compute[70924]:     <nova:user uuid="5a5e9a9bfa864d5f85a3a79499019d9b">tempest-TaggedAttachmentsTest-209058297-project-member</nova:user>
Jul 29 14:43:40 user nova-compute[70924]:     <nova:project uuid="3f5512f71fe048c5936b9154c0e3126b">tempest-TaggedAttachmentsTest-209058297</nova:project>
Jul 29 14:43:40 user nova-compute[70924]:   </nova:owner>
Jul 29 14:43:40 user nova-compute[70924]:   <nova:root type="image" uuid="3aba2e73-6832-404b-8bd0-d0503ce82b8c"/>
Jul 29 14:43:40 user nova-compute[70924]:   <nova:ports>
Jul 29 14:43:40 user nova-compute[70924]:     <nova:port uuid="4350e95a-3892-4c83-a407-aa696585eac6">
Jul 29 14:43:40 user nova-compute[70924]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 29 14:43:40 user nova-compute[70924]:     </nova:port>
Jul 29 14:43:40 user nova-compute[70924]:   </nova:ports>
Jul 29 14:43:40 user nova-compute[70924]: </nova:instance>
Jul 29 14:43:40 user nova-compute[70924]:   </metadata>
Jul 29 14:43:40 user nova-compute[70924]:   <memory unit='KiB'>524288</memory>
Jul 29 14:43:40 user nova-compute[70924]:   <currentMemory unit='KiB'>524288</currentMemory>
Jul 29 14:43:40 user nova-compute[70924]:   <vcpu placement='static'>1</vcpu>
Jul 29 14:43:40 user nova-compute[70924]:   <resource>
Jul 29 14:43:40 user nova-compute[70924]:     <partition>/machine</partition>
Jul 29 14:43:40 user nova-compute[70924]:   </resource>
Jul 29 14:43:40 user nova-compute[70924]:   <sysinfo type='smbios'>
Jul 29 14:43:40 user nova-compute[70924]:     <system>
Jul 29 14:43:40 user nova-compute[70924]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Jul 29 14:43:40 user nova-compute[70924]:       <entry name='product'>OpenStack Nova</entry>
Jul 29 14:43:40 user nova-compute[70924]:       <entry name='version'>0.0.0</entry>
Jul 29 14:43:40 user nova-compute[70924]:       <entry name='serial'>a9549556-e9a7-4782-ade4-9d397d5323d0</entry>
Jul 29 14:43:40 user nova-compute[70924]:       <entry name='uuid'>a9549556-e9a7-4782-ade4-9d397d5323d0</entry>
Jul 29 14:43:40 user nova-compute[70924]:       <entry name='family'>Virtual Machine</entry>
Jul 29 14:43:40 user nova-compute[70924]:     </system>
Jul 29 14:43:40 user nova-compute[70924]:   </sysinfo>
Jul 29 14:43:40 user nova-compute[70924]:   <os>
Jul 29 14:43:40 user nova-compute[70924]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Jul 29 14:43:40 user nova-compute[70924]:     <boot dev='hd'/>
Jul 29 14:43:40 user nova-compute[70924]:     <smbios mode='sysinfo'/>
Jul 29 14:43:40 user nova-compute[70924]:   </os>
Jul 29 14:43:40 user nova-compute[70924]:   <features>
Jul 29 14:43:40 user nova-compute[70924]:     <acpi/>
Jul 29 14:43:40 user nova-compute[70924]:     <apic/>
Jul 29 14:43:40 user nova-compute[70924]:     <vmcoreinfo state='on'/>
Jul 29 14:43:40 user nova-compute[70924]:   </features>
Jul 29 14:43:40 user nova-compute[70924]:   <cpu mode='custom' match='exact' check='full'>
Jul 29 14:43:40 user nova-compute[70924]:     <model fallback='forbid'>Nehalem</model>
Jul 29 14:43:40 user nova-compute[70924]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Jul 29 14:43:40 user nova-compute[70924]:     <feature policy='require' name='vme'/>
Jul 29 14:43:40 user nova-compute[70924]:     <feature policy='require' name='x2apic'/>
Jul 29 14:43:40 user nova-compute[70924]:     <feature policy='require' name='hypervisor'/>
Jul 29 14:43:40 user nova-compute[70924]:   </cpu>
Jul 29 14:43:40 user nova-compute[70924]:   <clock offset='utc'>
Jul 29 14:43:40 user nova-compute[70924]:     <timer name='pit' tickpolicy='delay'/>
Jul 29 14:43:40 user nova-compute[70924]:     <timer name='rtc' tickpolicy='catchup'/>
Jul 29 14:43:40 user nova-compute[70924]:     <timer name='hpet' present='no'/>
Jul 29 14:43:40 user nova-compute[70924]:   </clock>
Jul 29 14:43:40 user nova-compute[70924]:   <on_poweroff>destroy</on_poweroff>
Jul 29 14:43:40 user nova-compute[70924]:   <on_reboot>restart</on_reboot>
Jul 29 14:43:40 user nova-compute[70924]:   <on_crash>destroy</on_crash>
Jul 29 14:43:40 user nova-compute[70924]:   <devices>
Jul 29 14:43:40 user nova-compute[70924]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 29 14:43:40 user nova-compute[70924]:     <disk type='file' device='disk'>
Jul 29 14:43:40 user nova-compute[70924]:       <driver name='qemu' type='qcow2' cache='none'/>
Jul 29 14:43:40 user nova-compute[70924]:       <source file='/opt/stack/data/nova/instances/a9549556-e9a7-4782-ade4-9d397d5323d0/disk' index='2'/>
Jul 29 14:43:40 user nova-compute[70924]:       <backingStore type='file' index='3'>
Jul 29 14:43:40 user nova-compute[70924]:         <format type='raw'/>
Jul 29 14:43:40 user nova-compute[70924]:         <source file='/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009'/>
Jul 29 14:43:40 user nova-compute[70924]:         <backingStore/>
Jul 29 14:43:40 user nova-compute[70924]:       </backingStore>
Jul 29 14:43:40 user nova-compute[70924]:       <target dev='vda' bus='virtio'/>
Jul 29 14:43:40 user nova-compute[70924]:       <alias name='virtio-disk0'/>
Jul 29 14:43:40 user nova-compute[70924]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Jul 29 14:43:40 user nova-compute[70924]:     </disk>
Jul 29 14:43:40 user nova-compute[70924]:     <disk type='file' device='cdrom'>
Jul 29 14:43:40 user nova-compute[70924]:       <driver name='qemu' type='raw' cache='none'/>
Jul 29 14:43:40 user nova-compute[70924]:       <source file='/opt/stack/data/nova/instances/a9549556-e9a7-4782-ade4-9d397d5323d0/disk.config' index='1'/>
Jul 29 14:43:40 user nova-compute[70924]:       <backingStore/>
Jul 29 14:43:40 user nova-compute[70924]:       <target dev='hda' bus='ide'/>
Jul 29 14:43:40 user nova-compute[70924]:       <readonly/>
Jul 29 14:43:40 user nova-compute[70924]:       <alias name='ide0-0-0'/>
Jul 29 14:43:40 user nova-compute[70924]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Jul 29 14:43:40 user nova-compute[70924]:     </disk>
Jul 29 14:43:40 user nova-compute[70924]:     <controller type='usb' index='0' model='none'>
Jul 29 14:43:40 user nova-compute[70924]:       <alias name='usb'/>
Jul 29 14:43:40 user nova-compute[70924]:     </controller>
Jul 29 14:43:40 user nova-compute[70924]:     <controller type='pci' index='0' model='pci-root'>
Jul 29 14:43:40 user nova-compute[70924]:       <alias name='pci.0'/>
Jul 29 14:43:40 user nova-compute[70924]:     </controller>
Jul 29 14:43:40 user nova-compute[70924]:     <controller type='ide' index='0'>
Jul 29 14:43:40 user nova-compute[70924]:       <alias name='ide'/>
Jul 29 14:43:40 user nova-compute[70924]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Jul 29 14:43:40 user nova-compute[70924]:     </controller>
Jul 29 14:43:40 user nova-compute[70924]:     <interface type='ethernet'>
Jul 29 14:43:40 user nova-compute[70924]:       <mac address='fa:16:3e:5d:b8:2a'/>
Jul 29 14:43:40 user nova-compute[70924]:       <target dev='tap4350e95a-38'/>
Jul 29 14:43:40 user nova-compute[70924]:       <model type='virtio'/>
Jul 29 14:43:40 user nova-compute[70924]:       <mtu size='1442'/>
Jul 29 14:43:40 user nova-compute[70924]:       <alias name='net0'/>
Jul 29 14:43:40 user nova-compute[70924]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Jul 29 14:43:40 user nova-compute[70924]:     </interface>
Jul 29 14:43:40 user nova-compute[70924]:     <serial type='pty'>
Jul 29 14:43:40 user nova-compute[70924]:       <source path='/dev/pts/7'/>
Jul 29 14:43:40 user nova-compute[70924]:       <log file='/opt/stack/data/nova/instances/a9549556-e9a7-4782-ade4-9d397d5323d0/console.log' append='off'/>
Jul 29 14:43:40 user nova-compute[70924]:       <target type='isa-serial' port='0'>
Jul 29 14:43:40 user nova-compute[70924]:         <model name='isa-serial'/>
Jul 29 14:43:40 user nova-compute[70924]:       </target>
Jul 29 14:43:40 user nova-compute[70924]:       <alias name='serial0'/>
Jul 29 14:43:40 user nova-compute[70924]:     </serial>
Jul 29 14:43:40 user nova-compute[70924]:     <console type='pty' tty='/dev/pts/7'>
Jul 29 14:43:40 user nova-compute[70924]:       <source path='/dev/pts/7'/>
Jul 29 14:43:40 user nova-compute[70924]:       <log file='/opt/stack/data/nova/instances/a9549556-e9a7-4782-ade4-9d397d5323d0/console.log' append='off'/>
Jul 29 14:43:40 user nova-compute[70924]:       <target type='serial' port='0'/>
Jul 29 14:43:40 user nova-compute[70924]:       <alias name='serial0'/>
Jul 29 14:43:40 user nova-compute[70924]:     </console>
Jul 29 14:43:40 user nova-compute[70924]:     <input type='mouse' bus='ps2'>
Jul 29 14:43:40 user nova-compute[70924]:       <alias name='input0'/>
Jul 29 14:43:40 user nova-compute[70924]:     </input>
Jul 29 14:43:40 user nova-compute[70924]:     <input type='keyboard' bus='ps2'>
Jul 29 14:43:40 user nova-compute[70924]:       <alias name='input1'/>
Jul 29 14:43:40 user nova-compute[70924]:     </input>
Jul 29 14:43:40 user nova-compute[70924]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Jul 29 14:43:40 user nova-compute[70924]:       <listen type='address' address='0.0.0.0'/>
Jul 29 14:43:40 user nova-compute[70924]:     </graphics>
Jul 29 14:43:40 user nova-compute[70924]:     <audio id='1' type='none'/>
Jul 29 14:43:40 user nova-compute[70924]:     <video>
Jul 29 14:43:40 user nova-compute[70924]:       <model type='virtio' heads='1' primary='yes'/>
Jul 29 14:43:40 user nova-compute[70924]:       <alias name='video0'/>
Jul 29 14:43:40 user nova-compute[70924]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Jul 29 14:43:40 user nova-compute[70924]:     </video>
Jul 29 14:43:40 user nova-compute[70924]:     <memballoon model='virtio'>
Jul 29 14:43:40 user nova-compute[70924]:       <stats period='10'/>
Jul 29 14:43:40 user nova-compute[70924]:       <alias name='balloon0'/>
Jul 29 14:43:40 user nova-compute[70924]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Jul 29 14:43:40 user nova-compute[70924]:     </memballoon>
Jul 29 14:43:40 user nova-compute[70924]:     <rng model='virtio'>
Jul 29 14:43:40 user nova-compute[70924]:       <backend model='random'>/dev/urandom</backend>
Jul 29 14:43:40 user nova-compute[70924]:       <alias name='rng0'/>
Jul 29 14:43:40 user nova-compute[70924]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Jul 29 14:43:40 user nova-compute[70924]:     </rng>
Jul 29 14:43:40 user nova-compute[70924]:   </devices>
Jul 29 14:43:40 user nova-compute[70924]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Jul 29 14:43:40 user nova-compute[70924]:     <label>libvirt-a9549556-e9a7-4782-ade4-9d397d5323d0</label>
Jul 29 14:43:40 user nova-compute[70924]:     <imagelabel>libvirt-a9549556-e9a7-4782-ade4-9d397d5323d0</imagelabel>
Jul 29 14:43:40 user nova-compute[70924]:   </seclabel>
Jul 29 14:43:40 user nova-compute[70924]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Jul 29 14:43:40 user nova-compute[70924]:     <label>+64055:+108</label>
Jul 29 14:43:40 user nova-compute[70924]:     <imagelabel>+64055:+108</imagelabel>
Jul 29 14:43:40 user nova-compute[70924]:   </seclabel>
Jul 29 14:43:40 user nova-compute[70924]: </domain>
Jul 29 14:43:40 user nova-compute[70924]:  {{(pid=70924) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Jul 29 14:43:40 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [req-27aa72c9-60d1-402b-bf9f-a4536c678b85 req-e7ed9f7e-b23c-4156-a3c2-e6074eed73be service nova] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Detaching interface fa:16:3e:15:50:23 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap3330a4ca-44' not found.
Jul 29 14:43:40 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [req-27aa72c9-60d1-402b-bf9f-a4536c678b85 req-e7ed9f7e-b23c-4156-a3c2-e6074eed73be service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T14:41:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-850043246',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-850043246',id=8,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFowQgMXsn6ojeJst6U4SII3CK7C8iaLrF5WpK72LhkyBx1DR2/8ARcNjiYRGN2W6nR3e0I7GRFV8EHB/gQZBqjcYpW+ZSwmA+QfOaNLnctkqx//pbvW+SsaaXulcoKRlQ==',key_name='tempest-keypair-1737564447',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:41:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3f5512f71fe048c5936b9154c0e3126b',ramdisk_id='',reservation_id='r-2gg4afvj',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-209058297',owner_user_name='tempest-TaggedAttachmentsTest-209058297-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:41:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a5e9a9bfa864d5f85a3a79499019d9b',uuid=a9549556-e9a7-4782-ade4-9d397d5323d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3330a4ca-44e5-4069-9cc8-0da51c0f10d2", "address": "fa:16:3e:15:50:23", "network": {"id": "d3274b98-c5db-4936-ad6a-d97250e08d2e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1553772351", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3f5512f71fe048c5936b9154c0e3126b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3330a4ca-44", "ovs_interfaceid": "3330a4ca-44e5-4069-9cc8-0da51c0f10d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 14:43:40 user nova-compute[70924]: DEBUG nova.network.os_vif_util [req-27aa72c9-60d1-402b-bf9f-a4536c678b85 req-e7ed9f7e-b23c-4156-a3c2-e6074eed73be service nova] Converting VIF {"id": "3330a4ca-44e5-4069-9cc8-0da51c0f10d2", "address": "fa:16:3e:15:50:23", "network": {"id": "d3274b98-c5db-4936-ad6a-d97250e08d2e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1553772351", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3f5512f71fe048c5936b9154c0e3126b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3330a4ca-44", "ovs_interfaceid": "3330a4ca-44e5-4069-9cc8-0da51c0f10d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:43:40 user nova-compute[70924]: DEBUG nova.network.os_vif_util [req-27aa72c9-60d1-402b-bf9f-a4536c678b85 req-e7ed9f7e-b23c-4156-a3c2-e6074eed73be service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:50:23,bridge_name='br-int',has_traffic_filtering=True,id=3330a4ca-44e5-4069-9cc8-0da51c0f10d2,network=Network(d3274b98-c5db-4936-ad6a-d97250e08d2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3330a4ca-44') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:43:40 user nova-compute[70924]: DEBUG os_vif [req-27aa72c9-60d1-402b-bf9f-a4536c678b85 req-e7ed9f7e-b23c-4156-a3c2-e6074eed73be service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:50:23,bridge_name='br-int',has_traffic_filtering=True,id=3330a4ca-44e5-4069-9cc8-0da51c0f10d2,network=Network(d3274b98-c5db-4936-ad6a-d97250e08d2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3330a4ca-44') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 14:43:40 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:43:40 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3330a4ca-44, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:43:40 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 14:43:40 user nova-compute[70924]: INFO os_vif [req-27aa72c9-60d1-402b-bf9f-a4536c678b85 req-e7ed9f7e-b23c-4156-a3c2-e6074eed73be service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:50:23,bridge_name='br-int',has_traffic_filtering=True,id=3330a4ca-44e5-4069-9cc8-0da51c0f10d2,network=Network(d3274b98-c5db-4936-ad6a-d97250e08d2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3330a4ca-44')
Jul 29 14:43:40 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [req-27aa72c9-60d1-402b-bf9f-a4536c678b85 req-e7ed9f7e-b23c-4156-a3c2-e6074eed73be service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 14:43:40 user nova-compute[70924]:   <nova:package version="0.0.0"/>
Jul 29 14:43:40 user nova-compute[70924]:   <nova:name>tempest-device-tagging-server-850043246</nova:name>
Jul 29 14:43:40 user nova-compute[70924]:   <nova:creationTime>2023-07-29 14:43:40</nova:creationTime>
Jul 29 14:43:40 user nova-compute[70924]:   <nova:flavor name="m1.tiny">
Jul 29 14:43:40 user nova-compute[70924]:     <nova:memory>512</nova:memory>
Jul 29 14:43:40 user nova-compute[70924]:     <nova:disk>1</nova:disk>
Jul 29 14:43:40 user nova-compute[70924]:     <nova:swap>0</nova:swap>
Jul 29 14:43:40 user nova-compute[70924]:     <nova:ephemeral>0</nova:ephemeral>
Jul 29 14:43:40 user nova-compute[70924]:     <nova:vcpus>1</nova:vcpus>
Jul 29 14:43:40 user nova-compute[70924]:   </nova:flavor>
Jul 29 14:43:40 user nova-compute[70924]:   <nova:owner>
Jul 29 14:43:40 user nova-compute[70924]:     <nova:user uuid="5a5e9a9bfa864d5f85a3a79499019d9b">tempest-TaggedAttachmentsTest-209058297-project-member</nova:user>
Jul 29 14:43:40 user nova-compute[70924]:     <nova:project uuid="3f5512f71fe048c5936b9154c0e3126b">tempest-TaggedAttachmentsTest-209058297</nova:project>
Jul 29 14:43:40 user nova-compute[70924]:   </nova:owner>
Jul 29 14:43:40 user nova-compute[70924]:   <nova:root type="image" uuid="3aba2e73-6832-404b-8bd0-d0503ce82b8c"/>
Jul 29 14:43:40 user nova-compute[70924]:   <nova:ports>
Jul 29 14:43:40 user nova-compute[70924]:     <nova:port uuid="4350e95a-3892-4c83-a407-aa696585eac6">
Jul 29 14:43:40 user nova-compute[70924]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 29 14:43:40 user nova-compute[70924]:     </nova:port>
Jul 29 14:43:40 user nova-compute[70924]:   </nova:ports>
Jul 29 14:43:40 user nova-compute[70924]: </nova:instance>
Jul 29 14:43:40 user nova-compute[70924]:  {{(pid=70924) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Jul 29 14:43:41 user nova-compute[70924]: DEBUG nova.network.neutron [None req-cba77ef3-0ee1-49d0-aaba-28459410c539 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Updating instance_info_cache with network_info: [{"id": "4350e95a-3892-4c83-a407-aa696585eac6", "address": "fa:16:3e:5d:b8:2a", "network": {"id": "4ca69734-4a00-4e6b-bbad-8bc03edba586", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1313665133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f5512f71fe048c5936b9154c0e3126b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4350e95a-38", "ovs_interfaceid": "4350e95a-3892-4c83-a407-aa696585eac6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:43:41 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:43:41 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:43:41 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:43:41 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:43:41 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Auditing locally available compute resources for user (node: user) {{(pid=70924) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 14:43:41 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-cba77ef3-0ee1-49d0-aaba-28459410c539 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Releasing lock "refresh_cache-a9549556-e9a7-4782-ade4-9d397d5323d0" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:43:41 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-cba77ef3-0ee1-49d0-aaba-28459410c539 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Lock "interface-a9549556-e9a7-4782-ade4-9d397d5323d0-3330a4ca-44e5-4069-9cc8-0da51c0f10d2" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 1.685s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:43:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:41 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 14:43:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcbb998c-2dac-47d9-985a-d5b2a15ddaa0/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcbb998c-2dac-47d9-985a-d5b2a15ddaa0/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcbb998c-2dac-47d9-985a-d5b2a15ddaa0/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcbb998c-2dac-47d9-985a-d5b2a15ddaa0/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:42 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 14:43:42 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 14:43:42 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 14:43:42 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 14:43:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:42 user nova-compute[70924]: DEBUG nova.compute.manager [req-1c25737e-84f1-4cbd-856e-2862269ca60d req-9f07cbab-c8a6-4979-b5b1-48c5be70b9c8 service nova] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Received event network-vif-plugged-3330a4ca-44e5-4069-9cc8-0da51c0f10d2 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:43:42 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-1c25737e-84f1-4cbd-856e-2862269ca60d req-9f07cbab-c8a6-4979-b5b1-48c5be70b9c8 service nova] Acquiring lock "a9549556-e9a7-4782-ade4-9d397d5323d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:43:42 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-1c25737e-84f1-4cbd-856e-2862269ca60d req-9f07cbab-c8a6-4979-b5b1-48c5be70b9c8 service nova] Lock "a9549556-e9a7-4782-ade4-9d397d5323d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:43:42 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-1c25737e-84f1-4cbd-856e-2862269ca60d req-9f07cbab-c8a6-4979-b5b1-48c5be70b9c8 service nova] Lock "a9549556-e9a7-4782-ade4-9d397d5323d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:43:42 user nova-compute[70924]: DEBUG nova.compute.manager [req-1c25737e-84f1-4cbd-856e-2862269ca60d req-9f07cbab-c8a6-4979-b5b1-48c5be70b9c8 service nova] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] No waiting events found dispatching network-vif-plugged-3330a4ca-44e5-4069-9cc8-0da51c0f10d2 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:43:42 user nova-compute[70924]: WARNING nova.compute.manager [req-1c25737e-84f1-4cbd-856e-2862269ca60d req-9f07cbab-c8a6-4979-b5b1-48c5be70b9c8 service nova] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Received unexpected event network-vif-plugged-3330a4ca-44e5-4069-9cc8-0da51c0f10d2 for instance with vm_state active and task_state None.
Jul 29 14:43:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5929dcf-8594-4323-a6f5-a322aff7c881/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5929dcf-8594-4323-a6f5-a322aff7c881/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5929dcf-8594-4323-a6f5-a322aff7c881/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:42 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] Acquiring lock "9ba37020-824a-4ae5-9836-462fe4de476b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:43:42 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] Lock "9ba37020-824a-4ae5-9836-462fe4de476b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:43:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5929dcf-8594-4323-a6f5-a322aff7c881/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:42 user nova-compute[70924]: DEBUG nova.compute.manager [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] [instance: 9ba37020-824a-4ae5-9836-462fe4de476b] Starting instance... {{(pid=70924) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 14:43:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00231136-233f-4a1b-88ff-b678482ca5bb/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:42 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:43:42 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:43:42 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:43:42 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70924) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 14:43:42 user nova-compute[70924]: INFO nova.compute.claims [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] [instance: 9ba37020-824a-4ae5-9836-462fe4de476b] Claim successful on node user
Jul 29 14:43:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00231136-233f-4a1b-88ff-b678482ca5bb/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00231136-233f-4a1b-88ff-b678482ca5bb/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:43 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00231136-233f-4a1b-88ff-b678482ca5bb/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:43 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2250b0d6-5542-4a7f-90a9-93745a776fcc/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:43 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2250b0d6-5542-4a7f-90a9-93745a776fcc/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:43 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2250b0d6-5542-4a7f-90a9-93745a776fcc/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:43 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:43:43 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:43:43 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2250b0d6-5542-4a7f-90a9-93745a776fcc/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:43 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9549556-e9a7-4782-ade4-9d397d5323d0/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:43 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.548s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:43:43 user nova-compute[70924]: DEBUG nova.compute.manager [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] [instance: 9ba37020-824a-4ae5-9836-462fe4de476b] Start building networks asynchronously for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 14:43:43 user nova-compute[70924]: DEBUG nova.compute.manager [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] [instance: 9ba37020-824a-4ae5-9836-462fe4de476b] Allocating IP information in the background. {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 14:43:43 user nova-compute[70924]: DEBUG nova.network.neutron [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] [instance: 9ba37020-824a-4ae5-9836-462fe4de476b] allocate_for_instance() {{(pid=70924) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 14:43:43 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] [instance: 9ba37020-824a-4ae5-9836-462fe4de476b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 14:43:43 user nova-compute[70924]: DEBUG nova.compute.manager [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] [instance: 9ba37020-824a-4ae5-9836-462fe4de476b] Start building block device mappings for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 14:43:43 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9549556-e9a7-4782-ade4-9d397d5323d0/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:43 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9549556-e9a7-4782-ade4-9d397d5323d0/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:43 user nova-compute[70924]: DEBUG nova.policy [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c04095cb42ad4a659cda5d22878b4445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1b30b901be4e57b34c74a8bbb2519b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70924) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 14:43:43 user nova-compute[70924]: DEBUG nova.compute.manager [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] [instance: 9ba37020-824a-4ae5-9836-462fe4de476b] Start spawning the instance on the hypervisor. {{(pid=70924) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 14:43:43 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] [instance: 9ba37020-824a-4ae5-9836-462fe4de476b] Creating instance directory {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 14:43:43 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] [instance: 9ba37020-824a-4ae5-9836-462fe4de476b] Creating image(s)
Jul 29 14:43:43 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] Acquiring lock "/opt/stack/data/nova/instances/9ba37020-824a-4ae5-9836-462fe4de476b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:43:43 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] Lock "/opt/stack/data/nova/instances/9ba37020-824a-4ae5-9836-462fe4de476b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:43:43 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] Lock "/opt/stack/data/nova/instances/9ba37020-824a-4ae5-9836-462fe4de476b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:43:43 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:43 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9549556-e9a7-4782-ade4-9d397d5323d0/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.599s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] Acquiring lock "bd72453517468710f1de26b27fb0ea28688e9009" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:44 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:43:44 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:43:44 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Hypervisor/Node resource view: name=user free_ram=7192MB free_disk=25.656490325927734GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70924) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG nova.compute.manager [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6bb60216-0d32-464f-b727-30d5918681f2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BZsXQAFa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fcbb998c-2dac-47d9-985a-d5b2a15ddaa0', 'attached_at': '', 'detached_at': '', 'volume_id': '6bb60216-0d32-464f-b727-30d5918681f2', 'serial': '6bb60216-0d32-464f-b727-30d5918681f2'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zlgQFZis', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'fcbb998c-2dac-47d9-985a-d5b2a15ddaa0', 'attached_at': '', 'detached_at': '', 'volume_id': '19775624-b219-4d3e-9c48-58c1b8dfb648', 'serial'} {{(pid=70924) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Calling os-brick to attach iSCSI Volume {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6bb60216-0d32-464f-b727-30d5918681f2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BZsXQAFa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:43:44 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:43:44 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:43:44 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:43:44 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6bb60216-0d32-464f-b727-30d5918681f2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6bb60216-0d32-464f-b727-30d5918681f2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:43:44 user nova-compute[70924]: INFO os_brick.initiator.connectors.iscsi [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 14:43:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bb60216-0d32-464f-b727-30d5918681f2 -p 172.16.0.220:3260 {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.287s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/9ba37020-824a-4ae5-9836-462fe4de476b/disk 1073741824 {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG nova.network.neutron [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] [instance: 9ba37020-824a-4ae5-9836-462fe4de476b] Successfully created port: 6a96191e-52fa-4efd-9c32-c5dec84b69ec {{(pid=70924) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bb60216-0d32-464f-b727-30d5918681f2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[18785d83-fac8-4ccd-88dc-4e3540815d18]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 14:43:44 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bb60216-0d32-464f-b727-30d5918681f2 -p 172.16.0.220:3260 --interface default --op new {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/9ba37020-824a-4ae5-9836-462fe4de476b/disk 1073741824" returned: 0 in 0.063s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.353s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance db656346-c4af-43da-9600-fd39f1b9e4dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 2250b0d6-5542-4a7f-90a9-93745a776fcc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance f5929dcf-8594-4323-a6f5-a322aff7c881 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 86ecc6cb-88a8-4572-8e41-d4c5859036a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 00231136-233f-4a1b-88ff-b678482ca5bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance a9549556-e9a7-4782-ade4-9d397d5323d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance fcbb998c-2dac-47d9-985a-d5b2a15ddaa0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 7d71c003-6ad9-495f-ac65-083f07d65201 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 9b4c76df-f74f-43b4-968f-b730cc5b0ec6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 9ba37020-824a-4ae5-9836-462fe4de476b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bb60216-0d32-464f-b727-30d5918681f2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c311e2e1-fa47-44c6-bc76-c9983332c37a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6bb60216-0d32-464f-b727-30d5918681f2] added\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6bb60216-0d32-464f-b727-30d5918681f2] added
Jul 29 14:43:44 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bb60216-0d32-464f-b727-30d5918681f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bb60216-0d32-464f-b727-30d5918681f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c438a3a-cbaf-478d-93a4-1f029ec6e59d]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bb60216-0d32-464f-b727-30d5918681f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bb60216-0d32-464f-b727-30d5918681f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd8d7f9-6766-4b44-80f2-a72a48902a2e]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bb60216-0d32-464f-b727-30d5918681f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BZsXQAFa {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bb60216-0d32-464f-b727-30d5918681f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BZsXQAFa" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d76b9f7e-3d6e-4b1b-bc2c-b6e48862f18e]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BZsXQAFa'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bb60216-0d32-464f-b727-30d5918681f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.138s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9ba37020-824a-4ae5-9836-462fe4de476b/disk. size=1073741824 {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ba37020-824a-4ae5-9836-462fe4de476b/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bb60216-0d32-464f-b727-30d5918681f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[33920ceb-0087-44e8-9d7c-0689a20b0741]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a83498-d4cc-4c6e-9a35-4ecbd4b5b8c3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)
Jul 29 14:43:44 user nova-compute[70924]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)
Jul 29 14:43:44 user nova-compute[70924]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)
Jul 29 14:43:44 user nova-compute[70924]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:43:44 user nova-compute[70924]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 (non-flash)
Jul 29 14:43:44 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)
Jul 29 14:43:44 user nova-compute[70924]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)
Jul 29 14:43:44 user nova-compute[70924]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)
Jul 29 14:43:44 user nova-compute[70924]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:43:44 user nova-compute[70924]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 (non-flash)
Jul 29 14:43:44 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bb60216-0d32-464f-b727-30d5918681f2 -p 172.16.0.220:3260 --login {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ba37020-824a-4ae5-9836-462fe4de476b/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] Cannot resize image /opt/stack/data/nova/instances/9ba37020-824a-4ae5-9836-462fe4de476b/disk to a smaller size. {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG nova.objects.instance [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] Lazy-loading 'migration_context' on Instance uuid 9ba37020-824a-4ae5-9836-462fe4de476b {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bb60216-0d32-464f-b727-30d5918681f2 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[22593e95-7a9a-4e95-b3bd-bf24fb384de5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6bb60216-0d32-464f-b727-30d5918681f2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6bb60216-0d32-464f-b727-30d5918681f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6bb60216-0d32-464f-b727-30d5918681f2, portal: 172.16.0.220,3260]
Jul 29 14:43:44 user nova-compute[70924]: Login to [iface: default, target: iqn.2010-10.org.openstack:6bb60216-0d32-464f-b727-30d5918681f2, portal: 172.16.0.220,3260] successful.
Jul 29 14:43:44 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bb60216-0d32-464f-b727-30d5918681f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] [instance: 9ba37020-824a-4ae5-9836-462fe4de476b] Created local disks {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] [instance: 9ba37020-824a-4ae5-9836-462fe4de476b] Ensure instance console log exists: /opt/stack/data/nova/instances/9ba37020-824a-4ae5-9836-462fe4de476b/console.log {{(pid=70924) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bb60216-0d32-464f-b727-30d5918681f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d817ccef-60db-4cf9-9f2c-bf99ec587e0d]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:43:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:45 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:43:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:45 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2867514a-ede1-4e8e-906e-3248cf47b565]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bb60216-0d32-464f-b727-30d5918681f2 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:45 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bb60216-0d32-464f-b727-30d5918681f2 (non-flash)
Jul 29 14:43:45 user nova-compute[70924]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)
Jul 29 14:43:45 user nova-compute[70924]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)
Jul 29 14:43:45 user nova-compute[70924]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)
Jul 29 14:43:45 user nova-compute[70924]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:43:45 user nova-compute[70924]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 (non-flash)
Jul 29 14:43:45 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:43:45 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bb60216-0d32-464f-b727-30d5918681f2 (non-flash)
Jul 29 14:43:45 user nova-compute[70924]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)
Jul 29 14:43:45 user nova-compute[70924]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)
Jul 29 14:43:45 user nova-compute[70924]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)
Jul 29 14:43:45 user nova-compute[70924]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:43:45 user nova-compute[70924]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 (non-flash)
Jul 29 14:43:45 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:43:45 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6bb60216-0d32-464f-b727-30d5918681f2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.442s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:43:45 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] Connected to 172.16.0.220:3260 {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 14:43:45 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] HCTL ('38', '-', '-', 0) found on session 11 with lun 0 {{(pid=70924) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 14:43:45 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] Scanning host 38 c: -, t: -, l: 0) {{(pid=70924) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 14:43:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:45 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:43:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:45 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1551cc-86e7-496f-89b5-bdad64001935]: (4, ('- - 0', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:45 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] Searching for a device in session 11 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 14:43:45 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BZsXQAFa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 14:43:45 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Compute_service record updated for user:user {{(pid=70924) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 14:43:45 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.645s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:43:45 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:43:45 user nova-compute[70924]: DEBUG nova.network.neutron [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] [instance: 9ba37020-824a-4ae5-9836-462fe4de476b] Successfully updated port: 6a96191e-52fa-4efd-9c32-c5dec84b69ec {{(pid=70924) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 14:43:45 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] Acquiring lock "refresh_cache-9ba37020-824a-4ae5-9836-462fe4de476b" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:43:45 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] Acquired lock "refresh_cache-9ba37020-824a-4ae5-9836-462fe4de476b" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:43:45 user nova-compute[70924]: DEBUG nova.network.neutron [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] [instance: 9ba37020-824a-4ae5-9836-462fe4de476b] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 14:43:45 user nova-compute[70924]: DEBUG nova.compute.manager [req-c5e22c5c-637a-4766-b6f8-1584f9c5ac2f req-3994703d-d66d-4d8c-87f4-6c2b8abb02e8 service nova] [instance: 9ba37020-824a-4ae5-9836-462fe4de476b] Received event network-changed-6a96191e-52fa-4efd-9c32-c5dec84b69ec {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:43:45 user nova-compute[70924]: DEBUG nova.compute.manager [req-c5e22c5c-637a-4766-b6f8-1584f9c5ac2f req-3994703d-d66d-4d8c-87f4-6c2b8abb02e8 service nova] [instance: 9ba37020-824a-4ae5-9836-462fe4de476b] Refreshing instance network info cache due to event network-changed-6a96191e-52fa-4efd-9c32-c5dec84b69ec. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:43:45 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c5e22c5c-637a-4766-b6f8-1584f9c5ac2f req-3994703d-d66d-4d8c-87f4-6c2b8abb02e8 service nova] Acquiring lock "refresh_cache-9ba37020-824a-4ae5-9836-462fe4de476b" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:43:45 user nova-compute[70924]: DEBUG nova.network.neutron [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] [instance: 9ba37020-824a-4ae5-9836-462fe4de476b] Instance cache missing network info. {{(pid=70924) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 14:43:46 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.498s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:43:46 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] <== connect_volume: return (1501ms) {'type': 'block', 'scsi_wwn': '26230626262376165', 'path': '/dev/sdg'} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:43:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26230626262376165', 'path': '/dev/sdg'} {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 14:43:46 user nova-compute[70924]: DEBUG nova.objects.instance [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] Lazy-loading 'flavor' on Instance uuid fcbb998c-2dac-47d9-985a-d5b2a15ddaa0 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:43:46 user nova-compute[70924]: DEBUG nova.network.neutron [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] [instance: 9ba37020-824a-4ae5-9836-462fe4de476b] Updating instance_info_cache with network_info: [{"id": "6a96191e-52fa-4efd-9c32-c5dec84b69ec", "address": "fa:16:3e:62:66:2f", "network": {"id": "7dca7036-5f4e-4888-becf-ffc2735302ed", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2256057123ba4f7181829a5b453f36be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a96191e-52", "ovs_interfaceid": "6a96191e-52fa-4efd-9c32-c5dec84b69ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:43:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] Releasing lock "refresh_cache-9ba37020-824a-4ae5-9836-462fe4de476b" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:43:46 user nova-compute[70924]: DEBUG nova.compute.manager [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] [instance: 9ba37020-824a-4ae5-9836-462fe4de476b] Instance network_info: |[{"id": "6a96191e-52fa-4efd-9c32-c5dec84b69ec", "address": "fa:16:3e:62:66:2f", "network": {"id": "7dca7036-5f4e-4888-becf-ffc2735302ed", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2256057123ba4f7181829a5b453f36be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a96191e-52", "ovs_interfaceid": "6a96191e-52fa-4efd-9c32-c5dec84b69ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 14:43:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c5e22c5c-637a-4766-b6f8-1584f9c5ac2f req-3994703d-d66d-4d8c-87f4-6c2b8abb02e8 service nova] Acquired lock "refresh_cache-9ba37020-824a-4ae5-9836-462fe4de476b" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:43:46 user nova-compute[70924]: DEBUG nova.network.neutron [req-c5e22c5c-637a-4766-b6f8-1584f9c5ac2f req-3994703d-d66d-4d8c-87f4-6c2b8abb02e8 service nova] [instance: 9ba37020-824a-4ae5-9836-462fe4de476b] Refreshing network info cache for port 6a96191e-52fa-4efd-9c32-c5dec84b69ec {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:43:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] [instance: 9ba37020-824a-4ae5-9836-462fe4de476b] Start _get_guest_xml network_info=[{"id": "6a96191e-52fa-4efd-9c32-c5dec84b69ec", "address": "fa:16:3e:62:66:2f", "network": {"id": "7dca7036-5f4e-4888-becf-ffc2735302ed", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2256057123ba4f7181829a5b453f36be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a96191e-52", "ovs_interfaceid": "6a96191e-52fa-4efd-9c32-c5dec84b69ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '3aba2e73-6832-404b-8bd0-d0503ce82b8c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 14:43:46 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:43:46 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:43:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 14:43:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] CPU controller missing on host. {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 14:43:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 14:43:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] CPU controller found on host. {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 14:43:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70924) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 14:43:46 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T14:36:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 14:43:46 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] Flavor limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 14:43:46 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] Image limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 14:43:46 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] Flavor pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 14:43:46 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] Image pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 14:43:46 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 14:43:46 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 14:43:46 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 14:43:46 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] Got 1 possible topologies {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 14:43:46 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 14:43:46 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 14:43:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:43:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-747691720',display_name='tempest-VolumesNegativeTest-instance-747691720',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-747691720',id=12,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f1b30b901be4e57b34c74a8bbb2519b',ramdisk_id='',reservation_id='r-th159ex1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1472430635',owner_user_name='tempest-VolumesNegativeTest-1472430635-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:43:44Z,user_data=None,user_id='c04095cb42ad4a659cda5d22878b4445',uuid=9ba37020-824a-4ae5-9836-462fe4de476b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a96191e-52fa-4efd-9c32-c5dec84b69ec", "address": "fa:16:3e:62:66:2f", "network": {"id": "7dca7036-5f4e-4888-becf-ffc2735302ed", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2256057123ba4f7181829a5b453f36be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a96191e-52", "ovs_interfaceid": "6a96191e-52fa-4efd-9c32-c5dec84b69ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:43:46 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] Converting VIF {"id": "6a96191e-52fa-4efd-9c32-c5dec84b69ec", "address": "fa:16:3e:62:66:2f", "network": {"id": "7dca7036-5f4e-4888-becf-ffc2735302ed", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2256057123ba4f7181829a5b453f36be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a96191e-52", "ovs_interfaceid": "6a96191e-52fa-4efd-9c32-c5dec84b69ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:43:46 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:66:2f,bridge_name='br-int',has_traffic_filtering=True,id=6a96191e-52fa-4efd-9c32-c5dec84b69ec,network=Network(7dca7036-5f4e-4888-becf-ffc2735302ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a96191e-52') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:43:46 user nova-compute[70924]: DEBUG nova.objects.instance [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] Lazy-loading 'pci_devices' on Instance uuid 9ba37020-824a-4ae5-9836-462fe4de476b {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:43:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] [instance: 9ba37020-824a-4ae5-9836-462fe4de476b] End _get_guest_xml xml=<domain type="kvm">
Jul 29 14:43:46 user nova-compute[70924]:   <uuid>9ba37020-824a-4ae5-9836-462fe4de476b</uuid>
Jul 29 14:43:46 user nova-compute[70924]:   <name>instance-0000000c</name>
Jul 29 14:43:46 user nova-compute[70924]:   <memory>524288</memory>
Jul 29 14:43:46 user nova-compute[70924]:   <vcpu>1</vcpu>
Jul 29 14:43:46 user nova-compute[70924]:   <metadata>
Jul 29 14:43:46 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 14:43:46 user nova-compute[70924]:       <nova:package version="0.0.0"/>
Jul 29 14:43:46 user nova-compute[70924]:       <nova:name>tempest-VolumesNegativeTest-instance-747691720</nova:name>
Jul 29 14:43:46 user nova-compute[70924]:       <nova:creationTime>2023-07-29 14:43:46</nova:creationTime>
Jul 29 14:43:46 user nova-compute[70924]:       <nova:flavor name="m1.tiny">
Jul 29 14:43:46 user nova-compute[70924]:         <nova:memory>512</nova:memory>
Jul 29 14:43:46 user nova-compute[70924]:         <nova:disk>1</nova:disk>
Jul 29 14:43:46 user nova-compute[70924]:         <nova:swap>0</nova:swap>
Jul 29 14:43:46 user nova-compute[70924]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 14:43:46 user nova-compute[70924]:         <nova:vcpus>1</nova:vcpus>
Jul 29 14:43:46 user nova-compute[70924]:       </nova:flavor>
Jul 29 14:43:46 user nova-compute[70924]:       <nova:owner>
Jul 29 14:43:46 user nova-compute[70924]:         <nova:user uuid="c04095cb42ad4a659cda5d22878b4445">tempest-VolumesNegativeTest-1472430635-project-member</nova:user>
Jul 29 14:43:46 user nova-compute[70924]:         <nova:project uuid="0f1b30b901be4e57b34c74a8bbb2519b">tempest-VolumesNegativeTest-1472430635</nova:project>
Jul 29 14:43:46 user nova-compute[70924]:       </nova:owner>
Jul 29 14:43:46 user nova-compute[70924]:       <nova:root type="image" uuid="3aba2e73-6832-404b-8bd0-d0503ce82b8c"/>
Jul 29 14:43:46 user nova-compute[70924]:       <nova:ports>
Jul 29 14:43:46 user nova-compute[70924]:         <nova:port uuid="6a96191e-52fa-4efd-9c32-c5dec84b69ec">
Jul 29 14:43:46 user nova-compute[70924]:           <nova:ip type="fixed" address="192.168.233.227" ipVersion="4"/>
Jul 29 14:43:46 user nova-compute[70924]:         </nova:port>
Jul 29 14:43:46 user nova-compute[70924]:       </nova:ports>
Jul 29 14:43:46 user nova-compute[70924]:     </nova:instance>
Jul 29 14:43:46 user nova-compute[70924]:   </metadata>
Jul 29 14:43:46 user nova-compute[70924]:   <sysinfo type="smbios">
Jul 29 14:43:46 user nova-compute[70924]:     <system>
Jul 29 14:43:46 user nova-compute[70924]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 14:43:46 user nova-compute[70924]:       <entry name="product">OpenStack Nova</entry>
Jul 29 14:43:46 user nova-compute[70924]:       <entry name="version">0.0.0</entry>
Jul 29 14:43:46 user nova-compute[70924]:       <entry name="serial">9ba37020-824a-4ae5-9836-462fe4de476b</entry>
Jul 29 14:43:46 user nova-compute[70924]:       <entry name="uuid">9ba37020-824a-4ae5-9836-462fe4de476b</entry>
Jul 29 14:43:46 user nova-compute[70924]:       <entry name="family">Virtual Machine</entry>
Jul 29 14:43:46 user nova-compute[70924]:     </system>
Jul 29 14:43:46 user nova-compute[70924]:   </sysinfo>
Jul 29 14:43:46 user nova-compute[70924]:   <os>
Jul 29 14:43:46 user nova-compute[70924]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 14:43:46 user nova-compute[70924]:     <boot dev="hd"/>
Jul 29 14:43:46 user nova-compute[70924]:     <smbios mode="sysinfo"/>
Jul 29 14:43:46 user nova-compute[70924]:   </os>
Jul 29 14:43:46 user nova-compute[70924]:   <features>
Jul 29 14:43:46 user nova-compute[70924]:     <acpi/>
Jul 29 14:43:46 user nova-compute[70924]:     <apic/>
Jul 29 14:43:46 user nova-compute[70924]:     <vmcoreinfo/>
Jul 29 14:43:46 user nova-compute[70924]:   </features>
Jul 29 14:43:46 user nova-compute[70924]:   <clock offset="utc">
Jul 29 14:43:46 user nova-compute[70924]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 14:43:46 user nova-compute[70924]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 14:43:46 user nova-compute[70924]:     <timer name="hpet" present="no"/>
Jul 29 14:43:46 user nova-compute[70924]:   </clock>
Jul 29 14:43:46 user nova-compute[70924]:   <cpu mode="custom" match="exact">
Jul 29 14:43:46 user nova-compute[70924]:     <model>Nehalem</model>
Jul 29 14:43:46 user nova-compute[70924]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 14:43:46 user nova-compute[70924]:   </cpu>
Jul 29 14:43:46 user nova-compute[70924]:   <devices>
Jul 29 14:43:46 user nova-compute[70924]:     <disk type="file" device="disk">
Jul 29 14:43:46 user nova-compute[70924]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 14:43:46 user nova-compute[70924]:       <source file="/opt/stack/data/nova/instances/9ba37020-824a-4ae5-9836-462fe4de476b/disk"/>
Jul 29 14:43:46 user nova-compute[70924]:       <target dev="vda" bus="virtio"/>
Jul 29 14:43:46 user nova-compute[70924]:     </disk>
Jul 29 14:43:46 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 14:43:46 user nova-compute[70924]:       <mac address="fa:16:3e:62:66:2f"/>
Jul 29 14:43:46 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:43:46 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 14:43:46 user nova-compute[70924]:       <target dev="tap6a96191e-52"/>
Jul 29 14:43:46 user nova-compute[70924]:     </interface>
Jul 29 14:43:46 user nova-compute[70924]:     <serial type="pty">
Jul 29 14:43:46 user nova-compute[70924]:       <log file="/opt/stack/data/nova/instances/9ba37020-824a-4ae5-9836-462fe4de476b/console.log" append="off"/>
Jul 29 14:43:46 user nova-compute[70924]:     </serial>
Jul 29 14:43:46 user nova-compute[70924]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 14:43:46 user nova-compute[70924]:     <video>
Jul 29 14:43:46 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:43:46 user nova-compute[70924]:     </video>
Jul 29 14:43:46 user nova-compute[70924]:     <rng model="virtio">
Jul 29 14:43:46 user nova-compute[70924]:       <backend model="random">/dev/urandom</backend>
Jul 29 14:43:46 user nova-compute[70924]:     </rng>
Jul 29 14:43:46 user nova-compute[70924]:     <controller type="usb" index="0" model="none"/>
Jul 29 14:43:46 user nova-compute[70924]:     <memballoon model="virtio">
Jul 29 14:43:46 user nova-compute[70924]:       <stats period="10"/>
Jul 29 14:43:46 user nova-compute[70924]:     </memballoon>
Jul 29 14:43:46 user nova-compute[70924]:   </devices>
Jul 29 14:43:46 user nova-compute[70924]: </domain>
Jul 29 14:43:46 user nova-compute[70924]:  {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 14:43:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:43:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-747691720',display_name='tempest-VolumesNegativeTest-instance-747691720',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-747691720',id=12,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f1b30b901be4e57b34c74a8bbb2519b',ramdisk_id='',reservation_id='r-th159ex1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1472430635',owner_user_name='tempest-VolumesNegativeTest-1472430635-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:43:44Z,user_data=None,user_id='c04095cb42ad4a659cda5d22878b4445',uuid=9ba37020-824a-4ae5-9836-462fe4de476b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a96191e-52fa-4efd-9c32-c5dec84b69ec", "address": "fa:16:3e:62:66:2f", "network": {"id": "7dca7036-5f4e-4888-becf-ffc2735302ed", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2256057123ba4f7181829a5b453f36be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a96191e-52", "ovs_interfaceid": "6a96191e-52fa-4efd-9c32-c5dec84b69ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 14:43:46 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] Converting VIF {"id": "6a96191e-52fa-4efd-9c32-c5dec84b69ec", "address": "fa:16:3e:62:66:2f", "network": {"id": "7dca7036-5f4e-4888-becf-ffc2735302ed", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2256057123ba4f7181829a5b453f36be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a96191e-52", "ovs_interfaceid": "6a96191e-52fa-4efd-9c32-c5dec84b69ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:43:46 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:66:2f,bridge_name='br-int',has_traffic_filtering=True,id=6a96191e-52fa-4efd-9c32-c5dec84b69ec,network=Network(7dca7036-5f4e-4888-becf-ffc2735302ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a96191e-52') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:43:46 user nova-compute[70924]: DEBUG os_vif [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:66:2f,bridge_name='br-int',has_traffic_filtering=True,id=6a96191e-52fa-4efd-9c32-c5dec84b69ec,network=Network(7dca7036-5f4e-4888-becf-ffc2735302ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a96191e-52') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 14:43:46 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:43:46 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:43:46 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 14:43:46 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:43:46 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6a96191e-52, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:43:46 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6a96191e-52, col_values=(('external_ids', {'iface-id': '6a96191e-52fa-4efd-9c32-c5dec84b69ec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:66:2f', 'vm-uuid': '9ba37020-824a-4ae5-9836-462fe4de476b'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:43:46 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:43:46 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:43:46 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:43:46 user nova-compute[70924]: INFO os_vif [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:66:2f,bridge_name='br-int',has_traffic_filtering=True,id=6a96191e-52fa-4efd-9c32-c5dec84b69ec,network=Network(7dca7036-5f4e-4888-becf-ffc2735302ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a96191e-52')
Jul 29 14:43:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:43:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] No VIF found with MAC fa:16:3e:62:66:2f, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:43:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] COPY block job progress, current cursor: 10485760 final cursor: 1073741824 {{(pid=70924) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 29 14:43:46 user nova-compute[70924]: DEBUG nova.network.neutron [req-c5e22c5c-637a-4766-b6f8-1584f9c5ac2f req-3994703d-d66d-4d8c-87f4-6c2b8abb02e8 service nova] [instance: 9ba37020-824a-4ae5-9836-462fe4de476b] Updated VIF entry in instance network info cache for port 6a96191e-52fa-4efd-9c32-c5dec84b69ec. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:43:46 user nova-compute[70924]: DEBUG nova.network.neutron [req-c5e22c5c-637a-4766-b6f8-1584f9c5ac2f req-3994703d-d66d-4d8c-87f4-6c2b8abb02e8 service nova] [instance: 9ba37020-824a-4ae5-9836-462fe4de476b] Updating instance_info_cache with network_info: [{"id": "6a96191e-52fa-4efd-9c32-c5dec84b69ec", "address": "fa:16:3e:62:66:2f", "network": {"id": "7dca7036-5f4e-4888-becf-ffc2735302ed", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2256057123ba4f7181829a5b453f36be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a96191e-52", "ovs_interfaceid": "6a96191e-52fa-4efd-9c32-c5dec84b69ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:43:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c5e22c5c-637a-4766-b6f8-1584f9c5ac2f req-3994703d-d66d-4d8c-87f4-6c2b8abb02e8 service nova] Releasing lock "refresh_cache-9ba37020-824a-4ae5-9836-462fe4de476b" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:43:47 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:43:47 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:43:47 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Starting heal instance info cache {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 14:43:47 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] COPY block job progress, current cursor: 173015040 final cursor: 1073741824 {{(pid=70924) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 29 14:43:47 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "refresh_cache-2250b0d6-5542-4a7f-90a9-93745a776fcc" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:43:47 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquired lock "refresh_cache-2250b0d6-5542-4a7f-90a9-93745a776fcc" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:43:47 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] Forcefully refreshing network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 29 14:43:47 user nova-compute[70924]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690641812.2191546, 1ea2e4b1-5b93-42bf-b29d-ce6986135826 => Stopped> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:43:47 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] VM Stopped (Lifecycle Event)
Jul 29 14:43:47 user nova-compute[70924]: DEBUG nova.compute.manager [None req-43db81b9-fde9-420f-8cda-25498e4b8185 None None] [instance: 1ea2e4b1-5b93-42bf-b29d-ce6986135826] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:43:47 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] COPY block job progress, current cursor: 342884352 final cursor: 1073741824 {{(pid=70924) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 29 14:43:47 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:43:47 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] Updating instance_info_cache with network_info: [{"id": "72829b2d-d54b-4792-bb99-ea15bf5149a6", "address": "fa:16:3e:b7:e0:eb", "network": {"id": "b6631336-b322-45e0-99b7-5e95539aa674", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2109271400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc2394c924af4a9aaa925d116b2117ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72829b2d-d5", "ovs_interfaceid": "72829b2d-d54b-4792-bb99-ea15bf5149a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:43:48 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Releasing lock "refresh_cache-2250b0d6-5542-4a7f-90a9-93745a776fcc" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:43:48 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] Updated the network info_cache for instance {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 29 14:43:48 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:43:48 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:43:48 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:43:48 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:43:48 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:43:48 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:43:48 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70924) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 14:43:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:43:48 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] COPY block job progress, current cursor: 491782144 final cursor: 1073741824 {{(pid=70924) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 29 14:43:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:43:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:43:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:43:48 user nova-compute[70924]: DEBUG nova.compute.manager [req-0e9eba2c-ff84-4229-bde3-5c659ebfc48b req-8129267c-4323-4c41-97cd-a56e1adbd743 service nova] [instance: 9ba37020-824a-4ae5-9836-462fe4de476b] Received event network-vif-plugged-6a96191e-52fa-4efd-9c32-c5dec84b69ec {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:43:48 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-0e9eba2c-ff84-4229-bde3-5c659ebfc48b req-8129267c-4323-4c41-97cd-a56e1adbd743 service nova] Acquiring lock "9ba37020-824a-4ae5-9836-462fe4de476b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:43:48 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-0e9eba2c-ff84-4229-bde3-5c659ebfc48b req-8129267c-4323-4c41-97cd-a56e1adbd743 service nova] Lock "9ba37020-824a-4ae5-9836-462fe4de476b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:43:48 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-0e9eba2c-ff84-4229-bde3-5c659ebfc48b req-8129267c-4323-4c41-97cd-a56e1adbd743 service nova] Lock "9ba37020-824a-4ae5-9836-462fe4de476b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:43:48 user nova-compute[70924]: DEBUG nova.compute.manager [req-0e9eba2c-ff84-4229-bde3-5c659ebfc48b req-8129267c-4323-4c41-97cd-a56e1adbd743 service nova] [instance: 9ba37020-824a-4ae5-9836-462fe4de476b] No waiting events found dispatching network-vif-plugged-6a96191e-52fa-4efd-9c32-c5dec84b69ec {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:43:48 user nova-compute[70924]: WARNING nova.compute.manager [req-0e9eba2c-ff84-4229-bde3-5c659ebfc48b req-8129267c-4323-4c41-97cd-a56e1adbd743 service nova] [instance: 9ba37020-824a-4ae5-9836-462fe4de476b] Received unexpected event network-vif-plugged-6a96191e-52fa-4efd-9c32-c5dec84b69ec for instance with vm_state building and task_state spawning.
Jul 29 14:43:48 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] COPY block job progress, current cursor: 666894336 final cursor: 1073741824 {{(pid=70924) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 29 14:43:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:43:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:43:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:43:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:43:49 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] COPY block job progress, current cursor: 817889280 final cursor: 1073741824 {{(pid=70924) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 29 14:43:49 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] COPY block job progress, current cursor: 998244352 final cursor: 1073741824 {{(pid=70924) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 29 14:43:50 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=70924) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 29 14:43:50 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] calling os-brick to detach iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 14:43:50 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, {'target_iqns': ['iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zlgQFZis', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:43:50 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:43:50 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:43:50 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:43:50 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648', 0)] {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 14:43:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:50 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c7ec98-9256-43bb-889b-73a5b6ff939d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6bb60216-0d32-464f-b727-30d5918681f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:50 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9459c56-6501-43f4-9300-66b6554b2486]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bb60216-0d32-464f-b727-30d5918681f2 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:50 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bb60216-0d32-464f-b727-30d5918681f2 (non-flash)
Jul 29 14:43:50 user nova-compute[70924]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)
Jul 29 14:43:50 user nova-compute[70924]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)
Jul 29 14:43:50 user nova-compute[70924]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)
Jul 29 14:43:50 user nova-compute[70924]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:43:50 user nova-compute[70924]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 (non-flash)
Jul 29 14:43:50 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:43:50 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bb60216-0d32-464f-b727-30d5918681f2 (non-flash)
Jul 29 14:43:50 user nova-compute[70924]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)
Jul 29 14:43:50 user nova-compute[70924]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)
Jul 29 14:43:50 user nova-compute[70924]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)
Jul 29 14:43:50 user nova-compute[70924]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:43:50 user nova-compute[70924]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 (non-flash)
Jul 29 14:43:50 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:43:50 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feedc360670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648'): ({'sdf'}, set())}) {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 14:43:50 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] Removing single pathed devices sdf {{(pid=70924) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 14:43:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:50 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[45981f6f-37a0-4651-9416-a353fbc4ddbd]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:50 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f7f60d-68ec-474c-8aa3-79d9b8a2647a]: (4, ('ok\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:50 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] Flushing IO for device /dev/sdf {{(pid=70924) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 14:43:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:50 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[8791d460-88ec-41dd-b951-49209bcbe386]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:50 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=70924) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 14:43:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.050s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:50 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f768fe1b-b113-4f08-acbf-7433bbabc780]: (4, ('1', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:50 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 14:43:50 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] SCSI volumes sdf have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 14:43:50 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648')] {{(pid=70924) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 14:43:50 user nova-compute[70924]: DEBUG nova.compute.manager [req-c7ada47b-522f-4d45-af16-da1bfcb62ef5 req-199131a7-712a-4a4b-a9af-2426467d8464 service nova] [instance: 9ba37020-824a-4ae5-9836-462fe4de476b] Received event network-vif-plugged-6a96191e-52fa-4efd-9c32-c5dec84b69ec {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:43:50 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c7ada47b-522f-4d45-af16-da1bfcb62ef5 req-199131a7-712a-4a4b-a9af-2426467d8464 service nova] Acquiring lock "9ba37020-824a-4ae5-9836-462fe4de476b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:43:50 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c7ada47b-522f-4d45-af16-da1bfcb62ef5 req-199131a7-712a-4a4b-a9af-2426467d8464 service nova] Lock "9ba37020-824a-4ae5-9836-462fe4de476b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:43:50 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c7ada47b-522f-4d45-af16-da1bfcb62ef5 req-199131a7-712a-4a4b-a9af-2426467d8464 service nova] Lock "9ba37020-824a-4ae5-9836-462fe4de476b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:43:50 user nova-compute[70924]: DEBUG nova.compute.manager [req-c7ada47b-522f-4d45-af16-da1bfcb62ef5 req-199131a7-712a-4a4b-a9af-2426467d8464 service nova] [instance: 9ba37020-824a-4ae5-9836-462fe4de476b] No waiting events found dispatching network-vif-plugged-6a96191e-52fa-4efd-9c32-c5dec84b69ec {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:43:50 user nova-compute[70924]: WARNING nova.compute.manager [req-c7ada47b-522f-4d45-af16-da1bfcb62ef5 req-199131a7-712a-4a4b-a9af-2426467d8464 service nova] [instance: 9ba37020-824a-4ae5-9836-462fe4de476b] Received unexpected event network-vif-plugged-6a96191e-52fa-4efd-9c32-c5dec84b69ec for instance with vm_state building and task_state spawning.
Jul 29 14:43:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:50 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e868fcbc-4535-43a2-a170-0b804de78cd9]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:50 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:43:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 -p 172.16.0.220:3260 --logout {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:50 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690641830.677358, 9ba37020-824a-4ae5-9836-462fe4de476b => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:43:50 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 9ba37020-824a-4ae5-9836-462fe4de476b] VM Resumed (Lifecycle Event)
Jul 29 14:43:50 user nova-compute[70924]: DEBUG nova.compute.manager [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] [instance: 9ba37020-824a-4ae5-9836-462fe4de476b] Instance event wait completed in 0 seconds for  {{(pid=70924) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 14:43:50 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] [instance: 9ba37020-824a-4ae5-9836-462fe4de476b] Guest created on hypervisor {{(pid=70924) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 14:43:50 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 9ba37020-824a-4ae5-9836-462fe4de476b] Instance spawned successfully.
Jul 29 14:43:50 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] [instance: 9ba37020-824a-4ae5-9836-462fe4de476b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 14:43:50 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 9ba37020-824a-4ae5-9836-462fe4de476b] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:43:50 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 9ba37020-824a-4ae5-9836-462fe4de476b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:43:50 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] [instance: 9ba37020-824a-4ae5-9836-462fe4de476b] Found default for hw_cdrom_bus of ide {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:43:50 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] [instance: 9ba37020-824a-4ae5-9836-462fe4de476b] Found default for hw_disk_bus of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:43:50 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] [instance: 9ba37020-824a-4ae5-9836-462fe4de476b] Found default for hw_input_bus of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:43:50 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] [instance: 9ba37020-824a-4ae5-9836-462fe4de476b] Found default for hw_pointer_model of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:43:50 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] [instance: 9ba37020-824a-4ae5-9836-462fe4de476b] Found default for hw_video_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:43:50 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] [instance: 9ba37020-824a-4ae5-9836-462fe4de476b] Found default for hw_vif_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:43:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:50 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2c3ddb-cf77-44e9-8381-5834a03b442f]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:50 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648, portal: 172.16.0.220,3260]
Jul 29 14:43:50 user nova-compute[70924]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648, portal: 172.16.0.220,3260] successful.
Jul 29 14:43:50 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:43:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 -p 172.16.0.220:3260 --op delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:50 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 9ba37020-824a-4ae5-9836-462fe4de476b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:43:50 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690641830.6776462, 9ba37020-824a-4ae5-9836-462fe4de476b => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:43:50 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 9ba37020-824a-4ae5-9836-462fe4de476b] VM Started (Lifecycle Event)
Jul 29 14:43:50 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 9ba37020-824a-4ae5-9836-462fe4de476b] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:43:50 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 9ba37020-824a-4ae5-9836-462fe4de476b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:43:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:50 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f0fdcd-5a49-4979-95ef-60b234aeb2b7]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:50 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:43:50 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:43:50 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] <== disconnect_volume: return (338ms) None {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:43:50 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Disconnected iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 14:43:50 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 9ba37020-824a-4ae5-9836-462fe4de476b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:43:50 user nova-compute[70924]: INFO nova.compute.manager [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] [instance: 9ba37020-824a-4ae5-9836-462fe4de476b] Took 7.11 seconds to spawn the instance on the hypervisor.
Jul 29 14:43:50 user nova-compute[70924]: DEBUG nova.compute.manager [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] [instance: 9ba37020-824a-4ae5-9836-462fe4de476b] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:43:50 user nova-compute[70924]: DEBUG nova.compute.manager [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6bb60216-0d32-464f-b727-30d5918681f2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BZsXQAFa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': 'fcbb998c-2dac-47d9-985a-d5b2a15ddaa0', 'attached_at': '', 'detached_at': '', 'volume_id': '6bb60216-0d32-464f-b727-30d5918681f2', 'serial'} {{(pid=70924) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Jul 29 14:43:50 user nova-compute[70924]: DEBUG nova.compute.manager [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] swap_volume: removing Cinder connection for volume 19775624-b219-4d3e-9c48-58c1b8dfb648 {{(pid=70924) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Jul 29 14:43:50 user nova-compute[70924]: INFO nova.compute.manager [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] [instance: 9ba37020-824a-4ae5-9836-462fe4de476b] Took 7.98 seconds to build instance.
Jul 29 14:43:50 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-662752cf-bbd1-4de0-bcb7-7e3d2d29405d tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] Lock "9ba37020-824a-4ae5-9836-462fe4de476b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.096s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:43:51 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:43:51 user nova-compute[70924]: DEBUG nova.compute.manager [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] swap_volume: Updating volume 19775624-b219-4d3e-9c48-58c1b8dfb648 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:6bb60216-0d32-464f-b727-30d5918681f2"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "BZsXQAFa", "auth_password": "eCaFiPVngdoSYv", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdg", "volume_id": "6bb60216-0d32-464f-b727-30d5918681f2"}, "status": "reserved", "instance": "fcbb998c-2dac-47d9-985a-d5b2a15ddaa0", "attached_at": "", "detached_at": "", "volume_id": "6bb60216-0d32-464f-b727-30d5918681f2", "serial": "6bb60216-0d32-464f-b727-30d5918681f2"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '6bb60216-0d32-464f-b727-30d5918681f2', 'no_device': None, 'attachment_id': '245e514e-0634-4edf-98b5-bfcb02b93d8f'} {{(pid=70924) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Jul 29 14:43:51 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5fdd4c8a-5466-4dbd-be28-122d0baaadb9 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] Lock "fcbb998c-2dac-47d9-985a-d5b2a15ddaa0" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 15.878s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:43:52 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Acquiring lock "02c75b00-a1b4-4ef9-ae96-bc67d8038589" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:43:52 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "02c75b00-a1b4-4ef9-ae96-bc67d8038589" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:43:52 user nova-compute[70924]: DEBUG nova.compute.manager [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Starting instance... {{(pid=70924) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 14:43:52 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:43:52 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:43:52 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70924) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 14:43:52 user nova-compute[70924]: INFO nova.compute.claims [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Claim successful on node user
Jul 29 14:43:52 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] Acquiring lock "fcbb998c-2dac-47d9-985a-d5b2a15ddaa0" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:43:52 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] Lock "fcbb998c-2dac-47d9-985a-d5b2a15ddaa0" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:43:52 user nova-compute[70924]: DEBUG os_brick.utils [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:43:52 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:52 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:52 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eeb8f9d-1a1d-4052-aac3-8b43461a6e21]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f2127c4a30d9\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:52 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:52 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:52 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5415ed-c536-4583-b16a-72cc7b536797]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:52 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:52 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:52 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e48fab63-2a1e-40a7-95e2-c40e6f600049]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:52 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[37fec29d-ef58-439e-9852-62c30d64a5e1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:52 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] Running cmd (subprocess): nvme version {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:52 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] 'nvme version' failed. Not Retrying. {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:43:52 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] nvme not present on system {{(pid=70924) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 14:43:52 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:52 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:43:52 user nova-compute[70924]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 14:43:52 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8748924-cd0a-4599-b90c-d07d49ccedce]: (4, '') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:52 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70924) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 14:43:52 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 14:43:52 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] LIGHTOS: no hostnqn found. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 14:43:52 user nova-compute[70924]: DEBUG os_brick.utils [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f2127c4a30d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:43:52 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:43:52 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:43:52 user nova-compute[70924]: INFO nova.compute.manager [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Swapping volume 6bb60216-0d32-464f-b727-30d5918681f2 for 19775624-b219-4d3e-9c48-58c1b8dfb648
Jul 29 14:43:52 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.525s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:43:52 user nova-compute[70924]: DEBUG nova.compute.manager [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Start building networks asynchronously for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 14:43:52 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:43:52 user nova-compute[70924]: DEBUG nova.compute.manager [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Allocating IP information in the background. {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 14:43:52 user nova-compute[70924]: DEBUG nova.network.neutron [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] allocate_for_instance() {{(pid=70924) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 14:43:52 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 14:43:52 user nova-compute[70924]: DEBUG nova.compute.manager [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Start building block device mappings for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 14:43:53 user nova-compute[70924]: INFO nova.virt.block_device [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Booting with blank volume at /dev/vda
Jul 29 14:43:53 user nova-compute[70924]: DEBUG nova.policy [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '43582a8a85c54b5e9d16d11b12bf50d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9e5c78c1684c359cfab4e32b9c213f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70924) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 14:43:53 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:43:53 user nova-compute[70924]: DEBUG nova.network.neutron [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Successfully created port: 25798da4-8f4d-4db1-afd2-7fb85693bc16 {{(pid=70924) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 14:43:54 user nova-compute[70924]: DEBUG nova.network.neutron [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Successfully updated port: 25798da4-8f4d-4db1-afd2-7fb85693bc16 {{(pid=70924) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 14:43:54 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Acquiring lock "refresh_cache-02c75b00-a1b4-4ef9-ae96-bc67d8038589" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:43:54 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Acquired lock "refresh_cache-02c75b00-a1b4-4ef9-ae96-bc67d8038589" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:43:54 user nova-compute[70924]: DEBUG nova.network.neutron [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 14:43:54 user nova-compute[70924]: DEBUG nova.compute.manager [req-b7f177b0-3795-4432-bb89-15b574a034f0 req-e954f69c-4293-4cf0-a225-a70f1648abc4 service nova] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Received event network-changed-25798da4-8f4d-4db1-afd2-7fb85693bc16 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:43:54 user nova-compute[70924]: DEBUG nova.compute.manager [req-b7f177b0-3795-4432-bb89-15b574a034f0 req-e954f69c-4293-4cf0-a225-a70f1648abc4 service nova] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Refreshing instance network info cache due to event network-changed-25798da4-8f4d-4db1-afd2-7fb85693bc16. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:43:54 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b7f177b0-3795-4432-bb89-15b574a034f0 req-e954f69c-4293-4cf0-a225-a70f1648abc4 service nova] Acquiring lock "refresh_cache-02c75b00-a1b4-4ef9-ae96-bc67d8038589" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:43:54 user nova-compute[70924]: DEBUG nova.network.neutron [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Instance cache missing network info. {{(pid=70924) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 14:43:54 user nova-compute[70924]: DEBUG nova.network.neutron [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Updating instance_info_cache with network_info: [{"id": "25798da4-8f4d-4db1-afd2-7fb85693bc16", "address": "fa:16:3e:59:2c:bb", "network": {"id": "d5876e18-e2af-45c2-aab5-2d0d552ebfe4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2035085552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9e5c78c1684c359cfab4e32b9c213f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25798da4-8f", "ovs_interfaceid": "25798da4-8f4d-4db1-afd2-7fb85693bc16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:43:54 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Releasing lock "refresh_cache-02c75b00-a1b4-4ef9-ae96-bc67d8038589" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:43:54 user nova-compute[70924]: DEBUG nova.compute.manager [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Instance network_info: |[{"id": "25798da4-8f4d-4db1-afd2-7fb85693bc16", "address": "fa:16:3e:59:2c:bb", "network": {"id": "d5876e18-e2af-45c2-aab5-2d0d552ebfe4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2035085552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9e5c78c1684c359cfab4e32b9c213f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25798da4-8f", "ovs_interfaceid": "25798da4-8f4d-4db1-afd2-7fb85693bc16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 14:43:54 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b7f177b0-3795-4432-bb89-15b574a034f0 req-e954f69c-4293-4cf0-a225-a70f1648abc4 service nova] Acquired lock "refresh_cache-02c75b00-a1b4-4ef9-ae96-bc67d8038589" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:43:54 user nova-compute[70924]: DEBUG nova.network.neutron [req-b7f177b0-3795-4432-bb89-15b574a034f0 req-e954f69c-4293-4cf0-a225-a70f1648abc4 service nova] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Refreshing network info cache for port 25798da4-8f4d-4db1-afd2-7fb85693bc16 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:43:55 user nova-compute[70924]: DEBUG nova.network.neutron [req-b7f177b0-3795-4432-bb89-15b574a034f0 req-e954f69c-4293-4cf0-a225-a70f1648abc4 service nova] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Updated VIF entry in instance network info cache for port 25798da4-8f4d-4db1-afd2-7fb85693bc16. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:43:55 user nova-compute[70924]: DEBUG nova.network.neutron [req-b7f177b0-3795-4432-bb89-15b574a034f0 req-e954f69c-4293-4cf0-a225-a70f1648abc4 service nova] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Updating instance_info_cache with network_info: [{"id": "25798da4-8f4d-4db1-afd2-7fb85693bc16", "address": "fa:16:3e:59:2c:bb", "network": {"id": "d5876e18-e2af-45c2-aab5-2d0d552ebfe4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2035085552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9e5c78c1684c359cfab4e32b9c213f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25798da4-8f", "ovs_interfaceid": "25798da4-8f4d-4db1-afd2-7fb85693bc16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:43:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b7f177b0-3795-4432-bb89-15b574a034f0 req-e954f69c-4293-4cf0-a225-a70f1648abc4 service nova] Releasing lock "refresh_cache-02c75b00-a1b4-4ef9-ae96-bc67d8038589" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:43:56 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:43:58 user nova-compute[70924]: DEBUG os_brick.utils [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:43:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:58 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b650d7-3a2c-47c1-a2c8-d5806879289f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f2127c4a30d9\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:58 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1e2597-61b3-4597-bd36-c64ab080b55e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:43:58 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d6477e-58e1-4e62-b1f6-1f6af8c5242d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:58 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[db2fef30-d714-41f8-8d77-aad352187816]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Running cmd (subprocess): nvme version {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] 'nvme version' failed. Not Retrying. {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:43:58 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] nvme not present on system {{(pid=70924) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 14:43:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:43:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:43:58 user nova-compute[70924]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 14:43:58 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[038ecaf9-3e28-4535-ad6a-2ccbb3ee8003]: (4, '') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:43:58 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70924) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 14:43:58 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 14:43:58 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] LIGHTOS: no hostnqn found. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 14:43:58 user nova-compute[70924]: DEBUG os_brick.utils [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] <== get_connector_properties: return (103ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f2127c4a30d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:43:58 user nova-compute[70924]: DEBUG nova.virt.block_device [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Updating existing volume attachment record: 69fb18b5-b34a-4041-8752-a573d9535cc3 {{(pid=70924) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 14:44:00 user nova-compute[70924]: DEBUG nova.compute.manager [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zlgQFZis', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fcbb998c-2dac-47d9-985a-d5b2a15ddaa0', 'attached_at': '', 'detached_at': '', 'volume_id': '19775624-b219-4d3e-9c48-58c1b8dfb648', 'serial': '19775624-b219-4d3e-9c48-58c1b8dfb648'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6bb60216-0d32-464f-b727-30d5918681f2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BZsXQAFa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'volume_id': '6bb60216-0d32-464f-b727-30d5918681f2'}, 'status': 'reserved', 'instance': 'fcbb998c-2dac-47d9-985a-d5b2a15ddaa0', 'attached_at': '', 'detached_at': '', 'volume_id': '6bb60216-0d32-464f-b727-30d5918681f2', 'serial'} {{(pid=70924) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Jul 29 14:44:00 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Calling os-brick to attach iSCSI Volume {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 14:44:00 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zlgQFZis', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:44:00 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:44:00 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:44:00 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:44:00 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:44:00 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:44:00 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:44:00 user nova-compute[70924]: INFO os_brick.initiator.connectors.iscsi [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 14:44:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 -p 172.16.0.220:3260 {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:00 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e1bcc1-8c82-4122-92c7-9959712a021d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:00 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 14:44:00 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:44:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 -p 172.16.0.220:3260 --interface default --op new {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:01 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:01 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[feffe9cd-10e3-4951-bf8b-1cc85e8b5c1b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648] added\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:01 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648] added
Jul 29 14:44:01 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:44:01 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:01 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:01 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d463a52e-56ab-4da2-b29c-774d8b9fa50c]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:01 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:44:01 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:01 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:01 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c325dfa-fb8b-4366-88a9-056c898a87f9]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:01 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:44:01 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zlgQFZis {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:01 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zlgQFZis" returned: 0 in 0.026s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:01 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b34da6c-cd8f-4ba3-9f46-a9c82580bd34]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:01 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zlgQFZis'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:44:01 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:01 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:01 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[224c417f-a61a-4a14-9ac1-eb4a1794b1e1]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:01 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:44:01 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:01 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:01 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[22956668-3fee-473e-8321-0beb249d6ede]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bb60216-0d32-464f-b727-30d5918681f2 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:01 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bb60216-0d32-464f-b727-30d5918681f2 (non-flash)
Jul 29 14:44:01 user nova-compute[70924]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)
Jul 29 14:44:01 user nova-compute[70924]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)
Jul 29 14:44:01 user nova-compute[70924]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)
Jul 29 14:44:01 user nova-compute[70924]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:44:01 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:44:01 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bb60216-0d32-464f-b727-30d5918681f2 (non-flash)
Jul 29 14:44:01 user nova-compute[70924]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)
Jul 29 14:44:01 user nova-compute[70924]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)
Jul 29 14:44:01 user nova-compute[70924]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)
Jul 29 14:44:01 user nova-compute[70924]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:44:01 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:44:01 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 -p 172.16.0.220:3260 --login {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:01 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:01 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[667c737c-2e5e-4777-8914-5660097f823d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:01 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648, portal: 172.16.0.220,3260]
Jul 29 14:44:01 user nova-compute[70924]: Login to [iface: default, target: iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648, portal: 172.16.0.220,3260] successful.
Jul 29 14:44:01 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:44:01 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:01 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:01 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[548067f1-6e8d-45a5-b9de-23614067b009]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:01 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:44:01 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:01 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:01 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[09afb392-0e61-4904-808c-634f7d76af6b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bb60216-0d32-464f-b727-30d5918681f2 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:01 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bb60216-0d32-464f-b727-30d5918681f2 (non-flash)
Jul 29 14:44:01 user nova-compute[70924]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 (non-flash)
Jul 29 14:44:01 user nova-compute[70924]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)
Jul 29 14:44:01 user nova-compute[70924]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)
Jul 29 14:44:01 user nova-compute[70924]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)
Jul 29 14:44:01 user nova-compute[70924]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:44:01 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:44:01 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bb60216-0d32-464f-b727-30d5918681f2 (non-flash)
Jul 29 14:44:01 user nova-compute[70924]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 (non-flash)
Jul 29 14:44:01 user nova-compute[70924]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)
Jul 29 14:44:01 user nova-compute[70924]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)
Jul 29 14:44:01 user nova-compute[70924]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)
Jul 29 14:44:01 user nova-compute[70924]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:44:01 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:44:01 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.345s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:44:01 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] Connected to 172.16.0.220:3260 {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 14:44:01 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] HCTL ('37', '-', '-', 0) found on session 12 with lun 0 {{(pid=70924) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 14:44:01 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=70924) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 14:44:01 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:01 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:01 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1351ddc4-d551-4aa1-bdf4-d46746b2632e]: (4, ('- - 0', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:01 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] Searching for a device in session 12 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 14:44:01 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zlgQFZis', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 14:44:01 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:44:01 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:01 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5007 ms, sending inactivity probe {{(pid=70924) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 29 14:44:01 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70924) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 14:44:01 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70924) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 14:44:01 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:44:01 user nova-compute[70924]: DEBUG nova.compute.manager [req-965a14be-0a49-422a-871b-c5d34714492d req-8686a199-9e91-454e-90f0-5d73fc53f3c4 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Received event network-changed-be358bcd-08a6-445b-afea-9b3335a8cac1 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:44:01 user nova-compute[70924]: DEBUG nova.compute.manager [req-965a14be-0a49-422a-871b-c5d34714492d req-8686a199-9e91-454e-90f0-5d73fc53f3c4 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Refreshing instance network info cache due to event network-changed-be358bcd-08a6-445b-afea-9b3335a8cac1. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:44:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-965a14be-0a49-422a-871b-c5d34714492d req-8686a199-9e91-454e-90f0-5d73fc53f3c4 service nova] Acquiring lock "refresh_cache-7d71c003-6ad9-495f-ac65-083f07d65201" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:44:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-965a14be-0a49-422a-871b-c5d34714492d req-8686a199-9e91-454e-90f0-5d73fc53f3c4 service nova] Acquired lock "refresh_cache-7d71c003-6ad9-495f-ac65-083f07d65201" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:44:01 user nova-compute[70924]: DEBUG nova.network.neutron [req-965a14be-0a49-422a-871b-c5d34714492d req-8686a199-9e91-454e-90f0-5d73fc53f3c4 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Refreshing network info cache for port be358bcd-08a6-445b-afea-9b3335a8cac1 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:44:02 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.384s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:44:02 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] <== connect_volume: return (1386ms) {'type': 'block', 'scsi_wwn': '23261336635343832', 'path': '/dev/sdf'} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:44:02 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23261336635343832', 'path': '/dev/sdf'} {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 14:44:02 user nova-compute[70924]: DEBUG nova.objects.instance [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] Lazy-loading 'flavor' on Instance uuid fcbb998c-2dac-47d9-985a-d5b2a15ddaa0 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:44:02 user nova-compute[70924]: DEBUG nova.network.neutron [req-965a14be-0a49-422a-871b-c5d34714492d req-8686a199-9e91-454e-90f0-5d73fc53f3c4 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Updated VIF entry in instance network info cache for port be358bcd-08a6-445b-afea-9b3335a8cac1. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:44:02 user nova-compute[70924]: DEBUG nova.network.neutron [req-965a14be-0a49-422a-871b-c5d34714492d req-8686a199-9e91-454e-90f0-5d73fc53f3c4 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Updating instance_info_cache with network_info: [{"id": "be358bcd-08a6-445b-afea-9b3335a8cac1", "address": "fa:16:3e:57:8e:35", "network": {"id": "7fce894f-cc4f-4e5d-8bc2-c046161b14d8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1405783563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe358bcd-08", "ovs_interfaceid": "be358bcd-08a6-445b-afea-9b3335a8cac1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b47a2389-92e5-4e93-89d3-ddb36806582f", "address": "fa:16:3e:87:c2:cc", "network": {"id": "b18952cf-830d-47b0-920f-467ad6e971f1", "bridge": "br-int", "label": "tempest-device-tagging-net1-724382461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb47a2389-92", "ovs_interfaceid": "b47a2389-92e5-4e93-89d3-ddb36806582f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0baed51f-cbf0-43db-9cbf-53bda0557b4c", "address": "fa:16:3e:fc:ca:c0", "network": {"id": "b18952cf-830d-47b0-920f-467ad6e971f1", "bridge": "br-int", "label": "tempest-device-tagging-net1-724382461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0baed51f-cb", "ovs_interfaceid": "0baed51f-cbf0-43db-9cbf-53bda0557b4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "514c7198-3395-4795-93a8-60ea475f119b", "address": "fa:16:3e:57:7c:0d", "network": {"id": "b18952cf-830d-47b0-920f-467ad6e971f1", "bridge": "br-int", "label": "tempest-device-tagging-net1-724382461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap514c7198-33", "ovs_interfaceid": "514c7198-3395-4795-93a8-60ea475f119b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "58e714a9-1fc7-4211-b2b6-f46e985123e8", "address": "fa:16:3e:63:6b:c0", "network": {"id": "b18952cf-830d-47b0-920f-467ad6e971f1", "bridge": "br-int", "label": "tempest-device-tagging-net1-724382461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58e714a9-1f", "ovs_interfaceid": "58e714a9-1fc7-4211-b2b6-f46e985123e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ba4b82c4-18e0-4863-b47a-139f71c45e27", "address": "fa:16:3e:77:64:39", "network": {"id": "2f6d769a-c90b-4a51-a6a7-93fab40860a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-972817671", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4b82c4-18", "ovs_interfaceid": "ba4b82c4-18e0-4863-b47a-139f71c45e27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ccee8ddb-f771-4238-aebc-0d9ef5eca6a1", "address": "fa:16:3e:76:86:8f", "network": {"id": "2f6d769a-c90b-4a51-a6a7-93fab40860a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-972817671", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccee8ddb-f7", "ovs_interfaceid": "ccee8ddb-f771-4238-aebc-0d9ef5eca6a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:44:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-965a14be-0a49-422a-871b-c5d34714492d req-8686a199-9e91-454e-90f0-5d73fc53f3c4 service nova] Releasing lock "refresh_cache-7d71c003-6ad9-495f-ac65-083f07d65201" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:44:02 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] COPY block job progress, current cursor: 6291456 final cursor: 1073741824 {{(pid=70924) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 29 14:44:02 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:03 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] COPY block job progress, current cursor: 161480704 final cursor: 1073741824 {{(pid=70924) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 29 14:44:03 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] COPY block job progress, current cursor: 279969792 final cursor: 1073741824 {{(pid=70924) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 29 14:44:04 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] COPY block job progress, current cursor: 451936256 final cursor: 1073741824 {{(pid=70924) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 29 14:44:04 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Acquiring lock "7d71c003-6ad9-495f-ac65-083f07d65201" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:44:04 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Lock "7d71c003-6ad9-495f-ac65-083f07d65201" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:44:04 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Acquiring lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:44:04 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:44:04 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:44:04 user nova-compute[70924]: INFO nova.compute.manager [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Terminating instance
Jul 29 14:44:04 user nova-compute[70924]: DEBUG nova.compute.manager [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Start destroying the instance on the hypervisor. {{(pid=70924) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 14:44:04 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:04 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:04 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:04 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:04 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:04 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] COPY block job progress, current cursor: 596639744 final cursor: 1073741824 {{(pid=70924) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 29 14:44:04 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:04 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:05 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:05 user nova-compute[70924]: DEBUG nova.compute.manager [req-39681c74-f31f-42db-87e4-686fddaa42a8 req-11fc3b42-8b25-4639-9178-26ae703c70bb service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Received event network-vif-unplugged-b47a2389-92e5-4e93-89d3-ddb36806582f {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:44:05 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-39681c74-f31f-42db-87e4-686fddaa42a8 req-11fc3b42-8b25-4639-9178-26ae703c70bb service nova] Acquiring lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:44:05 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-39681c74-f31f-42db-87e4-686fddaa42a8 req-11fc3b42-8b25-4639-9178-26ae703c70bb service nova] Lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:44:05 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-39681c74-f31f-42db-87e4-686fddaa42a8 req-11fc3b42-8b25-4639-9178-26ae703c70bb service nova] Lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:44:05 user nova-compute[70924]: DEBUG nova.compute.manager [req-39681c74-f31f-42db-87e4-686fddaa42a8 req-11fc3b42-8b25-4639-9178-26ae703c70bb service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] No waiting events found dispatching network-vif-unplugged-b47a2389-92e5-4e93-89d3-ddb36806582f {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:44:05 user nova-compute[70924]: DEBUG nova.compute.manager [req-39681c74-f31f-42db-87e4-686fddaa42a8 req-11fc3b42-8b25-4639-9178-26ae703c70bb service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Received event network-vif-unplugged-b47a2389-92e5-4e93-89d3-ddb36806582f for instance with task_state deleting. {{(pid=70924) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 14:44:05 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:05 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:05 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] COPY block job progress, current cursor: 721420288 final cursor: 1073741824 {{(pid=70924) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 29 14:44:05 user nova-compute[70924]: DEBUG nova.compute.manager [req-c9497300-e6c7-47fc-9edc-00cef5384fe5 req-95514852-ec90-4afc-b272-3f34615eefd8 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Received event network-vif-unplugged-be358bcd-08a6-445b-afea-9b3335a8cac1 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:44:05 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c9497300-e6c7-47fc-9edc-00cef5384fe5 req-95514852-ec90-4afc-b272-3f34615eefd8 service nova] Acquiring lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:44:05 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c9497300-e6c7-47fc-9edc-00cef5384fe5 req-95514852-ec90-4afc-b272-3f34615eefd8 service nova] Lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:44:05 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c9497300-e6c7-47fc-9edc-00cef5384fe5 req-95514852-ec90-4afc-b272-3f34615eefd8 service nova] Lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:44:05 user nova-compute[70924]: DEBUG nova.compute.manager [req-c9497300-e6c7-47fc-9edc-00cef5384fe5 req-95514852-ec90-4afc-b272-3f34615eefd8 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] No waiting events found dispatching network-vif-unplugged-be358bcd-08a6-445b-afea-9b3335a8cac1 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:44:05 user nova-compute[70924]: DEBUG nova.compute.manager [req-c9497300-e6c7-47fc-9edc-00cef5384fe5 req-95514852-ec90-4afc-b272-3f34615eefd8 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Received event network-vif-unplugged-be358bcd-08a6-445b-afea-9b3335a8cac1 for instance with task_state deleting. {{(pid=70924) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 14:44:05 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:05 user nova-compute[70924]: DEBUG nova.compute.manager [req-ca19bf6b-fabf-499f-99e8-c9279b80cc9d req-14b24d77-a35d-493a-a96b-532ddfad54a2 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Received event network-vif-unplugged-0baed51f-cbf0-43db-9cbf-53bda0557b4c {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:44:05 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-ca19bf6b-fabf-499f-99e8-c9279b80cc9d req-14b24d77-a35d-493a-a96b-532ddfad54a2 service nova] Acquiring lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:44:05 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-ca19bf6b-fabf-499f-99e8-c9279b80cc9d req-14b24d77-a35d-493a-a96b-532ddfad54a2 service nova] Lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:44:05 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-ca19bf6b-fabf-499f-99e8-c9279b80cc9d req-14b24d77-a35d-493a-a96b-532ddfad54a2 service nova] Lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:44:05 user nova-compute[70924]: DEBUG nova.compute.manager [req-ca19bf6b-fabf-499f-99e8-c9279b80cc9d req-14b24d77-a35d-493a-a96b-532ddfad54a2 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] No waiting events found dispatching network-vif-unplugged-0baed51f-cbf0-43db-9cbf-53bda0557b4c {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:44:05 user nova-compute[70924]: DEBUG nova.compute.manager [req-ca19bf6b-fabf-499f-99e8-c9279b80cc9d req-14b24d77-a35d-493a-a96b-532ddfad54a2 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Received event network-vif-unplugged-0baed51f-cbf0-43db-9cbf-53bda0557b4c for instance with task_state deleting. {{(pid=70924) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 14:44:05 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:05 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:05 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:05 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:05 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] COPY block job progress, current cursor: 876609536 final cursor: 1073741824 {{(pid=70924) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 29 14:44:05 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:06 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] COPY block job progress, current cursor: 1030750208 final cursor: 1073741824 {{(pid=70924) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 29 14:44:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:06 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Instance destroyed successfully.
Jul 29 14:44:06 user nova-compute[70924]: DEBUG nova.objects.instance [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Lazy-loading 'resources' on Instance uuid 7d71c003-6ad9-495f-ac65-083f07d65201 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:44:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:06 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T14:42:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-258468828',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-258468828',id=10,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8vhOVuXRjbQAFoxoAwoH8wPeKkNky0s/inopZaSY/VBTBt29RwOL3lmSODeTfAsQhH35wSIR4rsbuvFcq0Aiofsb1Txk0TNGyDZnF4CI77vmbpayOZGyAw/mvGvnUY+w==',key_name='tempest-keypair-1728574391',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:42:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5ce898102e394a1e8458ffd6635acbd3',ramdisk_id='',reservation_id='r-duicp9hg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1259288934',owner_user_name='tempest-TaggedBootDevicesTest-1259288934-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:42:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b4c56eb2047426f8e9d31f9221c49b2',uuid=7d71c003-6ad9-495f-ac65-083f07d65201,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "be358bcd-08a6-445b-afea-9b3335a8cac1", "address": "fa:16:3e:57:8e:35", "network": {"id": "7fce894f-cc4f-4e5d-8bc2-c046161b14d8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1405783563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe358bcd-08", "ovs_interfaceid": "be358bcd-08a6-445b-afea-9b3335a8cac1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 14:44:06 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Converting VIF {"id": "be358bcd-08a6-445b-afea-9b3335a8cac1", "address": "fa:16:3e:57:8e:35", "network": {"id": "7fce894f-cc4f-4e5d-8bc2-c046161b14d8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1405783563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe358bcd-08", "ovs_interfaceid": "be358bcd-08a6-445b-afea-9b3335a8cac1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:44:06 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:8e:35,bridge_name='br-int',has_traffic_filtering=True,id=be358bcd-08a6-445b-afea-9b3335a8cac1,network=Network(7fce894f-cc4f-4e5d-8bc2-c046161b14d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe358bcd-08') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:44:06 user nova-compute[70924]: DEBUG os_vif [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:8e:35,bridge_name='br-int',has_traffic_filtering=True,id=be358bcd-08a6-445b-afea-9b3335a8cac1,network=Network(7fce894f-cc4f-4e5d-8bc2-c046161b14d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe358bcd-08') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 14:44:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbe358bcd-08, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:44:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:44:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:06 user nova-compute[70924]: INFO os_vif [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:8e:35,bridge_name='br-int',has_traffic_filtering=True,id=be358bcd-08a6-445b-afea-9b3335a8cac1,network=Network(7fce894f-cc4f-4e5d-8bc2-c046161b14d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe358bcd-08')
Jul 29 14:44:06 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T14:42:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-258468828',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-258468828',id=10,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8vhOVuXRjbQAFoxoAwoH8wPeKkNky0s/inopZaSY/VBTBt29RwOL3lmSODeTfAsQhH35wSIR4rsbuvFcq0Aiofsb1Txk0TNGyDZnF4CI77vmbpayOZGyAw/mvGvnUY+w==',key_name='tempest-keypair-1728574391',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:42:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5ce898102e394a1e8458ffd6635acbd3',ramdisk_id='',reservation_id='r-duicp9hg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1259288934',owner_user_name='tempest-TaggedBootDevicesTest-1259288934-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:42:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b4c56eb2047426f8e9d31f9221c49b2',uuid=7d71c003-6ad9-495f-ac65-083f07d65201,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b47a2389-92e5-4e93-89d3-ddb36806582f", "address": "fa:16:3e:87:c2:cc", "network": {"id": "b18952cf-830d-47b0-920f-467ad6e971f1", "bridge": "br-int", "label": "tempest-device-tagging-net1-724382461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb47a2389-92", "ovs_interfaceid": "b47a2389-92e5-4e93-89d3-ddb36806582f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 14:44:06 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Converting VIF {"id": "b47a2389-92e5-4e93-89d3-ddb36806582f", "address": "fa:16:3e:87:c2:cc", "network": {"id": "b18952cf-830d-47b0-920f-467ad6e971f1", "bridge": "br-int", "label": "tempest-device-tagging-net1-724382461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb47a2389-92", "ovs_interfaceid": "b47a2389-92e5-4e93-89d3-ddb36806582f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:44:06 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:c2:cc,bridge_name='br-int',has_traffic_filtering=True,id=b47a2389-92e5-4e93-89d3-ddb36806582f,network=Network(b18952cf-830d-47b0-920f-467ad6e971f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb47a2389-92') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:44:06 user nova-compute[70924]: DEBUG os_vif [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:c2:cc,bridge_name='br-int',has_traffic_filtering=True,id=b47a2389-92e5-4e93-89d3-ddb36806582f,network=Network(b18952cf-830d-47b0-920f-467ad6e971f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb47a2389-92') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 14:44:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb47a2389-92, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:44:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:44:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:06 user nova-compute[70924]: INFO os_vif [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:c2:cc,bridge_name='br-int',has_traffic_filtering=True,id=b47a2389-92e5-4e93-89d3-ddb36806582f,network=Network(b18952cf-830d-47b0-920f-467ad6e971f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb47a2389-92')
Jul 29 14:44:06 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T14:42:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-258468828',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-258468828',id=10,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8vhOVuXRjbQAFoxoAwoH8wPeKkNky0s/inopZaSY/VBTBt29RwOL3lmSODeTfAsQhH35wSIR4rsbuvFcq0Aiofsb1Txk0TNGyDZnF4CI77vmbpayOZGyAw/mvGvnUY+w==',key_name='tempest-keypair-1728574391',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:42:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5ce898102e394a1e8458ffd6635acbd3',ramdisk_id='',reservation_id='r-duicp9hg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1259288934',owner_user_name='tempest-TaggedBootDevicesTest-1259288934-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:42:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b4c56eb2047426f8e9d31f9221c49b2',uuid=7d71c003-6ad9-495f-ac65-083f07d65201,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0baed51f-cbf0-43db-9cbf-53bda0557b4c", "address": "fa:16:3e:fc:ca:c0", "network": {"id": "b18952cf-830d-47b0-920f-467ad6e971f1", "bridge": "br-int", "label": "tempest-device-tagging-net1-724382461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0baed51f-cb", "ovs_interfaceid": "0baed51f-cbf0-43db-9cbf-53bda0557b4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 14:44:06 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Converting VIF {"id": "0baed51f-cbf0-43db-9cbf-53bda0557b4c", "address": "fa:16:3e:fc:ca:c0", "network": {"id": "b18952cf-830d-47b0-920f-467ad6e971f1", "bridge": "br-int", "label": "tempest-device-tagging-net1-724382461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0baed51f-cb", "ovs_interfaceid": "0baed51f-cbf0-43db-9cbf-53bda0557b4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:44:06 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:ca:c0,bridge_name='br-int',has_traffic_filtering=True,id=0baed51f-cbf0-43db-9cbf-53bda0557b4c,network=Network(b18952cf-830d-47b0-920f-467ad6e971f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0baed51f-cb') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:44:06 user nova-compute[70924]: DEBUG os_vif [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:ca:c0,bridge_name='br-int',has_traffic_filtering=True,id=0baed51f-cbf0-43db-9cbf-53bda0557b4c,network=Network(b18952cf-830d-47b0-920f-467ad6e971f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0baed51f-cb') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 14:44:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0baed51f-cb, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:44:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:44:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:06 user nova-compute[70924]: INFO os_vif [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:ca:c0,bridge_name='br-int',has_traffic_filtering=True,id=0baed51f-cbf0-43db-9cbf-53bda0557b4c,network=Network(b18952cf-830d-47b0-920f-467ad6e971f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0baed51f-cb')
Jul 29 14:44:06 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T14:42:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-258468828',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-258468828',id=10,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8vhOVuXRjbQAFoxoAwoH8wPeKkNky0s/inopZaSY/VBTBt29RwOL3lmSODeTfAsQhH35wSIR4rsbuvFcq0Aiofsb1Txk0TNGyDZnF4CI77vmbpayOZGyAw/mvGvnUY+w==',key_name='tempest-keypair-1728574391',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:42:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5ce898102e394a1e8458ffd6635acbd3',ramdisk_id='',reservation_id='r-duicp9hg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1259288934',owner_user_name='tempest-TaggedBootDevicesTest-1259288934-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:42:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b4c56eb2047426f8e9d31f9221c49b2',uuid=7d71c003-6ad9-495f-ac65-083f07d65201,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "514c7198-3395-4795-93a8-60ea475f119b", "address": "fa:16:3e:57:7c:0d", "network": {"id": "b18952cf-830d-47b0-920f-467ad6e971f1", "bridge": "br-int", "label": "tempest-device-tagging-net1-724382461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap514c7198-33", "ovs_interfaceid": "514c7198-3395-4795-93a8-60ea475f119b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 14:44:06 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Converting VIF {"id": "514c7198-3395-4795-93a8-60ea475f119b", "address": "fa:16:3e:57:7c:0d", "network": {"id": "b18952cf-830d-47b0-920f-467ad6e971f1", "bridge": "br-int", "label": "tempest-device-tagging-net1-724382461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap514c7198-33", "ovs_interfaceid": "514c7198-3395-4795-93a8-60ea475f119b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:44:06 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:7c:0d,bridge_name='br-int',has_traffic_filtering=True,id=514c7198-3395-4795-93a8-60ea475f119b,network=Network(b18952cf-830d-47b0-920f-467ad6e971f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap514c7198-33') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:44:06 user nova-compute[70924]: DEBUG os_vif [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:7c:0d,bridge_name='br-int',has_traffic_filtering=True,id=514c7198-3395-4795-93a8-60ea475f119b,network=Network(b18952cf-830d-47b0-920f-467ad6e971f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap514c7198-33') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 14:44:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap514c7198-33, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:44:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:44:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:06 user nova-compute[70924]: INFO os_vif [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:7c:0d,bridge_name='br-int',has_traffic_filtering=True,id=514c7198-3395-4795-93a8-60ea475f119b,network=Network(b18952cf-830d-47b0-920f-467ad6e971f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap514c7198-33')
Jul 29 14:44:06 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T14:42:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-258468828',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-258468828',id=10,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8vhOVuXRjbQAFoxoAwoH8wPeKkNky0s/inopZaSY/VBTBt29RwOL3lmSODeTfAsQhH35wSIR4rsbuvFcq0Aiofsb1Txk0TNGyDZnF4CI77vmbpayOZGyAw/mvGvnUY+w==',key_name='tempest-keypair-1728574391',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:42:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5ce898102e394a1e8458ffd6635acbd3',ramdisk_id='',reservation_id='r-duicp9hg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1259288934',owner_user_name='tempest-TaggedBootDevicesTest-1259288934-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:42:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b4c56eb2047426f8e9d31f9221c49b2',uuid=7d71c003-6ad9-495f-ac65-083f07d65201,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "58e714a9-1fc7-4211-b2b6-f46e985123e8", "address": "fa:16:3e:63:6b:c0", "network": {"id": "b18952cf-830d-47b0-920f-467ad6e971f1", "bridge": "br-int", "label": "tempest-device-tagging-net1-724382461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58e714a9-1f", "ovs_interfaceid": "58e714a9-1fc7-4211-b2b6-f46e985123e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 14:44:06 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Converting VIF {"id": "58e714a9-1fc7-4211-b2b6-f46e985123e8", "address": "fa:16:3e:63:6b:c0", "network": {"id": "b18952cf-830d-47b0-920f-467ad6e971f1", "bridge": "br-int", "label": "tempest-device-tagging-net1-724382461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58e714a9-1f", "ovs_interfaceid": "58e714a9-1fc7-4211-b2b6-f46e985123e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:44:06 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:6b:c0,bridge_name='br-int',has_traffic_filtering=True,id=58e714a9-1fc7-4211-b2b6-f46e985123e8,network=Network(b18952cf-830d-47b0-920f-467ad6e971f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58e714a9-1f') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:44:06 user nova-compute[70924]: DEBUG os_vif [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:6b:c0,bridge_name='br-int',has_traffic_filtering=True,id=58e714a9-1fc7-4211-b2b6-f46e985123e8,network=Network(b18952cf-830d-47b0-920f-467ad6e971f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58e714a9-1f') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 14:44:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap58e714a9-1f, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:44:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:06 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=70924) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 29 14:44:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:44:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:06 user nova-compute[70924]: INFO os_vif [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:6b:c0,bridge_name='br-int',has_traffic_filtering=True,id=58e714a9-1fc7-4211-b2b6-f46e985123e8,network=Network(b18952cf-830d-47b0-920f-467ad6e971f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58e714a9-1f')
Jul 29 14:44:06 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T14:42:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-258468828',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-258468828',id=10,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8vhOVuXRjbQAFoxoAwoH8wPeKkNky0s/inopZaSY/VBTBt29RwOL3lmSODeTfAsQhH35wSIR4rsbuvFcq0Aiofsb1Txk0TNGyDZnF4CI77vmbpayOZGyAw/mvGvnUY+w==',key_name='tempest-keypair-1728574391',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:42:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5ce898102e394a1e8458ffd6635acbd3',ramdisk_id='',reservation_id='r-duicp9hg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1259288934',owner_user_name='tempest-TaggedBootDevicesTest-1259288934-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:42:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b4c56eb2047426f8e9d31f9221c49b2',uuid=7d71c003-6ad9-495f-ac65-083f07d65201,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ba4b82c4-18e0-4863-b47a-139f71c45e27", "address": "fa:16:3e:77:64:39", "network": {"id": "2f6d769a-c90b-4a51-a6a7-93fab40860a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-972817671", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4b82c4-18", "ovs_interfaceid": "ba4b82c4-18e0-4863-b47a-139f71c45e27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 14:44:06 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Converting VIF {"id": "ba4b82c4-18e0-4863-b47a-139f71c45e27", "address": "fa:16:3e:77:64:39", "network": {"id": "2f6d769a-c90b-4a51-a6a7-93fab40860a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-972817671", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4b82c4-18", "ovs_interfaceid": "ba4b82c4-18e0-4863-b47a-139f71c45e27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:44:06 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:64:39,bridge_name='br-int',has_traffic_filtering=True,id=ba4b82c4-18e0-4863-b47a-139f71c45e27,network=Network(2f6d769a-c90b-4a51-a6a7-93fab40860a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4b82c4-18') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:44:06 user nova-compute[70924]: DEBUG os_vif [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:64:39,bridge_name='br-int',has_traffic_filtering=True,id=ba4b82c4-18e0-4863-b47a-139f71c45e27,network=Network(2f6d769a-c90b-4a51-a6a7-93fab40860a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4b82c4-18') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 14:44:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapba4b82c4-18, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:44:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:44:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:06 user nova-compute[70924]: INFO os_vif [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:64:39,bridge_name='br-int',has_traffic_filtering=True,id=ba4b82c4-18e0-4863-b47a-139f71c45e27,network=Network(2f6d769a-c90b-4a51-a6a7-93fab40860a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4b82c4-18')
Jul 29 14:44:06 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T14:42:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-258468828',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-258468828',id=10,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8vhOVuXRjbQAFoxoAwoH8wPeKkNky0s/inopZaSY/VBTBt29RwOL3lmSODeTfAsQhH35wSIR4rsbuvFcq0Aiofsb1Txk0TNGyDZnF4CI77vmbpayOZGyAw/mvGvnUY+w==',key_name='tempest-keypair-1728574391',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:42:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5ce898102e394a1e8458ffd6635acbd3',ramdisk_id='',reservation_id='r-duicp9hg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1259288934',owner_user_name='tempest-TaggedBootDevicesTest-1259288934-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:42:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b4c56eb2047426f8e9d31f9221c49b2',uuid=7d71c003-6ad9-495f-ac65-083f07d65201,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ccee8ddb-f771-4238-aebc-0d9ef5eca6a1", "address": "fa:16:3e:76:86:8f", "network": {"id": "2f6d769a-c90b-4a51-a6a7-93fab40860a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-972817671", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccee8ddb-f7", "ovs_interfaceid": "ccee8ddb-f771-4238-aebc-0d9ef5eca6a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 14:44:06 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Converting VIF {"id": "ccee8ddb-f771-4238-aebc-0d9ef5eca6a1", "address": "fa:16:3e:76:86:8f", "network": {"id": "2f6d769a-c90b-4a51-a6a7-93fab40860a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-972817671", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccee8ddb-f7", "ovs_interfaceid": "ccee8ddb-f771-4238-aebc-0d9ef5eca6a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:44:06 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:86:8f,bridge_name='br-int',has_traffic_filtering=True,id=ccee8ddb-f771-4238-aebc-0d9ef5eca6a1,network=Network(2f6d769a-c90b-4a51-a6a7-93fab40860a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccee8ddb-f7') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:44:06 user nova-compute[70924]: DEBUG os_vif [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:86:8f,bridge_name='br-int',has_traffic_filtering=True,id=ccee8ddb-f771-4238-aebc-0d9ef5eca6a1,network=Network(2f6d769a-c90b-4a51-a6a7-93fab40860a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccee8ddb-f7') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 14:44:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapccee8ddb-f7, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:44:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:07 user nova-compute[70924]: INFO os_vif [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:86:8f,bridge_name='br-int',has_traffic_filtering=True,id=ccee8ddb-f771-4238-aebc-0d9ef5eca6a1,network=Network(2f6d769a-c90b-4a51-a6a7-93fab40860a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccee8ddb-f7')
Jul 29 14:44:07 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] calling os-brick to detach iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, {'target_iqns': ['iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FWyUOZqc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:44:07 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:44:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541', 0)] {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2ba1f9-80f6-4c76-b534-dacabfbe0fd8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6bb60216-0d32-464f-b727-30d5918681f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c869b286-b414-48ad-8ca1-0f52a4dc03c6]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bb60216-0d32-464f-b727-30d5918681f2 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bb60216-0d32-464f-b727-30d5918681f2 (non-flash)
Jul 29 14:44:07 user nova-compute[70924]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 (non-flash)
Jul 29 14:44:07 user nova-compute[70924]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)
Jul 29 14:44:07 user nova-compute[70924]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)
Jul 29 14:44:07 user nova-compute[70924]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)
Jul 29 14:44:07 user nova-compute[70924]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:44:07 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bb60216-0d32-464f-b727-30d5918681f2 (non-flash)
Jul 29 14:44:07 user nova-compute[70924]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 (non-flash)
Jul 29 14:44:07 user nova-compute[70924]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 (non-flash)
Jul 29 14:44:07 user nova-compute[70924]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)
Jul 29 14:44:07 user nova-compute[70924]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)
Jul 29 14:44:07 user nova-compute[70924]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:44:07 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feee4091ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541'): ({'sdb'}, set())}) {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Removing single pathed devices sdb {{(pid=70924) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] calling os-brick to detach iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, {'target_iqns': ['iqn.2010-10.org.openstack:6bb60216-0d32-464f-b727-30d5918681f2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BZsXQAFa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'volume_id': '6bb60216-0d32-464f-b727-30d5918681f2'}, None), 'kwargs': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:44:07 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:44:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[744c4246-6d4c-4f59-bfbb-62cb9457b497]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be29ad9-2217-41bb-8920-5beb8a1e788f]: (4, ('ok\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Flushing IO for device /dev/sdb {{(pid=70924) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cab8d60-f176-4f13-8f85-ee1b1f766f49]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70924) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa07059-6332-4c86-a0bd-b4713b221e3c]: (4, ('1', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] SCSI volumes sdb have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541')] {{(pid=70924) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb2f96f-84df-4a71-82c0-c269060779d2]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 -p 172.16.0.220:3260 --logout {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG nova.compute.manager [req-4e7b0f5d-6b41-4851-a189-7b4793a79144 req-29a49d86-74d4-41e2-a449-f1a8ebf8a200 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Received event network-vif-plugged-b47a2389-92e5-4e93-89d3-ddb36806582f {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-4e7b0f5d-6b41-4851-a189-7b4793a79144 req-29a49d86-74d4-41e2-a449-f1a8ebf8a200 service nova] Acquiring lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-4e7b0f5d-6b41-4851-a189-7b4793a79144 req-29a49d86-74d4-41e2-a449-f1a8ebf8a200 service nova] Lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-4e7b0f5d-6b41-4851-a189-7b4793a79144 req-29a49d86-74d4-41e2-a449-f1a8ebf8a200 service nova] Lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG nova.compute.manager [req-4e7b0f5d-6b41-4851-a189-7b4793a79144 req-29a49d86-74d4-41e2-a449-f1a8ebf8a200 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] No waiting events found dispatching network-vif-plugged-b47a2389-92e5-4e93-89d3-ddb36806582f {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:44:07 user nova-compute[70924]: WARNING nova.compute.manager [req-4e7b0f5d-6b41-4851-a189-7b4793a79144 req-29a49d86-74d4-41e2-a449-f1a8ebf8a200 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Received unexpected event network-vif-plugged-b47a2389-92e5-4e93-89d3-ddb36806582f for instance with vm_state active and task_state deleting.
Jul 29 14:44:07 user nova-compute[70924]: DEBUG nova.compute.manager [req-4e7b0f5d-6b41-4851-a189-7b4793a79144 req-29a49d86-74d4-41e2-a449-f1a8ebf8a200 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Received event network-vif-unplugged-ccee8ddb-f771-4238-aebc-0d9ef5eca6a1 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-4e7b0f5d-6b41-4851-a189-7b4793a79144 req-29a49d86-74d4-41e2-a449-f1a8ebf8a200 service nova] Acquiring lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-4e7b0f5d-6b41-4851-a189-7b4793a79144 req-29a49d86-74d4-41e2-a449-f1a8ebf8a200 service nova] Lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-4e7b0f5d-6b41-4851-a189-7b4793a79144 req-29a49d86-74d4-41e2-a449-f1a8ebf8a200 service nova] Lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG nova.compute.manager [req-4e7b0f5d-6b41-4851-a189-7b4793a79144 req-29a49d86-74d4-41e2-a449-f1a8ebf8a200 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] No waiting events found dispatching network-vif-unplugged-ccee8ddb-f771-4238-aebc-0d9ef5eca6a1 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG nova.compute.manager [req-4e7b0f5d-6b41-4851-a189-7b4793a79144 req-29a49d86-74d4-41e2-a449-f1a8ebf8a200 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Received event network-vif-unplugged-ccee8ddb-f771-4238-aebc-0d9ef5eca6a1 for instance with task_state deleting. {{(pid=70924) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG nova.compute.manager [req-4e7b0f5d-6b41-4851-a189-7b4793a79144 req-29a49d86-74d4-41e2-a449-f1a8ebf8a200 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Received event network-vif-plugged-ccee8ddb-f771-4238-aebc-0d9ef5eca6a1 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-4e7b0f5d-6b41-4851-a189-7b4793a79144 req-29a49d86-74d4-41e2-a449-f1a8ebf8a200 service nova] Acquiring lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-4e7b0f5d-6b41-4851-a189-7b4793a79144 req-29a49d86-74d4-41e2-a449-f1a8ebf8a200 service nova] Lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-4e7b0f5d-6b41-4851-a189-7b4793a79144 req-29a49d86-74d4-41e2-a449-f1a8ebf8a200 service nova] Lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG nova.compute.manager [req-4e7b0f5d-6b41-4851-a189-7b4793a79144 req-29a49d86-74d4-41e2-a449-f1a8ebf8a200 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] No waiting events found dispatching network-vif-plugged-ccee8ddb-f771-4238-aebc-0d9ef5eca6a1 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:44:07 user nova-compute[70924]: WARNING nova.compute.manager [req-4e7b0f5d-6b41-4851-a189-7b4793a79144 req-29a49d86-74d4-41e2-a449-f1a8ebf8a200 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Received unexpected event network-vif-plugged-ccee8ddb-f771-4238-aebc-0d9ef5eca6a1 for instance with vm_state active and task_state deleting.
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4bd8f1-d1a8-40ce-88f0-f691260f83d9]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541, portal: 172.16.0.220,3260]
Jul 29 14:44:07 user nova-compute[70924]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541, portal: 172.16.0.220,3260] successful.
Jul 29 14:44:07 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 -p 172.16.0.220:3260 --op delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7edd99e-2313-40f4-a3aa-fcab98453541 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb4ecc3-3287-4f92-a66e-145586583ef6]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] <== disconnect_volume: return (327ms) None {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Disconnected iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.259s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6bb60216-0d32-464f-b727-30d5918681f2', 0)] {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] calling os-brick to detach iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, {'target_iqns': ['iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WwczfotS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:44:07 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:44:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[7136f9d7-6b40-448c-85e9-59dd5af9b776]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6bb60216-0d32-464f-b727-30d5918681f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d082d069-95ab-4659-bfab-1b2df5d755ef]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bb60216-0d32-464f-b727-30d5918681f2 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bb60216-0d32-464f-b727-30d5918681f2 (non-flash)
Jul 29 14:44:07 user nova-compute[70924]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 (non-flash)
Jul 29 14:44:07 user nova-compute[70924]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)
Jul 29 14:44:07 user nova-compute[70924]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)
Jul 29 14:44:07 user nova-compute[70924]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:44:07 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bb60216-0d32-464f-b727-30d5918681f2 (non-flash)
Jul 29 14:44:07 user nova-compute[70924]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 (non-flash)
Jul 29 14:44:07 user nova-compute[70924]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)
Jul 29 14:44:07 user nova-compute[70924]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)
Jul 29 14:44:07 user nova-compute[70924]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:44:07 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feee9aa83a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6bb60216-0d32-464f-b727-30d5918681f2'): ({'sdg'}, set())}) {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] Removing single pathed devices sdg {{(pid=70924) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[42926d1c-c9fb-4cad-87f0-df6c3617eb0c]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d4b90c-80d8-4549-ae64-0f2b1a0aa5d5]: (4, ('ok\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] Flushing IO for device /dev/sdg {{(pid=70924) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[003a92d4-1f6d-46dc-a1bc-a38e1749e07b]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=70924) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG nova.compute.manager [req-9bbecb79-b3e0-4879-bc5b-f21fa717a0da req-5d24ec9b-0f09-4308-8eb6-4584fb55aba0 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Received event network-vif-plugged-be358bcd-08a6-445b-afea-9b3335a8cac1 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-9bbecb79-b3e0-4879-bc5b-f21fa717a0da req-5d24ec9b-0f09-4308-8eb6-4584fb55aba0 service nova] Acquiring lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-9bbecb79-b3e0-4879-bc5b-f21fa717a0da req-5d24ec9b-0f09-4308-8eb6-4584fb55aba0 service nova] Lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-9bbecb79-b3e0-4879-bc5b-f21fa717a0da req-5d24ec9b-0f09-4308-8eb6-4584fb55aba0 service nova] Lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG nova.compute.manager [req-9bbecb79-b3e0-4879-bc5b-f21fa717a0da req-5d24ec9b-0f09-4308-8eb6-4584fb55aba0 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] No waiting events found dispatching network-vif-plugged-be358bcd-08a6-445b-afea-9b3335a8cac1 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:44:07 user nova-compute[70924]: WARNING nova.compute.manager [req-9bbecb79-b3e0-4879-bc5b-f21fa717a0da req-5d24ec9b-0f09-4308-8eb6-4584fb55aba0 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Received unexpected event network-vif-plugged-be358bcd-08a6-445b-afea-9b3335a8cac1 for instance with vm_state active and task_state deleting.
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.059s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[109c8447-18bc-474a-988c-cd898c652036]: (4, ('1', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] SCSI volumes sdg have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6bb60216-0d32-464f-b727-30d5918681f2')] {{(pid=70924) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bb60216-0d32-464f-b727-30d5918681f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bb60216-0d32-464f-b727-30d5918681f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2150c9c7-e4be-4eaa-a17e-6e04c0e35f8a]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bb60216-0d32-464f-b727-30d5918681f2 -p 172.16.0.220:3260 --logout {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG nova.compute.manager [req-f7dc0ff4-4ac8-4edf-9576-7deda669e4ab req-923e4ad2-58ca-48a3-afcd-772f0b37e349 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Received event network-vif-plugged-0baed51f-cbf0-43db-9cbf-53bda0557b4c {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-f7dc0ff4-4ac8-4edf-9576-7deda669e4ab req-923e4ad2-58ca-48a3-afcd-772f0b37e349 service nova] Acquiring lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-f7dc0ff4-4ac8-4edf-9576-7deda669e4ab req-923e4ad2-58ca-48a3-afcd-772f0b37e349 service nova] Lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-f7dc0ff4-4ac8-4edf-9576-7deda669e4ab req-923e4ad2-58ca-48a3-afcd-772f0b37e349 service nova] Lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG nova.compute.manager [req-f7dc0ff4-4ac8-4edf-9576-7deda669e4ab req-923e4ad2-58ca-48a3-afcd-772f0b37e349 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] No waiting events found dispatching network-vif-plugged-0baed51f-cbf0-43db-9cbf-53bda0557b4c {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:44:07 user nova-compute[70924]: WARNING nova.compute.manager [req-f7dc0ff4-4ac8-4edf-9576-7deda669e4ab req-923e4ad2-58ca-48a3-afcd-772f0b37e349 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Received unexpected event network-vif-plugged-0baed51f-cbf0-43db-9cbf-53bda0557b4c for instance with vm_state active and task_state deleting.
Jul 29 14:44:07 user nova-compute[70924]: DEBUG nova.compute.manager [req-f7dc0ff4-4ac8-4edf-9576-7deda669e4ab req-923e4ad2-58ca-48a3-afcd-772f0b37e349 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Received event network-vif-unplugged-514c7198-3395-4795-93a8-60ea475f119b {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-f7dc0ff4-4ac8-4edf-9576-7deda669e4ab req-923e4ad2-58ca-48a3-afcd-772f0b37e349 service nova] Acquiring lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-f7dc0ff4-4ac8-4edf-9576-7deda669e4ab req-923e4ad2-58ca-48a3-afcd-772f0b37e349 service nova] Lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-f7dc0ff4-4ac8-4edf-9576-7deda669e4ab req-923e4ad2-58ca-48a3-afcd-772f0b37e349 service nova] Lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG nova.compute.manager [req-f7dc0ff4-4ac8-4edf-9576-7deda669e4ab req-923e4ad2-58ca-48a3-afcd-772f0b37e349 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] No waiting events found dispatching network-vif-unplugged-514c7198-3395-4795-93a8-60ea475f119b {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG nova.compute.manager [req-f7dc0ff4-4ac8-4edf-9576-7deda669e4ab req-923e4ad2-58ca-48a3-afcd-772f0b37e349 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Received event network-vif-unplugged-514c7198-3395-4795-93a8-60ea475f119b for instance with task_state deleting. {{(pid=70924) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG nova.compute.manager [req-f7dc0ff4-4ac8-4edf-9576-7deda669e4ab req-923e4ad2-58ca-48a3-afcd-772f0b37e349 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Received event network-vif-plugged-514c7198-3395-4795-93a8-60ea475f119b {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-f7dc0ff4-4ac8-4edf-9576-7deda669e4ab req-923e4ad2-58ca-48a3-afcd-772f0b37e349 service nova] Acquiring lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-f7dc0ff4-4ac8-4edf-9576-7deda669e4ab req-923e4ad2-58ca-48a3-afcd-772f0b37e349 service nova] Lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-f7dc0ff4-4ac8-4edf-9576-7deda669e4ab req-923e4ad2-58ca-48a3-afcd-772f0b37e349 service nova] Lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG nova.compute.manager [req-f7dc0ff4-4ac8-4edf-9576-7deda669e4ab req-923e4ad2-58ca-48a3-afcd-772f0b37e349 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] No waiting events found dispatching network-vif-plugged-514c7198-3395-4795-93a8-60ea475f119b {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:44:07 user nova-compute[70924]: WARNING nova.compute.manager [req-f7dc0ff4-4ac8-4edf-9576-7deda669e4ab req-923e4ad2-58ca-48a3-afcd-772f0b37e349 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Received unexpected event network-vif-plugged-514c7198-3395-4795-93a8-60ea475f119b for instance with vm_state active and task_state deleting.
Jul 29 14:44:07 user nova-compute[70924]: DEBUG nova.compute.manager [req-f7dc0ff4-4ac8-4edf-9576-7deda669e4ab req-923e4ad2-58ca-48a3-afcd-772f0b37e349 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Received event network-vif-unplugged-58e714a9-1fc7-4211-b2b6-f46e985123e8 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-f7dc0ff4-4ac8-4edf-9576-7deda669e4ab req-923e4ad2-58ca-48a3-afcd-772f0b37e349 service nova] Acquiring lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-f7dc0ff4-4ac8-4edf-9576-7deda669e4ab req-923e4ad2-58ca-48a3-afcd-772f0b37e349 service nova] Lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-f7dc0ff4-4ac8-4edf-9576-7deda669e4ab req-923e4ad2-58ca-48a3-afcd-772f0b37e349 service nova] Lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG nova.compute.manager [req-f7dc0ff4-4ac8-4edf-9576-7deda669e4ab req-923e4ad2-58ca-48a3-afcd-772f0b37e349 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] No waiting events found dispatching network-vif-unplugged-58e714a9-1fc7-4211-b2b6-f46e985123e8 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG nova.compute.manager [req-f7dc0ff4-4ac8-4edf-9576-7deda669e4ab req-923e4ad2-58ca-48a3-afcd-772f0b37e349 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Received event network-vif-unplugged-58e714a9-1fc7-4211-b2b6-f46e985123e8 for instance with task_state deleting. {{(pid=70924) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG nova.compute.manager [req-f7dc0ff4-4ac8-4edf-9576-7deda669e4ab req-923e4ad2-58ca-48a3-afcd-772f0b37e349 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Received event network-vif-plugged-58e714a9-1fc7-4211-b2b6-f46e985123e8 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-f7dc0ff4-4ac8-4edf-9576-7deda669e4ab req-923e4ad2-58ca-48a3-afcd-772f0b37e349 service nova] Acquiring lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-f7dc0ff4-4ac8-4edf-9576-7deda669e4ab req-923e4ad2-58ca-48a3-afcd-772f0b37e349 service nova] Lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-f7dc0ff4-4ac8-4edf-9576-7deda669e4ab req-923e4ad2-58ca-48a3-afcd-772f0b37e349 service nova] Lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG nova.compute.manager [req-f7dc0ff4-4ac8-4edf-9576-7deda669e4ab req-923e4ad2-58ca-48a3-afcd-772f0b37e349 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] No waiting events found dispatching network-vif-plugged-58e714a9-1fc7-4211-b2b6-f46e985123e8 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:44:07 user nova-compute[70924]: WARNING nova.compute.manager [req-f7dc0ff4-4ac8-4edf-9576-7deda669e4ab req-923e4ad2-58ca-48a3-afcd-772f0b37e349 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Received unexpected event network-vif-plugged-58e714a9-1fc7-4211-b2b6-f46e985123e8 for instance with vm_state active and task_state deleting.
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bb60216-0d32-464f-b727-30d5918681f2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5aff72a-9ff5-42cf-b35e-833a1a70db06]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:6bb60216-0d32-464f-b727-30d5918681f2, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:6bb60216-0d32-464f-b727-30d5918681f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:6bb60216-0d32-464f-b727-30d5918681f2, portal: 172.16.0.220,3260]
Jul 29 14:44:07 user nova-compute[70924]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:6bb60216-0d32-464f-b727-30d5918681f2, portal: 172.16.0.220,3260] successful.
Jul 29 14:44:07 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bb60216-0d32-464f-b727-30d5918681f2 -p 172.16.0.220:3260 --op delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bb60216-0d32-464f-b727-30d5918681f2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a3abfc-9d5f-4447-a933-9393d01288bb]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] <== disconnect_volume: return (587ms) None {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Disconnected iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.329s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6', 0)] {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[41072b46-f636-4d0f-9237-df5954758a80]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c43e9c-173f-47d1-85dc-a5b88dfa1b65]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 (non-flash)
Jul 29 14:44:07 user nova-compute[70924]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)
Jul 29 14:44:07 user nova-compute[70924]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)
Jul 29 14:44:07 user nova-compute[70924]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:44:07 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 (non-flash)
Jul 29 14:44:07 user nova-compute[70924]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 (non-flash)
Jul 29 14:44:07 user nova-compute[70924]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)
Jul 29 14:44:07 user nova-compute[70924]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:44:07 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feedc3615a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6'): ({'sdc'}, set())}) {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Removing single pathed devices sdc {{(pid=70924) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG nova.compute.manager [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zlgQFZis', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'fcbb998c-2dac-47d9-985a-d5b2a15ddaa0', 'attached_at': '', 'detached_at': '', 'volume_id': '19775624-b219-4d3e-9c48-58c1b8dfb648', 'serial'} {{(pid=70924) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG nova.compute.manager [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] swap_volume: removing Cinder connection for volume 6bb60216-0d32-464f-b727-30d5918681f2 {{(pid=70924) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2be863-e55a-4526-9529-0189520181bb]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7dffba0-dff6-490d-ab00-ea82dbddfb35]: (4, ('ok\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Flushing IO for device /dev/sdc {{(pid=70924) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e69b5e-1e21-478d-8b3a-3e532affb34d]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70924) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.033s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab1636b-acd2-4636-be73-1f970f671de6]: (4, ('1', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] SCSI volumes sdc have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6')] {{(pid=70924) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60dc249-5add-4de2-8001-46a45e87eedb]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 -p 172.16.0.220:3260 --logout {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[94498daf-c762-4ec2-a568-fb4b4e39d80e]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6, portal: 172.16.0.220,3260]
Jul 29 14:44:07 user nova-compute[70924]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6, portal: 172.16.0.220,3260] successful.
Jul 29 14:44:07 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 -p 172.16.0.220:3260 --op delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d3bc2d9-4d24-41c8-a6fc-3efcca5a8ed6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea18607-e532-4992-af6f-75deba91a01a]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] <== disconnect_volume: return (648ms) None {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Disconnected iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] calling os-brick to detach iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, {'target_iqns': ['iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jNaxkriI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:44:07 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:44:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac', 0)] {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 14:44:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0adc2d8c-42f9-4164-9f47-2e181aa445a9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[01adae47-2bc3-4308-a3d0-acb3b380f5db]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 (non-flash)
Jul 29 14:44:08 user nova-compute[70924]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)
Jul 29 14:44:08 user nova-compute[70924]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:44:08 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 (non-flash)
Jul 29 14:44:08 user nova-compute[70924]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac (non-flash)
Jul 29 14:44:08 user nova-compute[70924]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:44:08 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feee9a89360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac'): ({'sdd'}, set())}) {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Removing single pathed devices sdd {{(pid=70924) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG nova.compute.manager [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Start spawning the instance on the hypervisor. {{(pid=70924) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Creating instance directory {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 14:44:08 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Creating image(s)
Jul 29 14:44:08 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Did not create local disks {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Ensure instance console log exists: /opt/stack/data/nova/instances/02c75b00-a1b4-4ef9-ae96-bc67d8038589/console.log {{(pid=70924) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Start _get_guest_xml network_info=[{"id": "25798da4-8f4d-4db1-afd2-7fb85693bc16", "address": "fa:16:3e:59:2c:bb", "network": {"id": "d5876e18-e2af-45c2-aab5-2d0d552ebfe4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2035085552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9e5c78c1684c359cfab4e32b9c213f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25798da4-8f", "ovs_interfaceid": "25798da4-8f4d-4db1-afd2-7fb85693bc16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kNagZKpr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '02c75b00-a1b4-4ef9-ae96-bc67d8038589', 'attached_at': '', 'detached_at': '', 'volume_id': 'd8161c51-93db-4707-bf78-63cb674c3453', 'serial': 'd8161c51-93db-4707-bf78-63cb674c3453'}, 'attachment_id': '69fb18b5-b34a-4041-8752-a573d9535cc3', 'volume_type': None} {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 14:44:08 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:44:08 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:44:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] CPU controller missing on host. {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae4aac3-c712-4dd4-ac5b-91a198871ffc]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] CPU controller found on host. {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70924) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T14:36:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Flavor limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Image limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Flavor pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Image pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Got 1 possible topologies {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Calling os-brick to attach iSCSI Volume {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kNagZKpr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:44:08 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:44:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[131ee07d-09b6-4c73-8dec-e9e7bd33e522]: (4, ('ok\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Flushing IO for device /dev/sdd {{(pid=70924) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e43f845-e2bf-4e2c-a330-83b87512b50c]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70924) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4178c6-4d81-4525-b493-9a61439a0751]: (4, ('1', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] SCSI volumes sdd have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac')] {{(pid=70924) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ad169a-3496-4c55-9f09-c60bea1baf2f]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac -p 172.16.0.220:3260 --logout {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[3468acb1-b7cf-4a61-bd89-7124b49c43e0]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac, portal: 172.16.0.220,3260]
Jul 29 14:44:08 user nova-compute[70924]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac, portal: 172.16.0.220,3260] successful.
Jul 29 14:44:08 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac -p 172.16.0.220:3260 --op delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c50b760-62ce-4a33-b930-6421814feeac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1f9c9e-b6a3-4729-97ad-898c03fe415b]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] <== disconnect_volume: return (326ms) None {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Disconnected iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 14:44:08 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Deleting instance files /opt/stack/data/nova/instances/7d71c003-6ad9-495f-ac65-083f07d65201_del
Jul 29 14:44:08 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Deletion of /opt/stack/data/nova/instances/7d71c003-6ad9-495f-ac65-083f07d65201_del complete
Jul 29 14:44:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.210s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:44:08 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:44:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:44:08 user nova-compute[70924]: INFO os_brick.initiator.connectors.iscsi [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 14:44:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 -p 172.16.0.220:3260 {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e919942-b950-4bb5-b1fd-0465921df965]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 14:44:08 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 -p 172.16.0.220:3260 --interface default --op new {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[def9d179-e33f-4c70-aeab-7a17d7c21c6d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453] added\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453] added
Jul 29 14:44:08 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1cdf36-b253-4b1f-b0c9-13a5d680217e]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:08 user nova-compute[70924]: INFO nova.compute.manager [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Took 3.97 seconds to destroy the instance on the hypervisor.
Jul 29 14:44:08 user nova-compute[70924]: DEBUG oslo.service.loopingcall [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70924) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG nova.compute.manager [-] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Deallocating network for instance {{(pid=70924) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] deallocate_for_instance() {{(pid=70924) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff369529-dd7a-4e16-904f-cada3772c653]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kNagZKpr {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kNagZKpr" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e940af97-442c-4939-9877-4ad78188d527]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kNagZKpr'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a7d8ff-ee02-481e-b9c2-4f02ac0c31b7]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd5d3fe-158c-48d2-8197-a4d847d1a3bc]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 (non-flash)
Jul 29 14:44:08 user nova-compute[70924]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:44:08 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 (non-flash)
Jul 29 14:44:08 user nova-compute[70924]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:44:08 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 -p 172.16.0.220:3260 --login {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1473f2-0298-4a8d-b56e-67d49616c363]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453, portal: 172.16.0.220,3260]
Jul 29 14:44:08 user nova-compute[70924]: Login to [iface: default, target: iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453, portal: 172.16.0.220,3260] successful.
Jul 29 14:44:08 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20dd235-c5b8-4c90-95ee-23f669498e0a]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG nova.compute.manager [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] swap_volume: Updating volume 6bb60216-0d32-464f-b727-30d5918681f2 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "zlgQFZis", "auth_password": "4rbzLRsXcZVCQh", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdf", "volume_id": "19775624-b219-4d3e-9c48-58c1b8dfb648"}, "status": "reserved", "instance": "fcbb998c-2dac-47d9-985a-d5b2a15ddaa0", "attached_at": "", "detached_at": "", "volume_id": "19775624-b219-4d3e-9c48-58c1b8dfb648", "serial": "19775624-b219-4d3e-9c48-58c1b8dfb648"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '19775624-b219-4d3e-9c48-58c1b8dfb648', 'no_device': None, 'attachment_id': 'f3569d92-d71c-46bc-be47-d72d59b8540f'} {{(pid=70924) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[27727e69-28f8-49f6-95a9-2f38fb1bf77b]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 (non-flash)
Jul 29 14:44:08 user nova-compute[70924]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:44:08 user nova-compute[70924]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:44:08 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 (non-flash)
Jul 29 14:44:08 user nova-compute[70924]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:44:08 user nova-compute[70924]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:44:08 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Connected to 172.16.0.220:3260 {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] HCTL ('33', '-', '-', 0) found on session 13 with lun 0 {{(pid=70924) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70924) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-e2904a7d-007b-4716-ad25-82f61a1a5662 tempest-TestVolumeSwap-1324688708 tempest-TestVolumeSwap-1324688708-project-admin] Lock "fcbb998c-2dac-47d9-985a-d5b2a15ddaa0" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 16.084s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b3c57a3-a5bf-4305-b47b-9800004519a7]: (4, ('- - 0', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kNagZKpr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 14:44:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-dfb117d0-805e-4e44-9bb2-3d813e396f6e tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Acquiring lock "fcbb998c-2dac-47d9-985a-d5b2a15ddaa0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:44:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-dfb117d0-805e-4e44-9bb2-3d813e396f6e tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Lock "fcbb998c-2dac-47d9-985a-d5b2a15ddaa0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:44:09 user nova-compute[70924]: INFO nova.compute.manager [None req-dfb117d0-805e-4e44-9bb2-3d813e396f6e tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Detaching volume 19775624-b219-4d3e-9c48-58c1b8dfb648
Jul 29 14:44:09 user nova-compute[70924]: INFO nova.virt.block_device [None req-dfb117d0-805e-4e44-9bb2-3d813e396f6e tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Attempting to driver detach volume 19775624-b219-4d3e-9c48-58c1b8dfb648 from mountpoint /dev/vdb
Jul 29 14:44:09 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-dfb117d0-805e-4e44-9bb2-3d813e396f6e tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Attempting to detach device vdb from instance fcbb998c-2dac-47d9-985a-d5b2a15ddaa0 from the persistent domain config. {{(pid=70924) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 29 14:44:09 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-dfb117d0-805e-4e44-9bb2-3d813e396f6e tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 14:44:09 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:44:09 user nova-compute[70924]:   <source dev="/dev/sdf"/>
Jul 29 14:44:09 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 14:44:09 user nova-compute[70924]:   <serial>19775624-b219-4d3e-9c48-58c1b8dfb648</serial>
Jul 29 14:44:09 user nova-compute[70924]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 14:44:09 user nova-compute[70924]: </disk>
Jul 29 14:44:09 user nova-compute[70924]:  {{(pid=70924) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 14:44:09 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-dfb117d0-805e-4e44-9bb2-3d813e396f6e tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Successfully detached device vdb from instance fcbb998c-2dac-47d9-985a-d5b2a15ddaa0 from the persistent domain config.
Jul 29 14:44:09 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-dfb117d0-805e-4e44-9bb2-3d813e396f6e tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fcbb998c-2dac-47d9-985a-d5b2a15ddaa0 from the live domain config. {{(pid=70924) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 29 14:44:09 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-dfb117d0-805e-4e44-9bb2-3d813e396f6e tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 14:44:09 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:44:09 user nova-compute[70924]:   <source dev="/dev/sdf"/>
Jul 29 14:44:09 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 14:44:09 user nova-compute[70924]:   <serial>19775624-b219-4d3e-9c48-58c1b8dfb648</serial>
Jul 29 14:44:09 user nova-compute[70924]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 14:44:09 user nova-compute[70924]: </disk>
Jul 29 14:44:09 user nova-compute[70924]:  {{(pid=70924) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 14:44:09 user nova-compute[70924]: DEBUG nova.compute.manager [req-c465531f-c4e6-4a31-acd2-ffdc9b9a85db req-4a952df1-8379-4012-8b3d-d9ca211aa123 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Received event network-vif-unplugged-ba4b82c4-18e0-4863-b47a-139f71c45e27 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:44:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c465531f-c4e6-4a31-acd2-ffdc9b9a85db req-4a952df1-8379-4012-8b3d-d9ca211aa123 service nova] Acquiring lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:44:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c465531f-c4e6-4a31-acd2-ffdc9b9a85db req-4a952df1-8379-4012-8b3d-d9ca211aa123 service nova] Lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:44:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c465531f-c4e6-4a31-acd2-ffdc9b9a85db req-4a952df1-8379-4012-8b3d-d9ca211aa123 service nova] Lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:44:09 user nova-compute[70924]: DEBUG nova.compute.manager [req-c465531f-c4e6-4a31-acd2-ffdc9b9a85db req-4a952df1-8379-4012-8b3d-d9ca211aa123 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] No waiting events found dispatching network-vif-unplugged-ba4b82c4-18e0-4863-b47a-139f71c45e27 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:44:09 user nova-compute[70924]: DEBUG nova.compute.manager [req-c465531f-c4e6-4a31-acd2-ffdc9b9a85db req-4a952df1-8379-4012-8b3d-d9ca211aa123 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Received event network-vif-unplugged-ba4b82c4-18e0-4863-b47a-139f71c45e27 for instance with task_state deleting. {{(pid=70924) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 14:44:09 user nova-compute[70924]: DEBUG nova.compute.manager [req-c465531f-c4e6-4a31-acd2-ffdc9b9a85db req-4a952df1-8379-4012-8b3d-d9ca211aa123 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Received event network-vif-plugged-ba4b82c4-18e0-4863-b47a-139f71c45e27 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:44:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c465531f-c4e6-4a31-acd2-ffdc9b9a85db req-4a952df1-8379-4012-8b3d-d9ca211aa123 service nova] Acquiring lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:44:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c465531f-c4e6-4a31-acd2-ffdc9b9a85db req-4a952df1-8379-4012-8b3d-d9ca211aa123 service nova] Lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:44:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c465531f-c4e6-4a31-acd2-ffdc9b9a85db req-4a952df1-8379-4012-8b3d-d9ca211aa123 service nova] Lock "7d71c003-6ad9-495f-ac65-083f07d65201-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:44:09 user nova-compute[70924]: DEBUG nova.compute.manager [req-c465531f-c4e6-4a31-acd2-ffdc9b9a85db req-4a952df1-8379-4012-8b3d-d9ca211aa123 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] No waiting events found dispatching network-vif-plugged-ba4b82c4-18e0-4863-b47a-139f71c45e27 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:44:09 user nova-compute[70924]: WARNING nova.compute.manager [req-c465531f-c4e6-4a31-acd2-ffdc9b9a85db req-4a952df1-8379-4012-8b3d-d9ca211aa123 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Received unexpected event network-vif-plugged-ba4b82c4-18e0-4863-b47a-139f71c45e27 for instance with vm_state active and task_state deleting.
Jul 29 14:44:09 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:44:09 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] <== connect_volume: return (1584ms) {'type': 'block', 'scsi_wwn': '23730316336623066', 'path': '/dev/sdb'} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:44:09 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730316336623066', 'path': '/dev/sdb'} {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 14:44:09 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:43:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-796517517',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-796517517',id=13,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a9e5c78c1684c359cfab4e32b9c213f',ramdisk_id='',reservation_id='r-zsivy5aj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2089253815',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:43:53Z,user_data=None,user_id='43582a8a85c54b5e9d16d11b12bf50d4',uuid=02c75b00-a1b4-4ef9-ae96-bc67d8038589,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "25798da4-8f4d-4db1-afd2-7fb85693bc16", "address": "fa:16:3e:59:2c:bb", "network": {"id": "d5876e18-e2af-45c2-aab5-2d0d552ebfe4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2035085552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9e5c78c1684c359cfab4e32b9c213f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25798da4-8f", "ovs_interfaceid": "25798da4-8f4d-4db1-afd2-7fb85693bc16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:44:09 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Converting VIF {"id": "25798da4-8f4d-4db1-afd2-7fb85693bc16", "address": "fa:16:3e:59:2c:bb", "network": {"id": "d5876e18-e2af-45c2-aab5-2d0d552ebfe4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2035085552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9e5c78c1684c359cfab4e32b9c213f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25798da4-8f", "ovs_interfaceid": "25798da4-8f4d-4db1-afd2-7fb85693bc16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:44:09 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:2c:bb,bridge_name='br-int',has_traffic_filtering=True,id=25798da4-8f4d-4db1-afd2-7fb85693bc16,network=Network(d5876e18-e2af-45c2-aab5-2d0d552ebfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25798da4-8f') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:44:09 user nova-compute[70924]: DEBUG nova.objects.instance [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lazy-loading 'pci_devices' on Instance uuid 02c75b00-a1b4-4ef9-ae96-bc67d8038589 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:44:09 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] End _get_guest_xml xml=<domain type="kvm">
Jul 29 14:44:09 user nova-compute[70924]:   <uuid>02c75b00-a1b4-4ef9-ae96-bc67d8038589</uuid>
Jul 29 14:44:09 user nova-compute[70924]:   <name>instance-0000000d</name>
Jul 29 14:44:09 user nova-compute[70924]:   <memory>524288</memory>
Jul 29 14:44:09 user nova-compute[70924]:   <vcpu>1</vcpu>
Jul 29 14:44:09 user nova-compute[70924]:   <metadata>
Jul 29 14:44:09 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 14:44:09 user nova-compute[70924]:       <nova:package version="0.0.0"/>
Jul 29 14:44:09 user nova-compute[70924]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-796517517</nova:name>
Jul 29 14:44:09 user nova-compute[70924]:       <nova:creationTime>2023-07-29 14:44:08</nova:creationTime>
Jul 29 14:44:09 user nova-compute[70924]:       <nova:flavor name="m1.tiny">
Jul 29 14:44:09 user nova-compute[70924]:         <nova:memory>512</nova:memory>
Jul 29 14:44:09 user nova-compute[70924]:         <nova:disk>1</nova:disk>
Jul 29 14:44:09 user nova-compute[70924]:         <nova:swap>0</nova:swap>
Jul 29 14:44:09 user nova-compute[70924]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 14:44:09 user nova-compute[70924]:         <nova:vcpus>1</nova:vcpus>
Jul 29 14:44:09 user nova-compute[70924]:       </nova:flavor>
Jul 29 14:44:09 user nova-compute[70924]:       <nova:owner>
Jul 29 14:44:09 user nova-compute[70924]:         <nova:user uuid="43582a8a85c54b5e9d16d11b12bf50d4">tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member</nova:user>
Jul 29 14:44:09 user nova-compute[70924]:         <nova:project uuid="5a9e5c78c1684c359cfab4e32b9c213f">tempest-ServerBootFromVolumeStableRescueTest-2089253815</nova:project>
Jul 29 14:44:09 user nova-compute[70924]:       </nova:owner>
Jul 29 14:44:09 user nova-compute[70924]:       <nova:root type="image" uuid="3aba2e73-6832-404b-8bd0-d0503ce82b8c"/>
Jul 29 14:44:09 user nova-compute[70924]:       <nova:ports>
Jul 29 14:44:09 user nova-compute[70924]:         <nova:port uuid="25798da4-8f4d-4db1-afd2-7fb85693bc16">
Jul 29 14:44:09 user nova-compute[70924]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 29 14:44:09 user nova-compute[70924]:         </nova:port>
Jul 29 14:44:09 user nova-compute[70924]:       </nova:ports>
Jul 29 14:44:09 user nova-compute[70924]:     </nova:instance>
Jul 29 14:44:09 user nova-compute[70924]:   </metadata>
Jul 29 14:44:09 user nova-compute[70924]:   <sysinfo type="smbios">
Jul 29 14:44:09 user nova-compute[70924]:     <system>
Jul 29 14:44:09 user nova-compute[70924]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 14:44:09 user nova-compute[70924]:       <entry name="product">OpenStack Nova</entry>
Jul 29 14:44:09 user nova-compute[70924]:       <entry name="version">0.0.0</entry>
Jul 29 14:44:09 user nova-compute[70924]:       <entry name="serial">02c75b00-a1b4-4ef9-ae96-bc67d8038589</entry>
Jul 29 14:44:09 user nova-compute[70924]:       <entry name="uuid">02c75b00-a1b4-4ef9-ae96-bc67d8038589</entry>
Jul 29 14:44:09 user nova-compute[70924]:       <entry name="family">Virtual Machine</entry>
Jul 29 14:44:09 user nova-compute[70924]:     </system>
Jul 29 14:44:09 user nova-compute[70924]:   </sysinfo>
Jul 29 14:44:09 user nova-compute[70924]:   <os>
Jul 29 14:44:09 user nova-compute[70924]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 14:44:09 user nova-compute[70924]:     <boot dev="hd"/>
Jul 29 14:44:09 user nova-compute[70924]:     <smbios mode="sysinfo"/>
Jul 29 14:44:09 user nova-compute[70924]:   </os>
Jul 29 14:44:09 user nova-compute[70924]:   <features>
Jul 29 14:44:09 user nova-compute[70924]:     <acpi/>
Jul 29 14:44:09 user nova-compute[70924]:     <apic/>
Jul 29 14:44:09 user nova-compute[70924]:     <vmcoreinfo/>
Jul 29 14:44:09 user nova-compute[70924]:   </features>
Jul 29 14:44:09 user nova-compute[70924]:   <clock offset="utc">
Jul 29 14:44:09 user nova-compute[70924]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 14:44:09 user nova-compute[70924]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 14:44:09 user nova-compute[70924]:     <timer name="hpet" present="no"/>
Jul 29 14:44:09 user nova-compute[70924]:   </clock>
Jul 29 14:44:09 user nova-compute[70924]:   <cpu mode="custom" match="exact">
Jul 29 14:44:09 user nova-compute[70924]:     <model>Nehalem</model>
Jul 29 14:44:09 user nova-compute[70924]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 14:44:09 user nova-compute[70924]:   </cpu>
Jul 29 14:44:09 user nova-compute[70924]:   <devices>
Jul 29 14:44:09 user nova-compute[70924]:     <disk type="block" device="disk">
Jul 29 14:44:09 user nova-compute[70924]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:44:09 user nova-compute[70924]:       <source dev="/dev/sdb"/>
Jul 29 14:44:09 user nova-compute[70924]:       <target dev="vda" bus="virtio"/>
Jul 29 14:44:09 user nova-compute[70924]:       <serial>d8161c51-93db-4707-bf78-63cb674c3453</serial>
Jul 29 14:44:09 user nova-compute[70924]:     </disk>
Jul 29 14:44:09 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 14:44:09 user nova-compute[70924]:       <mac address="fa:16:3e:59:2c:bb"/>
Jul 29 14:44:09 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:44:09 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 14:44:09 user nova-compute[70924]:       <target dev="tap25798da4-8f"/>
Jul 29 14:44:09 user nova-compute[70924]:     </interface>
Jul 29 14:44:09 user nova-compute[70924]:     <serial type="pty">
Jul 29 14:44:09 user nova-compute[70924]:       <log file="/opt/stack/data/nova/instances/02c75b00-a1b4-4ef9-ae96-bc67d8038589/console.log" append="off"/>
Jul 29 14:44:09 user nova-compute[70924]:     </serial>
Jul 29 14:44:09 user nova-compute[70924]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 14:44:09 user nova-compute[70924]:     <video>
Jul 29 14:44:09 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:44:09 user nova-compute[70924]:     </video>
Jul 29 14:44:09 user nova-compute[70924]:     <rng model="virtio">
Jul 29 14:44:09 user nova-compute[70924]:       <backend model="random">/dev/urandom</backend>
Jul 29 14:44:09 user nova-compute[70924]:     </rng>
Jul 29 14:44:09 user nova-compute[70924]:     <controller type="usb" index="0" model="none"/>
Jul 29 14:44:09 user nova-compute[70924]:     <memballoon model="virtio">
Jul 29 14:44:09 user nova-compute[70924]:       <stats period="10"/>
Jul 29 14:44:09 user nova-compute[70924]:     </memballoon>
Jul 29 14:44:09 user nova-compute[70924]:   </devices>
Jul 29 14:44:09 user nova-compute[70924]: </domain>
Jul 29 14:44:09 user nova-compute[70924]:  {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 14:44:09 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:43:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-796517517',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-796517517',id=13,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a9e5c78c1684c359cfab4e32b9c213f',ramdisk_id='',reservation_id='r-zsivy5aj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2089253815',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:43:53Z,user_data=None,user_id='43582a8a85c54b5e9d16d11b12bf50d4',uuid=02c75b00-a1b4-4ef9-ae96-bc67d8038589,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "25798da4-8f4d-4db1-afd2-7fb85693bc16", "address": "fa:16:3e:59:2c:bb", "network": {"id": "d5876e18-e2af-45c2-aab5-2d0d552ebfe4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2035085552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9e5c78c1684c359cfab4e32b9c213f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25798da4-8f", "ovs_interfaceid": "25798da4-8f4d-4db1-afd2-7fb85693bc16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 14:44:09 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Converting VIF {"id": "25798da4-8f4d-4db1-afd2-7fb85693bc16", "address": "fa:16:3e:59:2c:bb", "network": {"id": "d5876e18-e2af-45c2-aab5-2d0d552ebfe4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2035085552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9e5c78c1684c359cfab4e32b9c213f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25798da4-8f", "ovs_interfaceid": "25798da4-8f4d-4db1-afd2-7fb85693bc16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:44:09 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:2c:bb,bridge_name='br-int',has_traffic_filtering=True,id=25798da4-8f4d-4db1-afd2-7fb85693bc16,network=Network(d5876e18-e2af-45c2-aab5-2d0d552ebfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25798da4-8f') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:44:09 user nova-compute[70924]: DEBUG os_vif [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:2c:bb,bridge_name='br-int',has_traffic_filtering=True,id=25798da4-8f4d-4db1-afd2-7fb85693bc16,network=Network(d5876e18-e2af-45c2-aab5-2d0d552ebfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25798da4-8f') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 14:44:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:44:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 14:44:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap25798da4-8f, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:44:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap25798da4-8f, col_values=(('external_ids', {'iface-id': '25798da4-8f4d-4db1-afd2-7fb85693bc16', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:2c:bb', 'vm-uuid': '02c75b00-a1b4-4ef9-ae96-bc67d8038589'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:44:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:44:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:09 user nova-compute[70924]: INFO os_vif [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:2c:bb,bridge_name='br-int',has_traffic_filtering=True,id=25798da4-8f4d-4db1-afd2-7fb85693bc16,network=Network(d5876e18-e2af-45c2-aab5-2d0d552ebfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25798da4-8f')
Jul 29 14:44:09 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:44:09 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] No VIF found with MAC fa:16:3e:59:2c:bb, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:44:09 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Received event <DeviceRemovedEvent: 1690641849.8866835, fcbb998c-2dac-47d9-985a-d5b2a15ddaa0 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70924) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 29 14:44:09 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-dfb117d0-805e-4e44-9bb2-3d813e396f6e tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fcbb998c-2dac-47d9-985a-d5b2a15ddaa0 {{(pid=70924) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 29 14:44:09 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-dfb117d0-805e-4e44-9bb2-3d813e396f6e tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Successfully detached device vdb from instance fcbb998c-2dac-47d9-985a-d5b2a15ddaa0 from the live domain config.
Jul 29 14:44:09 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfb117d0-805e-4e44-9bb2-3d813e396f6e tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] calling os-brick to detach iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 14:44:09 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfb117d0-805e-4e44-9bb2-3d813e396f6e tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, {'target_iqns': ['iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zlgQFZis', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': '19775624-b219-4d3e-9c48-58c1b8dfb648'}, None), 'kwargs': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:44:09 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-dfb117d0-805e-4e44-9bb2-3d813e396f6e tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:44:09 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-dfb117d0-805e-4e44-9bb2-3d813e396f6e tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:44:09 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-dfb117d0-805e-4e44-9bb2-3d813e396f6e tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:44:09 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfb117d0-805e-4e44-9bb2-3d813e396f6e tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648', 0)] {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 14:44:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:09 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0e8cb7-a2f3-4da8-88fa-5281d7b52960]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:09 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d730a21d-eb49-4e67-bf4f-fcee1037581e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:09 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfb117d0-805e-4e44-9bb2-3d813e396f6e tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 (non-flash)
Jul 29 14:44:09 user nova-compute[70924]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:44:09 user nova-compute[70924]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:44:09 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:44:09 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfb117d0-805e-4e44-9bb2-3d813e396f6e tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 (non-flash)
Jul 29 14:44:09 user nova-compute[70924]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:44:09 user nova-compute[70924]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:44:09 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:44:09 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfb117d0-805e-4e44-9bb2-3d813e396f6e tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feee771b5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648'): ({'sdf'}, set())}) {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 14:44:09 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-dfb117d0-805e-4e44-9bb2-3d813e396f6e tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Removing single pathed devices sdf {{(pid=70924) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 14:44:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:09 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[7740eb79-f690-475c-92c4-829f79920f11]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:10 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[830a0b73-a3d6-4884-84eb-e2847555e6ef]: (4, ('ok\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:10 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-dfb117d0-805e-4e44-9bb2-3d813e396f6e tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Flushing IO for device /dev/sdf {{(pid=70924) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 14:44:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:10 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[90fb5c9c-7541-487c-935d-89e2a1d67090]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:10 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-dfb117d0-805e-4e44-9bb2-3d813e396f6e tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=70924) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 14:44:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.041s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:10 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dcfe6ea-9bc7-482c-9e9d-a073f8a00e6d]: (4, ('1', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:10 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-dfb117d0-805e-4e44-9bb2-3d813e396f6e tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 14:44:10 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-dfb117d0-805e-4e44-9bb2-3d813e396f6e tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] SCSI volumes sdf have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 14:44:10 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfb117d0-805e-4e44-9bb2-3d813e396f6e tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648')] {{(pid=70924) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 14:44:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:10 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[46240bc1-ae69-4c90-8fcf-870c93386886]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:10 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfb117d0-805e-4e44-9bb2-3d813e396f6e tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:44:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 -p 172.16.0.220:3260 --logout {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:10 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e294554-c02d-41cd-a1d2-aa3f3527fb75]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:10 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfb117d0-805e-4e44-9bb2-3d813e396f6e tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648, portal: 172.16.0.220,3260]
Jul 29 14:44:10 user nova-compute[70924]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648, portal: 172.16.0.220,3260] successful.
Jul 29 14:44:10 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:44:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 -p 172.16.0.220:3260 --op delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19775624-b219-4d3e-9c48-58c1b8dfb648 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:10 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e12eae4-41a1-4bf4-af5c-405836d730b2]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:10 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfb117d0-805e-4e44-9bb2-3d813e396f6e tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:44:10 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-dfb117d0-805e-4e44-9bb2-3d813e396f6e tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:44:10 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfb117d0-805e-4e44-9bb2-3d813e396f6e tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] <== disconnect_volume: return (304ms) None {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:44:10 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfb117d0-805e-4e44-9bb2-3d813e396f6e tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Disconnected iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 14:44:10 user nova-compute[70924]: DEBUG nova.compute.manager [req-e2f6f08c-e3af-4d9c-904c-1c154e4b0df2 req-d107ee7f-33bf-4928-b80b-74e38dc8aa89 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Received event network-vif-deleted-ba4b82c4-18e0-4863-b47a-139f71c45e27 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:44:10 user nova-compute[70924]: INFO nova.compute.manager [req-e2f6f08c-e3af-4d9c-904c-1c154e4b0df2 req-d107ee7f-33bf-4928-b80b-74e38dc8aa89 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Neutron deleted interface ba4b82c4-18e0-4863-b47a-139f71c45e27; detaching it from the instance and deleting it from the info cache
Jul 29 14:44:10 user nova-compute[70924]: DEBUG nova.network.neutron [req-e2f6f08c-e3af-4d9c-904c-1c154e4b0df2 req-d107ee7f-33bf-4928-b80b-74e38dc8aa89 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Updating instance_info_cache with network_info: [{"id": "be358bcd-08a6-445b-afea-9b3335a8cac1", "address": "fa:16:3e:57:8e:35", "network": {"id": "7fce894f-cc4f-4e5d-8bc2-c046161b14d8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1405783563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe358bcd-08", "ovs_interfaceid": "be358bcd-08a6-445b-afea-9b3335a8cac1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b47a2389-92e5-4e93-89d3-ddb36806582f", "address": "fa:16:3e:87:c2:cc", "network": {"id": "b18952cf-830d-47b0-920f-467ad6e971f1", "bridge": "br-int", "label": "tempest-device-tagging-net1-724382461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb47a2389-92", "ovs_interfaceid": "b47a2389-92e5-4e93-89d3-ddb36806582f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0baed51f-cbf0-43db-9cbf-53bda0557b4c", "address": "fa:16:3e:fc:ca:c0", "network": {"id": "b18952cf-830d-47b0-920f-467ad6e971f1", "bridge": "br-int", "label": "tempest-device-tagging-net1-724382461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0baed51f-cb", "ovs_interfaceid": "0baed51f-cbf0-43db-9cbf-53bda0557b4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "514c7198-3395-4795-93a8-60ea475f119b", "address": "fa:16:3e:57:7c:0d", "network": {"id": "b18952cf-830d-47b0-920f-467ad6e971f1", "bridge": "br-int", "label": "tempest-device-tagging-net1-724382461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap514c7198-33", "ovs_interfaceid": "514c7198-3395-4795-93a8-60ea475f119b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "58e714a9-1fc7-4211-b2b6-f46e985123e8", "address": "fa:16:3e:63:6b:c0", "network": {"id": "b18952cf-830d-47b0-920f-467ad6e971f1", "bridge": "br-int", "label": "tempest-device-tagging-net1-724382461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58e714a9-1f", "ovs_interfaceid": "58e714a9-1fc7-4211-b2b6-f46e985123e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ccee8ddb-f771-4238-aebc-0d9ef5eca6a1", "address": "fa:16:3e:76:86:8f", "network": {"id": "2f6d769a-c90b-4a51-a6a7-93fab40860a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-972817671", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccee8ddb-f7", "ovs_interfaceid": "ccee8ddb-f771-4238-aebc-0d9ef5eca6a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:44:10 user nova-compute[70924]: DEBUG nova.compute.manager [req-e2f6f08c-e3af-4d9c-904c-1c154e4b0df2 req-d107ee7f-33bf-4928-b80b-74e38dc8aa89 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Detach interface failed, port_id=ba4b82c4-18e0-4863-b47a-139f71c45e27, reason: Instance 7d71c003-6ad9-495f-ac65-083f07d65201 could not be found. {{(pid=70924) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 29 14:44:11 user nova-compute[70924]: DEBUG nova.objects.instance [None req-dfb117d0-805e-4e44-9bb2-3d813e396f6e tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Lazy-loading 'flavor' on Instance uuid fcbb998c-2dac-47d9-985a-d5b2a15ddaa0 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:44:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-dfb117d0-805e-4e44-9bb2-3d813e396f6e tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Lock "fcbb998c-2dac-47d9-985a-d5b2a15ddaa0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.771s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:44:11 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:11 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:11 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:12 user nova-compute[70924]: DEBUG nova.compute.manager [req-21d892d8-6ad6-4ca4-91b2-cebf9aeba3a4 req-aacb314d-0d95-4478-810c-e6ec2c16d6f9 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Received event network-vif-deleted-ccee8ddb-f771-4238-aebc-0d9ef5eca6a1 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:44:12 user nova-compute[70924]: INFO nova.compute.manager [req-21d892d8-6ad6-4ca4-91b2-cebf9aeba3a4 req-aacb314d-0d95-4478-810c-e6ec2c16d6f9 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Neutron deleted interface ccee8ddb-f771-4238-aebc-0d9ef5eca6a1; detaching it from the instance and deleting it from the info cache
Jul 29 14:44:12 user nova-compute[70924]: DEBUG nova.network.neutron [req-21d892d8-6ad6-4ca4-91b2-cebf9aeba3a4 req-aacb314d-0d95-4478-810c-e6ec2c16d6f9 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Updating instance_info_cache with network_info: [{"id": "be358bcd-08a6-445b-afea-9b3335a8cac1", "address": "fa:16:3e:57:8e:35", "network": {"id": "7fce894f-cc4f-4e5d-8bc2-c046161b14d8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1405783563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe358bcd-08", "ovs_interfaceid": "be358bcd-08a6-445b-afea-9b3335a8cac1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b47a2389-92e5-4e93-89d3-ddb36806582f", "address": "fa:16:3e:87:c2:cc", "network": {"id": "b18952cf-830d-47b0-920f-467ad6e971f1", "bridge": "br-int", "label": "tempest-device-tagging-net1-724382461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb47a2389-92", "ovs_interfaceid": "b47a2389-92e5-4e93-89d3-ddb36806582f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0baed51f-cbf0-43db-9cbf-53bda0557b4c", "address": "fa:16:3e:fc:ca:c0", "network": {"id": "b18952cf-830d-47b0-920f-467ad6e971f1", "bridge": "br-int", "label": "tempest-device-tagging-net1-724382461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0baed51f-cb", "ovs_interfaceid": "0baed51f-cbf0-43db-9cbf-53bda0557b4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "514c7198-3395-4795-93a8-60ea475f119b", "address": "fa:16:3e:57:7c:0d", "network": {"id": "b18952cf-830d-47b0-920f-467ad6e971f1", "bridge": "br-int", "label": "tempest-device-tagging-net1-724382461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap514c7198-33", "ovs_interfaceid": "514c7198-3395-4795-93a8-60ea475f119b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "58e714a9-1fc7-4211-b2b6-f46e985123e8", "address": "fa:16:3e:63:6b:c0", "network": {"id": "b18952cf-830d-47b0-920f-467ad6e971f1", "bridge": "br-int", "label": "tempest-device-tagging-net1-724382461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58e714a9-1f", "ovs_interfaceid": "58e714a9-1fc7-4211-b2b6-f46e985123e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:44:12 user nova-compute[70924]: DEBUG nova.compute.manager [req-21d892d8-6ad6-4ca4-91b2-cebf9aeba3a4 req-aacb314d-0d95-4478-810c-e6ec2c16d6f9 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Detach interface failed, port_id=ccee8ddb-f771-4238-aebc-0d9ef5eca6a1, reason: Instance 7d71c003-6ad9-495f-ac65-083f07d65201 could not be found. {{(pid=70924) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 29 14:44:12 user nova-compute[70924]: DEBUG nova.compute.manager [req-21d892d8-6ad6-4ca4-91b2-cebf9aeba3a4 req-aacb314d-0d95-4478-810c-e6ec2c16d6f9 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Received event network-vif-deleted-58e714a9-1fc7-4211-b2b6-f46e985123e8 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:44:12 user nova-compute[70924]: INFO nova.compute.manager [req-21d892d8-6ad6-4ca4-91b2-cebf9aeba3a4 req-aacb314d-0d95-4478-810c-e6ec2c16d6f9 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Neutron deleted interface 58e714a9-1fc7-4211-b2b6-f46e985123e8; detaching it from the instance and deleting it from the info cache
Jul 29 14:44:12 user nova-compute[70924]: DEBUG nova.network.neutron [req-21d892d8-6ad6-4ca4-91b2-cebf9aeba3a4 req-aacb314d-0d95-4478-810c-e6ec2c16d6f9 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Updating instance_info_cache with network_info: [{"id": "be358bcd-08a6-445b-afea-9b3335a8cac1", "address": "fa:16:3e:57:8e:35", "network": {"id": "7fce894f-cc4f-4e5d-8bc2-c046161b14d8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1405783563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe358bcd-08", "ovs_interfaceid": "be358bcd-08a6-445b-afea-9b3335a8cac1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b47a2389-92e5-4e93-89d3-ddb36806582f", "address": "fa:16:3e:87:c2:cc", "network": {"id": "b18952cf-830d-47b0-920f-467ad6e971f1", "bridge": "br-int", "label": "tempest-device-tagging-net1-724382461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb47a2389-92", "ovs_interfaceid": "b47a2389-92e5-4e93-89d3-ddb36806582f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0baed51f-cbf0-43db-9cbf-53bda0557b4c", "address": "fa:16:3e:fc:ca:c0", "network": {"id": "b18952cf-830d-47b0-920f-467ad6e971f1", "bridge": "br-int", "label": "tempest-device-tagging-net1-724382461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0baed51f-cb", "ovs_interfaceid": "0baed51f-cbf0-43db-9cbf-53bda0557b4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "514c7198-3395-4795-93a8-60ea475f119b", "address": "fa:16:3e:57:7c:0d", "network": {"id": "b18952cf-830d-47b0-920f-467ad6e971f1", "bridge": "br-int", "label": "tempest-device-tagging-net1-724382461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap514c7198-33", "ovs_interfaceid": "514c7198-3395-4795-93a8-60ea475f119b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:44:12 user nova-compute[70924]: DEBUG nova.compute.manager [req-21d892d8-6ad6-4ca4-91b2-cebf9aeba3a4 req-aacb314d-0d95-4478-810c-e6ec2c16d6f9 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Detach interface failed, port_id=58e714a9-1fc7-4211-b2b6-f46e985123e8, reason: Instance 7d71c003-6ad9-495f-ac65-083f07d65201 could not be found. {{(pid=70924) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 29 14:44:12 user nova-compute[70924]: DEBUG nova.compute.manager [req-21d892d8-6ad6-4ca4-91b2-cebf9aeba3a4 req-aacb314d-0d95-4478-810c-e6ec2c16d6f9 service nova] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Received event network-vif-plugged-25798da4-8f4d-4db1-afd2-7fb85693bc16 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:44:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-21d892d8-6ad6-4ca4-91b2-cebf9aeba3a4 req-aacb314d-0d95-4478-810c-e6ec2c16d6f9 service nova] Acquiring lock "02c75b00-a1b4-4ef9-ae96-bc67d8038589-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:44:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-21d892d8-6ad6-4ca4-91b2-cebf9aeba3a4 req-aacb314d-0d95-4478-810c-e6ec2c16d6f9 service nova] Lock "02c75b00-a1b4-4ef9-ae96-bc67d8038589-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:44:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-21d892d8-6ad6-4ca4-91b2-cebf9aeba3a4 req-aacb314d-0d95-4478-810c-e6ec2c16d6f9 service nova] Lock "02c75b00-a1b4-4ef9-ae96-bc67d8038589-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:44:12 user nova-compute[70924]: DEBUG nova.compute.manager [req-21d892d8-6ad6-4ca4-91b2-cebf9aeba3a4 req-aacb314d-0d95-4478-810c-e6ec2c16d6f9 service nova] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] No waiting events found dispatching network-vif-plugged-25798da4-8f4d-4db1-afd2-7fb85693bc16 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:44:12 user nova-compute[70924]: WARNING nova.compute.manager [req-21d892d8-6ad6-4ca4-91b2-cebf9aeba3a4 req-aacb314d-0d95-4478-810c-e6ec2c16d6f9 service nova] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Received unexpected event network-vif-plugged-25798da4-8f4d-4db1-afd2-7fb85693bc16 for instance with vm_state building and task_state spawning.
Jul 29 14:44:12 user nova-compute[70924]: DEBUG nova.compute.manager [req-21d892d8-6ad6-4ca4-91b2-cebf9aeba3a4 req-aacb314d-0d95-4478-810c-e6ec2c16d6f9 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Received event network-vif-deleted-514c7198-3395-4795-93a8-60ea475f119b {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:44:12 user nova-compute[70924]: INFO nova.compute.manager [req-21d892d8-6ad6-4ca4-91b2-cebf9aeba3a4 req-aacb314d-0d95-4478-810c-e6ec2c16d6f9 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Neutron deleted interface 514c7198-3395-4795-93a8-60ea475f119b; detaching it from the instance and deleting it from the info cache
Jul 29 14:44:12 user nova-compute[70924]: DEBUG nova.network.neutron [req-21d892d8-6ad6-4ca4-91b2-cebf9aeba3a4 req-aacb314d-0d95-4478-810c-e6ec2c16d6f9 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Updating instance_info_cache with network_info: [{"id": "be358bcd-08a6-445b-afea-9b3335a8cac1", "address": "fa:16:3e:57:8e:35", "network": {"id": "7fce894f-cc4f-4e5d-8bc2-c046161b14d8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1405783563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe358bcd-08", "ovs_interfaceid": "be358bcd-08a6-445b-afea-9b3335a8cac1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b47a2389-92e5-4e93-89d3-ddb36806582f", "address": "fa:16:3e:87:c2:cc", "network": {"id": "b18952cf-830d-47b0-920f-467ad6e971f1", "bridge": "br-int", "label": "tempest-device-tagging-net1-724382461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb47a2389-92", "ovs_interfaceid": "b47a2389-92e5-4e93-89d3-ddb36806582f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0baed51f-cbf0-43db-9cbf-53bda0557b4c", "address": "fa:16:3e:fc:ca:c0", "network": {"id": "b18952cf-830d-47b0-920f-467ad6e971f1", "bridge": "br-int", "label": "tempest-device-tagging-net1-724382461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce898102e394a1e8458ffd6635acbd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0baed51f-cb", "ovs_interfaceid": "0baed51f-cbf0-43db-9cbf-53bda0557b4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:44:12 user nova-compute[70924]: DEBUG nova.compute.manager [req-21d892d8-6ad6-4ca4-91b2-cebf9aeba3a4 req-aacb314d-0d95-4478-810c-e6ec2c16d6f9 service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Detach interface failed, port_id=514c7198-3395-4795-93a8-60ea475f119b, reason: Instance 7d71c003-6ad9-495f-ac65-083f07d65201 could not be found. {{(pid=70924) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 29 14:44:12 user nova-compute[70924]: DEBUG nova.compute.manager [req-21d892d8-6ad6-4ca4-91b2-cebf9aeba3a4 req-aacb314d-0d95-4478-810c-e6ec2c16d6f9 service nova] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Received event network-vif-plugged-25798da4-8f4d-4db1-afd2-7fb85693bc16 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:44:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-21d892d8-6ad6-4ca4-91b2-cebf9aeba3a4 req-aacb314d-0d95-4478-810c-e6ec2c16d6f9 service nova] Acquiring lock "02c75b00-a1b4-4ef9-ae96-bc67d8038589-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:44:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-21d892d8-6ad6-4ca4-91b2-cebf9aeba3a4 req-aacb314d-0d95-4478-810c-e6ec2c16d6f9 service nova] Lock "02c75b00-a1b4-4ef9-ae96-bc67d8038589-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:44:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-21d892d8-6ad6-4ca4-91b2-cebf9aeba3a4 req-aacb314d-0d95-4478-810c-e6ec2c16d6f9 service nova] Lock "02c75b00-a1b4-4ef9-ae96-bc67d8038589-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:44:12 user nova-compute[70924]: DEBUG nova.compute.manager [req-21d892d8-6ad6-4ca4-91b2-cebf9aeba3a4 req-aacb314d-0d95-4478-810c-e6ec2c16d6f9 service nova] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] No waiting events found dispatching network-vif-plugged-25798da4-8f4d-4db1-afd2-7fb85693bc16 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:44:12 user nova-compute[70924]: WARNING nova.compute.manager [req-21d892d8-6ad6-4ca4-91b2-cebf9aeba3a4 req-aacb314d-0d95-4478-810c-e6ec2c16d6f9 service nova] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Received unexpected event network-vif-plugged-25798da4-8f4d-4db1-afd2-7fb85693bc16 for instance with vm_state building and task_state spawning.
Jul 29 14:44:12 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:44:12 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Took 4.47 seconds to deallocate network for instance.
Jul 29 14:44:12 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:13 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690641853.561383, 02c75b00-a1b4-4ef9-ae96-bc67d8038589 => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:44:13 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] VM Resumed (Lifecycle Event)
Jul 29 14:44:13 user nova-compute[70924]: DEBUG nova.compute.manager [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Instance event wait completed in 0 seconds for  {{(pid=70924) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 14:44:13 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Guest created on hypervisor {{(pid=70924) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 14:44:13 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Instance spawned successfully.
Jul 29 14:44:13 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 14:44:13 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:44:13 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Found default for hw_cdrom_bus of ide {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:44:13 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Found default for hw_disk_bus of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:44:13 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Found default for hw_input_bus of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:44:13 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Found default for hw_pointer_model of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:44:13 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Found default for hw_video_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:44:13 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Found default for hw_vif_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:44:13 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:44:13 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:44:13 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690641853.563258, 02c75b00-a1b4-4ef9-ae96-bc67d8038589 => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:44:13 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] VM Started (Lifecycle Event)
Jul 29 14:44:13 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:44:13 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:44:13 user nova-compute[70924]: INFO nova.compute.manager [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Took 5.64 seconds to spawn the instance on the hypervisor.
Jul 29 14:44:13 user nova-compute[70924]: DEBUG nova.compute.manager [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:44:13 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:44:13 user nova-compute[70924]: INFO nova.compute.manager [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Took 21.46 seconds to build instance.
Jul 29 14:44:13 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0c15c0f9-caa8-4e7b-bfe6-c67be9626b53 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "02c75b00-a1b4-4ef9-ae96-bc67d8038589" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.557s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:44:14 user nova-compute[70924]: DEBUG nova.compute.manager [req-a3192416-4485-422b-9b12-5645130b87ce req-6de49756-ba40-4eeb-ae3c-de47f7d2c09b service nova] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Received event network-vif-deleted-be358bcd-08a6-445b-afea-9b3335a8cac1 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:44:14 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:15 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:15 user nova-compute[70924]: INFO nova.compute.manager [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Took 2.32 seconds to detach 3 volumes for instance.
Jul 29 14:44:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:44:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:44:15 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:44:15 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:44:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.347s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:44:15 user nova-compute[70924]: INFO nova.scheduler.client.report [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Deleted allocations for instance 7d71c003-6ad9-495f-ac65-083f07d65201
Jul 29 14:44:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-b13a6f7a-2d37-41f3-a323-009554448865 tempest-TaggedBootDevicesTest-1259288934 tempest-TaggedBootDevicesTest-1259288934-project-member] Lock "7d71c003-6ad9-495f-ac65-083f07d65201" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.324s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:44:17 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:17 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:19 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:21 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:21 user nova-compute[70924]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690641846.5741737, 7d71c003-6ad9-495f-ac65-083f07d65201 => Stopped> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:44:21 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] VM Stopped (Lifecycle Event)
Jul 29 14:44:21 user nova-compute[70924]: DEBUG nova.compute.manager [None req-9ee12de6-d170-4faf-b20d-5e60b94d9667 None None] [instance: 7d71c003-6ad9-495f-ac65-083f07d65201] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:44:22 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Acquiring lock "0d2a0fe9-f17a-40b5-8252-6eff34fa618f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:44:22 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Lock "0d2a0fe9-f17a-40b5-8252-6eff34fa618f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:44:22 user nova-compute[70924]: DEBUG nova.compute.manager [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] Starting instance... {{(pid=70924) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 14:44:22 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:44:22 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:44:22 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70924) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 14:44:22 user nova-compute[70924]: INFO nova.compute.claims [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] Claim successful on node user
Jul 29 14:44:22 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:23 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:44:23 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:44:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.555s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:44:23 user nova-compute[70924]: DEBUG nova.compute.manager [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] Start building networks asynchronously for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 14:44:23 user nova-compute[70924]: DEBUG nova.compute.manager [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] Allocating IP information in the background. {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 14:44:23 user nova-compute[70924]: DEBUG nova.network.neutron [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] allocate_for_instance() {{(pid=70924) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 14:44:23 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 14:44:23 user nova-compute[70924]: DEBUG nova.compute.manager [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] Start building block device mappings for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 14:44:23 user nova-compute[70924]: DEBUG nova.compute.manager [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] Start spawning the instance on the hypervisor. {{(pid=70924) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 14:44:23 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] Creating instance directory {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 14:44:23 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] Creating image(s)
Jul 29 14:44:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Acquiring lock "/opt/stack/data/nova/instances/0d2a0fe9-f17a-40b5-8252-6eff34fa618f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:44:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Lock "/opt/stack/data/nova/instances/0d2a0fe9-f17a-40b5-8252-6eff34fa618f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:44:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Lock "/opt/stack/data/nova/instances/0d2a0fe9-f17a-40b5-8252-6eff34fa618f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:44:23 user nova-compute[70924]: DEBUG nova.policy [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e86112b87b2d47d88ac5fb9b6fccb31c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7e4c0801264e7794b962f8856e5734', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70924) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 14:44:23 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:23 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.166s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Acquiring lock "bd72453517468710f1de26b27fb0ea28688e9009" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:44:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:44:23 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:23 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:24 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.149s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:24 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/0d2a0fe9-f17a-40b5-8252-6eff34fa618f/disk 1073741824 {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:24 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/0d2a0fe9-f17a-40b5-8252-6eff34fa618f/disk 1073741824" returned: 0 in 0.087s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:24 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:44:24 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:24 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.147s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:24 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0d2a0fe9-f17a-40b5-8252-6eff34fa618f/disk. size=1073741824 {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 14:44:24 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d2a0fe9-f17a-40b5-8252-6eff34fa618f/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:24 user nova-compute[70924]: DEBUG nova.network.neutron [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] Successfully created port: 726bb311-0a74-419a-bbd7-007aca63f8ee {{(pid=70924) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 14:44:24 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d2a0fe9-f17a-40b5-8252-6eff34fa618f/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:24 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Cannot resize image /opt/stack/data/nova/instances/0d2a0fe9-f17a-40b5-8252-6eff34fa618f/disk to a smaller size. {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 14:44:24 user nova-compute[70924]: DEBUG nova.objects.instance [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Lazy-loading 'migration_context' on Instance uuid 0d2a0fe9-f17a-40b5-8252-6eff34fa618f {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:44:24 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] Created local disks {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 14:44:24 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] Ensure instance console log exists: /opt/stack/data/nova/instances/0d2a0fe9-f17a-40b5-8252-6eff34fa618f/console.log {{(pid=70924) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 14:44:24 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:44:24 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:44:24 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:44:24 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:25 user nova-compute[70924]: DEBUG nova.network.neutron [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] Successfully updated port: 726bb311-0a74-419a-bbd7-007aca63f8ee {{(pid=70924) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 14:44:25 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Acquiring lock "refresh_cache-0d2a0fe9-f17a-40b5-8252-6eff34fa618f" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:44:25 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Acquired lock "refresh_cache-0d2a0fe9-f17a-40b5-8252-6eff34fa618f" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:44:25 user nova-compute[70924]: DEBUG nova.network.neutron [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 14:44:25 user nova-compute[70924]: DEBUG nova.compute.manager [req-d348cbf0-5fbf-49d1-b121-fa88277fc9ec req-e65a3e22-a5da-4901-a33d-3b2877bf3188 service nova] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] Received event network-changed-726bb311-0a74-419a-bbd7-007aca63f8ee {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:44:25 user nova-compute[70924]: DEBUG nova.compute.manager [req-d348cbf0-5fbf-49d1-b121-fa88277fc9ec req-e65a3e22-a5da-4901-a33d-3b2877bf3188 service nova] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] Refreshing instance network info cache due to event network-changed-726bb311-0a74-419a-bbd7-007aca63f8ee. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:44:25 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-d348cbf0-5fbf-49d1-b121-fa88277fc9ec req-e65a3e22-a5da-4901-a33d-3b2877bf3188 service nova] Acquiring lock "refresh_cache-0d2a0fe9-f17a-40b5-8252-6eff34fa618f" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:44:25 user nova-compute[70924]: DEBUG nova.network.neutron [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] Instance cache missing network info. {{(pid=70924) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 14:44:25 user nova-compute[70924]: DEBUG nova.network.neutron [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] Updating instance_info_cache with network_info: [{"id": "726bb311-0a74-419a-bbd7-007aca63f8ee", "address": "fa:16:3e:66:a3:9f", "network": {"id": "40edab25-ab3a-4874-b47f-1ffa2b5452ee", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1511348766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c7e4c0801264e7794b962f8856e5734", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap726bb311-0a", "ovs_interfaceid": "726bb311-0a74-419a-bbd7-007aca63f8ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:44:25 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Releasing lock "refresh_cache-0d2a0fe9-f17a-40b5-8252-6eff34fa618f" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:44:25 user nova-compute[70924]: DEBUG nova.compute.manager [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] Instance network_info: |[{"id": "726bb311-0a74-419a-bbd7-007aca63f8ee", "address": "fa:16:3e:66:a3:9f", "network": {"id": "40edab25-ab3a-4874-b47f-1ffa2b5452ee", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1511348766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c7e4c0801264e7794b962f8856e5734", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap726bb311-0a", "ovs_interfaceid": "726bb311-0a74-419a-bbd7-007aca63f8ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 14:44:25 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-d348cbf0-5fbf-49d1-b121-fa88277fc9ec req-e65a3e22-a5da-4901-a33d-3b2877bf3188 service nova] Acquired lock "refresh_cache-0d2a0fe9-f17a-40b5-8252-6eff34fa618f" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:44:25 user nova-compute[70924]: DEBUG nova.network.neutron [req-d348cbf0-5fbf-49d1-b121-fa88277fc9ec req-e65a3e22-a5da-4901-a33d-3b2877bf3188 service nova] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] Refreshing network info cache for port 726bb311-0a74-419a-bbd7-007aca63f8ee {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:44:25 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] Start _get_guest_xml network_info=[{"id": "726bb311-0a74-419a-bbd7-007aca63f8ee", "address": "fa:16:3e:66:a3:9f", "network": {"id": "40edab25-ab3a-4874-b47f-1ffa2b5452ee", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1511348766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c7e4c0801264e7794b962f8856e5734", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap726bb311-0a", "ovs_interfaceid": "726bb311-0a74-419a-bbd7-007aca63f8ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '3aba2e73-6832-404b-8bd0-d0503ce82b8c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 14:44:25 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:44:25 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:44:25 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 14:44:25 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] CPU controller missing on host. {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 14:44:25 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 14:44:25 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] CPU controller found on host. {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 14:44:25 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70924) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 14:44:25 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T14:36:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 14:44:25 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Flavor limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 14:44:25 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Image limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 14:44:25 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Flavor pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 14:44:25 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Image pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 14:44:25 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 14:44:25 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 14:44:25 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 14:44:25 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Got 1 possible topologies {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 14:44:25 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 14:44:25 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 14:44:25 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:44:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-398399675',display_name='tempest-VolumesAdminNegativeTest-server-398399675',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-398399675',id=14,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c7e4c0801264e7794b962f8856e5734',ramdisk_id='',reservation_id='r-hksbuuf6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-831352148',owner_user_name='tempest-VolumesAdminNegativeTest-831352148-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:44:24Z,user_data=None,user_id='e86112b87b2d47d88ac5fb9b6fccb31c',uuid=0d2a0fe9-f17a-40b5-8252-6eff34fa618f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "726bb311-0a74-419a-bbd7-007aca63f8ee", "address": "fa:16:3e:66:a3:9f", "network": {"id": "40edab25-ab3a-4874-b47f-1ffa2b5452ee", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1511348766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c7e4c0801264e7794b962f8856e5734", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap726bb311-0a", "ovs_interfaceid": "726bb311-0a74-419a-bbd7-007aca63f8ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:44:25 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Converting VIF {"id": "726bb311-0a74-419a-bbd7-007aca63f8ee", "address": "fa:16:3e:66:a3:9f", "network": {"id": "40edab25-ab3a-4874-b47f-1ffa2b5452ee", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1511348766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c7e4c0801264e7794b962f8856e5734", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap726bb311-0a", "ovs_interfaceid": "726bb311-0a74-419a-bbd7-007aca63f8ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:44:25 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:a3:9f,bridge_name='br-int',has_traffic_filtering=True,id=726bb311-0a74-419a-bbd7-007aca63f8ee,network=Network(40edab25-ab3a-4874-b47f-1ffa2b5452ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap726bb311-0a') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:44:25 user nova-compute[70924]: DEBUG nova.objects.instance [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Lazy-loading 'pci_devices' on Instance uuid 0d2a0fe9-f17a-40b5-8252-6eff34fa618f {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:44:25 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] End _get_guest_xml xml=<domain type="kvm">
Jul 29 14:44:25 user nova-compute[70924]:   <uuid>0d2a0fe9-f17a-40b5-8252-6eff34fa618f</uuid>
Jul 29 14:44:25 user nova-compute[70924]:   <name>instance-0000000e</name>
Jul 29 14:44:25 user nova-compute[70924]:   <memory>524288</memory>
Jul 29 14:44:25 user nova-compute[70924]:   <vcpu>1</vcpu>
Jul 29 14:44:25 user nova-compute[70924]:   <metadata>
Jul 29 14:44:25 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 14:44:25 user nova-compute[70924]:       <nova:package version="0.0.0"/>
Jul 29 14:44:25 user nova-compute[70924]:       <nova:name>tempest-VolumesAdminNegativeTest-server-398399675</nova:name>
Jul 29 14:44:25 user nova-compute[70924]:       <nova:creationTime>2023-07-29 14:44:25</nova:creationTime>
Jul 29 14:44:25 user nova-compute[70924]:       <nova:flavor name="m1.tiny">
Jul 29 14:44:25 user nova-compute[70924]:         <nova:memory>512</nova:memory>
Jul 29 14:44:25 user nova-compute[70924]:         <nova:disk>1</nova:disk>
Jul 29 14:44:25 user nova-compute[70924]:         <nova:swap>0</nova:swap>
Jul 29 14:44:25 user nova-compute[70924]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 14:44:25 user nova-compute[70924]:         <nova:vcpus>1</nova:vcpus>
Jul 29 14:44:25 user nova-compute[70924]:       </nova:flavor>
Jul 29 14:44:25 user nova-compute[70924]:       <nova:owner>
Jul 29 14:44:25 user nova-compute[70924]:         <nova:user uuid="e86112b87b2d47d88ac5fb9b6fccb31c">tempest-VolumesAdminNegativeTest-831352148-project-member</nova:user>
Jul 29 14:44:25 user nova-compute[70924]:         <nova:project uuid="4c7e4c0801264e7794b962f8856e5734">tempest-VolumesAdminNegativeTest-831352148</nova:project>
Jul 29 14:44:25 user nova-compute[70924]:       </nova:owner>
Jul 29 14:44:25 user nova-compute[70924]:       <nova:root type="image" uuid="3aba2e73-6832-404b-8bd0-d0503ce82b8c"/>
Jul 29 14:44:25 user nova-compute[70924]:       <nova:ports>
Jul 29 14:44:25 user nova-compute[70924]:         <nova:port uuid="726bb311-0a74-419a-bbd7-007aca63f8ee">
Jul 29 14:44:25 user nova-compute[70924]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 29 14:44:25 user nova-compute[70924]:         </nova:port>
Jul 29 14:44:25 user nova-compute[70924]:       </nova:ports>
Jul 29 14:44:25 user nova-compute[70924]:     </nova:instance>
Jul 29 14:44:25 user nova-compute[70924]:   </metadata>
Jul 29 14:44:25 user nova-compute[70924]:   <sysinfo type="smbios">
Jul 29 14:44:25 user nova-compute[70924]:     <system>
Jul 29 14:44:25 user nova-compute[70924]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 14:44:25 user nova-compute[70924]:       <entry name="product">OpenStack Nova</entry>
Jul 29 14:44:25 user nova-compute[70924]:       <entry name="version">0.0.0</entry>
Jul 29 14:44:25 user nova-compute[70924]:       <entry name="serial">0d2a0fe9-f17a-40b5-8252-6eff34fa618f</entry>
Jul 29 14:44:25 user nova-compute[70924]:       <entry name="uuid">0d2a0fe9-f17a-40b5-8252-6eff34fa618f</entry>
Jul 29 14:44:25 user nova-compute[70924]:       <entry name="family">Virtual Machine</entry>
Jul 29 14:44:25 user nova-compute[70924]:     </system>
Jul 29 14:44:25 user nova-compute[70924]:   </sysinfo>
Jul 29 14:44:25 user nova-compute[70924]:   <os>
Jul 29 14:44:25 user nova-compute[70924]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 14:44:25 user nova-compute[70924]:     <boot dev="hd"/>
Jul 29 14:44:25 user nova-compute[70924]:     <smbios mode="sysinfo"/>
Jul 29 14:44:25 user nova-compute[70924]:   </os>
Jul 29 14:44:25 user nova-compute[70924]:   <features>
Jul 29 14:44:25 user nova-compute[70924]:     <acpi/>
Jul 29 14:44:25 user nova-compute[70924]:     <apic/>
Jul 29 14:44:25 user nova-compute[70924]:     <vmcoreinfo/>
Jul 29 14:44:25 user nova-compute[70924]:   </features>
Jul 29 14:44:25 user nova-compute[70924]:   <clock offset="utc">
Jul 29 14:44:25 user nova-compute[70924]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 14:44:25 user nova-compute[70924]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 14:44:25 user nova-compute[70924]:     <timer name="hpet" present="no"/>
Jul 29 14:44:25 user nova-compute[70924]:   </clock>
Jul 29 14:44:25 user nova-compute[70924]:   <cpu mode="custom" match="exact">
Jul 29 14:44:25 user nova-compute[70924]:     <model>Nehalem</model>
Jul 29 14:44:25 user nova-compute[70924]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 14:44:25 user nova-compute[70924]:   </cpu>
Jul 29 14:44:25 user nova-compute[70924]:   <devices>
Jul 29 14:44:25 user nova-compute[70924]:     <disk type="file" device="disk">
Jul 29 14:44:25 user nova-compute[70924]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 14:44:25 user nova-compute[70924]:       <source file="/opt/stack/data/nova/instances/0d2a0fe9-f17a-40b5-8252-6eff34fa618f/disk"/>
Jul 29 14:44:25 user nova-compute[70924]:       <target dev="vda" bus="virtio"/>
Jul 29 14:44:25 user nova-compute[70924]:     </disk>
Jul 29 14:44:25 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 14:44:25 user nova-compute[70924]:       <mac address="fa:16:3e:66:a3:9f"/>
Jul 29 14:44:25 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:44:25 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 14:44:25 user nova-compute[70924]:       <target dev="tap726bb311-0a"/>
Jul 29 14:44:25 user nova-compute[70924]:     </interface>
Jul 29 14:44:25 user nova-compute[70924]:     <serial type="pty">
Jul 29 14:44:25 user nova-compute[70924]:       <log file="/opt/stack/data/nova/instances/0d2a0fe9-f17a-40b5-8252-6eff34fa618f/console.log" append="off"/>
Jul 29 14:44:25 user nova-compute[70924]:     </serial>
Jul 29 14:44:25 user nova-compute[70924]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 14:44:25 user nova-compute[70924]:     <video>
Jul 29 14:44:25 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:44:25 user nova-compute[70924]:     </video>
Jul 29 14:44:25 user nova-compute[70924]:     <rng model="virtio">
Jul 29 14:44:25 user nova-compute[70924]:       <backend model="random">/dev/urandom</backend>
Jul 29 14:44:25 user nova-compute[70924]:     </rng>
Jul 29 14:44:25 user nova-compute[70924]:     <controller type="usb" index="0" model="none"/>
Jul 29 14:44:25 user nova-compute[70924]:     <memballoon model="virtio">
Jul 29 14:44:25 user nova-compute[70924]:       <stats period="10"/>
Jul 29 14:44:25 user nova-compute[70924]:     </memballoon>
Jul 29 14:44:25 user nova-compute[70924]:   </devices>
Jul 29 14:44:25 user nova-compute[70924]: </domain>
Jul 29 14:44:25 user nova-compute[70924]:  {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 14:44:25 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:44:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-398399675',display_name='tempest-VolumesAdminNegativeTest-server-398399675',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-398399675',id=14,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c7e4c0801264e7794b962f8856e5734',ramdisk_id='',reservation_id='r-hksbuuf6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-831352148',owner_user_name='tempest-VolumesAdminNegativeTest-831352148-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:44:24Z,user_data=None,user_id='e86112b87b2d47d88ac5fb9b6fccb31c',uuid=0d2a0fe9-f17a-40b5-8252-6eff34fa618f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "726bb311-0a74-419a-bbd7-007aca63f8ee", "address": "fa:16:3e:66:a3:9f", "network": {"id": "40edab25-ab3a-4874-b47f-1ffa2b5452ee", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1511348766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c7e4c0801264e7794b962f8856e5734", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap726bb311-0a", "ovs_interfaceid": "726bb311-0a74-419a-bbd7-007aca63f8ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 14:44:25 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Converting VIF {"id": "726bb311-0a74-419a-bbd7-007aca63f8ee", "address": "fa:16:3e:66:a3:9f", "network": {"id": "40edab25-ab3a-4874-b47f-1ffa2b5452ee", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1511348766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c7e4c0801264e7794b962f8856e5734", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap726bb311-0a", "ovs_interfaceid": "726bb311-0a74-419a-bbd7-007aca63f8ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:44:25 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:a3:9f,bridge_name='br-int',has_traffic_filtering=True,id=726bb311-0a74-419a-bbd7-007aca63f8ee,network=Network(40edab25-ab3a-4874-b47f-1ffa2b5452ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap726bb311-0a') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:44:25 user nova-compute[70924]: DEBUG os_vif [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:a3:9f,bridge_name='br-int',has_traffic_filtering=True,id=726bb311-0a74-419a-bbd7-007aca63f8ee,network=Network(40edab25-ab3a-4874-b47f-1ffa2b5452ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap726bb311-0a') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 14:44:25 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:25 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:44:25 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 14:44:25 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:25 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap726bb311-0a, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:44:25 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap726bb311-0a, col_values=(('external_ids', {'iface-id': '726bb311-0a74-419a-bbd7-007aca63f8ee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:a3:9f', 'vm-uuid': '0d2a0fe9-f17a-40b5-8252-6eff34fa618f'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:44:25 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:25 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:44:25 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:25 user nova-compute[70924]: INFO os_vif [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:a3:9f,bridge_name='br-int',has_traffic_filtering=True,id=726bb311-0a74-419a-bbd7-007aca63f8ee,network=Network(40edab25-ab3a-4874-b47f-1ffa2b5452ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap726bb311-0a')
Jul 29 14:44:25 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:44:25 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] No VIF found with MAC fa:16:3e:66:a3:9f, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:44:26 user nova-compute[70924]: DEBUG nova.network.neutron [req-d348cbf0-5fbf-49d1-b121-fa88277fc9ec req-e65a3e22-a5da-4901-a33d-3b2877bf3188 service nova] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] Updated VIF entry in instance network info cache for port 726bb311-0a74-419a-bbd7-007aca63f8ee. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:44:26 user nova-compute[70924]: DEBUG nova.network.neutron [req-d348cbf0-5fbf-49d1-b121-fa88277fc9ec req-e65a3e22-a5da-4901-a33d-3b2877bf3188 service nova] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] Updating instance_info_cache with network_info: [{"id": "726bb311-0a74-419a-bbd7-007aca63f8ee", "address": "fa:16:3e:66:a3:9f", "network": {"id": "40edab25-ab3a-4874-b47f-1ffa2b5452ee", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1511348766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c7e4c0801264e7794b962f8856e5734", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap726bb311-0a", "ovs_interfaceid": "726bb311-0a74-419a-bbd7-007aca63f8ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:44:26 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-d348cbf0-5fbf-49d1-b121-fa88277fc9ec req-e65a3e22-a5da-4901-a33d-3b2877bf3188 service nova] Releasing lock "refresh_cache-0d2a0fe9-f17a-40b5-8252-6eff34fa618f" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:44:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:27 user nova-compute[70924]: DEBUG nova.compute.manager [req-0992e56e-f46a-480d-b3ab-cbe6df3f978f req-f7cb8b76-5855-4f39-8e8f-4049a1314226 service nova] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] Received event network-vif-plugged-726bb311-0a74-419a-bbd7-007aca63f8ee {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:44:27 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-0992e56e-f46a-480d-b3ab-cbe6df3f978f req-f7cb8b76-5855-4f39-8e8f-4049a1314226 service nova] Acquiring lock "0d2a0fe9-f17a-40b5-8252-6eff34fa618f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:44:27 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-0992e56e-f46a-480d-b3ab-cbe6df3f978f req-f7cb8b76-5855-4f39-8e8f-4049a1314226 service nova] Lock "0d2a0fe9-f17a-40b5-8252-6eff34fa618f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:44:27 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-0992e56e-f46a-480d-b3ab-cbe6df3f978f req-f7cb8b76-5855-4f39-8e8f-4049a1314226 service nova] Lock "0d2a0fe9-f17a-40b5-8252-6eff34fa618f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:44:27 user nova-compute[70924]: DEBUG nova.compute.manager [req-0992e56e-f46a-480d-b3ab-cbe6df3f978f req-f7cb8b76-5855-4f39-8e8f-4049a1314226 service nova] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] No waiting events found dispatching network-vif-plugged-726bb311-0a74-419a-bbd7-007aca63f8ee {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:44:27 user nova-compute[70924]: WARNING nova.compute.manager [req-0992e56e-f46a-480d-b3ab-cbe6df3f978f req-f7cb8b76-5855-4f39-8e8f-4049a1314226 service nova] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] Received unexpected event network-vif-plugged-726bb311-0a74-419a-bbd7-007aca63f8ee for instance with vm_state building and task_state spawning.
Jul 29 14:44:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:29 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690641869.2345805, 0d2a0fe9-f17a-40b5-8252-6eff34fa618f => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:44:29 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] VM Resumed (Lifecycle Event)
Jul 29 14:44:29 user nova-compute[70924]: DEBUG nova.compute.manager [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] Instance event wait completed in 0 seconds for  {{(pid=70924) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 14:44:29 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] Guest created on hypervisor {{(pid=70924) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 14:44:29 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] Instance spawned successfully.
Jul 29 14:44:29 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 14:44:29 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:44:29 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] Found default for hw_cdrom_bus of ide {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:44:29 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] Found default for hw_disk_bus of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:44:29 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] Found default for hw_input_bus of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:44:29 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] Found default for hw_pointer_model of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:44:29 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] Found default for hw_video_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:44:29 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] Found default for hw_vif_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:44:29 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:44:29 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:44:29 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690641869.2347882, 0d2a0fe9-f17a-40b5-8252-6eff34fa618f => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:44:29 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] VM Started (Lifecycle Event)
Jul 29 14:44:29 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:44:29 user nova-compute[70924]: DEBUG nova.compute.manager [req-6bcaed0c-181a-4dd0-8e9e-2c1e943dade4 req-78359efe-0067-4a80-bee7-b5350b6be04f service nova] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] Received event network-vif-plugged-726bb311-0a74-419a-bbd7-007aca63f8ee {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:44:29 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-6bcaed0c-181a-4dd0-8e9e-2c1e943dade4 req-78359efe-0067-4a80-bee7-b5350b6be04f service nova] Acquiring lock "0d2a0fe9-f17a-40b5-8252-6eff34fa618f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:44:29 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-6bcaed0c-181a-4dd0-8e9e-2c1e943dade4 req-78359efe-0067-4a80-bee7-b5350b6be04f service nova] Lock "0d2a0fe9-f17a-40b5-8252-6eff34fa618f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:44:29 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-6bcaed0c-181a-4dd0-8e9e-2c1e943dade4 req-78359efe-0067-4a80-bee7-b5350b6be04f service nova] Lock "0d2a0fe9-f17a-40b5-8252-6eff34fa618f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:44:29 user nova-compute[70924]: DEBUG nova.compute.manager [req-6bcaed0c-181a-4dd0-8e9e-2c1e943dade4 req-78359efe-0067-4a80-bee7-b5350b6be04f service nova] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] No waiting events found dispatching network-vif-plugged-726bb311-0a74-419a-bbd7-007aca63f8ee {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:44:29 user nova-compute[70924]: WARNING nova.compute.manager [req-6bcaed0c-181a-4dd0-8e9e-2c1e943dade4 req-78359efe-0067-4a80-bee7-b5350b6be04f service nova] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] Received unexpected event network-vif-plugged-726bb311-0a74-419a-bbd7-007aca63f8ee for instance with vm_state building and task_state spawning.
Jul 29 14:44:29 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:44:29 user nova-compute[70924]: INFO nova.compute.manager [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] Took 5.69 seconds to spawn the instance on the hypervisor.
Jul 29 14:44:29 user nova-compute[70924]: DEBUG nova.compute.manager [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:44:29 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:44:29 user nova-compute[70924]: INFO nova.compute.manager [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] Took 6.59 seconds to build instance.
Jul 29 14:44:29 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-509cf1f4-3eef-4627-a33b-ffbfed4bcdd0 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Lock "0d2a0fe9-f17a-40b5-8252-6eff34fa618f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.689s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:44:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-67ed6d2a-aa2f-48fe-8c7d-d2ec233e4175 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Acquiring lock "a9549556-e9a7-4782-ade4-9d397d5323d0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:44:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-67ed6d2a-aa2f-48fe-8c7d-d2ec233e4175 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Lock "a9549556-e9a7-4782-ade4-9d397d5323d0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:44:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-67ed6d2a-aa2f-48fe-8c7d-d2ec233e4175 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Acquiring lock "a9549556-e9a7-4782-ade4-9d397d5323d0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:44:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-67ed6d2a-aa2f-48fe-8c7d-d2ec233e4175 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Lock "a9549556-e9a7-4782-ade4-9d397d5323d0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:44:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-67ed6d2a-aa2f-48fe-8c7d-d2ec233e4175 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Lock "a9549556-e9a7-4782-ade4-9d397d5323d0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:44:30 user nova-compute[70924]: INFO nova.compute.manager [None req-67ed6d2a-aa2f-48fe-8c7d-d2ec233e4175 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Terminating instance
Jul 29 14:44:30 user nova-compute[70924]: DEBUG nova.compute.manager [None req-67ed6d2a-aa2f-48fe-8c7d-d2ec233e4175 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Start destroying the instance on the hypervisor. {{(pid=70924) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 14:44:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:31 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Instance destroyed successfully.
Jul 29 14:44:31 user nova-compute[70924]: DEBUG nova.objects.instance [None req-67ed6d2a-aa2f-48fe-8c7d-d2ec233e4175 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Lazy-loading 'resources' on Instance uuid a9549556-e9a7-4782-ade4-9d397d5323d0 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:44:31 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-67ed6d2a-aa2f-48fe-8c7d-d2ec233e4175 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T14:41:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-850043246',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-850043246',id=8,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFowQgMXsn6ojeJst6U4SII3CK7C8iaLrF5WpK72LhkyBx1DR2/8ARcNjiYRGN2W6nR3e0I7GRFV8EHB/gQZBqjcYpW+ZSwmA+QfOaNLnctkqx//pbvW+SsaaXulcoKRlQ==',key_name='tempest-keypair-1737564447',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:41:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3f5512f71fe048c5936b9154c0e3126b',ramdisk_id='',reservation_id='r-2gg4afvj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-209058297',owner_user_name='tempest-TaggedAttachmentsTest-209058297-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:41:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a5e9a9bfa864d5f85a3a79499019d9b',uuid=a9549556-e9a7-4782-ade4-9d397d5323d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4350e95a-3892-4c83-a407-aa696585eac6", "address": "fa:16:3e:5d:b8:2a", "network": {"id": "4ca69734-4a00-4e6b-bbad-8bc03edba586", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1313665133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f5512f71fe048c5936b9154c0e3126b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4350e95a-38", "ovs_interfaceid": "4350e95a-3892-4c83-a407-aa696585eac6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 14:44:31 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-67ed6d2a-aa2f-48fe-8c7d-d2ec233e4175 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Converting VIF {"id": "4350e95a-3892-4c83-a407-aa696585eac6", "address": "fa:16:3e:5d:b8:2a", "network": {"id": "4ca69734-4a00-4e6b-bbad-8bc03edba586", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1313665133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f5512f71fe048c5936b9154c0e3126b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4350e95a-38", "ovs_interfaceid": "4350e95a-3892-4c83-a407-aa696585eac6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:44:31 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-67ed6d2a-aa2f-48fe-8c7d-d2ec233e4175 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:b8:2a,bridge_name='br-int',has_traffic_filtering=True,id=4350e95a-3892-4c83-a407-aa696585eac6,network=Network(4ca69734-4a00-4e6b-bbad-8bc03edba586),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4350e95a-38') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:44:31 user nova-compute[70924]: DEBUG os_vif [None req-67ed6d2a-aa2f-48fe-8c7d-d2ec233e4175 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:b8:2a,bridge_name='br-int',has_traffic_filtering=True,id=4350e95a-3892-4c83-a407-aa696585eac6,network=Network(4ca69734-4a00-4e6b-bbad-8bc03edba586),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4350e95a-38') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 14:44:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4350e95a-38, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:44:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:31 user nova-compute[70924]: INFO os_vif [None req-67ed6d2a-aa2f-48fe-8c7d-d2ec233e4175 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:b8:2a,bridge_name='br-int',has_traffic_filtering=True,id=4350e95a-3892-4c83-a407-aa696585eac6,network=Network(4ca69734-4a00-4e6b-bbad-8bc03edba586),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4350e95a-38')
Jul 29 14:44:31 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-67ed6d2a-aa2f-48fe-8c7d-d2ec233e4175 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Deleting instance files /opt/stack/data/nova/instances/a9549556-e9a7-4782-ade4-9d397d5323d0_del
Jul 29 14:44:31 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-67ed6d2a-aa2f-48fe-8c7d-d2ec233e4175 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Deletion of /opt/stack/data/nova/instances/a9549556-e9a7-4782-ade4-9d397d5323d0_del complete
Jul 29 14:44:31 user nova-compute[70924]: DEBUG nova.compute.manager [req-fb40880b-d253-41a9-bf25-b6c8d7ae6f46 req-49f6e157-bcde-460d-ad92-7c592fbaa089 service nova] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Received event network-vif-unplugged-4350e95a-3892-4c83-a407-aa696585eac6 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:44:31 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-fb40880b-d253-41a9-bf25-b6c8d7ae6f46 req-49f6e157-bcde-460d-ad92-7c592fbaa089 service nova] Acquiring lock "a9549556-e9a7-4782-ade4-9d397d5323d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:44:31 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-fb40880b-d253-41a9-bf25-b6c8d7ae6f46 req-49f6e157-bcde-460d-ad92-7c592fbaa089 service nova] Lock "a9549556-e9a7-4782-ade4-9d397d5323d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:44:31 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-fb40880b-d253-41a9-bf25-b6c8d7ae6f46 req-49f6e157-bcde-460d-ad92-7c592fbaa089 service nova] Lock "a9549556-e9a7-4782-ade4-9d397d5323d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:44:31 user nova-compute[70924]: DEBUG nova.compute.manager [req-fb40880b-d253-41a9-bf25-b6c8d7ae6f46 req-49f6e157-bcde-460d-ad92-7c592fbaa089 service nova] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] No waiting events found dispatching network-vif-unplugged-4350e95a-3892-4c83-a407-aa696585eac6 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:44:31 user nova-compute[70924]: DEBUG nova.compute.manager [req-fb40880b-d253-41a9-bf25-b6c8d7ae6f46 req-49f6e157-bcde-460d-ad92-7c592fbaa089 service nova] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Received event network-vif-unplugged-4350e95a-3892-4c83-a407-aa696585eac6 for instance with task_state deleting. {{(pid=70924) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 14:44:31 user nova-compute[70924]: INFO nova.compute.manager [None req-67ed6d2a-aa2f-48fe-8c7d-d2ec233e4175 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Took 0.97 seconds to destroy the instance on the hypervisor.
Jul 29 14:44:31 user nova-compute[70924]: DEBUG oslo.service.loopingcall [None req-67ed6d2a-aa2f-48fe-8c7d-d2ec233e4175 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70924) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 14:44:31 user nova-compute[70924]: DEBUG nova.compute.manager [-] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Deallocating network for instance {{(pid=70924) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 14:44:31 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] deallocate_for_instance() {{(pid=70924) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 14:44:33 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:33 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:33 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:44:33 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Took 1.58 seconds to deallocate network for instance.
Jul 29 14:44:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-67ed6d2a-aa2f-48fe-8c7d-d2ec233e4175 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:44:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-67ed6d2a-aa2f-48fe-8c7d-d2ec233e4175 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:44:33 user nova-compute[70924]: DEBUG nova.compute.manager [req-4593ec80-71ed-4e76-a3af-d3acd8f8e07f req-bfb7180a-6c0d-4280-becb-a08e9bd4b824 service nova] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Received event network-vif-plugged-4350e95a-3892-4c83-a407-aa696585eac6 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:44:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-4593ec80-71ed-4e76-a3af-d3acd8f8e07f req-bfb7180a-6c0d-4280-becb-a08e9bd4b824 service nova] Acquiring lock "a9549556-e9a7-4782-ade4-9d397d5323d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:44:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-4593ec80-71ed-4e76-a3af-d3acd8f8e07f req-bfb7180a-6c0d-4280-becb-a08e9bd4b824 service nova] Lock "a9549556-e9a7-4782-ade4-9d397d5323d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:44:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-4593ec80-71ed-4e76-a3af-d3acd8f8e07f req-bfb7180a-6c0d-4280-becb-a08e9bd4b824 service nova] Lock "a9549556-e9a7-4782-ade4-9d397d5323d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:44:33 user nova-compute[70924]: DEBUG nova.compute.manager [req-4593ec80-71ed-4e76-a3af-d3acd8f8e07f req-bfb7180a-6c0d-4280-becb-a08e9bd4b824 service nova] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] No waiting events found dispatching network-vif-plugged-4350e95a-3892-4c83-a407-aa696585eac6 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:44:33 user nova-compute[70924]: WARNING nova.compute.manager [req-4593ec80-71ed-4e76-a3af-d3acd8f8e07f req-bfb7180a-6c0d-4280-becb-a08e9bd4b824 service nova] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Received unexpected event network-vif-plugged-4350e95a-3892-4c83-a407-aa696585eac6 for instance with vm_state deleted and task_state None.
Jul 29 14:44:33 user nova-compute[70924]: DEBUG nova.compute.manager [req-4593ec80-71ed-4e76-a3af-d3acd8f8e07f req-bfb7180a-6c0d-4280-becb-a08e9bd4b824 service nova] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Received event network-vif-deleted-4350e95a-3892-4c83-a407-aa696585eac6 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:44:33 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-67ed6d2a-aa2f-48fe-8c7d-d2ec233e4175 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:44:33 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-67ed6d2a-aa2f-48fe-8c7d-d2ec233e4175 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:44:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-67ed6d2a-aa2f-48fe-8c7d-d2ec233e4175 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.453s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:44:33 user nova-compute[70924]: INFO nova.scheduler.client.report [None req-67ed6d2a-aa2f-48fe-8c7d-d2ec233e4175 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Deleted allocations for instance a9549556-e9a7-4782-ade4-9d397d5323d0
Jul 29 14:44:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-67ed6d2a-aa2f-48fe-8c7d-d2ec233e4175 tempest-TaggedAttachmentsTest-209058297 tempest-TaggedAttachmentsTest-209058297-project-member] Lock "a9549556-e9a7-4782-ade4-9d397d5323d0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.198s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:44:36 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:36 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:38 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:41 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:43 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:44:43 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:44:43 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:44:43 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:44:43 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:44:43 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Auditing locally available compute resources for user (node: user) {{(pid=70924) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 14:44:43 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:43 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:43 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:43 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:43 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 14:44:43 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcbb998c-2dac-47d9-985a-d5b2a15ddaa0/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcbb998c-2dac-47d9-985a-d5b2a15ddaa0/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcbb998c-2dac-47d9-985a-d5b2a15ddaa0/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcbb998c-2dac-47d9-985a-d5b2a15ddaa0/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:44 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 14:44:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5929dcf-8594-4323-a6f5-a322aff7c881/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5929dcf-8594-4323-a6f5-a322aff7c881/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5929dcf-8594-4323-a6f5-a322aff7c881/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5929dcf-8594-4323-a6f5-a322aff7c881/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00231136-233f-4a1b-88ff-b678482ca5bb/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00231136-233f-4a1b-88ff-b678482ca5bb/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00231136-233f-4a1b-88ff-b678482ca5bb/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00231136-233f-4a1b-88ff-b678482ca5bb/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2250b0d6-5542-4a7f-90a9-93745a776fcc/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2250b0d6-5542-4a7f-90a9-93745a776fcc/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2250b0d6-5542-4a7f-90a9-93745a776fcc/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2250b0d6-5542-4a7f-90a9-93745a776fcc/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ba37020-824a-4ae5-9836-462fe4de476b/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ba37020-824a-4ae5-9836-462fe4de476b/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ba37020-824a-4ae5-9836-462fe4de476b/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ba37020-824a-4ae5-9836-462fe4de476b/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d2a0fe9-f17a-40b5-8252-6eff34fa618f/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d2a0fe9-f17a-40b5-8252-6eff34fa618f/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d2a0fe9-f17a-40b5-8252-6eff34fa618f/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:46 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d2a0fe9-f17a-40b5-8252-6eff34fa618f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:46 user nova-compute[70924]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690641871.7005184, a9549556-e9a7-4782-ade4-9d397d5323d0 => Stopped> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:44:46 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] VM Stopped (Lifecycle Event)
Jul 29 14:44:46 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:44:46 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:44:46 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Hypervisor/Node resource view: name=user free_ram=7481MB free_disk=25.65481185913086GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70924) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 14:44:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:44:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:44:46 user nova-compute[70924]: DEBUG nova.compute.manager [None req-cbc7aab8-4b98-4795-8606-e67b8f64e490 None None] [instance: a9549556-e9a7-4782-ade4-9d397d5323d0] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:44:46 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:46 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance db656346-c4af-43da-9600-fd39f1b9e4dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:44:46 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 2250b0d6-5542-4a7f-90a9-93745a776fcc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:44:46 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance f5929dcf-8594-4323-a6f5-a322aff7c881 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:44:46 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 86ecc6cb-88a8-4572-8e41-d4c5859036a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:44:46 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 00231136-233f-4a1b-88ff-b678482ca5bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:44:46 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance fcbb998c-2dac-47d9-985a-d5b2a15ddaa0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:44:46 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 9b4c76df-f74f-43b4-968f-b730cc5b0ec6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:44:46 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 9ba37020-824a-4ae5-9836-462fe4de476b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:44:46 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 02c75b00-a1b4-4ef9-ae96-bc67d8038589 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:44:46 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 0d2a0fe9-f17a-40b5-8252-6eff34fa618f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:44:46 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 14:44:46 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 14:44:47 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:44:47 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:44:47 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Compute_service record updated for user:user {{(pid=70924) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 14:44:47 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.693s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:44:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:48 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Acquiring lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:44:48 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:44:48 user nova-compute[70924]: DEBUG nova.compute.manager [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Starting instance... {{(pid=70924) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 14:44:48 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:44:48 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:44:48 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70924) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 14:44:48 user nova-compute[70924]: INFO nova.compute.claims [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Claim successful on node user
Jul 29 14:44:48 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:44:48 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Starting heal instance info cache {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 14:44:48 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "refresh_cache-f5929dcf-8594-4323-a6f5-a322aff7c881" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:44:48 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquired lock "refresh_cache-f5929dcf-8594-4323-a6f5-a322aff7c881" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:44:48 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Forcefully refreshing network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 29 14:44:48 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-7c759860-ca8e-49be-bed8-317ab93469ca tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Acquiring lock "f5929dcf-8594-4323-a6f5-a322aff7c881" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:44:48 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-7c759860-ca8e-49be-bed8-317ab93469ca tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Lock "f5929dcf-8594-4323-a6f5-a322aff7c881" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:44:48 user nova-compute[70924]: DEBUG nova.objects.instance [None req-7c759860-ca8e-49be-bed8-317ab93469ca tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Lazy-loading 'flavor' on Instance uuid f5929dcf-8594-4323-a6f5-a322aff7c881 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:44:48 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-7c759860-ca8e-49be-bed8-317ab93469ca tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Lock "f5929dcf-8594-4323-a6f5-a322aff7c881" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:44:48 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:44:48 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:44:48 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.474s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:44:48 user nova-compute[70924]: DEBUG nova.compute.manager [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Start building networks asynchronously for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 14:44:48 user nova-compute[70924]: DEBUG nova.compute.manager [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Allocating IP information in the background. {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 14:44:48 user nova-compute[70924]: DEBUG nova.network.neutron [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] allocate_for_instance() {{(pid=70924) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 14:44:48 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 14:44:48 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-7c759860-ca8e-49be-bed8-317ab93469ca tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Acquiring lock "f5929dcf-8594-4323-a6f5-a322aff7c881" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:44:48 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-7c759860-ca8e-49be-bed8-317ab93469ca tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Lock "f5929dcf-8594-4323-a6f5-a322aff7c881" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:44:48 user nova-compute[70924]: INFO nova.compute.manager [None req-7c759860-ca8e-49be-bed8-317ab93469ca tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Attaching volume 477164fc-6cb9-4ac2-af70-40460ad69c15 to /dev/vdb
Jul 29 14:44:48 user nova-compute[70924]: DEBUG nova.compute.manager [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Start building block device mappings for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 14:44:48 user nova-compute[70924]: DEBUG os_brick.utils [None req-7c759860-ca8e-49be-bed8-317ab93469ca tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:44:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:48 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f05968-226c-48fb-86c3-ab14ee726ef5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f2127c4a30d9\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4e0a7b-e153-49d0-ac7f-8454141c3596]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:49 user nova-compute[70924]: INFO nova.virt.block_device [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Booting with volume 4a7d5e0c-d135-4dd9-be3f-8dd700523339 at /dev/vda
Jul 29 14:44:49 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Updating instance_info_cache with network_info: [{"id": "14b12f31-f886-4752-bac2-e4673c74ae85", "address": "fa:16:3e:0b:f1:80", "network": {"id": "4a3c2dab-e462-4e17-a2a3-f07747a26bbe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1820325619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b2ac23ab8cd48b390fa2047c1fd0e3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14b12f31-f8", "ovs_interfaceid": "14b12f31-f886-4752-bac2-e4673c74ae85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd2dd15-b66d-4913-9fc6-e34c6b57712a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ceea9d-0ba7-4772-b03e-72e1b330346b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-7c759860-ca8e-49be-bed8-317ab93469ca tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Running cmd (subprocess): nvme version {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-7c759860-ca8e-49be-bed8-317ab93469ca tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] 'nvme version' failed. Not Retrying. {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7c759860-ca8e-49be-bed8-317ab93469ca tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] nvme not present on system {{(pid=70924) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Releasing lock "refresh_cache-f5929dcf-8594-4323-a6f5-a322aff7c881" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Updated the network info_cache for instance {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG os_brick.utils [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70924) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:44:49 user nova-compute[70924]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 14:44:49 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b820953d-cad3-4672-84bd-db7b22a74f37]: (4, '') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-7c759860-ca8e-49be-bed8-317ab93469ca tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70924) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-7c759860-ca8e-49be-bed8-317ab93469ca tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-7c759860-ca8e-49be-bed8-317ab93469ca tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] LIGHTOS: no hostnqn found. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG os_brick.utils [None req-7c759860-ca8e-49be-bed8-317ab93469ca tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f2127c4a30d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG nova.virt.block_device [None req-7c759860-ca8e-49be-bed8-317ab93469ca tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Updating existing volume attachment record: 5cf5b994-3a52-4891-8a29-920600d1ce42 {{(pid=70924) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ab5122-0d5c-406c-b3ce-8cfec634fe36]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f2127c4a30d9\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c153ca0-0f12-473e-8686-37b7b97163a5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6753880-f38b-482f-b8b5-a352e04d752e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-98929939-0134-4c33-b07d-30611843f70a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Acquiring lock "86ecc6cb-88a8-4572-8e41-d4c5859036a6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-98929939-0134-4c33-b07d-30611843f70a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "86ecc6cb-88a8-4572-8e41-d4c5859036a6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8ac058-5d5c-4606-8faf-b70eef096445]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Running cmd (subprocess): nvme version {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] 'nvme version' failed. Not Retrying. {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG nova.policy [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '69f7b3722f784d4cb61ba6b0cf325912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87bd9746a49c4efeaea2c4b38c1b42c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70924) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] nvme not present on system {{(pid=70924) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG nova.objects.instance [None req-98929939-0134-4c33-b07d-30611843f70a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lazy-loading 'flavor' on Instance uuid 86ecc6cb-88a8-4572-8e41-d4c5859036a6 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:44:49 user nova-compute[70924]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 14:44:49 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f913bbaf-308f-4f9b-92d0-3aed6e5dc8ab]: (4, '') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70924) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] LIGHTOS: no hostnqn found. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG os_brick.utils [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] <== get_connector_properties: return (172ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f2127c4a30d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG nova.virt.block_device [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Updating existing volume attachment record: 1f41d654-d9e1-46b5-8944-0630a2957806 {{(pid=70924) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-98929939-0134-4c33-b07d-30611843f70a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "86ecc6cb-88a8-4572-8e41-d4c5859036a6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.116s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-98929939-0134-4c33-b07d-30611843f70a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Acquiring lock "86ecc6cb-88a8-4572-8e41-d4c5859036a6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-98929939-0134-4c33-b07d-30611843f70a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "86ecc6cb-88a8-4572-8e41-d4c5859036a6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:44:49 user nova-compute[70924]: INFO nova.compute.manager [None req-98929939-0134-4c33-b07d-30611843f70a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Attaching volume 45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 to /dev/vdb
Jul 29 14:44:49 user nova-compute[70924]: DEBUG os_brick.utils [None req-98929939-0134-4c33-b07d-30611843f70a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac6fcc1-32fe-4949-bd7d-4476e39cfaeb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f2127c4a30d9\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d34f53-ee5f-4f56-bbaf-1b38966cee8f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d53d85-0623-4b50-8574-b67137c98386]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[03802505-3ed5-4862-b7e1-897ded893044]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-98929939-0134-4c33-b07d-30611843f70a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Running cmd (subprocess): nvme version {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-98929939-0134-4c33-b07d-30611843f70a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] 'nvme version' failed. Not Retrying. {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.nvmeof [None req-98929939-0134-4c33-b07d-30611843f70a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] nvme not present on system {{(pid=70924) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:44:49 user nova-compute[70924]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 14:44:49 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd83cf96-f274-4cfe-b794-aae841e42336]: (4, '') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-98929939-0134-4c33-b07d-30611843f70a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70924) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-98929939-0134-4c33-b07d-30611843f70a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-98929939-0134-4c33-b07d-30611843f70a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] LIGHTOS: no hostnqn found. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG os_brick.utils [None req-98929939-0134-4c33-b07d-30611843f70a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f2127c4a30d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG nova.virt.block_device [None req-98929939-0134-4c33-b07d-30611843f70a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Updating existing volume attachment record: 41157124-f7a6-4236-9d35-eae9fc27866a {{(pid=70924) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 14:44:49 user nova-compute[70924]: DEBUG nova.network.neutron [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Successfully created port: 195c1f76-2177-4201-bb05-291d7131c3c2 {{(pid=70924) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 14:44:50 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:44:50 user nova-compute[70924]: DEBUG nova.network.neutron [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Successfully created port: 0a5aa889-f4ad-49dd-9741-ce0d161bc25f {{(pid=70924) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 14:44:51 user nova-compute[70924]: DEBUG nova.network.neutron [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Successfully created port: 2e35e8a0-e202-46d5-b854-9960de88edc2 {{(pid=70924) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 14:44:51 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:51 user nova-compute[70924]: DEBUG nova.network.neutron [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Successfully created port: 7334899f-e7c7-48d8-8c14-4fda63fea3b5 {{(pid=70924) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 14:44:52 user nova-compute[70924]: DEBUG nova.network.neutron [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Successfully created port: c6793a3b-97da-4584-a326-f1caf598cd78 {{(pid=70924) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 14:44:53 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:53 user nova-compute[70924]: DEBUG nova.network.neutron [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Successfully updated port: 195c1f76-2177-4201-bb05-291d7131c3c2 {{(pid=70924) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 14:44:53 user nova-compute[70924]: DEBUG nova.compute.manager [req-86fa3b56-89d3-410d-8f34-51a8608c0072 req-25922c50-1f77-45ec-a3a0-68eea7d8c331 service nova] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Received event network-changed-325110be-cad2-4b73-9044-3028f80f3d37 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:44:53 user nova-compute[70924]: DEBUG nova.compute.manager [req-86fa3b56-89d3-410d-8f34-51a8608c0072 req-25922c50-1f77-45ec-a3a0-68eea7d8c331 service nova] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Refreshing instance network info cache due to event network-changed-325110be-cad2-4b73-9044-3028f80f3d37. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:44:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-86fa3b56-89d3-410d-8f34-51a8608c0072 req-25922c50-1f77-45ec-a3a0-68eea7d8c331 service nova] Acquiring lock "refresh_cache-9b4c76df-f74f-43b4-968f-b730cc5b0ec6" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:44:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-86fa3b56-89d3-410d-8f34-51a8608c0072 req-25922c50-1f77-45ec-a3a0-68eea7d8c331 service nova] Acquired lock "refresh_cache-9b4c76df-f74f-43b4-968f-b730cc5b0ec6" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:44:53 user nova-compute[70924]: DEBUG nova.network.neutron [req-86fa3b56-89d3-410d-8f34-51a8608c0072 req-25922c50-1f77-45ec-a3a0-68eea7d8c331 service nova] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Refreshing network info cache for port 325110be-cad2-4b73-9044-3028f80f3d37 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:44:53 user nova-compute[70924]: DEBUG nova.compute.manager [req-28445a15-16a8-4fd1-9538-b580b2d6c13a req-853fabcb-564b-4910-8414-662bb6d5b348 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received event network-changed-195c1f76-2177-4201-bb05-291d7131c3c2 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:44:53 user nova-compute[70924]: DEBUG nova.compute.manager [req-28445a15-16a8-4fd1-9538-b580b2d6c13a req-853fabcb-564b-4910-8414-662bb6d5b348 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Refreshing instance network info cache due to event network-changed-195c1f76-2177-4201-bb05-291d7131c3c2. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:44:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-28445a15-16a8-4fd1-9538-b580b2d6c13a req-853fabcb-564b-4910-8414-662bb6d5b348 service nova] Acquiring lock "refresh_cache-35bdb2dd-d2d4-4a3d-9178-6892d478dfa3" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:44:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-28445a15-16a8-4fd1-9538-b580b2d6c13a req-853fabcb-564b-4910-8414-662bb6d5b348 service nova] Acquired lock "refresh_cache-35bdb2dd-d2d4-4a3d-9178-6892d478dfa3" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:44:53 user nova-compute[70924]: DEBUG nova.network.neutron [req-28445a15-16a8-4fd1-9538-b580b2d6c13a req-853fabcb-564b-4910-8414-662bb6d5b348 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Refreshing network info cache for port 195c1f76-2177-4201-bb05-291d7131c3c2 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:44:53 user nova-compute[70924]: DEBUG nova.network.neutron [req-28445a15-16a8-4fd1-9538-b580b2d6c13a req-853fabcb-564b-4910-8414-662bb6d5b348 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Instance cache missing network info. {{(pid=70924) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 14:44:53 user nova-compute[70924]: DEBUG nova.network.neutron [req-28445a15-16a8-4fd1-9538-b580b2d6c13a req-853fabcb-564b-4910-8414-662bb6d5b348 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:44:54 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-28445a15-16a8-4fd1-9538-b580b2d6c13a req-853fabcb-564b-4910-8414-662bb6d5b348 service nova] Releasing lock "refresh_cache-35bdb2dd-d2d4-4a3d-9178-6892d478dfa3" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:44:54 user nova-compute[70924]: DEBUG nova.network.neutron [req-86fa3b56-89d3-410d-8f34-51a8608c0072 req-25922c50-1f77-45ec-a3a0-68eea7d8c331 service nova] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Updated VIF entry in instance network info cache for port 325110be-cad2-4b73-9044-3028f80f3d37. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:44:54 user nova-compute[70924]: DEBUG nova.network.neutron [req-86fa3b56-89d3-410d-8f34-51a8608c0072 req-25922c50-1f77-45ec-a3a0-68eea7d8c331 service nova] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Updating instance_info_cache with network_info: [{"id": "325110be-cad2-4b73-9044-3028f80f3d37", "address": "fa:16:3e:68:19:c4", "network": {"id": "b6631336-b322-45e0-99b7-5e95539aa674", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2109271400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc2394c924af4a9aaa925d116b2117ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap325110be-ca", "ovs_interfaceid": "325110be-cad2-4b73-9044-3028f80f3d37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:44:54 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-86fa3b56-89d3-410d-8f34-51a8608c0072 req-25922c50-1f77-45ec-a3a0-68eea7d8c331 service nova] Releasing lock "refresh_cache-9b4c76df-f74f-43b4-968f-b730cc5b0ec6" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:44:54 user nova-compute[70924]: DEBUG nova.network.neutron [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Successfully updated port: e98a5996-f4ad-44fd-9fc9-591e411bbaa1 {{(pid=70924) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 14:44:55 user nova-compute[70924]: DEBUG nova.compute.manager [req-c39d93aa-8d45-4d2f-b595-4bc3e11afdd2 req-68db8d7b-ee86-4819-9bdb-834b5073ee80 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received event network-changed-e98a5996-f4ad-44fd-9fc9-591e411bbaa1 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:44:55 user nova-compute[70924]: DEBUG nova.compute.manager [req-c39d93aa-8d45-4d2f-b595-4bc3e11afdd2 req-68db8d7b-ee86-4819-9bdb-834b5073ee80 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Refreshing instance network info cache due to event network-changed-e98a5996-f4ad-44fd-9fc9-591e411bbaa1. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:44:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c39d93aa-8d45-4d2f-b595-4bc3e11afdd2 req-68db8d7b-ee86-4819-9bdb-834b5073ee80 service nova] Acquiring lock "refresh_cache-35bdb2dd-d2d4-4a3d-9178-6892d478dfa3" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:44:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c39d93aa-8d45-4d2f-b595-4bc3e11afdd2 req-68db8d7b-ee86-4819-9bdb-834b5073ee80 service nova] Acquired lock "refresh_cache-35bdb2dd-d2d4-4a3d-9178-6892d478dfa3" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:44:55 user nova-compute[70924]: DEBUG nova.network.neutron [req-c39d93aa-8d45-4d2f-b595-4bc3e11afdd2 req-68db8d7b-ee86-4819-9bdb-834b5073ee80 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Refreshing network info cache for port e98a5996-f4ad-44fd-9fc9-591e411bbaa1 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:44:55 user nova-compute[70924]: DEBUG nova.network.neutron [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Successfully updated port: f108e5c9-68f4-4444-b686-18df097fa015 {{(pid=70924) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 14:44:56 user nova-compute[70924]: DEBUG nova.network.neutron [req-c39d93aa-8d45-4d2f-b595-4bc3e11afdd2 req-68db8d7b-ee86-4819-9bdb-834b5073ee80 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Instance cache missing network info. {{(pid=70924) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 14:44:56 user nova-compute[70924]: DEBUG nova.network.neutron [req-c39d93aa-8d45-4d2f-b595-4bc3e11afdd2 req-68db8d7b-ee86-4819-9bdb-834b5073ee80 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:44:56 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c39d93aa-8d45-4d2f-b595-4bc3e11afdd2 req-68db8d7b-ee86-4819-9bdb-834b5073ee80 service nova] Releasing lock "refresh_cache-35bdb2dd-d2d4-4a3d-9178-6892d478dfa3" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:44:56 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:56 user nova-compute[70924]: DEBUG nova.network.neutron [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Successfully updated port: 0a5aa889-f4ad-49dd-9741-ce0d161bc25f {{(pid=70924) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 14:44:56 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:56 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c759860-ca8e-49be-bed8-317ab93469ca tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Calling os-brick to attach iSCSI Volume {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 14:44:56 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c759860-ca8e-49be-bed8-317ab93469ca tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fabqzNKw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:44:56 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-7c759860-ca8e-49be-bed8-317ab93469ca tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:44:56 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-7c759860-ca8e-49be-bed8-317ab93469ca tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:44:56 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-7c759860-ca8e-49be-bed8-317ab93469ca tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:44:56 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-7c759860-ca8e-49be-bed8-317ab93469ca tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:44:56 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-7c759860-ca8e-49be-bed8-317ab93469ca tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:44:56 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-7c759860-ca8e-49be-bed8-317ab93469ca tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:44:56 user nova-compute[70924]: INFO os_brick.initiator.connectors.iscsi [None req-7c759860-ca8e-49be-bed8-317ab93469ca tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 14:44:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 -p 172.16.0.220:3260 {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:56 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05451eb-fc03-4c07-960e-a071a820f79b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:56 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c759860-ca8e-49be-bed8-317ab93469ca tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 14:44:56 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:44:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 -p 172.16.0.220:3260 --interface default --op new {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:56 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0edd4a6b-58cd-48b1-85d4-5dba263590cf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15] added\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:56 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c759860-ca8e-49be-bed8-317ab93469ca tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15] added
Jul 29 14:44:56 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:44:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:56 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4f6bb2-ce09-4ea8-b14d-508050733d35]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:56 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c759860-ca8e-49be-bed8-317ab93469ca tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:44:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:57 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4539058-93bc-4d13-8536-e984dbd28cd4]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:57 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c759860-ca8e-49be-bed8-317ab93469ca tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:44:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fabqzNKw {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fabqzNKw" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:57 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ecdf36-9f9d-466b-834b-03970cbd8bce]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:57 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c759860-ca8e-49be-bed8-317ab93469ca tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fabqzNKw'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:44:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:57 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[504b1091-52bb-4171-a6f5-aeea141128f4]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:57 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c759860-ca8e-49be-bed8-317ab93469ca tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:44:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:57 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e737131a-ac8e-420c-ac72-2a704d0f6c39]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:57 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c759860-ca8e-49be-bed8-317ab93469ca tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:44:57 user nova-compute[70924]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:44:57 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:44:57 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c759860-ca8e-49be-bed8-317ab93469ca tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:44:57 user nova-compute[70924]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:44:57 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:44:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 -p 172.16.0.220:3260 --login {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:57 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0a623d-8712-4e3f-b99d-7e7e16d866d1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:57 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c759860-ca8e-49be-bed8-317ab93469ca tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15, portal: 172.16.0.220,3260]
Jul 29 14:44:57 user nova-compute[70924]: Login to [iface: default, target: iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15, portal: 172.16.0.220,3260] successful.
Jul 29 14:44:57 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:44:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:57 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[780331cb-41ff-474e-9ca3-4535c8ed3ca3]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:57 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c759860-ca8e-49be-bed8-317ab93469ca tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:44:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:57 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d689233-db52-4886-8b29-157b4105ef41]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:57 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c759860-ca8e-49be-bed8-317ab93469ca tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:44:57 user nova-compute[70924]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)
Jul 29 14:44:57 user nova-compute[70924]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:44:57 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:44:57 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c759860-ca8e-49be-bed8-317ab93469ca tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:44:57 user nova-compute[70924]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)
Jul 29 14:44:57 user nova-compute[70924]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:44:57 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:44:57 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-7c759860-ca8e-49be-bed8-317ab93469ca tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:44:57 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c759860-ca8e-49be-bed8-317ab93469ca tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Connected to 172.16.0.220:3260 {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 14:44:57 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-7c759860-ca8e-49be-bed8-317ab93469ca tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] HCTL ('34', '-', '-', 0) found on session 14 with lun 0 {{(pid=70924) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 14:44:57 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-7c759860-ca8e-49be-bed8-317ab93469ca tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70924) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 14:44:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:57 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[170b9afc-6f3f-4653-8ea2-6fe2110b8756]: (4, ('- - 0', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:57 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-7c759860-ca8e-49be-bed8-317ab93469ca tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: None {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 14:44:57 user nova-compute[70924]: INFO nova.virt.block_device [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Booting with volume 0763aadd-e95f-4582-bb01-fcc7dc4681cb at /dev/vdb
Jul 29 14:44:57 user nova-compute[70924]: DEBUG os_brick.utils [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:44:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:57 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85b374a-0cfe-4fb1-92b3-83b20c9426d4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f2127c4a30d9\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:57 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5337738-752e-4a85-b77f-0671b02e8074]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:57 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[60684a15-0f46-426a-913d-be85fd091951]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:57 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[4833ab85-c41f-4d0d-8a08-89ff8fd6ba54]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Running cmd (subprocess): nvme version {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] 'nvme version' failed. Not Retrying. {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:44:57 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] nvme not present on system {{(pid=70924) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 14:44:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:44:57 user nova-compute[70924]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 14:44:57 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[a232ebe7-de90-4651-b9fa-4af7780b3adf]: (4, '') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:57 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70924) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 14:44:57 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 14:44:57 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] LIGHTOS: no hostnqn found. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 14:44:57 user nova-compute[70924]: DEBUG os_brick.utils [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f2127c4a30d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:44:57 user nova-compute[70924]: DEBUG nova.virt.block_device [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Updating existing volume attachment record: 10e78f1c-348d-45c5-85d0-430e3c38f765 {{(pid=70924) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 14:44:57 user nova-compute[70924]: DEBUG nova.compute.manager [req-84078193-838b-48ab-9ae0-29e64bd18ce6 req-18e46cd1-3647-4eee-b6af-97303b034a06 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received event network-changed-f108e5c9-68f4-4444-b686-18df097fa015 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:44:57 user nova-compute[70924]: DEBUG nova.compute.manager [req-84078193-838b-48ab-9ae0-29e64bd18ce6 req-18e46cd1-3647-4eee-b6af-97303b034a06 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Refreshing instance network info cache due to event network-changed-f108e5c9-68f4-4444-b686-18df097fa015. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:44:57 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-84078193-838b-48ab-9ae0-29e64bd18ce6 req-18e46cd1-3647-4eee-b6af-97303b034a06 service nova] Acquiring lock "refresh_cache-35bdb2dd-d2d4-4a3d-9178-6892d478dfa3" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:44:57 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-84078193-838b-48ab-9ae0-29e64bd18ce6 req-18e46cd1-3647-4eee-b6af-97303b034a06 service nova] Acquired lock "refresh_cache-35bdb2dd-d2d4-4a3d-9178-6892d478dfa3" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:44:57 user nova-compute[70924]: DEBUG nova.network.neutron [req-84078193-838b-48ab-9ae0-29e64bd18ce6 req-18e46cd1-3647-4eee-b6af-97303b034a06 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Refreshing network info cache for port f108e5c9-68f4-4444-b686-18df097fa015 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:44:57 user nova-compute[70924]: DEBUG nova.network.neutron [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Successfully updated port: 2e35e8a0-e202-46d5-b854-9960de88edc2 {{(pid=70924) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 14:44:57 user nova-compute[70924]: DEBUG nova.network.neutron [req-84078193-838b-48ab-9ae0-29e64bd18ce6 req-18e46cd1-3647-4eee-b6af-97303b034a06 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Instance cache missing network info. {{(pid=70924) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 14:44:57 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98929939-0134-4c33-b07d-30611843f70a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Calling os-brick to attach iSCSI Volume {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 14:44:57 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-98929939-0134-4c33-b07d-30611843f70a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uaenIoSC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:44:57 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-98929939-0134-4c33-b07d-30611843f70a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:44:57 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-98929939-0134-4c33-b07d-30611843f70a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG nova.network.neutron [req-84078193-838b-48ab-9ae0-29e64bd18ce6 req-18e46cd1-3647-4eee-b6af-97303b034a06 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-84078193-838b-48ab-9ae0-29e64bd18ce6 req-18e46cd1-3647-4eee-b6af-97303b034a06 service nova] Releasing lock "refresh_cache-35bdb2dd-d2d4-4a3d-9178-6892d478dfa3" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG nova.compute.manager [req-84078193-838b-48ab-9ae0-29e64bd18ce6 req-18e46cd1-3647-4eee-b6af-97303b034a06 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received event network-changed-0a5aa889-f4ad-49dd-9741-ce0d161bc25f {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG nova.compute.manager [req-84078193-838b-48ab-9ae0-29e64bd18ce6 req-18e46cd1-3647-4eee-b6af-97303b034a06 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Refreshing instance network info cache due to event network-changed-0a5aa889-f4ad-49dd-9741-ce0d161bc25f. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-84078193-838b-48ab-9ae0-29e64bd18ce6 req-18e46cd1-3647-4eee-b6af-97303b034a06 service nova] Acquiring lock "refresh_cache-35bdb2dd-d2d4-4a3d-9178-6892d478dfa3" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-84078193-838b-48ab-9ae0-29e64bd18ce6 req-18e46cd1-3647-4eee-b6af-97303b034a06 service nova] Acquired lock "refresh_cache-35bdb2dd-d2d4-4a3d-9178-6892d478dfa3" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG nova.network.neutron [req-84078193-838b-48ab-9ae0-29e64bd18ce6 req-18e46cd1-3647-4eee-b6af-97303b034a06 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Refreshing network info cache for port 0a5aa889-f4ad-49dd-9741-ce0d161bc25f {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:58 user nova-compute[70924]: INFO nova.compute.manager [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Rebuilding instance
Jul 29 14:44:58 user nova-compute[70924]: DEBUG nova.network.neutron [req-84078193-838b-48ab-9ae0-29e64bd18ce6 req-18e46cd1-3647-4eee-b6af-97303b034a06 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Instance cache missing network info. {{(pid=70924) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG nova.objects.instance [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9b4c76df-f74f-43b4-968f-b730cc5b0ec6 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG nova.compute.manager [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG nova.objects.instance [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Lazy-loading 'pci_requests' on Instance uuid 9b4c76df-f74f-43b4-968f-b730cc5b0ec6 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG nova.objects.instance [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Lazy-loading 'pci_devices' on Instance uuid 9b4c76df-f74f-43b4-968f-b730cc5b0ec6 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-7c759860-ca8e-49be-bed8-317ab93469ca tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c759860-ca8e-49be-bed8-317ab93469ca tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fabqzNKw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-7c759860-ca8e-49be-bed8-317ab93469ca tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c759860-ca8e-49be-bed8-317ab93469ca tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '23739373336373133', 'path': '/dev/sdc'} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c759860-ca8e-49be-bed8-317ab93469ca tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23739373336373133', 'path': '/dev/sdc'} {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG nova.objects.instance [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Lazy-loading 'resources' on Instance uuid 9b4c76df-f74f-43b4-968f-b730cc5b0ec6 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-98929939-0134-4c33-b07d-30611843f70a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.343s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:44:58 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-98929939-0134-4c33-b07d-30611843f70a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:44:58 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-98929939-0134-4c33-b07d-30611843f70a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-98929939-0134-4c33-b07d-30611843f70a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:44:58 user nova-compute[70924]: INFO os_brick.initiator.connectors.iscsi [None req-98929939-0134-4c33-b07d-30611843f70a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 14:44:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 -p 172.16.0.220:3260 {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG nova.objects.instance [None req-7c759860-ca8e-49be-bed8-317ab93469ca tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Lazy-loading 'flavor' on Instance uuid f5929dcf-8594-4323-a6f5-a322aff7c881 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG nova.objects.instance [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Lazy-loading 'migration_context' on Instance uuid 9b4c76df-f74f-43b4-968f-b730cc5b0ec6 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG nova.objects.instance [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Trying to apply a migration context that does not seem to be set for this instance {{(pid=70924) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ffc781f-0859-4ba5-a51c-dc883c50e0fd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-98929939-0134-4c33-b07d-30611843f70a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 14:44:58 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 -p 172.16.0.220:3260 --interface default --op new {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-7c759860-ca8e-49be-bed8-317ab93469ca tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] attach device xml: <disk type="block" device="disk">
Jul 29 14:44:58 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:44:58 user nova-compute[70924]:   <source dev="/dev/sdc"/>
Jul 29 14:44:58 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 14:44:58 user nova-compute[70924]:   <serial>477164fc-6cb9-4ac2-af70-40460ad69c15</serial>
Jul 29 14:44:58 user nova-compute[70924]: </disk>
Jul 29 14:44:58 user nova-compute[70924]:  {{(pid=70924) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d33c7cd-995a-47df-a377-0f6ed0d0c03f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59] added\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-98929939-0134-4c33-b07d-30611843f70a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59] added
Jul 29 14:44:58 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[be68a064-4a6f-4bb6-a6e5-73581a8390a2]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-98929939-0134-4c33-b07d-30611843f70a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c526c03f-6209-4821-8bca-8a4f38bf826a]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-98929939-0134-4c33-b07d-30611843f70a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uaenIoSC {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uaenIoSC" returned: 0 in 0.033s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7b52b3-0848-428b-8fb0-2a30b3e93fdc]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-98929939-0134-4c33-b07d-30611843f70a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uaenIoSC'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG nova.network.neutron [req-84078193-838b-48ab-9ae0-29e64bd18ce6 req-18e46cd1-3647-4eee-b6af-97303b034a06 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-84078193-838b-48ab-9ae0-29e64bd18ce6 req-18e46cd1-3647-4eee-b6af-97303b034a06 service nova] Releasing lock "refresh_cache-35bdb2dd-d2d4-4a3d-9178-6892d478dfa3" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.047s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8785c8f-5cf3-4fa3-9ba9-0dfd18030e7f]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-98929939-0134-4c33-b07d-30611843f70a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[87287c43-d21f-4195-817a-0c3ef92c95df]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-98929939-0134-4c33-b07d-30611843f70a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:44:58 user nova-compute[70924]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)
Jul 29 14:44:58 user nova-compute[70924]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:44:58 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-98929939-0134-4c33-b07d-30611843f70a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:44:58 user nova-compute[70924]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)
Jul 29 14:44:58 user nova-compute[70924]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:44:58 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 -p 172.16.0.220:3260 --login {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c74c020-dd23-4268-89a6-a3314042a1a3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-98929939-0134-4c33-b07d-30611843f70a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59, portal: 172.16.0.220,3260]
Jul 29 14:44:58 user nova-compute[70924]: Login to [iface: default, target: iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59, portal: 172.16.0.220,3260] successful.
Jul 29 14:44:58 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56de81b-dae5-4a21-a546-2a296a5d03ed]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-98929939-0134-4c33-b07d-30611843f70a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab2bd46-c779-45db-ad3e-f083f7cc051c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-98929939-0134-4c33-b07d-30611843f70a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:44:58 user nova-compute[70924]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)
Jul 29 14:44:58 user nova-compute[70924]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 (non-flash)
Jul 29 14:44:58 user nova-compute[70924]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:44:58 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-98929939-0134-4c33-b07d-30611843f70a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:44:58 user nova-compute[70924]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)
Jul 29 14:44:58 user nova-compute[70924]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 (non-flash)
Jul 29 14:44:58 user nova-compute[70924]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:44:58 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-98929939-0134-4c33-b07d-30611843f70a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.385s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-98929939-0134-4c33-b07d-30611843f70a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Connected to 172.16.0.220:3260 {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-98929939-0134-4c33-b07d-30611843f70a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] HCTL ('35', '-', '-', 0) found on session 15 with lun 0 {{(pid=70924) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-98929939-0134-4c33-b07d-30611843f70a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70924) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.038s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd863826-f75c-4060-83d2-54200ddfaffc]: (4, ('- - 0', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-98929939-0134-4c33-b07d-30611843f70a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Searching for a device in session 15 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-98929939-0134-4c33-b07d-30611843f70a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uaenIoSC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-7c759860-ca8e-49be-bed8-317ab93469ca tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-7c759860-ca8e-49be-bed8-317ab93469ca tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-7c759860-ca8e-49be-bed8-317ab93469ca tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] No VIF found with MAC fa:16:3e:0b:f1:80, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:44:58 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-7c759860-ca8e-49be-bed8-317ab93469ca tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Lock "f5929dcf-8594-4323-a6f5-a322aff7c881" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.057s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:44:59 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Instance destroyed successfully.
Jul 29 14:44:59 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Instance destroyed successfully.
Jul 29 14:44:59 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:43:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-548861444',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-557172459',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIRtdSU+MVFf8qwfTK/HOmWFsyOji10ll1mwxkAqJoexyhER2LF96x27gUwwiTyRjXgCHH8B6MegN4zey5bLI+qd4irGAGZrC8bAT7qofxp4xjUAZePgyakCsMZxbHsjfw==',key_name='tempest-keypair-1008786546',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:43:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fc2394c924af4a9aaa925d116b2117ae',ramdisk_id='',reservation_id='r-8ju02t52',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1372699391',owner_user_name='tempest-ServerActionsV293TestJSON-1372699391-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:44:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b744bbecccf48d1833ea4810b2af2d0',uuid=9b4c76df-f74f-43b4-968f-b730cc5b0ec6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "325110be-cad2-4b73-9044-3028f80f3d37", "address": "fa:16:3e:68:19:c4", "network": {"id": "b6631336-b322-45e0-99b7-5e95539aa674", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2109271400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc2394c924af4a9aaa925d116b2117ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap325110be-ca", "ovs_interfaceid": "325110be-cad2-4b73-9044-3028f80f3d37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 14:44:59 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Converting VIF {"id": "325110be-cad2-4b73-9044-3028f80f3d37", "address": "fa:16:3e:68:19:c4", "network": {"id": "b6631336-b322-45e0-99b7-5e95539aa674", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2109271400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc2394c924af4a9aaa925d116b2117ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap325110be-ca", "ovs_interfaceid": "325110be-cad2-4b73-9044-3028f80f3d37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:44:59 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:19:c4,bridge_name='br-int',has_traffic_filtering=True,id=325110be-cad2-4b73-9044-3028f80f3d37,network=Network(b6631336-b322-45e0-99b7-5e95539aa674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap325110be-ca') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:44:59 user nova-compute[70924]: DEBUG os_vif [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:19:c4,bridge_name='br-int',has_traffic_filtering=True,id=325110be-cad2-4b73-9044-3028f80f3d37,network=Network(b6631336-b322-45e0-99b7-5e95539aa674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap325110be-ca') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 14:44:59 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:59 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap325110be-ca, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:44:59 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:59 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:44:59 user nova-compute[70924]: INFO os_vif [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:19:c4,bridge_name='br-int',has_traffic_filtering=True,id=325110be-cad2-4b73-9044-3028f80f3d37,network=Network(b6631336-b322-45e0-99b7-5e95539aa674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap325110be-ca')
Jul 29 14:44:59 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] calling os-brick to detach iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 14:44:59 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, {'target_iqns': ['iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uNkATmgG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:44:59 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 29 14:44:59 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:44:59 user nova-compute[70924]: DEBUG nova.network.neutron [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Successfully updated port: 7334899f-e7c7-48d8-8c14-4fda63fea3b5 {{(pid=70924) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 14:44:59 user nova-compute[70924]: DEBUG nova.compute.manager [req-17833712-c5b0-4f5e-a46b-71cd47fae418 req-095d45a3-96bf-4799-a867-1cbd006f5668 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received event network-changed-7334899f-e7c7-48d8-8c14-4fda63fea3b5 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:44:59 user nova-compute[70924]: DEBUG nova.compute.manager [req-17833712-c5b0-4f5e-a46b-71cd47fae418 req-095d45a3-96bf-4799-a867-1cbd006f5668 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Refreshing instance network info cache due to event network-changed-7334899f-e7c7-48d8-8c14-4fda63fea3b5. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:44:59 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-17833712-c5b0-4f5e-a46b-71cd47fae418 req-095d45a3-96bf-4799-a867-1cbd006f5668 service nova] Acquiring lock "refresh_cache-35bdb2dd-d2d4-4a3d-9178-6892d478dfa3" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:44:59 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-17833712-c5b0-4f5e-a46b-71cd47fae418 req-095d45a3-96bf-4799-a867-1cbd006f5668 service nova] Acquired lock "refresh_cache-35bdb2dd-d2d4-4a3d-9178-6892d478dfa3" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:44:59 user nova-compute[70924]: DEBUG nova.network.neutron [req-17833712-c5b0-4f5e-a46b-71cd47fae418 req-095d45a3-96bf-4799-a867-1cbd006f5668 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Refreshing network info cache for port 7334899f-e7c7-48d8-8c14-4fda63fea3b5 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:44:59 user nova-compute[70924]: DEBUG nova.network.neutron [req-17833712-c5b0-4f5e-a46b-71cd47fae418 req-095d45a3-96bf-4799-a867-1cbd006f5668 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Instance cache missing network info. {{(pid=70924) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 14:44:59 user nova-compute[70924]: INFO nova.compute.manager [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Rescuing
Jul 29 14:44:59 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Acquiring lock "refresh_cache-f5929dcf-8594-4323-a6f5-a322aff7c881" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:44:59 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Acquired lock "refresh_cache-f5929dcf-8594-4323-a6f5-a322aff7c881" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:44:59 user nova-compute[70924]: DEBUG nova.network.neutron [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 14:44:59 user nova-compute[70924]: DEBUG nova.compute.manager [req-b3cbb4dd-a994-4f45-acc2-8c803c3a9d79 req-2c7546bf-ad22-4fa6-b657-790e685328ac service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received event network-changed-2e35e8a0-e202-46d5-b854-9960de88edc2 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:44:59 user nova-compute[70924]: DEBUG nova.compute.manager [req-b3cbb4dd-a994-4f45-acc2-8c803c3a9d79 req-2c7546bf-ad22-4fa6-b657-790e685328ac service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Refreshing instance network info cache due to event network-changed-2e35e8a0-e202-46d5-b854-9960de88edc2. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:44:59 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b3cbb4dd-a994-4f45-acc2-8c803c3a9d79 req-2c7546bf-ad22-4fa6-b657-790e685328ac service nova] Acquiring lock "refresh_cache-35bdb2dd-d2d4-4a3d-9178-6892d478dfa3" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:44:59 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2c61f33c-84c2-4a87-be80-e0535105e5d0 tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Acquiring lock "fcbb998c-2dac-47d9-985a-d5b2a15ddaa0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:44:59 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2c61f33c-84c2-4a87-be80-e0535105e5d0 tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Lock "fcbb998c-2dac-47d9-985a-d5b2a15ddaa0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:44:59 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2c61f33c-84c2-4a87-be80-e0535105e5d0 tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Acquiring lock "fcbb998c-2dac-47d9-985a-d5b2a15ddaa0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:44:59 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2c61f33c-84c2-4a87-be80-e0535105e5d0 tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Lock "fcbb998c-2dac-47d9-985a-d5b2a15ddaa0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:44:59 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2c61f33c-84c2-4a87-be80-e0535105e5d0 tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Lock "fcbb998c-2dac-47d9-985a-d5b2a15ddaa0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:44:59 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-98929939-0134-4c33-b07d-30611843f70a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.457s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:44:59 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-98929939-0134-4c33-b07d-30611843f70a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] <== connect_volume: return (1800ms) {'type': 'block', 'scsi_wwn': '23361356530333131', 'path': '/dev/sdd'} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:44:59 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98929939-0134-4c33-b07d-30611843f70a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23361356530333131', 'path': '/dev/sdd'} {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 14:44:59 user nova-compute[70924]: INFO nova.compute.manager [None req-2c61f33c-84c2-4a87-be80-e0535105e5d0 tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Terminating instance
Jul 29 14:44:59 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.594s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:44:59 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7', 0)] {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 14:44:59 user nova-compute[70924]: DEBUG nova.compute.manager [None req-2c61f33c-84c2-4a87-be80-e0535105e5d0 tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Start destroying the instance on the hypervisor. {{(pid=70924) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 14:44:59 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:59 user nova-compute[70924]: DEBUG nova.objects.instance [None req-98929939-0134-4c33-b07d-30611843f70a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lazy-loading 'flavor' on Instance uuid 86ecc6cb-88a8-4572-8e41-d4c5859036a6 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:44:59 user nova-compute[70924]: DEBUG nova.network.neutron [req-17833712-c5b0-4f5e-a46b-71cd47fae418 req-095d45a3-96bf-4799-a867-1cbd006f5668 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:44:59 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:59 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[602eaf41-92ba-4655-bf0f-e5a77f019a82]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:59 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:59 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-98929939-0134-4c33-b07d-30611843f70a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] attach device xml: <disk type="block" device="disk">
Jul 29 14:44:59 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:44:59 user nova-compute[70924]:   <source dev="/dev/sdd"/>
Jul 29 14:44:59 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 14:44:59 user nova-compute[70924]:   <serial>45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59</serial>
Jul 29 14:44:59 user nova-compute[70924]: </disk>
Jul 29 14:44:59 user nova-compute[70924]:  {{(pid=70924) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 29 14:44:59 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-17833712-c5b0-4f5e-a46b-71cd47fae418 req-095d45a3-96bf-4799-a867-1cbd006f5668 service nova] Releasing lock "refresh_cache-35bdb2dd-d2d4-4a3d-9178-6892d478dfa3" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:44:59 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b3cbb4dd-a994-4f45-acc2-8c803c3a9d79 req-2c7546bf-ad22-4fa6-b657-790e685328ac service nova] Acquired lock "refresh_cache-35bdb2dd-d2d4-4a3d-9178-6892d478dfa3" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:44:59 user nova-compute[70924]: DEBUG nova.network.neutron [req-b3cbb4dd-a994-4f45-acc2-8c803c3a9d79 req-2c7546bf-ad22-4fa6-b657-790e685328ac service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Refreshing network info cache for port 2e35e8a0-e202-46d5-b854-9960de88edc2 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:44:59 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:59 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee802ca6-84d7-43f1-aff5-3ee2be35d184]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:59 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:59 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:44:59 user nova-compute[70924]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)
Jul 29 14:44:59 user nova-compute[70924]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 (non-flash)
Jul 29 14:44:59 user nova-compute[70924]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:44:59 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:44:59 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:44:59 user nova-compute[70924]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)
Jul 29 14:44:59 user nova-compute[70924]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 (non-flash)
Jul 29 14:44:59 user nova-compute[70924]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:44:59 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:44:59 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feee9aabbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7'): ({'sde'}, set())}) {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 14:44:59 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Removing single pathed devices sde {{(pid=70924) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 14:44:59 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:59 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:59 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:59 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae2c2cf-3149-4eb5-b525-d8c7770cc545]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:59 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:59 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:59 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:59 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[70cddca9-9a15-4b98-8bf6-945d7900a18b]: (4, ('ok\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:59 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Flushing IO for device /dev/sde {{(pid=70924) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 14:44:59 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:59 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:44:59 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:59 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d86783f-f8d7-4f87-8bb5-9ae331e3729e]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:59 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70924) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 14:44:59 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:44:59 user nova-compute[70924]: DEBUG nova.network.neutron [req-b3cbb4dd-a994-4f45-acc2-8c803c3a9d79 req-2c7546bf-ad22-4fa6-b657-790e685328ac service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Instance cache missing network info. {{(pid=70924) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 14:44:59 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.061s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:44:59 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e29752-d9b3-4499-a0e2-1851196a5e11]: (4, ('1', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:44:59 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 14:44:59 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] SCSI volumes sde have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 14:44:59 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7')] {{(pid=70924) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 14:45:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:00 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d057c1-643c-46ea-a05d-b4b45f5f290e]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:00 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:45:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 -p 172.16.0.220:3260 --logout {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:00 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88adc1e-de2c-4b31-808f-59485f6b076b]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:00 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7, portal: 172.16.0.220,3260]
Jul 29 14:45:00 user nova-compute[70924]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7, portal: 172.16.0.220,3260] successful.
Jul 29 14:45:00 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:45:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 -p 172.16.0.220:3260 --op delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:00 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34efdc4-40fe-4532-b3ed-846830a25bdf]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:00 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:45:00 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.401s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:45:00 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] <== disconnect_volume: return (995ms) None {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:45:00 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Disconnected iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 14:45:00 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Deleting instance files /opt/stack/data/nova/instances/9b4c76df-f74f-43b4-968f-b730cc5b0ec6_del
Jul 29 14:45:00 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Deletion of /opt/stack/data/nova/instances/9b4c76df-f74f-43b4-968f-b730cc5b0ec6_del complete
Jul 29 14:45:00 user nova-compute[70924]: DEBUG nova.compute.manager [req-f280b71f-b136-4f11-9c60-001c240a87aa req-aa2ba579-a804-4fdc-940c-e96d4a6f783c service nova] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Received event network-vif-unplugged-ef43604c-04b6-43b1-83c3-324102987873 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:45:00 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-f280b71f-b136-4f11-9c60-001c240a87aa req-aa2ba579-a804-4fdc-940c-e96d4a6f783c service nova] Acquiring lock "fcbb998c-2dac-47d9-985a-d5b2a15ddaa0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:45:00 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-f280b71f-b136-4f11-9c60-001c240a87aa req-aa2ba579-a804-4fdc-940c-e96d4a6f783c service nova] Lock "fcbb998c-2dac-47d9-985a-d5b2a15ddaa0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:45:00 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-f280b71f-b136-4f11-9c60-001c240a87aa req-aa2ba579-a804-4fdc-940c-e96d4a6f783c service nova] Lock "fcbb998c-2dac-47d9-985a-d5b2a15ddaa0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:00 user nova-compute[70924]: DEBUG nova.compute.manager [req-f280b71f-b136-4f11-9c60-001c240a87aa req-aa2ba579-a804-4fdc-940c-e96d4a6f783c service nova] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] No waiting events found dispatching network-vif-unplugged-ef43604c-04b6-43b1-83c3-324102987873 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:45:00 user nova-compute[70924]: DEBUG nova.compute.manager [req-f280b71f-b136-4f11-9c60-001c240a87aa req-aa2ba579-a804-4fdc-940c-e96d4a6f783c service nova] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Received event network-vif-unplugged-ef43604c-04b6-43b1-83c3-324102987873 for instance with task_state deleting. {{(pid=70924) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 14:45:00 user nova-compute[70924]: DEBUG nova.network.neutron [req-b3cbb4dd-a994-4f45-acc2-8c803c3a9d79 req-2c7546bf-ad22-4fa6-b657-790e685328ac service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:45:00 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b3cbb4dd-a994-4f45-acc2-8c803c3a9d79 req-2c7546bf-ad22-4fa6-b657-790e685328ac service nova] Releasing lock "refresh_cache-35bdb2dd-d2d4-4a3d-9178-6892d478dfa3" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:45:00 user nova-compute[70924]: DEBUG nova.compute.manager [req-b3cbb4dd-a994-4f45-acc2-8c803c3a9d79 req-2c7546bf-ad22-4fa6-b657-790e685328ac service nova] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Received event network-vif-unplugged-325110be-cad2-4b73-9044-3028f80f3d37 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:45:00 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b3cbb4dd-a994-4f45-acc2-8c803c3a9d79 req-2c7546bf-ad22-4fa6-b657-790e685328ac service nova] Acquiring lock "9b4c76df-f74f-43b4-968f-b730cc5b0ec6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:45:00 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b3cbb4dd-a994-4f45-acc2-8c803c3a9d79 req-2c7546bf-ad22-4fa6-b657-790e685328ac service nova] Lock "9b4c76df-f74f-43b4-968f-b730cc5b0ec6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:45:00 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b3cbb4dd-a994-4f45-acc2-8c803c3a9d79 req-2c7546bf-ad22-4fa6-b657-790e685328ac service nova] Lock "9b4c76df-f74f-43b4-968f-b730cc5b0ec6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:00 user nova-compute[70924]: DEBUG nova.compute.manager [req-b3cbb4dd-a994-4f45-acc2-8c803c3a9d79 req-2c7546bf-ad22-4fa6-b657-790e685328ac service nova] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] No waiting events found dispatching network-vif-unplugged-325110be-cad2-4b73-9044-3028f80f3d37 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:45:00 user nova-compute[70924]: WARNING nova.compute.manager [req-b3cbb4dd-a994-4f45-acc2-8c803c3a9d79 req-2c7546bf-ad22-4fa6-b657-790e685328ac service nova] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Received unexpected event network-vif-unplugged-325110be-cad2-4b73-9044-3028f80f3d37 for instance with vm_state active and task_state rebuilding.
Jul 29 14:45:00 user nova-compute[70924]: DEBUG nova.compute.manager [req-b3cbb4dd-a994-4f45-acc2-8c803c3a9d79 req-2c7546bf-ad22-4fa6-b657-790e685328ac service nova] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Received event network-vif-plugged-325110be-cad2-4b73-9044-3028f80f3d37 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:45:00 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b3cbb4dd-a994-4f45-acc2-8c803c3a9d79 req-2c7546bf-ad22-4fa6-b657-790e685328ac service nova] Acquiring lock "9b4c76df-f74f-43b4-968f-b730cc5b0ec6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:45:00 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b3cbb4dd-a994-4f45-acc2-8c803c3a9d79 req-2c7546bf-ad22-4fa6-b657-790e685328ac service nova] Lock "9b4c76df-f74f-43b4-968f-b730cc5b0ec6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:45:00 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b3cbb4dd-a994-4f45-acc2-8c803c3a9d79 req-2c7546bf-ad22-4fa6-b657-790e685328ac service nova] Lock "9b4c76df-f74f-43b4-968f-b730cc5b0ec6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:00 user nova-compute[70924]: DEBUG nova.compute.manager [req-b3cbb4dd-a994-4f45-acc2-8c803c3a9d79 req-2c7546bf-ad22-4fa6-b657-790e685328ac service nova] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] No waiting events found dispatching network-vif-plugged-325110be-cad2-4b73-9044-3028f80f3d37 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:45:00 user nova-compute[70924]: WARNING nova.compute.manager [req-b3cbb4dd-a994-4f45-acc2-8c803c3a9d79 req-2c7546bf-ad22-4fa6-b657-790e685328ac service nova] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Received unexpected event network-vif-plugged-325110be-cad2-4b73-9044-3028f80f3d37 for instance with vm_state active and task_state rebuilding.
Jul 29 14:45:00 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 9b4c76df-f74f-43b4-968f-b730cc5b0ec6 could not be found.
Jul 29 14:45:00 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] calling os-brick to detach iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 14:45:00 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, {'target_iqns': ['iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uNkATmgG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:45:00 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 29 14:45:00 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:45:00 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:45:00 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7', 0)] {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 14:45:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:00 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[79837a4c-9e32-4c7f-b3fc-ac7c1e89dc40]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:00 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a44ebed-cb6b-4985-990b-7517ecc37994]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:00 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:45:00 user nova-compute[70924]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)
Jul 29 14:45:00 user nova-compute[70924]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 (non-flash)
Jul 29 14:45:00 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:45:00 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:45:00 user nova-compute[70924]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)
Jul 29 14:45:00 user nova-compute[70924]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 (non-flash)
Jul 29 14:45:00 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:45:00 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feedc3b3880>, {}) {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 14:45:00 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Disconnecting from: [] {{(pid=70924) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 14:45:00 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.059s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:45:00 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] <== disconnect_volume: return (60ms) None {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:45:00 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Disconnected iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 14:45:00 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:00 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:00 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:00 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Instance destroyed successfully.
Jul 29 14:45:00 user nova-compute[70924]: DEBUG nova.objects.instance [None req-2c61f33c-84c2-4a87-be80-e0535105e5d0 tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Lazy-loading 'resources' on Instance uuid fcbb998c-2dac-47d9-985a-d5b2a15ddaa0 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:45:00 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-2c61f33c-84c2-4a87-be80-e0535105e5d0 tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:41:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-298188460',display_name='tempest-TestVolumeSwap-server-298188460',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-298188460',id=9,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIy5LMzYse1FTE5GonGcYFS2TcGVpsTizS2meMDDkzfNfMIybKkYVHNgzFvQJUkIkOpohYUlBGuDUhTNUlDCRvoXtaDUvNITaWruK4KVYMNJHhf68aSIsvABKVG3OjhnfQ==',key_name='tempest-keypair-1549902199',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:41:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7350cca282f7405f9f232110869df140',ramdisk_id='',reservation_id='r-3g33ed37',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1582539677',owner_user_name='tempest-TestVolumeSwap-1582539677-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:41:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2749d3895a8441c9177c99442a6657c',uuid=fcbb998c-2dac-47d9-985a-d5b2a15ddaa0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ef43604c-04b6-43b1-83c3-324102987873", "address": "fa:16:3e:92:af:8a", "network": {"id": "6c9a59aa-27fd-4da3-b686-bafa34c4d807", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1260570280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7350cca282f7405f9f232110869df140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef43604c-04", "ovs_interfaceid": "ef43604c-04b6-43b1-83c3-324102987873", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 14:45:00 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-2c61f33c-84c2-4a87-be80-e0535105e5d0 tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Converting VIF {"id": "ef43604c-04b6-43b1-83c3-324102987873", "address": "fa:16:3e:92:af:8a", "network": {"id": "6c9a59aa-27fd-4da3-b686-bafa34c4d807", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1260570280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7350cca282f7405f9f232110869df140", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef43604c-04", "ovs_interfaceid": "ef43604c-04b6-43b1-83c3-324102987873", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:45:00 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-2c61f33c-84c2-4a87-be80-e0535105e5d0 tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:af:8a,bridge_name='br-int',has_traffic_filtering=True,id=ef43604c-04b6-43b1-83c3-324102987873,network=Network(6c9a59aa-27fd-4da3-b686-bafa34c4d807),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef43604c-04') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:45:00 user nova-compute[70924]: DEBUG os_vif [None req-2c61f33c-84c2-4a87-be80-e0535105e5d0 tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:af:8a,bridge_name='br-int',has_traffic_filtering=True,id=ef43604c-04b6-43b1-83c3-324102987873,network=Network(6c9a59aa-27fd-4da3-b686-bafa34c4d807),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef43604c-04') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 14:45:00 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:00 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapef43604c-04, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:45:00 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:00 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:00 user nova-compute[70924]: INFO os_vif [None req-2c61f33c-84c2-4a87-be80-e0535105e5d0 tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:af:8a,bridge_name='br-int',has_traffic_filtering=True,id=ef43604c-04b6-43b1-83c3-324102987873,network=Network(6c9a59aa-27fd-4da3-b686-bafa34c4d807),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef43604c-04')
Jul 29 14:45:00 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-2c61f33c-84c2-4a87-be80-e0535105e5d0 tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Deleting instance files /opt/stack/data/nova/instances/fcbb998c-2dac-47d9-985a-d5b2a15ddaa0_del
Jul 29 14:45:00 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-2c61f33c-84c2-4a87-be80-e0535105e5d0 tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Deletion of /opt/stack/data/nova/instances/fcbb998c-2dac-47d9-985a-d5b2a15ddaa0_del complete
Jul 29 14:45:00 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-98929939-0134-4c33-b07d-30611843f70a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:45:00 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-98929939-0134-4c33-b07d-30611843f70a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:45:00 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-98929939-0134-4c33-b07d-30611843f70a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] No VIF found with MAC fa:16:3e:d6:b6:d3, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:45:00 user nova-compute[70924]: INFO nova.compute.manager [None req-2c61f33c-84c2-4a87-be80-e0535105e5d0 tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Took 1.03 seconds to destroy the instance on the hypervisor.
Jul 29 14:45:00 user nova-compute[70924]: DEBUG oslo.service.loopingcall [None req-2c61f33c-84c2-4a87-be80-e0535105e5d0 tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70924) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 14:45:00 user nova-compute[70924]: DEBUG nova.compute.manager [-] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Deallocating network for instance {{(pid=70924) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 14:45:00 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] deallocate_for_instance() {{(pid=70924) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 14:45:00 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:00 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-98929939-0134-4c33-b07d-30611843f70a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "86ecc6cb-88a8-4572-8e41-d4c5859036a6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.467s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:01 user nova-compute[70924]: DEBUG nova.network.neutron [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Updating instance_info_cache with network_info: [{"id": "14b12f31-f886-4752-bac2-e4673c74ae85", "address": "fa:16:3e:0b:f1:80", "network": {"id": "4a3c2dab-e462-4e17-a2a3-f07747a26bbe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1820325619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b2ac23ab8cd48b390fa2047c1fd0e3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14b12f31-f8", "ovs_interfaceid": "14b12f31-f886-4752-bac2-e4673c74ae85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:45:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Releasing lock "refresh_cache-f5929dcf-8594-4323-a6f5-a322aff7c881" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:45:01 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:01 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:01 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:01 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:01 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:01 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:01 user nova-compute[70924]: DEBUG nova.network.neutron [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Successfully updated port: c6793a3b-97da-4584-a326-f1caf598cd78 {{(pid=70924) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 14:45:01 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Acquiring lock "refresh_cache-35bdb2dd-d2d4-4a3d-9178-6892d478dfa3" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:45:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Acquired lock "refresh_cache-35bdb2dd-d2d4-4a3d-9178-6892d478dfa3" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:45:01 user nova-compute[70924]: DEBUG nova.network.neutron [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 14:45:01 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:01 user nova-compute[70924]: DEBUG nova.compute.manager [req-8f6d478d-1545-4029-b893-a1e117c71f35 req-b5b54af8-f99a-4b43-af6b-ff66c26dcee2 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received event network-changed-c6793a3b-97da-4584-a326-f1caf598cd78 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:45:01 user nova-compute[70924]: DEBUG nova.compute.manager [req-8f6d478d-1545-4029-b893-a1e117c71f35 req-b5b54af8-f99a-4b43-af6b-ff66c26dcee2 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Refreshing instance network info cache due to event network-changed-c6793a3b-97da-4584-a326-f1caf598cd78. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:45:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-8f6d478d-1545-4029-b893-a1e117c71f35 req-b5b54af8-f99a-4b43-af6b-ff66c26dcee2 service nova] Acquiring lock "refresh_cache-35bdb2dd-d2d4-4a3d-9178-6892d478dfa3" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:45:01 user nova-compute[70924]: DEBUG nova.network.neutron [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Instance cache missing network info. {{(pid=70924) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 14:45:01 user nova-compute[70924]: DEBUG nova.compute.manager [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Preparing to wait for external event volume-reimaged-45a218df-4554-4d68-ba78-d0232ff799b7 {{(pid=70924) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Jul 29 14:45:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Acquiring lock "9b4c76df-f74f-43b4-968f-b730cc5b0ec6-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:45:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Lock "9b4c76df-f74f-43b4-968f-b730cc5b0ec6-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:45:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Lock "9b4c76df-f74f-43b4-968f-b730cc5b0ec6-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:01 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:01 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:01 user nova-compute[70924]: DEBUG nova.compute.manager [req-63baff10-6b32-42ef-9519-f07a7ac7b00d req-92c4f954-5ec9-4b31-96f1-1c39f3435582 service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Received event network-vif-unplugged-14b12f31-f886-4752-bac2-e4673c74ae85 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:45:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-63baff10-6b32-42ef-9519-f07a7ac7b00d req-92c4f954-5ec9-4b31-96f1-1c39f3435582 service nova] Acquiring lock "f5929dcf-8594-4323-a6f5-a322aff7c881-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:45:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-63baff10-6b32-42ef-9519-f07a7ac7b00d req-92c4f954-5ec9-4b31-96f1-1c39f3435582 service nova] Lock "f5929dcf-8594-4323-a6f5-a322aff7c881-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:45:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-63baff10-6b32-42ef-9519-f07a7ac7b00d req-92c4f954-5ec9-4b31-96f1-1c39f3435582 service nova] Lock "f5929dcf-8594-4323-a6f5-a322aff7c881-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:01 user nova-compute[70924]: DEBUG nova.compute.manager [req-63baff10-6b32-42ef-9519-f07a7ac7b00d req-92c4f954-5ec9-4b31-96f1-1c39f3435582 service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] No waiting events found dispatching network-vif-unplugged-14b12f31-f886-4752-bac2-e4673c74ae85 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:45:01 user nova-compute[70924]: WARNING nova.compute.manager [req-63baff10-6b32-42ef-9519-f07a7ac7b00d req-92c4f954-5ec9-4b31-96f1-1c39f3435582 service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Received unexpected event network-vif-unplugged-14b12f31-f886-4752-bac2-e4673c74ae85 for instance with vm_state active and task_state rescuing.
Jul 29 14:45:01 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:01 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:01 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:01 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:02 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:02 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Instance destroyed successfully.
Jul 29 14:45:02 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Attempting a stable device rescue
Jul 29 14:45:02 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=70924) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 29 14:45:02 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Instance directory exists: not creating {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 29 14:45:02 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Creating image(s)
Jul 29 14:45:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Acquiring lock "/opt/stack/data/nova/instances/f5929dcf-8594-4323-a6f5-a322aff7c881/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:45:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Lock "/opt/stack/data/nova/instances/f5929dcf-8594-4323-a6f5-a322aff7c881/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:45:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Lock "/opt/stack/data/nova/instances/f5929dcf-8594-4323-a6f5-a322aff7c881/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:02 user nova-compute[70924]: DEBUG nova.objects.instance [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Lazy-loading 'trusted_certs' on Instance uuid f5929dcf-8594-4323-a6f5-a322aff7c881 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:45:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Acquiring lock "56cdab891b70ac73db8f1f2fc90cacf2adc01345" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:45:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Lock "56cdab891b70ac73db8f1f2fc90cacf2adc01345" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:45:02 user nova-compute[70924]: DEBUG nova.compute.manager [req-13a055e0-1d41-4324-851e-d0ce29093640 req-a76b0dc3-927d-4b44-ac0b-4f0a1419a4cc service nova] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Received event network-vif-plugged-ef43604c-04b6-43b1-83c3-324102987873 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:45:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-13a055e0-1d41-4324-851e-d0ce29093640 req-a76b0dc3-927d-4b44-ac0b-4f0a1419a4cc service nova] Acquiring lock "fcbb998c-2dac-47d9-985a-d5b2a15ddaa0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:45:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-13a055e0-1d41-4324-851e-d0ce29093640 req-a76b0dc3-927d-4b44-ac0b-4f0a1419a4cc service nova] Lock "fcbb998c-2dac-47d9-985a-d5b2a15ddaa0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:45:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-13a055e0-1d41-4324-851e-d0ce29093640 req-a76b0dc3-927d-4b44-ac0b-4f0a1419a4cc service nova] Lock "fcbb998c-2dac-47d9-985a-d5b2a15ddaa0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:02 user nova-compute[70924]: DEBUG nova.compute.manager [req-13a055e0-1d41-4324-851e-d0ce29093640 req-a76b0dc3-927d-4b44-ac0b-4f0a1419a4cc service nova] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] No waiting events found dispatching network-vif-plugged-ef43604c-04b6-43b1-83c3-324102987873 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:45:02 user nova-compute[70924]: WARNING nova.compute.manager [req-13a055e0-1d41-4324-851e-d0ce29093640 req-a76b0dc3-927d-4b44-ac0b-4f0a1419a4cc service nova] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Received unexpected event network-vif-plugged-ef43604c-04b6-43b1-83c3-324102987873 for instance with vm_state active and task_state deleting.
Jul 29 14:45:02 user nova-compute[70924]: DEBUG nova.compute.manager [req-13a055e0-1d41-4324-851e-d0ce29093640 req-a76b0dc3-927d-4b44-ac0b-4f0a1419a4cc service nova] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Received event network-vif-plugged-ef43604c-04b6-43b1-83c3-324102987873 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:45:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-13a055e0-1d41-4324-851e-d0ce29093640 req-a76b0dc3-927d-4b44-ac0b-4f0a1419a4cc service nova] Acquiring lock "fcbb998c-2dac-47d9-985a-d5b2a15ddaa0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:45:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-13a055e0-1d41-4324-851e-d0ce29093640 req-a76b0dc3-927d-4b44-ac0b-4f0a1419a4cc service nova] Lock "fcbb998c-2dac-47d9-985a-d5b2a15ddaa0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:45:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-13a055e0-1d41-4324-851e-d0ce29093640 req-a76b0dc3-927d-4b44-ac0b-4f0a1419a4cc service nova] Lock "fcbb998c-2dac-47d9-985a-d5b2a15ddaa0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:02 user nova-compute[70924]: DEBUG nova.compute.manager [req-13a055e0-1d41-4324-851e-d0ce29093640 req-a76b0dc3-927d-4b44-ac0b-4f0a1419a4cc service nova] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] No waiting events found dispatching network-vif-plugged-ef43604c-04b6-43b1-83c3-324102987873 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:45:02 user nova-compute[70924]: WARNING nova.compute.manager [req-13a055e0-1d41-4324-851e-d0ce29093640 req-a76b0dc3-927d-4b44-ac0b-4f0a1419a4cc service nova] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Received unexpected event network-vif-plugged-ef43604c-04b6-43b1-83c3-324102987873 for instance with vm_state active and task_state deleting.
Jul 29 14:45:02 user nova-compute[70924]: DEBUG nova.compute.manager [req-13a055e0-1d41-4324-851e-d0ce29093640 req-a76b0dc3-927d-4b44-ac0b-4f0a1419a4cc service nova] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Received event network-vif-plugged-ef43604c-04b6-43b1-83c3-324102987873 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:45:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-13a055e0-1d41-4324-851e-d0ce29093640 req-a76b0dc3-927d-4b44-ac0b-4f0a1419a4cc service nova] Acquiring lock "fcbb998c-2dac-47d9-985a-d5b2a15ddaa0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:45:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-13a055e0-1d41-4324-851e-d0ce29093640 req-a76b0dc3-927d-4b44-ac0b-4f0a1419a4cc service nova] Lock "fcbb998c-2dac-47d9-985a-d5b2a15ddaa0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:45:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-13a055e0-1d41-4324-851e-d0ce29093640 req-a76b0dc3-927d-4b44-ac0b-4f0a1419a4cc service nova] Lock "fcbb998c-2dac-47d9-985a-d5b2a15ddaa0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:02 user nova-compute[70924]: DEBUG nova.compute.manager [req-13a055e0-1d41-4324-851e-d0ce29093640 req-a76b0dc3-927d-4b44-ac0b-4f0a1419a4cc service nova] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] No waiting events found dispatching network-vif-plugged-ef43604c-04b6-43b1-83c3-324102987873 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:45:02 user nova-compute[70924]: WARNING nova.compute.manager [req-13a055e0-1d41-4324-851e-d0ce29093640 req-a76b0dc3-927d-4b44-ac0b-4f0a1419a4cc service nova] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Received unexpected event network-vif-plugged-ef43604c-04b6-43b1-83c3-324102987873 for instance with vm_state active and task_state deleting.
Jul 29 14:45:02 user nova-compute[70924]: DEBUG nova.compute.manager [req-13a055e0-1d41-4324-851e-d0ce29093640 req-a76b0dc3-927d-4b44-ac0b-4f0a1419a4cc service nova] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Received event network-vif-unplugged-ef43604c-04b6-43b1-83c3-324102987873 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:45:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-13a055e0-1d41-4324-851e-d0ce29093640 req-a76b0dc3-927d-4b44-ac0b-4f0a1419a4cc service nova] Acquiring lock "fcbb998c-2dac-47d9-985a-d5b2a15ddaa0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:45:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-13a055e0-1d41-4324-851e-d0ce29093640 req-a76b0dc3-927d-4b44-ac0b-4f0a1419a4cc service nova] Lock "fcbb998c-2dac-47d9-985a-d5b2a15ddaa0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:45:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-13a055e0-1d41-4324-851e-d0ce29093640 req-a76b0dc3-927d-4b44-ac0b-4f0a1419a4cc service nova] Lock "fcbb998c-2dac-47d9-985a-d5b2a15ddaa0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:02 user nova-compute[70924]: DEBUG nova.compute.manager [req-13a055e0-1d41-4324-851e-d0ce29093640 req-a76b0dc3-927d-4b44-ac0b-4f0a1419a4cc service nova] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] No waiting events found dispatching network-vif-unplugged-ef43604c-04b6-43b1-83c3-324102987873 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:45:02 user nova-compute[70924]: DEBUG nova.compute.manager [req-13a055e0-1d41-4324-851e-d0ce29093640 req-a76b0dc3-927d-4b44-ac0b-4f0a1419a4cc service nova] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Received event network-vif-unplugged-ef43604c-04b6-43b1-83c3-324102987873 for instance with task_state deleting. {{(pid=70924) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 14:45:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/56cdab891b70ac73db8f1f2fc90cacf2adc01345.part --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:03 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:03 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:45:03 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Took 2.84 seconds to deallocate network for instance.
Jul 29 14:45:03 user nova-compute[70924]: INFO nova.compute.manager [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Rebuilding instance
Jul 29 14:45:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/56cdab891b70ac73db8f1f2fc90cacf2adc01345.part --force-share --output=json" returned: 0 in 0.167s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:03 user nova-compute[70924]: DEBUG nova.virt.images [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] b84ecaa3-2aa7-4f6e-93e5-c106ef0b8187 was qcow2, converting to raw {{(pid=70924) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 29 14:45:03 user nova-compute[70924]: DEBUG nova.privsep.utils [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70924) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 29 14:45:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/56cdab891b70ac73db8f1f2fc90cacf2adc01345.part /opt/stack/data/nova/instances/_base/56cdab891b70ac73db8f1f2fc90cacf2adc01345.converted {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:03 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2c61f33c-84c2-4a87-be80-e0535105e5d0 tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:45:03 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2c61f33c-84c2-4a87-be80-e0535105e5d0 tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:45:03 user nova-compute[70924]: DEBUG nova.objects.instance [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lazy-loading 'trusted_certs' on Instance uuid 86ecc6cb-88a8-4572-8e41-d4c5859036a6 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:45:03 user nova-compute[70924]: DEBUG nova.compute.manager [req-2728cc5f-e39f-4c1b-acca-88a22a6c0dce req-7b40dbc8-2ee3-4b36-b0cb-99c833647124 service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Received event network-vif-plugged-14b12f31-f886-4752-bac2-e4673c74ae85 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:45:03 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-2728cc5f-e39f-4c1b-acca-88a22a6c0dce req-7b40dbc8-2ee3-4b36-b0cb-99c833647124 service nova] Acquiring lock "f5929dcf-8594-4323-a6f5-a322aff7c881-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:45:03 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-2728cc5f-e39f-4c1b-acca-88a22a6c0dce req-7b40dbc8-2ee3-4b36-b0cb-99c833647124 service nova] Lock "f5929dcf-8594-4323-a6f5-a322aff7c881-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:45:03 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-2728cc5f-e39f-4c1b-acca-88a22a6c0dce req-7b40dbc8-2ee3-4b36-b0cb-99c833647124 service nova] Lock "f5929dcf-8594-4323-a6f5-a322aff7c881-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:03 user nova-compute[70924]: DEBUG nova.compute.manager [req-2728cc5f-e39f-4c1b-acca-88a22a6c0dce req-7b40dbc8-2ee3-4b36-b0cb-99c833647124 service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] No waiting events found dispatching network-vif-plugged-14b12f31-f886-4752-bac2-e4673c74ae85 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:45:03 user nova-compute[70924]: WARNING nova.compute.manager [req-2728cc5f-e39f-4c1b-acca-88a22a6c0dce req-7b40dbc8-2ee3-4b36-b0cb-99c833647124 service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Received unexpected event network-vif-plugged-14b12f31-f886-4752-bac2-e4673c74ae85 for instance with vm_state active and task_state rescuing.
Jul 29 14:45:03 user nova-compute[70924]: DEBUG nova.compute.manager [req-2728cc5f-e39f-4c1b-acca-88a22a6c0dce req-7b40dbc8-2ee3-4b36-b0cb-99c833647124 service nova] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Received event network-vif-deleted-ef43604c-04b6-43b1-83c3-324102987873 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:45:03 user nova-compute[70924]: DEBUG nova.compute.manager [req-2728cc5f-e39f-4c1b-acca-88a22a6c0dce req-7b40dbc8-2ee3-4b36-b0cb-99c833647124 service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Received event network-vif-plugged-14b12f31-f886-4752-bac2-e4673c74ae85 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:45:03 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-2728cc5f-e39f-4c1b-acca-88a22a6c0dce req-7b40dbc8-2ee3-4b36-b0cb-99c833647124 service nova] Acquiring lock "f5929dcf-8594-4323-a6f5-a322aff7c881-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:45:03 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-2728cc5f-e39f-4c1b-acca-88a22a6c0dce req-7b40dbc8-2ee3-4b36-b0cb-99c833647124 service nova] Lock "f5929dcf-8594-4323-a6f5-a322aff7c881-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:45:03 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-2728cc5f-e39f-4c1b-acca-88a22a6c0dce req-7b40dbc8-2ee3-4b36-b0cb-99c833647124 service nova] Lock "f5929dcf-8594-4323-a6f5-a322aff7c881-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:03 user nova-compute[70924]: DEBUG nova.compute.manager [req-2728cc5f-e39f-4c1b-acca-88a22a6c0dce req-7b40dbc8-2ee3-4b36-b0cb-99c833647124 service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] No waiting events found dispatching network-vif-plugged-14b12f31-f886-4752-bac2-e4673c74ae85 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:45:03 user nova-compute[70924]: WARNING nova.compute.manager [req-2728cc5f-e39f-4c1b-acca-88a22a6c0dce req-7b40dbc8-2ee3-4b36-b0cb-99c833647124 service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Received unexpected event network-vif-plugged-14b12f31-f886-4752-bac2-e4673c74ae85 for instance with vm_state active and task_state rescuing.
Jul 29 14:45:03 user nova-compute[70924]: DEBUG nova.compute.manager [req-2728cc5f-e39f-4c1b-acca-88a22a6c0dce req-7b40dbc8-2ee3-4b36-b0cb-99c833647124 service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Received event network-vif-plugged-14b12f31-f886-4752-bac2-e4673c74ae85 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:45:03 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-2728cc5f-e39f-4c1b-acca-88a22a6c0dce req-7b40dbc8-2ee3-4b36-b0cb-99c833647124 service nova] Acquiring lock "f5929dcf-8594-4323-a6f5-a322aff7c881-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:45:03 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-2728cc5f-e39f-4c1b-acca-88a22a6c0dce req-7b40dbc8-2ee3-4b36-b0cb-99c833647124 service nova] Lock "f5929dcf-8594-4323-a6f5-a322aff7c881-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:45:03 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-2728cc5f-e39f-4c1b-acca-88a22a6c0dce req-7b40dbc8-2ee3-4b36-b0cb-99c833647124 service nova] Lock "f5929dcf-8594-4323-a6f5-a322aff7c881-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:03 user nova-compute[70924]: DEBUG nova.compute.manager [req-2728cc5f-e39f-4c1b-acca-88a22a6c0dce req-7b40dbc8-2ee3-4b36-b0cb-99c833647124 service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] No waiting events found dispatching network-vif-plugged-14b12f31-f886-4752-bac2-e4673c74ae85 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:45:03 user nova-compute[70924]: WARNING nova.compute.manager [req-2728cc5f-e39f-4c1b-acca-88a22a6c0dce req-7b40dbc8-2ee3-4b36-b0cb-99c833647124 service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Received unexpected event network-vif-plugged-14b12f31-f886-4752-bac2-e4673c74ae85 for instance with vm_state active and task_state rescuing.
Jul 29 14:45:03 user nova-compute[70924]: DEBUG nova.compute.manager [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:45:04 user nova-compute[70924]: DEBUG nova.objects.instance [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lazy-loading 'pci_requests' on Instance uuid 86ecc6cb-88a8-4572-8e41-d4c5859036a6 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:45:04 user nova-compute[70924]: DEBUG nova.objects.instance [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lazy-loading 'pci_devices' on Instance uuid 86ecc6cb-88a8-4572-8e41-d4c5859036a6 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:45:04 user nova-compute[70924]: DEBUG nova.objects.instance [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lazy-loading 'resources' on Instance uuid 86ecc6cb-88a8-4572-8e41-d4c5859036a6 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:45:04 user nova-compute[70924]: DEBUG nova.objects.instance [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lazy-loading 'migration_context' on Instance uuid 86ecc6cb-88a8-4572-8e41-d4c5859036a6 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:45:04 user nova-compute[70924]: DEBUG nova.objects.instance [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Trying to apply a migration context that does not seem to be set for this instance {{(pid=70924) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Jul 29 14:45:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/56cdab891b70ac73db8f1f2fc90cacf2adc01345.part /opt/stack/data/nova/instances/_base/56cdab891b70ac73db8f1f2fc90cacf2adc01345.converted" returned: 0 in 0.633s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/56cdab891b70ac73db8f1f2fc90cacf2adc01345.converted --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:04 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:04 user nova-compute[70924]: DEBUG nova.compute.manager [req-e17b8add-7656-4235-bac3-ce1c7e26723b req-9b2b9380-95e7-4612-acff-eea26bc261e9 service nova] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Received event network-vif-plugged-ef43604c-04b6-43b1-83c3-324102987873 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:45:04 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-e17b8add-7656-4235-bac3-ce1c7e26723b req-9b2b9380-95e7-4612-acff-eea26bc261e9 service nova] Acquiring lock "fcbb998c-2dac-47d9-985a-d5b2a15ddaa0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:45:04 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-e17b8add-7656-4235-bac3-ce1c7e26723b req-9b2b9380-95e7-4612-acff-eea26bc261e9 service nova] Lock "fcbb998c-2dac-47d9-985a-d5b2a15ddaa0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:45:04 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-e17b8add-7656-4235-bac3-ce1c7e26723b req-9b2b9380-95e7-4612-acff-eea26bc261e9 service nova] Lock "fcbb998c-2dac-47d9-985a-d5b2a15ddaa0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:04 user nova-compute[70924]: DEBUG nova.compute.manager [req-e17b8add-7656-4235-bac3-ce1c7e26723b req-9b2b9380-95e7-4612-acff-eea26bc261e9 service nova] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] No waiting events found dispatching network-vif-plugged-ef43604c-04b6-43b1-83c3-324102987873 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:45:04 user nova-compute[70924]: WARNING nova.compute.manager [req-e17b8add-7656-4235-bac3-ce1c7e26723b req-9b2b9380-95e7-4612-acff-eea26bc261e9 service nova] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Received unexpected event network-vif-plugged-ef43604c-04b6-43b1-83c3-324102987873 for instance with vm_state deleted and task_state None.
Jul 29 14:45:04 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-2c61f33c-84c2-4a87-be80-e0535105e5d0 tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:45:04 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:04 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-2c61f33c-84c2-4a87-be80-e0535105e5d0 tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:45:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/56cdab891b70ac73db8f1f2fc90cacf2adc01345.converted --force-share --output=json" returned: 0 in 0.177s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:04 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Lock "56cdab891b70ac73db8f1f2fc90cacf2adc01345" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.273s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:04 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Acquiring lock "56cdab891b70ac73db8f1f2fc90cacf2adc01345" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:45:04 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Lock "56cdab891b70ac73db8f1f2fc90cacf2adc01345" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:45:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/56cdab891b70ac73db8f1f2fc90cacf2adc01345 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:04 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2c61f33c-84c2-4a87-be80-e0535105e5d0 tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.844s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:04 user nova-compute[70924]: INFO nova.scheduler.client.report [None req-2c61f33c-84c2-4a87-be80-e0535105e5d0 tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Deleted allocations for instance fcbb998c-2dac-47d9-985a-d5b2a15ddaa0
Jul 29 14:45:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/56cdab891b70ac73db8f1f2fc90cacf2adc01345 --force-share --output=json" returned: 0 in 0.140s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/56cdab891b70ac73db8f1f2fc90cacf2adc01345,backing_fmt=raw /opt/stack/data/nova/instances/f5929dcf-8594-4323-a6f5-a322aff7c881/disk.rescue {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/56cdab891b70ac73db8f1f2fc90cacf2adc01345,backing_fmt=raw /opt/stack/data/nova/instances/f5929dcf-8594-4323-a6f5-a322aff7c881/disk.rescue" returned: 0 in 0.060s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:04 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Lock "56cdab891b70ac73db8f1f2fc90cacf2adc01345" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:04 user nova-compute[70924]: DEBUG nova.objects.instance [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Lazy-loading 'migration_context' on Instance uuid f5929dcf-8594-4323-a6f5-a322aff7c881 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:45:04 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2c61f33c-84c2-4a87-be80-e0535105e5d0 tempest-TestVolumeSwap-1582539677 tempest-TestVolumeSwap-1582539677-project-member] Lock "fcbb998c-2dac-47d9-985a-d5b2a15ddaa0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.988s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:04 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Created local disks {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 14:45:04 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Start _get_guest_xml network_info=[{"id": "14b12f31-f886-4752-bac2-e4673c74ae85", "address": "fa:16:3e:0b:f1:80", "network": {"id": "4a3c2dab-e462-4e17-a2a3-f07747a26bbe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1820325619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1820325619-network", "vif_mac": "fa:16:3e:0b:f1:80"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b2ac23ab8cd48b390fa2047c1fd0e3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14b12f31-f8", "ovs_interfaceid": "14b12f31-f886-4752-bac2-e4673c74ae85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'b84ecaa3-2aa7-4f6e-93e5-c106ef0b8187', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '3aba2e73-6832-404b-8bd0-d0503ce82b8c'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'boot_index': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fabqzNKw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'f5929dcf-8594-4323-a6f5-a322aff7c881', 'attached_at': '', 'detached_at': '', 'volume_id': '477164fc-6cb9-4ac2-af70-40460ad69c15', 'serial': '477164fc-6cb9-4ac2-af70-40460ad69c15'}, 'attachment_id': '5cf5b994-3a52-4891-8a29-920600d1ce42', 'volume_type': None} {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 14:45:04 user nova-compute[70924]: DEBUG nova.objects.instance [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Lazy-loading 'resources' on Instance uuid f5929dcf-8594-4323-a6f5-a322aff7c881 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:45:04 user nova-compute[70924]: DEBUG nova.objects.instance [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Lazy-loading 'numa_topology' on Instance uuid f5929dcf-8594-4323-a6f5-a322aff7c881 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:45:04 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:45:04 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:45:04 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 14:45:04 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] CPU controller missing on host. {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 14:45:04 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 14:45:04 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] CPU controller found on host. {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 14:45:04 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70924) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 14:45:04 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T14:36:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 14:45:04 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Flavor limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 14:45:04 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Image limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 14:45:04 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Flavor pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 14:45:04 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Image pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 14:45:04 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 14:45:04 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 14:45:04 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 14:45:04 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Got 1 possible topologies {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 14:45:04 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 14:45:04 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 14:45:04 user nova-compute[70924]: DEBUG nova.objects.instance [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Lazy-loading 'vcpu_model' on Instance uuid f5929dcf-8594-4323-a6f5-a322aff7c881 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:45:04 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Calling os-brick to attach iSCSI Volume {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 14:45:04 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fabqzNKw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:45:04 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:45:04 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:45:04 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:45:04 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:45:04 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:45:04 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:45:04 user nova-compute[70924]: INFO os_brick.initiator.connectors.iscsi [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 14:45:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 -p 172.16.0.220:3260 {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 -p 172.16.0.220:3260" returned: 0 in 0.027s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:04 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc1bd94-8b6d-4d59-a3e7-d58d0a31a4c7]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = fabqzNKw\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:04 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Jul 29 14:45:04 user nova-compute[70924]: node.name = iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15
Jul 29 14:45:04 user nova-compute[70924]: node.tpgt = -1
Jul 29 14:45:04 user nova-compute[70924]: node.startup = automatic
Jul 29 14:45:04 user nova-compute[70924]: node.leading_login = No
Jul 29 14:45:04 user nova-compute[70924]: iface.iscsi_ifacename = default
Jul 29 14:45:04 user nova-compute[70924]: iface.net_ifacename = <empty>
Jul 29 14:45:04 user nova-compute[70924]: iface.ipaddress = <empty>
Jul 29 14:45:04 user nova-compute[70924]: iface.prefix_len = 0
Jul 29 14:45:04 user nova-compute[70924]: iface.hwaddress = <empty>
Jul 29 14:45:04 user nova-compute[70924]: iface.transport_name = tcp
Jul 29 14:45:04 user nova-compute[70924]: iface.initiatorname = <empty>
Jul 29 14:45:04 user nova-compute[70924]: iface.state = <empty>
Jul 29 14:45:04 user nova-compute[70924]: iface.vlan_id = 0
Jul 29 14:45:04 user nova-compute[70924]: iface.vlan_priority = 0
Jul 29 14:45:04 user nova-compute[70924]: iface.vlan_state = <empty>
Jul 29 14:45:04 user nova-compute[70924]: iface.iface_num = 0
Jul 29 14:45:04 user nova-compute[70924]: iface.mtu = 0
Jul 29 14:45:04 user nova-compute[70924]: iface.port = 0
Jul 29 14:45:04 user nova-compute[70924]: iface.bootproto = <empty>
Jul 29 14:45:04 user nova-compute[70924]: iface.subnet_mask = <empty>
Jul 29 14:45:04 user nova-compute[70924]: iface.gateway = <empty>
Jul 29 14:45:04 user nova-compute[70924]: iface.dhcp_alt_client_id_state = <empty>
Jul 29 14:45:04 user nova-compute[70924]: iface.dhcp_alt_client_id = <empty>
Jul 29 14:45:04 user nova-compute[70924]: iface.dhcp_dns = <empty>
Jul 29 14:45:04 user nova-compute[70924]: iface.dhcp_learn_iqn = <empty>
Jul 29 14:45:04 user nova-compute[70924]: iface.dhcp_req_vendor_id_state = <empty>
Jul 29 14:45:04 user nova-compute[70924]: iface.dhcp_vendor_id_state = <empty>
Jul 29 14:45:04 user nova-compute[70924]: iface.dhcp_vendor_id = <empty>
Jul 29 14:45:04 user nova-compute[70924]: iface.dhcp_slp_da = <empty>
Jul 29 14:45:04 user nova-compute[70924]: iface.fragmentation = <empty>
Jul 29 14:45:04 user nova-compute[70924]: iface.gratuitous_arp = <empty>
Jul 29 14:45:04 user nova-compute[70924]: iface.incoming_forwarding = <empty>
Jul 29 14:45:04 user nova-compute[70924]: iface.tos_state = <empty>
Jul 29 14:45:04 user nova-compute[70924]: iface.tos = 0
Jul 29 14:45:04 user nova-compute[70924]: iface.ttl = 0
Jul 29 14:45:04 user nova-compute[70924]: iface.delayed_ack = <empty>
Jul 29 14:45:04 user nova-compute[70924]: iface.tcp_nagle = <empty>
Jul 29 14:45:04 user nova-compute[70924]: iface.tcp_wsf_state = <empty>
Jul 29 14:45:04 user nova-compute[70924]: iface.tcp_wsf = 0
Jul 29 14:45:04 user nova-compute[70924]: iface.tcp_timer_scale = 0
Jul 29 14:45:04 user nova-compute[70924]: iface.tcp_timestamp = <empty>
Jul 29 14:45:04 user nova-compute[70924]: iface.redirect = <empty>
Jul 29 14:45:04 user nova-compute[70924]: iface.def_task_mgmt_timeout = 0
Jul 29 14:45:04 user nova-compute[70924]: iface.header_digest = <empty>
Jul 29 14:45:04 user nova-compute[70924]: iface.data_digest = <empty>
Jul 29 14:45:04 user nova-compute[70924]: iface.immediate_data = <empty>
Jul 29 14:45:04 user nova-compute[70924]: iface.initial_r2t = <empty>
Jul 29 14:45:04 user nova-compute[70924]: iface.data_seq_inorder = <empty>
Jul 29 14:45:04 user nova-compute[70924]: iface.data_pdu_inorder = <empty>
Jul 29 14:45:04 user nova-compute[70924]: iface.erl = 0
Jul 29 14:45:04 user nova-compute[70924]: iface.max_receive_data_len = 0
Jul 29 14:45:04 user nova-compute[70924]: iface.first_burst_len = 0
Jul 29 14:45:04 user nova-compute[70924]: iface.max_outstanding_r2t = 0
Jul 29 14:45:04 user nova-compute[70924]: iface.max_burst_len = 0
Jul 29 14:45:04 user nova-compute[70924]: iface.chap_auth = <empty>
Jul 29 14:45:04 user nova-compute[70924]: iface.bidi_chap = <empty>
Jul 29 14:45:04 user nova-compute[70924]: iface.strict_login_compliance = <empty>
Jul 29 14:45:04 user nova-compute[70924]: iface.discovery_auth = <empty>
Jul 29 14:45:04 user nova-compute[70924]: iface.discovery_logout = <empty>
Jul 29 14:45:04 user nova-compute[70924]: node.discovery_address = <empty>
Jul 29 14:45:04 user nova-compute[70924]: node.discovery_port = 0
Jul 29 14:45:04 user nova-compute[70924]: node.discovery_type = static
Jul 29 14:45:04 user nova-compute[70924]: node.session.initial_cmdsn = 0
Jul 29 14:45:04 user nova-compute[70924]: node.session.initial_login_retry_max = 8
Jul 29 14:45:04 user nova-compute[70924]: node.session.xmit_thread_priority = -20
Jul 29 14:45:04 user nova-compute[70924]: node.session.cmds_max = 128
Jul 29 14:45:04 user nova-compute[70924]: node.session.queue_depth = 32
Jul 29 14:45:04 user nova-compute[70924]: node.session.nr_sessions = 1
Jul 29 14:45:04 user nova-compute[70924]: node.session.auth.authmethod = CHAP
Jul 29 14:45:04 user nova-compute[70924]: node.session.auth.username = fabqzNKw
Jul 29 14:45:04 user nova-compute[70924]: node.session.auth.password = ***
Jul 29 14:45:04 user nova-compute[70924]: node.session.auth.username_in = <empty>
Jul 29 14:45:04 user nova-compute[70924]: node.session.auth.password_in = <empty>
Jul 29 14:45:04 user nova-compute[70924]: node.session.auth.chap_algs = MD5
Jul 29 14:45:04 user nova-compute[70924]: node.session.timeo.replacement_timeout = 120
Jul 29 14:45:04 user nova-compute[70924]: node.session.err_timeo.abort_timeout = 15
Jul 29 14:45:04 user nova-compute[70924]: node.session.err_timeo.lu_reset_timeout = 30
Jul 29 14:45:04 user nova-compute[70924]: node.session.err_timeo.tgt_reset_timeout = 30
Jul 29 14:45:04 user nova-compute[70924]: node.session.err_timeo.host_reset_timeout = 60
Jul 29 14:45:04 user nova-compute[70924]: node.session.iscsi.FastAbort = Yes
Jul 29 14:45:04 user nova-compute[70924]: node.session.iscsi.InitialR2T = No
Jul 29 14:45:04 user nova-compute[70924]: node.session.iscsi.ImmediateData = Yes
Jul 29 14:45:04 user nova-compute[70924]: node.session.iscsi.FirstBurstLength = 262144
Jul 29 14:45:04 user nova-compute[70924]: node.session.iscsi.MaxBurstLength = 16776192
Jul 29 14:45:04 user nova-compute[70924]: node.session.iscsi.DefaultTime2Retain = 0
Jul 29 14:45:04 user nova-compute[70924]: node.session.iscsi.DefaultTime2Wait = 2
Jul 29 14:45:04 user nova-compute[70924]: node.session.iscsi.MaxConnections = 1
Jul 29 14:45:04 user nova-compute[70924]: node.session.iscsi.MaxOutstandingR2T = 1
Jul 29 14:45:04 user nova-compute[70924]: node.session.iscsi.ERL = 0
Jul 29 14:45:04 user nova-compute[70924]: node.session.scan = manual
Jul 29 14:45:04 user nova-compute[70924]: node.session.reopen_max = 0
Jul 29 14:45:04 user nova-compute[70924]: node.conn[0].address = 172.16.0.220
Jul 29 14:45:04 user nova-compute[70924]: node.conn[0].port = 3260
Jul 29 14:45:04 user nova-compute[70924]: node.conn[0].startup = manual
Jul 29 14:45:04 user nova-compute[70924]: node.conn[0].tcp.window_size = 524288
Jul 29 14:45:04 user nova-compute[70924]: node.conn[0].tcp.type_of_service = 0
Jul 29 14:45:04 user nova-compute[70924]: node.conn[0].timeo.logout_timeout = 15
Jul 29 14:45:04 user nova-compute[70924]: node.conn[0].timeo.login_timeout = 15
Jul 29 14:45:04 user nova-compute[70924]: node.conn[0].timeo.auth_timeout = 45
Jul 29 14:45:04 user nova-compute[70924]: node.conn[0].timeo.noop_out_interval = 5
Jul 29 14:45:04 user nova-compute[70924]: node.conn[0].timeo.noop_out_timeout = 5
Jul 29 14:45:04 user nova-compute[70924]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jul 29 14:45:04 user nova-compute[70924]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jul 29 14:45:04 user nova-compute[70924]: node.conn[0].iscsi.HeaderDigest = None
Jul 29 14:45:04 user nova-compute[70924]: node.conn[0].iscsi.DataDigest = None
Jul 29 14:45:04 user nova-compute[70924]: node.conn[0].iscsi.IFMarker = No
Jul 29 14:45:04 user nova-compute[70924]: node.conn[0].iscsi.OFMarker = No
Jul 29 14:45:04 user nova-compute[70924]: # END RECORD
Jul 29 14:45:04 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:45:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:04 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[877c5cab-d9bb-45a9-9d1a-0f1962fcd91d]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:04 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:45:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:04 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d3b2a4-475f-4f7a-b0ba-c2b14c87bb06]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:04 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:45:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fabqzNKw {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fabqzNKw" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:04 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[18092813-4aa4-49de-8871-1c23a417155d]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:04 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fabqzNKw'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:45:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.049s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a2015f-893b-419f-b3f6-93e86554aa78]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2757e44-c84d-4ffc-95e8-fb4d950d9113]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:45:05 user nova-compute[70924]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)
Jul 29 14:45:05 user nova-compute[70924]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 (non-flash)
Jul 29 14:45:05 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:45:05 user nova-compute[70924]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)
Jul 29 14:45:05 user nova-compute[70924]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 (non-flash)
Jul 29 14:45:05 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.208s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Connected to 172.16.0.220:3260 {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] HCTL ('34', '0', '0', 0) found on session 14 with lun 0 {{(pid=70924) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=70924) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:05 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Instance destroyed successfully.
Jul 29 14:45:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[16fffc2c-6d6c-4f1a-b1de-e73700d67e51]: (4, ('0 0 0', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Searching for a device in session 14 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fabqzNKw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.240s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] <== connect_volume: return (241ms) {'type': 'block', 'scsi_wwn': '23739373336373133', 'path': '/dev/sdc'} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23739373336373133', 'path': '/dev/sdc'} {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:40:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1109941832',display_name='tempest-ServerStableDeviceRescueTest-server-1109941832',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1109941832',id=4,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDbdP6qGTfEYwkvD4KR81+NGcmQ5kesde3Do7g0iEjKlNSihoatuFiO0botBQ2I+jEu+EJEYmwNNO9AuJw1Z33NLdKhJ+GqI2KS8DPqodG22nTbacKe8+28M7qz7hHEmA==',key_name='tempest-keypair-1327088183',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:41:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7b2ac23ab8cd48b390fa2047c1fd0e3a',ramdisk_id='',reservation_id='r-uz3xh7j4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1945714992',owner_user_name='tempest-ServerStableDeviceRescueTest-1945714992-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:43:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d93ef8af16ed4907897254f0ef7dc4f8',uuid=f5929dcf-8594-4323-a6f5-a322aff7c881,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "14b12f31-f886-4752-bac2-e4673c74ae85", "address": "fa:16:3e:0b:f1:80", "network": {"id": "4a3c2dab-e462-4e17-a2a3-f07747a26bbe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1820325619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1820325619-network", "vif_mac": "fa:16:3e:0b:f1:80"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b2ac23ab8cd48b390fa2047c1fd0e3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14b12f31-f8", "ovs_interfaceid": "14b12f31-f886-4752-bac2-e4673c74ae85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Converting VIF {"id": "14b12f31-f886-4752-bac2-e4673c74ae85", "address": "fa:16:3e:0b:f1:80", "network": {"id": "4a3c2dab-e462-4e17-a2a3-f07747a26bbe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1820325619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1820325619-network", "vif_mac": "fa:16:3e:0b:f1:80"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b2ac23ab8cd48b390fa2047c1fd0e3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14b12f31-f8", "ovs_interfaceid": "14b12f31-f886-4752-bac2-e4673c74ae85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0b:f1:80,bridge_name='br-int',has_traffic_filtering=True,id=14b12f31-f886-4752-bac2-e4673c74ae85,network=Network(4a3c2dab-e462-4e17-a2a3-f07747a26bbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14b12f31-f8') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG nova.objects.instance [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Lazy-loading 'pci_devices' on Instance uuid f5929dcf-8594-4323-a6f5-a322aff7c881 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] End _get_guest_xml xml=<domain type="kvm">
Jul 29 14:45:05 user nova-compute[70924]:   <uuid>f5929dcf-8594-4323-a6f5-a322aff7c881</uuid>
Jul 29 14:45:05 user nova-compute[70924]:   <name>instance-00000004</name>
Jul 29 14:45:05 user nova-compute[70924]:   <memory>524288</memory>
Jul 29 14:45:05 user nova-compute[70924]:   <vcpu>1</vcpu>
Jul 29 14:45:05 user nova-compute[70924]:   <metadata>
Jul 29 14:45:05 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 14:45:05 user nova-compute[70924]:       <nova:package version="0.0.0"/>
Jul 29 14:45:05 user nova-compute[70924]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1109941832</nova:name>
Jul 29 14:45:05 user nova-compute[70924]:       <nova:creationTime>2023-07-29 14:45:04</nova:creationTime>
Jul 29 14:45:05 user nova-compute[70924]:       <nova:flavor name="m1.tiny">
Jul 29 14:45:05 user nova-compute[70924]:         <nova:memory>512</nova:memory>
Jul 29 14:45:05 user nova-compute[70924]:         <nova:disk>1</nova:disk>
Jul 29 14:45:05 user nova-compute[70924]:         <nova:swap>0</nova:swap>
Jul 29 14:45:05 user nova-compute[70924]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 14:45:05 user nova-compute[70924]:         <nova:vcpus>1</nova:vcpus>
Jul 29 14:45:05 user nova-compute[70924]:       </nova:flavor>
Jul 29 14:45:05 user nova-compute[70924]:       <nova:owner>
Jul 29 14:45:05 user nova-compute[70924]:         <nova:user uuid="d93ef8af16ed4907897254f0ef7dc4f8">tempest-ServerStableDeviceRescueTest-1945714992-project-member</nova:user>
Jul 29 14:45:05 user nova-compute[70924]:         <nova:project uuid="7b2ac23ab8cd48b390fa2047c1fd0e3a">tempest-ServerStableDeviceRescueTest-1945714992</nova:project>
Jul 29 14:45:05 user nova-compute[70924]:       </nova:owner>
Jul 29 14:45:05 user nova-compute[70924]:       <nova:root type="image" uuid="3aba2e73-6832-404b-8bd0-d0503ce82b8c"/>
Jul 29 14:45:05 user nova-compute[70924]:       <nova:ports>
Jul 29 14:45:05 user nova-compute[70924]:         <nova:port uuid="14b12f31-f886-4752-bac2-e4673c74ae85">
Jul 29 14:45:05 user nova-compute[70924]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 29 14:45:05 user nova-compute[70924]:         </nova:port>
Jul 29 14:45:05 user nova-compute[70924]:       </nova:ports>
Jul 29 14:45:05 user nova-compute[70924]:     </nova:instance>
Jul 29 14:45:05 user nova-compute[70924]:   </metadata>
Jul 29 14:45:05 user nova-compute[70924]:   <sysinfo type="smbios">
Jul 29 14:45:05 user nova-compute[70924]:     <system>
Jul 29 14:45:05 user nova-compute[70924]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 14:45:05 user nova-compute[70924]:       <entry name="product">OpenStack Nova</entry>
Jul 29 14:45:05 user nova-compute[70924]:       <entry name="version">0.0.0</entry>
Jul 29 14:45:05 user nova-compute[70924]:       <entry name="serial">f5929dcf-8594-4323-a6f5-a322aff7c881</entry>
Jul 29 14:45:05 user nova-compute[70924]:       <entry name="uuid">f5929dcf-8594-4323-a6f5-a322aff7c881</entry>
Jul 29 14:45:05 user nova-compute[70924]:       <entry name="family">Virtual Machine</entry>
Jul 29 14:45:05 user nova-compute[70924]:     </system>
Jul 29 14:45:05 user nova-compute[70924]:   </sysinfo>
Jul 29 14:45:05 user nova-compute[70924]:   <os>
Jul 29 14:45:05 user nova-compute[70924]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 14:45:05 user nova-compute[70924]:     <smbios mode="sysinfo"/>
Jul 29 14:45:05 user nova-compute[70924]:   </os>
Jul 29 14:45:05 user nova-compute[70924]:   <features>
Jul 29 14:45:05 user nova-compute[70924]:     <acpi/>
Jul 29 14:45:05 user nova-compute[70924]:     <apic/>
Jul 29 14:45:05 user nova-compute[70924]:     <vmcoreinfo/>
Jul 29 14:45:05 user nova-compute[70924]:   </features>
Jul 29 14:45:05 user nova-compute[70924]:   <clock offset="utc">
Jul 29 14:45:05 user nova-compute[70924]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 14:45:05 user nova-compute[70924]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 14:45:05 user nova-compute[70924]:     <timer name="hpet" present="no"/>
Jul 29 14:45:05 user nova-compute[70924]:   </clock>
Jul 29 14:45:05 user nova-compute[70924]:   <cpu mode="custom" match="exact">
Jul 29 14:45:05 user nova-compute[70924]:     <model>Nehalem</model>
Jul 29 14:45:05 user nova-compute[70924]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 14:45:05 user nova-compute[70924]:   </cpu>
Jul 29 14:45:05 user nova-compute[70924]:   <devices>
Jul 29 14:45:05 user nova-compute[70924]:     <disk type="file" device="disk">
Jul 29 14:45:05 user nova-compute[70924]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 14:45:05 user nova-compute[70924]:       <source file="/opt/stack/data/nova/instances/f5929dcf-8594-4323-a6f5-a322aff7c881/disk"/>
Jul 29 14:45:05 user nova-compute[70924]:       <target dev="vda" bus="virtio"/>
Jul 29 14:45:05 user nova-compute[70924]:     </disk>
Jul 29 14:45:05 user nova-compute[70924]:     <disk type="block" device="disk">
Jul 29 14:45:05 user nova-compute[70924]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:45:05 user nova-compute[70924]:       <source dev="/dev/sdc"/>
Jul 29 14:45:05 user nova-compute[70924]:       <target dev="vdb" bus="virtio"/>
Jul 29 14:45:05 user nova-compute[70924]:       <serial>477164fc-6cb9-4ac2-af70-40460ad69c15</serial>
Jul 29 14:45:05 user nova-compute[70924]:     </disk>
Jul 29 14:45:05 user nova-compute[70924]:     <disk type="file" device="disk">
Jul 29 14:45:05 user nova-compute[70924]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 14:45:05 user nova-compute[70924]:       <source file="/opt/stack/data/nova/instances/f5929dcf-8594-4323-a6f5-a322aff7c881/disk.rescue"/>
Jul 29 14:45:05 user nova-compute[70924]:       <target dev="vdc" bus="virtio"/>
Jul 29 14:45:05 user nova-compute[70924]:       <boot order="1"/>
Jul 29 14:45:05 user nova-compute[70924]:     </disk>
Jul 29 14:45:05 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 14:45:05 user nova-compute[70924]:       <mac address="fa:16:3e:0b:f1:80"/>
Jul 29 14:45:05 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:45:05 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 14:45:05 user nova-compute[70924]:       <target dev="tap14b12f31-f8"/>
Jul 29 14:45:05 user nova-compute[70924]:     </interface>
Jul 29 14:45:05 user nova-compute[70924]:     <serial type="pty">
Jul 29 14:45:05 user nova-compute[70924]:       <log file="/opt/stack/data/nova/instances/f5929dcf-8594-4323-a6f5-a322aff7c881/console.log" append="off"/>
Jul 29 14:45:05 user nova-compute[70924]:     </serial>
Jul 29 14:45:05 user nova-compute[70924]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 14:45:05 user nova-compute[70924]:     <video>
Jul 29 14:45:05 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:45:05 user nova-compute[70924]:     </video>
Jul 29 14:45:05 user nova-compute[70924]:     <rng model="virtio">
Jul 29 14:45:05 user nova-compute[70924]:       <backend model="random">/dev/urandom</backend>
Jul 29 14:45:05 user nova-compute[70924]:     </rng>
Jul 29 14:45:05 user nova-compute[70924]:     <controller type="usb" index="0" model="none"/>
Jul 29 14:45:05 user nova-compute[70924]:     <memballoon model="virtio">
Jul 29 14:45:05 user nova-compute[70924]:       <stats period="10"/>
Jul 29 14:45:05 user nova-compute[70924]:     </memballoon>
Jul 29 14:45:05 user nova-compute[70924]:   </devices>
Jul 29 14:45:05 user nova-compute[70924]: </domain>
Jul 29 14:45:05 user nova-compute[70924]:  {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 14:45:05 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Instance destroyed successfully.
Jul 29 14:45:05 user nova-compute[70924]: INFO nova.compute.manager [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Detaching volume 45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59
Jul 29 14:45:05 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] No BDM found with device name vdc, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] No VIF found with MAC fa:16:3e:0b:f1:80, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:45:05 user nova-compute[70924]: INFO nova.virt.block_device [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Attempting to driver detach volume 45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 from mountpoint /dev/vdb
Jul 29 14:45:05 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Attempting to detach device vdb from instance 86ecc6cb-88a8-4572-8e41-d4c5859036a6 from the persistent domain config. {{(pid=70924) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 14:45:05 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:45:05 user nova-compute[70924]:   <source dev="/dev/sdd"/>
Jul 29 14:45:05 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 14:45:05 user nova-compute[70924]:   <serial>45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59</serial>
Jul 29 14:45:05 user nova-compute[70924]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 14:45:05 user nova-compute[70924]: </disk>
Jul 29 14:45:05 user nova-compute[70924]:  {{(pid=70924) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 14:45:05 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Successfully detached device vdb from instance 86ecc6cb-88a8-4572-8e41-d4c5859036a6 from the persistent domain config.
Jul 29 14:45:05 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] calling os-brick to detach iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, {'target_iqns': ['iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uaenIoSC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:45:05 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 29 14:45:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59', 0)] {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d0c9ea8-bab8-48c6-b255-e6ce1133e4ac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea36cbc-07cc-4657-94e9-88a8cd821b6a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:45:05 user nova-compute[70924]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)
Jul 29 14:45:05 user nova-compute[70924]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 (non-flash)
Jul 29 14:45:05 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:45:05 user nova-compute[70924]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)
Jul 29 14:45:05 user nova-compute[70924]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 (non-flash)
Jul 29 14:45:05 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feedc448820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59'): ({'sdd'}, set())}) {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Removing single pathed devices sdd {{(pid=70924) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e2fdfa-0c9d-416b-b2bb-24a31243c805]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.032s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e33667-acfe-46b3-af13-d1981322b276]: (4, ('ok\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Flushing IO for device /dev/sdd {{(pid=70924) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba49fda-544c-4fa4-bf0b-4d6b5942bb9d]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70924) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f5ff24b-1c3e-4c69-ba4f-44278a0815e2]: (4, ('1', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] SCSI volumes sdd have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59')] {{(pid=70924) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a88134-7ea7-43bd-9a29-b3f6833c7634]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 -p 172.16.0.220:3260 --logout {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2323b0-1578-4d1d-9091-846b466cc500]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59, portal: 172.16.0.220,3260]
Jul 29 14:45:05 user nova-compute[70924]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59, portal: 172.16.0.220,3260] successful.
Jul 29 14:45:05 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 -p 172.16.0.220:3260 --op delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd696ba1-fa95-4039-81e1-de36eb5184bf]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] <== disconnect_volume: return (325ms) None {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Disconnected iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG nova.compute.manager [req-ed21ff6b-fcfb-438d-94be-1ac17427d11a req-7a0f5239-82eb-4f67-9809-11f7b33fa575 service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Received event network-vif-unplugged-14b12f31-f886-4752-bac2-e4673c74ae85 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-ed21ff6b-fcfb-438d-94be-1ac17427d11a req-7a0f5239-82eb-4f67-9809-11f7b33fa575 service nova] Acquiring lock "f5929dcf-8594-4323-a6f5-a322aff7c881-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-ed21ff6b-fcfb-438d-94be-1ac17427d11a req-7a0f5239-82eb-4f67-9809-11f7b33fa575 service nova] Lock "f5929dcf-8594-4323-a6f5-a322aff7c881-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-ed21ff6b-fcfb-438d-94be-1ac17427d11a req-7a0f5239-82eb-4f67-9809-11f7b33fa575 service nova] Lock "f5929dcf-8594-4323-a6f5-a322aff7c881-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG nova.compute.manager [req-ed21ff6b-fcfb-438d-94be-1ac17427d11a req-7a0f5239-82eb-4f67-9809-11f7b33fa575 service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] No waiting events found dispatching network-vif-unplugged-14b12f31-f886-4752-bac2-e4673c74ae85 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:45:05 user nova-compute[70924]: WARNING nova.compute.manager [req-ed21ff6b-fcfb-438d-94be-1ac17427d11a req-7a0f5239-82eb-4f67-9809-11f7b33fa575 service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Received unexpected event network-vif-unplugged-14b12f31-f886-4752-bac2-e4673c74ae85 for instance with vm_state active and task_state rescuing.
Jul 29 14:45:05 user nova-compute[70924]: DEBUG nova.compute.manager [req-ed21ff6b-fcfb-438d-94be-1ac17427d11a req-7a0f5239-82eb-4f67-9809-11f7b33fa575 service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Received event network-vif-plugged-14b12f31-f886-4752-bac2-e4673c74ae85 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-ed21ff6b-fcfb-438d-94be-1ac17427d11a req-7a0f5239-82eb-4f67-9809-11f7b33fa575 service nova] Acquiring lock "f5929dcf-8594-4323-a6f5-a322aff7c881-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-ed21ff6b-fcfb-438d-94be-1ac17427d11a req-7a0f5239-82eb-4f67-9809-11f7b33fa575 service nova] Lock "f5929dcf-8594-4323-a6f5-a322aff7c881-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-ed21ff6b-fcfb-438d-94be-1ac17427d11a req-7a0f5239-82eb-4f67-9809-11f7b33fa575 service nova] Lock "f5929dcf-8594-4323-a6f5-a322aff7c881-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:05 user nova-compute[70924]: DEBUG nova.compute.manager [req-ed21ff6b-fcfb-438d-94be-1ac17427d11a req-7a0f5239-82eb-4f67-9809-11f7b33fa575 service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] No waiting events found dispatching network-vif-plugged-14b12f31-f886-4752-bac2-e4673c74ae85 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:45:05 user nova-compute[70924]: WARNING nova.compute.manager [req-ed21ff6b-fcfb-438d-94be-1ac17427d11a req-7a0f5239-82eb-4f67-9809-11f7b33fa575 service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Received unexpected event network-vif-plugged-14b12f31-f886-4752-bac2-e4673c74ae85 for instance with vm_state active and task_state rescuing.
Jul 29 14:45:06 user nova-compute[70924]: DEBUG nova.network.neutron [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Updating instance_info_cache with network_info: [{"id": "195c1f76-2177-4201-bb05-291d7131c3c2", "address": "fa:16:3e:15:a9:c3", "network": {"id": "a836313e-84ad-4a1a-b4de-5eee3652fe69", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-368818776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195c1f76-21", "ovs_interfaceid": "195c1f76-2177-4201-bb05-291d7131c3c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e98a5996-f4ad-44fd-9fc9-591e411bbaa1", "address": "fa:16:3e:bc:51:b6", "network": {"id": "5f1efb98-21ff-48db-95aa-ab5f29e5ff45", "bridge": "br-int", "label": "tempest-device-tagging-net1-473596273", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape98a5996-f4", "ovs_interfaceid": "e98a5996-f4ad-44fd-9fc9-591e411bbaa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f108e5c9-68f4-4444-b686-18df097fa015", "address": "fa:16:3e:08:fb:b3", "network": {"id": "5f1efb98-21ff-48db-95aa-ab5f29e5ff45", "bridge": "br-int", "label": "tempest-device-tagging-net1-473596273", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf108e5c9-68", "ovs_interfaceid": "f108e5c9-68f4-4444-b686-18df097fa015", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0a5aa889-f4ad-49dd-9741-ce0d161bc25f", "address": "fa:16:3e:65:cc:a7", "network": {"id": "5f1efb98-21ff-48db-95aa-ab5f29e5ff45", "bridge": "br-int", "label": "tempest-device-tagging-net1-473596273", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a5aa889-f4", "ovs_interfaceid": "0a5aa889-f4ad-49dd-9741-ce0d161bc25f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2e35e8a0-e202-46d5-b854-9960de88edc2", "address": "fa:16:3e:cc:03:d5", "network": {"id": "5f1efb98-21ff-48db-95aa-ab5f29e5ff45", "bridge": "br-int", "label": "tempest-device-tagging-net1-473596273", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e35e8a0-e2", "ovs_interfaceid": "2e35e8a0-e202-46d5-b854-9960de88edc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7334899f-e7c7-48d8-8c14-4fda63fea3b5", "address": "fa:16:3e:ae:d5:21", "network": {"id": "381d607e-5106-44f3-b3e0-8926c54e74f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-197405985", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7334899f-e7", "ovs_interfaceid": "7334899f-e7c7-48d8-8c14-4fda63fea3b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c6793a3b-97da-4584-a326-f1caf598cd78", "address": "fa:16:3e:30:14:87", "network": {"id": "381d607e-5106-44f3-b3e0-8926c54e74f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-197405985", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6793a3b-97", "ovs_interfaceid": "c6793a3b-97da-4584-a326-f1caf598cd78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:45:06 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Releasing lock "refresh_cache-35bdb2dd-d2d4-4a3d-9178-6892d478dfa3" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:45:06 user nova-compute[70924]: DEBUG nova.compute.manager [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Instance network_info: |[{"id": "195c1f76-2177-4201-bb05-291d7131c3c2", "address": "fa:16:3e:15:a9:c3", "network": {"id": "a836313e-84ad-4a1a-b4de-5eee3652fe69", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-368818776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195c1f76-21", "ovs_interfaceid": "195c1f76-2177-4201-bb05-291d7131c3c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e98a5996-f4ad-44fd-9fc9-591e411bbaa1", "address": "fa:16:3e:bc:51:b6", "network": {"id": "5f1efb98-21ff-48db-95aa-ab5f29e5ff45", "bridge": "br-int", "label": "tempest-device-tagging-net1-473596273", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape98a5996-f4", "ovs_interfaceid": "e98a5996-f4ad-44fd-9fc9-591e411bbaa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f108e5c9-68f4-4444-b686-18df097fa015", "address": "fa:16:3e:08:fb:b3", "network": {"id": "5f1efb98-21ff-48db-95aa-ab5f29e5ff45", "bridge": "br-int", "label": "tempest-device-tagging-net1-473596273", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf108e5c9-68", "ovs_interfaceid": "f108e5c9-68f4-4444-b686-18df097fa015", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0a5aa889-f4ad-49dd-9741-ce0d161bc25f", "address": "fa:16:3e:65:cc:a7", "network": {"id": "5f1efb98-21ff-48db-95aa-ab5f29e5ff45", "bridge": "br-int", "label": "tempest-device-tagging-net1-473596273", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a5aa889-f4", "ovs_interfaceid": "0a5aa889-f4ad-49dd-9741-ce0d161bc25f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2e35e8a0-e202-46d5-b854-9960de88edc2", "address": "fa:16:3e:cc:03:d5", "network": {"id": "5f1efb98-21ff-48db-95aa-ab5f29e5ff45", "bridge": "br-int", "label": "tempest-device-tagging-net1-473596273", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e35e8a0-e2", "ovs_interfaceid": "2e35e8a0-e202-46d5-b854-9960de88edc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7334899f-e7c7-48d8-8c14-4fda63fea3b5", "address": "fa:16:3e:ae:d5:21", "network": {"id": "381d607e-5106-44f3-b3e0-8926c54e74f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-197405985", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7334899f-e7", "ovs_interfaceid": "7334899f-e7c7-48d8-8c14-4fda63fea3b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c6793a3b-97da-4584-a326-f1caf598cd78", "address": "fa:16:3e:30:14:87", "network": {"id": "381d607e-5106-44f3-b3e0-8926c54e74f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-197405985", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6793a3b-97", "ovs_interfaceid": "c6793a3b-97da-4584-a326-f1caf598cd78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 14:45:06 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-8f6d478d-1545-4029-b893-a1e117c71f35 req-b5b54af8-f99a-4b43-af6b-ff66c26dcee2 service nova] Acquired lock "refresh_cache-35bdb2dd-d2d4-4a3d-9178-6892d478dfa3" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:45:06 user nova-compute[70924]: DEBUG nova.network.neutron [req-8f6d478d-1545-4029-b893-a1e117c71f35 req-b5b54af8-f99a-4b43-af6b-ff66c26dcee2 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Refreshing network info cache for port c6793a3b-97da-4584-a326-f1caf598cd78 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:45:06 user nova-compute[70924]: DEBUG nova.compute.manager [req-525ef614-c14f-4721-a0ec-d0c9c54052be req-1b5d711b-82e6-4bc8-b062-67daeb5b295b service nova] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Received event network-vif-unplugged-4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:45:06 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-525ef614-c14f-4721-a0ec-d0c9c54052be req-1b5d711b-82e6-4bc8-b062-67daeb5b295b service nova] Acquiring lock "86ecc6cb-88a8-4572-8e41-d4c5859036a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:45:06 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-525ef614-c14f-4721-a0ec-d0c9c54052be req-1b5d711b-82e6-4bc8-b062-67daeb5b295b service nova] Lock "86ecc6cb-88a8-4572-8e41-d4c5859036a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:45:06 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-525ef614-c14f-4721-a0ec-d0c9c54052be req-1b5d711b-82e6-4bc8-b062-67daeb5b295b service nova] Lock "86ecc6cb-88a8-4572-8e41-d4c5859036a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:06 user nova-compute[70924]: DEBUG nova.compute.manager [req-525ef614-c14f-4721-a0ec-d0c9c54052be req-1b5d711b-82e6-4bc8-b062-67daeb5b295b service nova] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] No waiting events found dispatching network-vif-unplugged-4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:45:06 user nova-compute[70924]: WARNING nova.compute.manager [req-525ef614-c14f-4721-a0ec-d0c9c54052be req-1b5d711b-82e6-4bc8-b062-67daeb5b295b service nova] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Received unexpected event network-vif-unplugged-4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3 for instance with vm_state active and task_state rebuilding.
Jul 29 14:45:06 user nova-compute[70924]: DEBUG nova.compute.manager [req-525ef614-c14f-4721-a0ec-d0c9c54052be req-1b5d711b-82e6-4bc8-b062-67daeb5b295b service nova] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Received event network-vif-plugged-4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:45:06 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-525ef614-c14f-4721-a0ec-d0c9c54052be req-1b5d711b-82e6-4bc8-b062-67daeb5b295b service nova] Acquiring lock "86ecc6cb-88a8-4572-8e41-d4c5859036a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:45:06 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-525ef614-c14f-4721-a0ec-d0c9c54052be req-1b5d711b-82e6-4bc8-b062-67daeb5b295b service nova] Lock "86ecc6cb-88a8-4572-8e41-d4c5859036a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:45:06 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-525ef614-c14f-4721-a0ec-d0c9c54052be req-1b5d711b-82e6-4bc8-b062-67daeb5b295b service nova] Lock "86ecc6cb-88a8-4572-8e41-d4c5859036a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:06 user nova-compute[70924]: DEBUG nova.compute.manager [req-525ef614-c14f-4721-a0ec-d0c9c54052be req-1b5d711b-82e6-4bc8-b062-67daeb5b295b service nova] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] No waiting events found dispatching network-vif-plugged-4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:45:06 user nova-compute[70924]: WARNING nova.compute.manager [req-525ef614-c14f-4721-a0ec-d0c9c54052be req-1b5d711b-82e6-4bc8-b062-67daeb5b295b service nova] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Received unexpected event network-vif-plugged-4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3 for instance with vm_state active and task_state rebuilding.
Jul 29 14:45:06 user nova-compute[70924]: INFO nova.virt.block_device [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Booting with volume 49b03148-7445-466e-b4dd-4b84dcaaa95a at /dev/vdc
Jul 29 14:45:06 user nova-compute[70924]: DEBUG nova.network.neutron [req-8f6d478d-1545-4029-b893-a1e117c71f35 req-b5b54af8-f99a-4b43-af6b-ff66c26dcee2 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Updated VIF entry in instance network info cache for port c6793a3b-97da-4584-a326-f1caf598cd78. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:45:06 user nova-compute[70924]: DEBUG nova.network.neutron [req-8f6d478d-1545-4029-b893-a1e117c71f35 req-b5b54af8-f99a-4b43-af6b-ff66c26dcee2 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Updating instance_info_cache with network_info: [{"id": "195c1f76-2177-4201-bb05-291d7131c3c2", "address": "fa:16:3e:15:a9:c3", "network": {"id": "a836313e-84ad-4a1a-b4de-5eee3652fe69", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-368818776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195c1f76-21", "ovs_interfaceid": "195c1f76-2177-4201-bb05-291d7131c3c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e98a5996-f4ad-44fd-9fc9-591e411bbaa1", "address": "fa:16:3e:bc:51:b6", "network": {"id": "5f1efb98-21ff-48db-95aa-ab5f29e5ff45", "bridge": "br-int", "label": "tempest-device-tagging-net1-473596273", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape98a5996-f4", "ovs_interfaceid": "e98a5996-f4ad-44fd-9fc9-591e411bbaa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f108e5c9-68f4-4444-b686-18df097fa015", "address": "fa:16:3e:08:fb:b3", "network": {"id": "5f1efb98-21ff-48db-95aa-ab5f29e5ff45", "bridge": "br-int", "label": "tempest-device-tagging-net1-473596273", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf108e5c9-68", "ovs_interfaceid": "f108e5c9-68f4-4444-b686-18df097fa015", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0a5aa889-f4ad-49dd-9741-ce0d161bc25f", "address": "fa:16:3e:65:cc:a7", "network": {"id": "5f1efb98-21ff-48db-95aa-ab5f29e5ff45", "bridge": "br-int", "label": "tempest-device-tagging-net1-473596273", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a5aa889-f4", "ovs_interfaceid": "0a5aa889-f4ad-49dd-9741-ce0d161bc25f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2e35e8a0-e202-46d5-b854-9960de88edc2", "address": "fa:16:3e:cc:03:d5", "network": {"id": "5f1efb98-21ff-48db-95aa-ab5f29e5ff45", "bridge": "br-int", "label": "tempest-device-tagging-net1-473596273", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e35e8a0-e2", "ovs_interfaceid": "2e35e8a0-e202-46d5-b854-9960de88edc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7334899f-e7c7-48d8-8c14-4fda63fea3b5", "address": "fa:16:3e:ae:d5:21", "network": {"id": "381d607e-5106-44f3-b3e0-8926c54e74f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-197405985", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7334899f-e7", "ovs_interfaceid": "7334899f-e7c7-48d8-8c14-4fda63fea3b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c6793a3b-97da-4584-a326-f1caf598cd78", "address": "fa:16:3e:30:14:87", "network": {"id": "381d607e-5106-44f3-b3e0-8926c54e74f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-197405985", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6793a3b-97", "ovs_interfaceid": "c6793a3b-97da-4584-a326-f1caf598cd78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:45:06 user nova-compute[70924]: DEBUG os_brick.utils [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:45:06 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:06 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-8f6d478d-1545-4029-b893-a1e117c71f35 req-b5b54af8-f99a-4b43-af6b-ff66c26dcee2 service nova] Releasing lock "refresh_cache-35bdb2dd-d2d4-4a3d-9178-6892d478dfa3" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:45:06 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:06 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65c0676-9671-4066-8009-c7fcf2d3ca21]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f2127c4a30d9\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:06 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:06 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.029s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:06 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b9bd27-a739-4a8e-a31c-e2cfc47ab457]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:06 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:06 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:06 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfbc6d0f-a08b-45cb-b1e7-86b221949d98]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:06 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1757d056-7b6e-40df-9e94-7f0ef00175e5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:06 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Running cmd (subprocess): nvme version {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:06 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] 'nvme version' failed. Not Retrying. {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:45:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:06 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] nvme not present on system {{(pid=70924) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 14:45:06 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:06 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Instance destroyed successfully.
Jul 29 14:45:06 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:45:06 user nova-compute[70924]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 14:45:06 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd805db-7eef-4bea-a821-71453d8aed2b]: (4, '') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:06 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:41:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2046651584',display_name='tempest-ServerActionsTestOtherA-server-413431300',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2046651584',id=5,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfg71Q+cjedfRarcbIler9POuKvX/jsQII2ANgknh6qTEvuHJAE8T34RCDfGUcAvd9SbwZCzhWP8ikNDBjVZKRBIySMsLhBLIX0hKsMOAV+S3aIT6/Yawicov1EmjAkDw==',key_name='tempest-keypair-1866871140',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:41:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b33d01ba458f466b99b6bc5bba88d8c0',ramdisk_id='',reservation_id='r-uso70bui',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-166265056',owner_user_name='tempest-ServerActionsTestOtherA-166265056-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:45:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55b9032bef2d4d3586dc5d18cdc1ee55',uuid=86ecc6cb-88a8-4572-8e41-d4c5859036a6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3", "address": "fa:16:3e:d6:b6:d3", "network": {"id": "55c18d07-a341-4678-9d1c-2dff057a9b1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1092921088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b33d01ba458f466b99b6bc5bba88d8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cd05bcc-ca", "ovs_interfaceid": "4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 14:45:06 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Converting VIF {"id": "4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3", "address": "fa:16:3e:d6:b6:d3", "network": {"id": "55c18d07-a341-4678-9d1c-2dff057a9b1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1092921088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b33d01ba458f466b99b6bc5bba88d8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cd05bcc-ca", "ovs_interfaceid": "4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:45:06 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d6:b6:d3,bridge_name='br-int',has_traffic_filtering=True,id=4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3,network=Network(55c18d07-a341-4678-9d1c-2dff057a9b1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cd05bcc-ca') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:45:06 user nova-compute[70924]: DEBUG os_vif [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:b6:d3,bridge_name='br-int',has_traffic_filtering=True,id=4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3,network=Network(55c18d07-a341-4678-9d1c-2dff057a9b1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cd05bcc-ca') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 14:45:06 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70924) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 14:45:06 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 14:45:06 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] LIGHTOS: no hostnqn found. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 14:45:06 user nova-compute[70924]: DEBUG os_brick.utils [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] <== get_connector_properties: return (183ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f2127c4a30d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:45:06 user nova-compute[70924]: DEBUG nova.virt.block_device [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Updating existing volume attachment record: 4672fcf1-a9c5-4d32-b7d2-8412ab2676ba {{(pid=70924) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 14:45:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4cd05bcc-ca, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:45:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:45:06 user nova-compute[70924]: INFO os_vif [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:b6:d3,bridge_name='br-int',has_traffic_filtering=True,id=4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3,network=Network(55c18d07-a341-4678-9d1c-2dff057a9b1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cd05bcc-ca')
Jul 29 14:45:06 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] calling os-brick to detach iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 14:45:06 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, {'target_iqns': ['iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uaenIoSC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:45:06 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 29 14:45:06 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:45:06 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:45:06 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59', 0)] {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 14:45:06 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:06 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:06 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2d508d-6f05-47c7-bb0d-2d71e73c659c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:06 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:06 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:06 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[91aae6e2-4928-40fd-a4b6-b0f54f8a6e11]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:06 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:45:06 user nova-compute[70924]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)
Jul 29 14:45:06 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:45:06 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:45:06 user nova-compute[70924]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)
Jul 29 14:45:06 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:45:06 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feedc389f30>, {}) {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 14:45:06 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Disconnecting from: [] {{(pid=70924) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 14:45:06 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.050s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:45:06 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] <== disconnect_volume: return (51ms) None {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:45:06 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Disconnected iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 14:45:06 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Deleting instance files /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6_del
Jul 29 14:45:06 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Deletion of /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6_del complete
Jul 29 14:45:07 user nova-compute[70924]: INFO nova.virt.block_device [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Booting with volume 45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 at /dev/vdb
Jul 29 14:45:07 user nova-compute[70924]: DEBUG os_brick.utils [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:45:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:07 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b733bb3-8fd3-4221-9438-5a9ccc88e6ab]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f2127c4a30d9\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:07 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c8b68c-27fb-4f30-b95e-0812d2015e56]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:07 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e967170f-d0ce-45ed-9aad-5df364f63c5d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:07 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9022741-f3fe-4121-ad5f-9544e1432c80]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Running cmd (subprocess): nvme version {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] 'nvme version' failed. Not Retrying. {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:45:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] nvme not present on system {{(pid=70924) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 14:45:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:45:07 user nova-compute[70924]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 14:45:07 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[90cc52ce-c962-4bd3-a3a0-7eef18d8964b]: (4, '') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70924) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 14:45:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 14:45:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] LIGHTOS: no hostnqn found. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 14:45:07 user nova-compute[70924]: DEBUG os_brick.utils [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f2127c4a30d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:45:07 user nova-compute[70924]: DEBUG nova.virt.block_device [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Updating existing volume attachment record: d0675ffe-24da-4492-9800-4b24c9111e1b {{(pid=70924) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 14:45:07 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:07 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:08 user nova-compute[70924]: DEBUG nova.compute.manager [req-5e49b7c8-0c91-4177-a5c6-5420ba2ce91d req-6a0916e4-1ee2-4ed1-9d79-fb2c1560d402 service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Received event network-vif-plugged-14b12f31-f886-4752-bac2-e4673c74ae85 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:45:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-5e49b7c8-0c91-4177-a5c6-5420ba2ce91d req-6a0916e4-1ee2-4ed1-9d79-fb2c1560d402 service nova] Acquiring lock "f5929dcf-8594-4323-a6f5-a322aff7c881-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:45:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-5e49b7c8-0c91-4177-a5c6-5420ba2ce91d req-6a0916e4-1ee2-4ed1-9d79-fb2c1560d402 service nova] Lock "f5929dcf-8594-4323-a6f5-a322aff7c881-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:45:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-5e49b7c8-0c91-4177-a5c6-5420ba2ce91d req-6a0916e4-1ee2-4ed1-9d79-fb2c1560d402 service nova] Lock "f5929dcf-8594-4323-a6f5-a322aff7c881-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:08 user nova-compute[70924]: DEBUG nova.compute.manager [req-5e49b7c8-0c91-4177-a5c6-5420ba2ce91d req-6a0916e4-1ee2-4ed1-9d79-fb2c1560d402 service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] No waiting events found dispatching network-vif-plugged-14b12f31-f886-4752-bac2-e4673c74ae85 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:45:08 user nova-compute[70924]: WARNING nova.compute.manager [req-5e49b7c8-0c91-4177-a5c6-5420ba2ce91d req-6a0916e4-1ee2-4ed1-9d79-fb2c1560d402 service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Received unexpected event network-vif-plugged-14b12f31-f886-4752-bac2-e4673c74ae85 for instance with vm_state active and task_state rescuing.
Jul 29 14:45:08 user nova-compute[70924]: DEBUG nova.compute.manager [req-5e49b7c8-0c91-4177-a5c6-5420ba2ce91d req-6a0916e4-1ee2-4ed1-9d79-fb2c1560d402 service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Received event network-vif-plugged-14b12f31-f886-4752-bac2-e4673c74ae85 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:45:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-5e49b7c8-0c91-4177-a5c6-5420ba2ce91d req-6a0916e4-1ee2-4ed1-9d79-fb2c1560d402 service nova] Acquiring lock "f5929dcf-8594-4323-a6f5-a322aff7c881-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:45:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-5e49b7c8-0c91-4177-a5c6-5420ba2ce91d req-6a0916e4-1ee2-4ed1-9d79-fb2c1560d402 service nova] Lock "f5929dcf-8594-4323-a6f5-a322aff7c881-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:45:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-5e49b7c8-0c91-4177-a5c6-5420ba2ce91d req-6a0916e4-1ee2-4ed1-9d79-fb2c1560d402 service nova] Lock "f5929dcf-8594-4323-a6f5-a322aff7c881-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:08 user nova-compute[70924]: DEBUG nova.compute.manager [req-5e49b7c8-0c91-4177-a5c6-5420ba2ce91d req-6a0916e4-1ee2-4ed1-9d79-fb2c1560d402 service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] No waiting events found dispatching network-vif-plugged-14b12f31-f886-4752-bac2-e4673c74ae85 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:45:08 user nova-compute[70924]: WARNING nova.compute.manager [req-5e49b7c8-0c91-4177-a5c6-5420ba2ce91d req-6a0916e4-1ee2-4ed1-9d79-fb2c1560d402 service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Received unexpected event network-vif-plugged-14b12f31-f886-4752-bac2-e4673c74ae85 for instance with vm_state active and task_state rescuing.
Jul 29 14:45:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:09 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Removed pending event for f5929dcf-8594-4323-a6f5-a322aff7c881 due to event {{(pid=70924) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 29 14:45:09 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690641909.3942366, f5929dcf-8594-4323-a6f5-a322aff7c881 => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:45:09 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] VM Resumed (Lifecycle Event)
Jul 29 14:45:09 user nova-compute[70924]: DEBUG nova.compute.manager [None req-7b45ddd6-f1d5-4d8c-b8d2-a407a411c76d tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:45:09 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:45:09 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:45:09 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 29 14:45:09 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690641909.3946972, f5929dcf-8594-4323-a6f5-a322aff7c881 => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:45:09 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] VM Started (Lifecycle Event)
Jul 29 14:45:09 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:45:09 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:45:11 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:13 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:14 user nova-compute[70924]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690641899.0827296, 9b4c76df-f74f-43b4-968f-b730cc5b0ec6 => Stopped> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:45:14 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] VM Stopped (Lifecycle Event)
Jul 29 14:45:14 user nova-compute[70924]: DEBUG nova.compute.manager [None req-303964c5-5699-4af9-9a35-6e0d250e290a None None] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:45:15 user nova-compute[70924]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690641900.5773315, fcbb998c-2dac-47d9-985a-d5b2a15ddaa0 => Stopped> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:45:15 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] VM Stopped (Lifecycle Event)
Jul 29 14:45:15 user nova-compute[70924]: DEBUG nova.compute.manager [None req-ab317d60-6770-4bd0-b2bd-3e0b5c446d84 None None] [instance: fcbb998c-2dac-47d9-985a-d5b2a15ddaa0] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:45:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Creating instance directory {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 14:45:16 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Creating image(s)
Jul 29 14:45:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Acquiring lock "/opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:45:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "/opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:45:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "/opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:16 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:16 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:16 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.230s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Acquiring lock "bd72453517468710f1de26b27fb0ea28688e9009" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:45:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:45:16 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:16 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.159s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:16 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk 1073741824 {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:16 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk 1073741824" returned: 0 in 0.053s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:16 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:16 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.145s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:16 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Checking if we can resize image /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk. size=1073741824 {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 14:45:16 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:16 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:16 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Cannot resize image /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk to a smaller size. {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 14:45:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Created local disks {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 14:45:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Ensure instance console log exists: /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/console.log {{(pid=70924) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 14:45:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:45:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:45:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Start _get_guest_xml network_info=[{"id": "4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3", "address": "fa:16:3e:d6:b6:d3", "network": {"id": "55c18d07-a341-4678-9d1c-2dff057a9b1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1092921088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b33d01ba458f466b99b6bc5bba88d8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cd05bcc-ca", "ovs_interfaceid": "4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '3aba2e73-6832-404b-8bd0-d0503ce82b8c'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'boot_index': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uaenIoSC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '86ecc6cb-88a8-4572-8e41-d4c5859036a6', 'attached_at': '', 'detached_at': '', 'volume_id': '45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59', 'serial': '45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59'}, 'attachment_id': 'd0675ffe-24da-4492-9800-4b24c9111e1b', 'volume_type': None} {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 14:45:16 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 29 14:45:16 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 29 14:45:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 14:45:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] CPU controller missing on host. {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 14:45:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 14:45:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] CPU controller found on host. {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 14:45:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70924) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 14:45:16 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T14:36:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 14:45:16 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Flavor limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 14:45:16 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Image limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 14:45:16 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Flavor pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 14:45:16 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Image pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 14:45:16 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 14:45:16 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 14:45:16 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 14:45:16 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Got 1 possible topologies {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 14:45:16 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 14:45:16 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 14:45:16 user nova-compute[70924]: DEBUG nova.objects.instance [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lazy-loading 'vcpu_model' on Instance uuid 86ecc6cb-88a8-4572-8e41-d4c5859036a6 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:45:16 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Calling os-brick to attach iSCSI Volume {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 14:45:16 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uaenIoSC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:45:16 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 29 14:45:16 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:45:16 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:45:16 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 29 14:45:16 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:45:16 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:45:16 user nova-compute[70924]: INFO os_brick.initiator.connectors.iscsi [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 14:45:16 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 -p 172.16.0.220:3260 {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:17 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:17 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1032053d-c795-4b99-9a8f-287bec049f28]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:17 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 14:45:17 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:45:17 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 -p 172.16.0.220:3260 --interface default --op new {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:17 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:17 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[471f57d9-90f7-48ba-a06d-23c946a8c7c2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59] added\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:17 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59] added
Jul 29 14:45:17 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:45:17 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:17 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.108s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:17 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3df57e2-9b36-4a41-8888-c6ae83f3c5b0]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:17 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:45:17 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:17 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:17 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[211d967b-8b46-4df3-8c99-69e01ab63f58]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:17 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:45:17 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uaenIoSC {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:17 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uaenIoSC" returned: 0 in 0.066s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:17 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e9a5ef-083f-4be7-9222-dbaa88f6f3a3]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:17 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uaenIoSC'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:45:17 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:17 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:17 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db4a2b0-b52e-44e2-994c-fa86503556aa]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:17 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:45:17 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:17 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:17 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3263e5e-fa60-46ee-b037-f888a53807f1]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:17 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:45:17 user nova-compute[70924]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)
Jul 29 14:45:17 user nova-compute[70924]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:45:17 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:45:17 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:45:17 user nova-compute[70924]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)
Jul 29 14:45:17 user nova-compute[70924]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:45:17 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:45:17 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 -p 172.16.0.220:3260 --login {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:17 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:17 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2c809d-d864-492f-89e0-9f5f33aa9732]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:17 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59, portal: 172.16.0.220,3260]
Jul 29 14:45:17 user nova-compute[70924]: Login to [iface: default, target: iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59, portal: 172.16.0.220,3260] successful.
Jul 29 14:45:17 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:45:17 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:17 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:17 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c94d7a6-f5c1-4cba-931e-e3321a5e160b]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:17 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:45:17 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:17 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:17 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[230b65a3-5b79-4169-b956-81cc49fe0f78]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:17 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:45:17 user nova-compute[70924]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)
Jul 29 14:45:17 user nova-compute[70924]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:45:17 user nova-compute[70924]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 (non-flash)
Jul 29 14:45:17 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:45:17 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:45:17 user nova-compute[70924]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)
Jul 29 14:45:17 user nova-compute[70924]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:45:17 user nova-compute[70924]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 (non-flash)
Jul 29 14:45:17 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:45:17 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.448s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:45:17 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Connected to 172.16.0.220:3260 {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 14:45:17 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] HCTL ('36', '-', '-', 0) found on session 17 with lun 0 {{(pid=70924) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 14:45:17 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70924) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 14:45:17 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:17 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.038s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:17 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f6eacc-977c-463c-b451-32df6cb3d716]: (4, ('- - 0', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:17 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Searching for a device in session 17 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 14:45:17 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uaenIoSC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 14:45:18 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:18 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.507s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:45:18 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] <== connect_volume: return (1509ms) {'type': 'block', 'scsi_wwn': '23361356530333131', 'path': '/dev/sde'} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:45:18 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23361356530333131', 'path': '/dev/sde'} {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 14:45:18 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-29T14:41:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2046651584',display_name='tempest-ServerActionsTestOtherA-server-413431300',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2046651584',id=5,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfg71Q+cjedfRarcbIler9POuKvX/jsQII2ANgknh6qTEvuHJAE8T34RCDfGUcAvd9SbwZCzhWP8ikNDBjVZKRBIySMsLhBLIX0hKsMOAV+S3aIT6/Yawicov1EmjAkDw==',key_name='tempest-keypair-1866871140',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:41:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b33d01ba458f466b99b6bc5bba88d8c0',ramdisk_id='',reservation_id='r-uso70bui',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-166265056',owner_user_name='tempest-ServerActionsTestOtherA-166265056-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:45:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55b9032bef2d4d3586dc5d18cdc1ee55',uuid=86ecc6cb-88a8-4572-8e41-d4c5859036a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3", "address": "fa:16:3e:d6:b6:d3", "network": {"id": "55c18d07-a341-4678-9d1c-2dff057a9b1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1092921088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b33d01ba458f466b99b6bc5bba88d8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cd05bcc-ca", "ovs_interfaceid": "4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:45:18 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Converting VIF {"id": "4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3", "address": "fa:16:3e:d6:b6:d3", "network": {"id": "55c18d07-a341-4678-9d1c-2dff057a9b1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1092921088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b33d01ba458f466b99b6bc5bba88d8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cd05bcc-ca", "ovs_interfaceid": "4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:45:18 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d6:b6:d3,bridge_name='br-int',has_traffic_filtering=True,id=4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3,network=Network(55c18d07-a341-4678-9d1c-2dff057a9b1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cd05bcc-ca') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:45:18 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] End _get_guest_xml xml=<domain type="kvm">
Jul 29 14:45:18 user nova-compute[70924]:   <uuid>86ecc6cb-88a8-4572-8e41-d4c5859036a6</uuid>
Jul 29 14:45:18 user nova-compute[70924]:   <name>instance-00000005</name>
Jul 29 14:45:18 user nova-compute[70924]:   <memory>524288</memory>
Jul 29 14:45:18 user nova-compute[70924]:   <vcpu>1</vcpu>
Jul 29 14:45:18 user nova-compute[70924]:   <metadata>
Jul 29 14:45:18 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 14:45:18 user nova-compute[70924]:       <nova:package version="0.0.0"/>
Jul 29 14:45:18 user nova-compute[70924]:       <nova:name>tempest-ServerActionsTestOtherA-server-413431300</nova:name>
Jul 29 14:45:18 user nova-compute[70924]:       <nova:creationTime>2023-07-29 14:45:16</nova:creationTime>
Jul 29 14:45:18 user nova-compute[70924]:       <nova:flavor name="m1.tiny">
Jul 29 14:45:18 user nova-compute[70924]:         <nova:memory>512</nova:memory>
Jul 29 14:45:18 user nova-compute[70924]:         <nova:disk>1</nova:disk>
Jul 29 14:45:18 user nova-compute[70924]:         <nova:swap>0</nova:swap>
Jul 29 14:45:18 user nova-compute[70924]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 14:45:18 user nova-compute[70924]:         <nova:vcpus>1</nova:vcpus>
Jul 29 14:45:18 user nova-compute[70924]:       </nova:flavor>
Jul 29 14:45:18 user nova-compute[70924]:       <nova:owner>
Jul 29 14:45:18 user nova-compute[70924]:         <nova:user uuid="55b9032bef2d4d3586dc5d18cdc1ee55">tempest-ServerActionsTestOtherA-166265056-project-member</nova:user>
Jul 29 14:45:18 user nova-compute[70924]:         <nova:project uuid="b33d01ba458f466b99b6bc5bba88d8c0">tempest-ServerActionsTestOtherA-166265056</nova:project>
Jul 29 14:45:18 user nova-compute[70924]:       </nova:owner>
Jul 29 14:45:18 user nova-compute[70924]:       <nova:root type="image" uuid="3aba2e73-6832-404b-8bd0-d0503ce82b8c"/>
Jul 29 14:45:18 user nova-compute[70924]:       <nova:ports>
Jul 29 14:45:18 user nova-compute[70924]:         <nova:port uuid="4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3">
Jul 29 14:45:18 user nova-compute[70924]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 29 14:45:18 user nova-compute[70924]:         </nova:port>
Jul 29 14:45:18 user nova-compute[70924]:       </nova:ports>
Jul 29 14:45:18 user nova-compute[70924]:     </nova:instance>
Jul 29 14:45:18 user nova-compute[70924]:   </metadata>
Jul 29 14:45:18 user nova-compute[70924]:   <sysinfo type="smbios">
Jul 29 14:45:18 user nova-compute[70924]:     <system>
Jul 29 14:45:18 user nova-compute[70924]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 14:45:18 user nova-compute[70924]:       <entry name="product">OpenStack Nova</entry>
Jul 29 14:45:18 user nova-compute[70924]:       <entry name="version">0.0.0</entry>
Jul 29 14:45:18 user nova-compute[70924]:       <entry name="serial">86ecc6cb-88a8-4572-8e41-d4c5859036a6</entry>
Jul 29 14:45:18 user nova-compute[70924]:       <entry name="uuid">86ecc6cb-88a8-4572-8e41-d4c5859036a6</entry>
Jul 29 14:45:18 user nova-compute[70924]:       <entry name="family">Virtual Machine</entry>
Jul 29 14:45:18 user nova-compute[70924]:     </system>
Jul 29 14:45:18 user nova-compute[70924]:   </sysinfo>
Jul 29 14:45:18 user nova-compute[70924]:   <os>
Jul 29 14:45:18 user nova-compute[70924]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 14:45:18 user nova-compute[70924]:     <boot dev="hd"/>
Jul 29 14:45:18 user nova-compute[70924]:     <smbios mode="sysinfo"/>
Jul 29 14:45:18 user nova-compute[70924]:   </os>
Jul 29 14:45:18 user nova-compute[70924]:   <features>
Jul 29 14:45:18 user nova-compute[70924]:     <acpi/>
Jul 29 14:45:18 user nova-compute[70924]:     <apic/>
Jul 29 14:45:18 user nova-compute[70924]:     <vmcoreinfo/>
Jul 29 14:45:18 user nova-compute[70924]:   </features>
Jul 29 14:45:18 user nova-compute[70924]:   <clock offset="utc">
Jul 29 14:45:18 user nova-compute[70924]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 14:45:18 user nova-compute[70924]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 14:45:18 user nova-compute[70924]:     <timer name="hpet" present="no"/>
Jul 29 14:45:18 user nova-compute[70924]:   </clock>
Jul 29 14:45:18 user nova-compute[70924]:   <cpu mode="custom" match="exact">
Jul 29 14:45:18 user nova-compute[70924]:     <model>Nehalem</model>
Jul 29 14:45:18 user nova-compute[70924]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 14:45:18 user nova-compute[70924]:   </cpu>
Jul 29 14:45:18 user nova-compute[70924]:   <devices>
Jul 29 14:45:18 user nova-compute[70924]:     <disk type="file" device="disk">
Jul 29 14:45:18 user nova-compute[70924]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 14:45:18 user nova-compute[70924]:       <source file="/opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk"/>
Jul 29 14:45:18 user nova-compute[70924]:       <target dev="vda" bus="virtio"/>
Jul 29 14:45:18 user nova-compute[70924]:     </disk>
Jul 29 14:45:18 user nova-compute[70924]:     <disk type="block" device="disk">
Jul 29 14:45:18 user nova-compute[70924]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:45:18 user nova-compute[70924]:       <source dev="/dev/sde"/>
Jul 29 14:45:18 user nova-compute[70924]:       <target dev="vdb" bus="virtio"/>
Jul 29 14:45:18 user nova-compute[70924]:       <serial>45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59</serial>
Jul 29 14:45:18 user nova-compute[70924]:     </disk>
Jul 29 14:45:18 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 14:45:18 user nova-compute[70924]:       <mac address="fa:16:3e:d6:b6:d3"/>
Jul 29 14:45:18 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:45:18 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 14:45:18 user nova-compute[70924]:       <target dev="tap4cd05bcc-ca"/>
Jul 29 14:45:18 user nova-compute[70924]:     </interface>
Jul 29 14:45:18 user nova-compute[70924]:     <serial type="pty">
Jul 29 14:45:18 user nova-compute[70924]:       <log file="/opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/console.log" append="off"/>
Jul 29 14:45:18 user nova-compute[70924]:     </serial>
Jul 29 14:45:18 user nova-compute[70924]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 14:45:18 user nova-compute[70924]:     <video>
Jul 29 14:45:18 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:45:18 user nova-compute[70924]:     </video>
Jul 29 14:45:18 user nova-compute[70924]:     <rng model="virtio">
Jul 29 14:45:18 user nova-compute[70924]:       <backend model="random">/dev/urandom</backend>
Jul 29 14:45:18 user nova-compute[70924]:     </rng>
Jul 29 14:45:18 user nova-compute[70924]:     <controller type="usb" index="0" model="none"/>
Jul 29 14:45:18 user nova-compute[70924]:     <memballoon model="virtio">
Jul 29 14:45:18 user nova-compute[70924]:       <stats period="10"/>
Jul 29 14:45:18 user nova-compute[70924]:     </memballoon>
Jul 29 14:45:18 user nova-compute[70924]:   </devices>
Jul 29 14:45:18 user nova-compute[70924]: </domain>
Jul 29 14:45:18 user nova-compute[70924]:  {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 14:45:18 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-29T14:41:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2046651584',display_name='tempest-ServerActionsTestOtherA-server-413431300',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2046651584',id=5,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfg71Q+cjedfRarcbIler9POuKvX/jsQII2ANgknh6qTEvuHJAE8T34RCDfGUcAvd9SbwZCzhWP8ikNDBjVZKRBIySMsLhBLIX0hKsMOAV+S3aIT6/Yawicov1EmjAkDw==',key_name='tempest-keypair-1866871140',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:41:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b33d01ba458f466b99b6bc5bba88d8c0',ramdisk_id='',reservation_id='r-uso70bui',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-166265056',owner_user_name='tempest-ServerActionsTestOtherA-166265056-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:45:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55b9032bef2d4d3586dc5d18cdc1ee55',uuid=86ecc6cb-88a8-4572-8e41-d4c5859036a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3", "address": "fa:16:3e:d6:b6:d3", "network": {"id": "55c18d07-a341-4678-9d1c-2dff057a9b1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1092921088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b33d01ba458f466b99b6bc5bba88d8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cd05bcc-ca", "ovs_interfaceid": "4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 14:45:18 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Converting VIF {"id": "4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3", "address": "fa:16:3e:d6:b6:d3", "network": {"id": "55c18d07-a341-4678-9d1c-2dff057a9b1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1092921088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b33d01ba458f466b99b6bc5bba88d8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cd05bcc-ca", "ovs_interfaceid": "4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:45:18 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d6:b6:d3,bridge_name='br-int',has_traffic_filtering=True,id=4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3,network=Network(55c18d07-a341-4678-9d1c-2dff057a9b1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cd05bcc-ca') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:45:18 user nova-compute[70924]: DEBUG os_vif [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:b6:d3,bridge_name='br-int',has_traffic_filtering=True,id=4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3,network=Network(55c18d07-a341-4678-9d1c-2dff057a9b1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cd05bcc-ca') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 14:45:18 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:18 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:45:18 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 14:45:18 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:18 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4cd05bcc-ca, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:45:18 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4cd05bcc-ca, col_values=(('external_ids', {'iface-id': '4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:b6:d3', 'vm-uuid': '86ecc6cb-88a8-4572-8e41-d4c5859036a6'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:45:18 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:45:18 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:18 user nova-compute[70924]: INFO os_vif [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:b6:d3,bridge_name='br-int',has_traffic_filtering=True,id=4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3,network=Network(55c18d07-a341-4678-9d1c-2dff057a9b1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cd05bcc-ca')
Jul 29 14:45:18 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:45:18 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:45:18 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] No VIF found with MAC fa:16:3e:d6:b6:d3, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:45:19 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:20 user nova-compute[70924]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690641905.0817416, 86ecc6cb-88a8-4572-8e41-d4c5859036a6 => Stopped> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:45:20 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] VM Stopped (Lifecycle Event)
Jul 29 14:45:20 user nova-compute[70924]: DEBUG nova.compute.manager [None req-be960367-da47-4b75-af20-e4b269fd0200 None None] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:45:20 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:20 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:20 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:20 user nova-compute[70924]: DEBUG nova.compute.manager [req-b80be236-978f-4fbd-b12e-ac052ab0e47b req-a5cc8c3c-4862-4ce6-80d2-2aceae98f66e service nova] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Received event network-vif-plugged-4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:45:20 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b80be236-978f-4fbd-b12e-ac052ab0e47b req-a5cc8c3c-4862-4ce6-80d2-2aceae98f66e service nova] Acquiring lock "86ecc6cb-88a8-4572-8e41-d4c5859036a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:45:20 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b80be236-978f-4fbd-b12e-ac052ab0e47b req-a5cc8c3c-4862-4ce6-80d2-2aceae98f66e service nova] Lock "86ecc6cb-88a8-4572-8e41-d4c5859036a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:45:20 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b80be236-978f-4fbd-b12e-ac052ab0e47b req-a5cc8c3c-4862-4ce6-80d2-2aceae98f66e service nova] Lock "86ecc6cb-88a8-4572-8e41-d4c5859036a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:20 user nova-compute[70924]: DEBUG nova.compute.manager [req-b80be236-978f-4fbd-b12e-ac052ab0e47b req-a5cc8c3c-4862-4ce6-80d2-2aceae98f66e service nova] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] No waiting events found dispatching network-vif-plugged-4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:45:20 user nova-compute[70924]: WARNING nova.compute.manager [req-b80be236-978f-4fbd-b12e-ac052ab0e47b req-a5cc8c3c-4862-4ce6-80d2-2aceae98f66e service nova] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Received unexpected event network-vif-plugged-4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3 for instance with vm_state active and task_state rebuild_spawning.
Jul 29 14:45:20 user nova-compute[70924]: DEBUG nova.compute.manager [req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de req-05a2725a-1881-4c75-bab2-4493bfc6a95b service nova] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Received event volume-reimaged-45a218df-4554-4d68-ba78-d0232ff799b7 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:45:20 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de req-05a2725a-1881-4c75-bab2-4493bfc6a95b service nova] Acquiring lock "9b4c76df-f74f-43b4-968f-b730cc5b0ec6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:45:20 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de req-05a2725a-1881-4c75-bab2-4493bfc6a95b service nova] Lock "9b4c76df-f74f-43b4-968f-b730cc5b0ec6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:45:20 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de req-05a2725a-1881-4c75-bab2-4493bfc6a95b service nova] Lock "9b4c76df-f74f-43b4-968f-b730cc5b0ec6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:20 user nova-compute[70924]: DEBUG nova.compute.manager [req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de req-05a2725a-1881-4c75-bab2-4493bfc6a95b service nova] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Processing event volume-reimaged-45a218df-4554-4d68-ba78-d0232ff799b7 {{(pid=70924) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Jul 29 14:45:20 user nova-compute[70924]: DEBUG nova.compute.manager [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Instance event wait completed in 18 seconds for volume-reimaged {{(pid=70924) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 14:45:20 user nova-compute[70924]: INFO nova.virt.block_device [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Booting with volume 45a218df-4554-4d68-ba78-d0232ff799b7 at /dev/vda
Jul 29 14:45:21 user nova-compute[70924]: DEBUG os_brick.utils [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:45:21 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:21 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:21 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[a100a7b2-2cad-4b44-86c3-a30cf725c1bd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f2127c4a30d9\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:21 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:21 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:21 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d49100-2e37-4d3e-856c-8eae246e7014]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:21 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:21 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:21 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[398f32b3-513a-4d46-9988-43833e951176]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:21 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[544b4a82-2594-4dfc-9180-e52d59a13e5c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:21 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Running cmd (subprocess): nvme version {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:21 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] 'nvme version' failed. Not Retrying. {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:45:21 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.nvmeof [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] nvme not present on system {{(pid=70924) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 14:45:21 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:21 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:45:21 user nova-compute[70924]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 14:45:21 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f71f708-f135-4a5e-8d25-49fe7dc230ee]: (4, '') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:21 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70924) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 14:45:21 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 14:45:21 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] LIGHTOS: no hostnqn found. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 14:45:21 user nova-compute[70924]: DEBUG os_brick.utils [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f2127c4a30d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:45:21 user nova-compute[70924]: DEBUG nova.virt.block_device [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Updating existing volume attachment record: 07d4e431-e43d-4e0f-9381-5c9478cd5f5f {{(pid=70924) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 14:45:21 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:21 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:22 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690641922.7158992, 86ecc6cb-88a8-4572-8e41-d4c5859036a6 => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:45:22 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] VM Resumed (Lifecycle Event)
Jul 29 14:45:22 user nova-compute[70924]: DEBUG nova.compute.manager [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Instance event wait completed in 0 seconds for  {{(pid=70924) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 14:45:22 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Guest created on hypervisor {{(pid=70924) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 14:45:22 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Instance spawned successfully.
Jul 29 14:45:22 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 14:45:22 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:45:22 user nova-compute[70924]: DEBUG nova.compute.manager [req-d7d5ca37-4cdd-4f36-a286-dbb5651f93a1 req-29caf9ba-4089-44c6-97d8-a1690837e988 service nova] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Received event network-vif-plugged-4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:45:22 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-d7d5ca37-4cdd-4f36-a286-dbb5651f93a1 req-29caf9ba-4089-44c6-97d8-a1690837e988 service nova] Acquiring lock "86ecc6cb-88a8-4572-8e41-d4c5859036a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:45:22 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-d7d5ca37-4cdd-4f36-a286-dbb5651f93a1 req-29caf9ba-4089-44c6-97d8-a1690837e988 service nova] Lock "86ecc6cb-88a8-4572-8e41-d4c5859036a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:45:22 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-d7d5ca37-4cdd-4f36-a286-dbb5651f93a1 req-29caf9ba-4089-44c6-97d8-a1690837e988 service nova] Lock "86ecc6cb-88a8-4572-8e41-d4c5859036a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:22 user nova-compute[70924]: DEBUG nova.compute.manager [req-d7d5ca37-4cdd-4f36-a286-dbb5651f93a1 req-29caf9ba-4089-44c6-97d8-a1690837e988 service nova] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] No waiting events found dispatching network-vif-plugged-4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:45:22 user nova-compute[70924]: WARNING nova.compute.manager [req-d7d5ca37-4cdd-4f36-a286-dbb5651f93a1 req-29caf9ba-4089-44c6-97d8-a1690837e988 service nova] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Received unexpected event network-vif-plugged-4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3 for instance with vm_state active and task_state rebuild_spawning.
Jul 29 14:45:22 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:45:22 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Found default for hw_cdrom_bus of ide {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:45:22 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Found default for hw_disk_bus of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:45:22 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Found default for hw_input_bus of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:45:22 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Found default for hw_pointer_model of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:45:22 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Found default for hw_video_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:45:22 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Found default for hw_vif_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:45:22 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 29 14:45:22 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690641922.7174573, 86ecc6cb-88a8-4572-8e41-d4c5859036a6 => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:45:22 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] VM Started (Lifecycle Event)
Jul 29 14:45:22 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:45:22 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:45:22 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 29 14:45:22 user nova-compute[70924]: DEBUG nova.compute.manager [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG nova.objects.instance [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Trying to apply a migration context that does not seem to be set for this instance {{(pid=70924) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG nova.compute.manager [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Start spawning the instance on the hypervisor. {{(pid=70924) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Creating instance directory {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 14:45:23 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Creating image(s)
Jul 29 14:45:23 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Did not create local disks {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Ensure instance console log exists: /opt/stack/data/nova/instances/35bdb2dd-d2d4-4a3d-9178-6892d478dfa3/console.log {{(pid=70924) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Start _get_guest_xml network_info=[{"id": "195c1f76-2177-4201-bb05-291d7131c3c2", "address": "fa:16:3e:15:a9:c3", "network": {"id": "a836313e-84ad-4a1a-b4de-5eee3652fe69", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-368818776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195c1f76-21", "ovs_interfaceid": "195c1f76-2177-4201-bb05-291d7131c3c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e98a5996-f4ad-44fd-9fc9-591e411bbaa1", "address": "fa:16:3e:bc:51:b6", "network": {"id": "5f1efb98-21ff-48db-95aa-ab5f29e5ff45", "bridge": "br-int", "label": "tempest-device-tagging-net1-473596273", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape98a5996-f4", "ovs_interfaceid": "e98a5996-f4ad-44fd-9fc9-591e411bbaa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f108e5c9-68f4-4444-b686-18df097fa015", "address": "fa:16:3e:08:fb:b3", "network": {"id": "5f1efb98-21ff-48db-95aa-ab5f29e5ff45", "bridge": "br-int", "label": "tempest-device-tagging-net1-473596273", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf108e5c9-68", "ovs_interfaceid": "f108e5c9-68f4-4444-b686-18df097fa015", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0a5aa889-f4ad-49dd-9741-ce0d161bc25f", "address": "fa:16:3e:65:cc:a7", "network": {"id": "5f1efb98-21ff-48db-95aa-ab5f29e5ff45", "bridge": "br-int", "label": "tempest-device-tagging-net1-473596273", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a5aa889-f4", "ovs_interfaceid": "0a5aa889-f4ad-49dd-9741-ce0d161bc25f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2e35e8a0-e202-46d5-b854-9960de88edc2", "address": "fa:16:3e:cc:03:d5", "network": {"id": "5f1efb98-21ff-48db-95aa-ab5f29e5ff45", "bridge": "br-int", "label": "tempest-device-tagging-net1-473596273", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e35e8a0-e2", "ovs_interfaceid": "2e35e8a0-e202-46d5-b854-9960de88edc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7334899f-e7c7-48d8-8c14-4fda63fea3b5", "address": "fa:16:3e:ae:d5:21", "network": {"id": "381d607e-5106-44f3-b3e0-8926c54e74f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-197405985", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7334899f-e7", "ovs_interfaceid": "7334899f-e7c7-48d8-8c14-4fda63fea3b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c6793a3b-97da-4584-a326-f1caf598cd78", "address": "fa:16:3e:30:14:87", "network": {"id": "381d607e-5106-44f3-b3e0-8926c54e74f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-197405985", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6793a3b-97", "ovs_interfaceid": "c6793a3b-97da-4584-a326-f1caf598cd78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4a7d5e0c-d135-4dd9-be3f-8dd700523339'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IlACESVa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '35bdb2dd-d2d4-4a3d-9178-6892d478dfa3', 'attached_at': '', 'detached_at': '', 'volume_id': '4a7d5e0c-d135-4dd9-be3f-8dd700523339', 'serial': '4a7d5e0c-d135-4dd9-be3f-8dd700523339'}, 'attachment_id': '1f41d654-d9e1-46b5-8944-0630a2957806', 'volume_type': None}, {'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'boot_index': 1, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0763aadd-e95f-4582-bb01-fcc7dc4681cb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OfBQWvDo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '35bdb2dd-d2d4-4a3d-9178-6892d478dfa3', 'attached_at': '', 'detached_at': '', 'volume_id': '0763aadd-e95f-4582-bb01-fcc7dc4681cb', 'serial': '0763aadd-e95f-4582-bb01-fcc7dc4681cb'}, 'attachment_id': '10e78f1c-348d-45c5-85d0-430e3c38f765', 'volume_type': None}, {'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdc', 'boot_index': 2, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:49b03148-7445-466e-b4dd-4b84dcaaa95a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QTtlFgGX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '35bdb2dd-d2d4-4a3d-9178-6892d478dfa3', 'attached_at': '', 'detached_at': '', 'volume_id': '49b03148-7445-466e-b4dd-4b84dcaaa95a', 'serial': '49b03148-7445-466e-b4dd-4b84dcaaa95a'}, 'attachment_id': '4672fcf1-a9c5-4d32-b7d2-8412ab2676ba', 'volume_type': None} {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ebfbfd25-d282-4e3d-8ebc-af2564a2d50f tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.144s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:23 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:45:23 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:45:23 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] CPU controller missing on host. {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] CPU controller found on host. {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70924) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T14:36:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Flavor limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Image limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Flavor pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Image pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Got 1 possible topologies {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Calling os-brick to attach iSCSI Volume {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4a7d5e0c-d135-4dd9-be3f-8dd700523339'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IlACESVa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:45:23 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:45:23 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:45:23 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:45:23 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a7d5e0c-d135-4dd9-be3f-8dd700523339" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a7d5e0c-d135-4dd9-be3f-8dd700523339" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:45:23 user nova-compute[70924]: INFO os_brick.initiator.connectors.iscsi [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 14:45:23 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a7d5e0c-d135-4dd9-be3f-8dd700523339 -p 172.16.0.220:3260 {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a7d5e0c-d135-4dd9-be3f-8dd700523339 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c29ede-41ee-4ea6-b066-a140ea2065f7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 14:45:23 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a7d5e0c-d135-4dd9-be3f-8dd700523339 -p 172.16.0.220:3260 --interface default --op new {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a7d5e0c-d135-4dd9-be3f-8dd700523339 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ae9560-c30e-48fa-adad-11bab54903f0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a7d5e0c-d135-4dd9-be3f-8dd700523339] added\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a7d5e0c-d135-4dd9-be3f-8dd700523339] added
Jul 29 14:45:23 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a7d5e0c-d135-4dd9-be3f-8dd700523339 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a7d5e0c-d135-4dd9-be3f-8dd700523339 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[533ff642-9e3b-438a-8a52-ca6479eac3b0]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a7d5e0c-d135-4dd9-be3f-8dd700523339 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a7d5e0c-d135-4dd9-be3f-8dd700523339 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.044s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c932bde7-7b69-42d2-a66d-75283a31da11]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a7d5e0c-d135-4dd9-be3f-8dd700523339 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IlACESVa {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a7d5e0c-d135-4dd9-be3f-8dd700523339 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IlACESVa" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d19b45c-339d-4158-9e8f-864d87176cf9]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IlACESVa'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a7d5e0c-d135-4dd9-be3f-8dd700523339 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a7d5e0c-d135-4dd9-be3f-8dd700523339 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[da958d18-4b11-402f-97eb-0adf06ea2426]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[935e03b9-0fda-417b-b8be-7520ef6829fd]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:45:23 user nova-compute[70924]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)
Jul 29 14:45:23 user nova-compute[70924]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 (non-flash)
Jul 29 14:45:23 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:45:23 user nova-compute[70924]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)
Jul 29 14:45:23 user nova-compute[70924]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 (non-flash)
Jul 29 14:45:23 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a7d5e0c-d135-4dd9-be3f-8dd700523339 -p 172.16.0.220:3260 --login {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a7d5e0c-d135-4dd9-be3f-8dd700523339 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21015ab-1442-46f6-a357-f657d2d08bc5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a7d5e0c-d135-4dd9-be3f-8dd700523339, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4a7d5e0c-d135-4dd9-be3f-8dd700523339, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a7d5e0c-d135-4dd9-be3f-8dd700523339, portal: 172.16.0.220,3260]
Jul 29 14:45:23 user nova-compute[70924]: Login to [iface: default, target: iqn.2010-10.org.openstack:4a7d5e0c-d135-4dd9-be3f-8dd700523339, portal: 172.16.0.220,3260] successful.
Jul 29 14:45:23 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a7d5e0c-d135-4dd9-be3f-8dd700523339 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a7d5e0c-d135-4dd9-be3f-8dd700523339 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff2260e-60f3-4f93-9247-347f7b26abaf]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5287040-a1cc-42f6-8bf8-c06f24b830e0]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a7d5e0c-d135-4dd9-be3f-8dd700523339 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:45:23 user nova-compute[70924]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)
Jul 29 14:45:23 user nova-compute[70924]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 (non-flash)
Jul 29 14:45:23 user nova-compute[70924]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a7d5e0c-d135-4dd9-be3f-8dd700523339 (non-flash)
Jul 29 14:45:23 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:45:23 user nova-compute[70924]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)
Jul 29 14:45:23 user nova-compute[70924]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 (non-flash)
Jul 29 14:45:23 user nova-compute[70924]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a7d5e0c-d135-4dd9-be3f-8dd700523339 (non-flash)
Jul 29 14:45:23 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a7d5e0c-d135-4dd9-be3f-8dd700523339" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.399s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Connected to 172.16.0.220:3260 {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] HCTL ('35', '-', '-', 0) found on session 18 with lun 0 {{(pid=70924) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70924) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.032s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0615d939-4923-4128-9403-9842b2f6d928]: (4, ('- - 0', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Searching for a device in session 18 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 14:45:23 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IlACESVa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 14:45:24 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.449s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:45:24 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] <== connect_volume: return (1451ms) {'type': 'block', 'scsi_wwn': '26262353066393363', 'path': '/dev/sdd'} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:45:24 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262353066393363', 'path': '/dev/sdd'} {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 14:45:24 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:24 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Calling os-brick to attach iSCSI Volume {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 14:45:24 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0763aadd-e95f-4582-bb01-fcc7dc4681cb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OfBQWvDo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:45:24 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:45:24 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:45:24 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:45:24 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:45:24 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0763aadd-e95f-4582-bb01-fcc7dc4681cb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:45:24 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0763aadd-e95f-4582-bb01-fcc7dc4681cb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:45:24 user nova-compute[70924]: INFO os_brick.initiator.connectors.iscsi [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 14:45:24 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0763aadd-e95f-4582-bb01-fcc7dc4681cb -p 172.16.0.220:3260 {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:24 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0763aadd-e95f-4582-bb01-fcc7dc4681cb -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:24 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4deb7b-ef04-4dc4-9abf-b570ce9d758b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:24 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 14:45:24 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:45:24 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0763aadd-e95f-4582-bb01-fcc7dc4681cb -p 172.16.0.220:3260 --interface default --op new {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:24 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0763aadd-e95f-4582-bb01-fcc7dc4681cb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:24 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e646704-7881-465b-afec-48577d015984]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0763aadd-e95f-4582-bb01-fcc7dc4681cb] added\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:24 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0763aadd-e95f-4582-bb01-fcc7dc4681cb] added
Jul 29 14:45:24 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:45:24 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0763aadd-e95f-4582-bb01-fcc7dc4681cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:24 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0763aadd-e95f-4582-bb01-fcc7dc4681cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:24 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaaffc9a-120a-4a76-a66b-6aeae5898793]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:24 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:45:24 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0763aadd-e95f-4582-bb01-fcc7dc4681cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:24 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0763aadd-e95f-4582-bb01-fcc7dc4681cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:24 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[da32afe7-3469-4e33-b609-4c4c8acd87f3]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:24 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:45:24 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0763aadd-e95f-4582-bb01-fcc7dc4681cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OfBQWvDo {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:24 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0763aadd-e95f-4582-bb01-fcc7dc4681cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OfBQWvDo" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:24 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d9c165-a6e5-4d50-8686-90f47449bfef]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:24 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OfBQWvDo'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:45:24 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0763aadd-e95f-4582-bb01-fcc7dc4681cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:24 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0763aadd-e95f-4582-bb01-fcc7dc4681cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:24 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d305ff05-4e51-46b3-8f39-b238050b875a]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:24 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:45:24 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:24 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:24 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ac635c-9e20-4ac8-860b-0b5282ecf315]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a7d5e0c-d135-4dd9-be3f-8dd700523339 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:24 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:45:24 user nova-compute[70924]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)
Jul 29 14:45:24 user nova-compute[70924]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 (non-flash)
Jul 29 14:45:24 user nova-compute[70924]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a7d5e0c-d135-4dd9-be3f-8dd700523339 (non-flash)
Jul 29 14:45:24 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:45:24 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:45:24 user nova-compute[70924]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)
Jul 29 14:45:24 user nova-compute[70924]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 (non-flash)
Jul 29 14:45:24 user nova-compute[70924]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a7d5e0c-d135-4dd9-be3f-8dd700523339 (non-flash)
Jul 29 14:45:24 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:45:24 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0763aadd-e95f-4582-bb01-fcc7dc4681cb -p 172.16.0.220:3260 --login {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:25 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0763aadd-e95f-4582-bb01-fcc7dc4681cb -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:25 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d43bf6-aa55-49c5-8fb8-3f6e0223fdde]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0763aadd-e95f-4582-bb01-fcc7dc4681cb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0763aadd-e95f-4582-bb01-fcc7dc4681cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:25 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0763aadd-e95f-4582-bb01-fcc7dc4681cb, portal: 172.16.0.220,3260]
Jul 29 14:45:25 user nova-compute[70924]: Login to [iface: default, target: iqn.2010-10.org.openstack:0763aadd-e95f-4582-bb01-fcc7dc4681cb, portal: 172.16.0.220,3260] successful.
Jul 29 14:45:25 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:45:25 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0763aadd-e95f-4582-bb01-fcc7dc4681cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:25 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0763aadd-e95f-4582-bb01-fcc7dc4681cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:25 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07dc1f2-2a06-472d-a14b-b6e8917c4746]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:25 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:45:25 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:25 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:25 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[a319bb81-a29c-4eb5-a909-2f84f7e564bc]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a7d5e0c-d135-4dd9-be3f-8dd700523339 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0763aadd-e95f-4582-bb01-fcc7dc4681cb (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:25 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:45:25 user nova-compute[70924]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)
Jul 29 14:45:25 user nova-compute[70924]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 (non-flash)
Jul 29 14:45:25 user nova-compute[70924]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a7d5e0c-d135-4dd9-be3f-8dd700523339 (non-flash)
Jul 29 14:45:25 user nova-compute[70924]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0763aadd-e95f-4582-bb01-fcc7dc4681cb (non-flash)
Jul 29 14:45:25 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:45:25 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:45:25 user nova-compute[70924]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)
Jul 29 14:45:25 user nova-compute[70924]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 (non-flash)
Jul 29 14:45:25 user nova-compute[70924]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a7d5e0c-d135-4dd9-be3f-8dd700523339 (non-flash)
Jul 29 14:45:25 user nova-compute[70924]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0763aadd-e95f-4582-bb01-fcc7dc4681cb (non-flash)
Jul 29 14:45:25 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:45:25 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0763aadd-e95f-4582-bb01-fcc7dc4681cb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.358s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:45:25 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Connected to 172.16.0.220:3260 {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 14:45:25 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] HCTL ('37', '-', '-', 0) found on session 19 with lun 0 {{(pid=70924) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 14:45:25 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=70924) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 14:45:25 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:25 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.029s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:25 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc438906-7893-4ff2-a7dc-a7a8004b1087]: (4, ('- - 0', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:25 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Searching for a device in session 19 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 14:45:25 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OfBQWvDo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 14:45:26 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.410s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:45:26 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] <== connect_volume: return (1411ms) {'type': 'block', 'scsi_wwn': '23766663737613532', 'path': '/dev/sdf'} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:45:26 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23766663737613532', 'path': '/dev/sdf'} {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 14:45:26 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Calling os-brick to attach iSCSI Volume {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 14:45:26 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:49b03148-7445-466e-b4dd-4b84dcaaa95a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QTtlFgGX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:45:26 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:45:26 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:45:26 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:45:26 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:45:26 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49b03148-7445-466e-b4dd-4b84dcaaa95a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:45:26 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49b03148-7445-466e-b4dd-4b84dcaaa95a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:45:26 user nova-compute[70924]: INFO os_brick.initiator.connectors.iscsi [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 14:45:26 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49b03148-7445-466e-b4dd-4b84dcaaa95a -p 172.16.0.220:3260 {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:26 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49b03148-7445-466e-b4dd-4b84dcaaa95a -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:26 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e043661-e88b-4ac7-9208-ffff1eb2f763]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:26 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 14:45:26 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:45:26 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49b03148-7445-466e-b4dd-4b84dcaaa95a -p 172.16.0.220:3260 --interface default --op new {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:26 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49b03148-7445-466e-b4dd-4b84dcaaa95a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:26 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34fcdcf-e8d6-40eb-82a3-bd8c9e761904]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49b03148-7445-466e-b4dd-4b84dcaaa95a] added\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:26 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49b03148-7445-466e-b4dd-4b84dcaaa95a] added
Jul 29 14:45:26 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:45:26 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49b03148-7445-466e-b4dd-4b84dcaaa95a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:26 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49b03148-7445-466e-b4dd-4b84dcaaa95a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:26 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[089c2217-06c1-4031-9d13-83ed82ff16cd]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:26 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:45:26 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49b03148-7445-466e-b4dd-4b84dcaaa95a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:26 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49b03148-7445-466e-b4dd-4b84dcaaa95a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:26 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[74bb1207-3c1c-43ff-bd53-6570253fa845]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:26 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:45:26 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49b03148-7445-466e-b4dd-4b84dcaaa95a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QTtlFgGX {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:26 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49b03148-7445-466e-b4dd-4b84dcaaa95a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QTtlFgGX" returned: 0 in 0.028s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:26 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5581d56b-fcbe-4aa6-bc68-1d02650798ba]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:26 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QTtlFgGX'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:45:26 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49b03148-7445-466e-b4dd-4b84dcaaa95a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:26 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49b03148-7445-466e-b4dd-4b84dcaaa95a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:26 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e4a24d-7758-40d0-a063-9254140c90e5]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:26 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:45:26 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:26 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:26 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[460e8474-a2a5-44d6-b430-2f2ecdfd3153]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a7d5e0c-d135-4dd9-be3f-8dd700523339 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0763aadd-e95f-4582-bb01-fcc7dc4681cb (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:26 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:45:26 user nova-compute[70924]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)
Jul 29 14:45:26 user nova-compute[70924]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 (non-flash)
Jul 29 14:45:26 user nova-compute[70924]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a7d5e0c-d135-4dd9-be3f-8dd700523339 (non-flash)
Jul 29 14:45:26 user nova-compute[70924]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0763aadd-e95f-4582-bb01-fcc7dc4681cb (non-flash)
Jul 29 14:45:26 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:45:26 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:45:26 user nova-compute[70924]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)
Jul 29 14:45:26 user nova-compute[70924]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 (non-flash)
Jul 29 14:45:26 user nova-compute[70924]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a7d5e0c-d135-4dd9-be3f-8dd700523339 (non-flash)
Jul 29 14:45:26 user nova-compute[70924]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0763aadd-e95f-4582-bb01-fcc7dc4681cb (non-flash)
Jul 29 14:45:26 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:45:26 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49b03148-7445-466e-b4dd-4b84dcaaa95a -p 172.16.0.220:3260 --login {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:26 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49b03148-7445-466e-b4dd-4b84dcaaa95a -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:26 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ceba912-3eb7-408e-9f5c-8de58fb36da7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:49b03148-7445-466e-b4dd-4b84dcaaa95a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:49b03148-7445-466e-b4dd-4b84dcaaa95a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:26 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:49b03148-7445-466e-b4dd-4b84dcaaa95a, portal: 172.16.0.220,3260]
Jul 29 14:45:26 user nova-compute[70924]: Login to [iface: default, target: iqn.2010-10.org.openstack:49b03148-7445-466e-b4dd-4b84dcaaa95a, portal: 172.16.0.220,3260] successful.
Jul 29 14:45:26 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:45:26 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49b03148-7445-466e-b4dd-4b84dcaaa95a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:26 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49b03148-7445-466e-b4dd-4b84dcaaa95a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:26 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e64232-9f9e-47a8-888e-1c3e026d9d90]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:26 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:45:26 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:26 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:26 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2770f5d9-6675-4d45-8bf0-2a0fc118114d]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a7d5e0c-d135-4dd9-be3f-8dd700523339 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0763aadd-e95f-4582-bb01-fcc7dc4681cb (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49b03148-7445-466e-b4dd-4b84dcaaa95a (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:26 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:45:26 user nova-compute[70924]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)
Jul 29 14:45:26 user nova-compute[70924]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 (non-flash)
Jul 29 14:45:26 user nova-compute[70924]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a7d5e0c-d135-4dd9-be3f-8dd700523339 (non-flash)
Jul 29 14:45:26 user nova-compute[70924]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0763aadd-e95f-4582-bb01-fcc7dc4681cb (non-flash)
Jul 29 14:45:26 user nova-compute[70924]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49b03148-7445-466e-b4dd-4b84dcaaa95a (non-flash)
Jul 29 14:45:26 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:45:26 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:45:26 user nova-compute[70924]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)
Jul 29 14:45:26 user nova-compute[70924]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 (non-flash)
Jul 29 14:45:26 user nova-compute[70924]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a7d5e0c-d135-4dd9-be3f-8dd700523339 (non-flash)
Jul 29 14:45:26 user nova-compute[70924]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0763aadd-e95f-4582-bb01-fcc7dc4681cb (non-flash)
Jul 29 14:45:26 user nova-compute[70924]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49b03148-7445-466e-b4dd-4b84dcaaa95a (non-flash)
Jul 29 14:45:26 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:45:26 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49b03148-7445-466e-b4dd-4b84dcaaa95a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.348s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:45:26 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Connected to 172.16.0.220:3260 {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 14:45:26 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] HCTL ('38', '-', '-', 0) found on session 20 with lun 0 {{(pid=70924) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 14:45:26 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=70924) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 14:45:26 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:26 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:26 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[084be21e-f9b2-4d4b-ac3f-fed59cc25032]: (4, ('- - 0', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:26 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Searching for a device in session 20 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 14:45:26 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QTtlFgGX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.398s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] <== connect_volume: return (1399ms) {'type': 'block', 'scsi_wwn': '23733623130336137', 'path': '/dev/sdg'} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733623130336137', 'path': '/dev/sdg'} {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T14:44:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-665402946',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-665402946',id=15,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5+0WvIsBj/j06hqnLQTtyszC978RLwfd3h9HEdPSOIa95oKqiIYN4A38Sy3a+7cgbLZMWi+UAEuTUU0Ac4QtvbKoz0WHaDZr5IdnS4lgNL4nNT8pTAKn6FSUPOEVUEvg==',key_name='tempest-keypair-1133379299',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87bd9746a49c4efeaea2c4b38c1b42c6',ramdisk_id='',reservation_id='r-xxt96qh6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-954540052',owner_user_name='tempest-TaggedBootDevicesTest_v242-954540052-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:44:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='69f7b3722f784d4cb61ba6b0cf325912',uuid=35bdb2dd-d2d4-4a3d-9178-6892d478dfa3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "195c1f76-2177-4201-bb05-291d7131c3c2", "address": "fa:16:3e:15:a9:c3", "network": {"id": "a836313e-84ad-4a1a-b4de-5eee3652fe69", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-368818776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195c1f76-21", "ovs_interfaceid": "195c1f76-2177-4201-bb05-291d7131c3c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Converting VIF {"id": "195c1f76-2177-4201-bb05-291d7131c3c2", "address": "fa:16:3e:15:a9:c3", "network": {"id": "a836313e-84ad-4a1a-b4de-5eee3652fe69", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-368818776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195c1f76-21", "ovs_interfaceid": "195c1f76-2177-4201-bb05-291d7131c3c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:a9:c3,bridge_name='br-int',has_traffic_filtering=True,id=195c1f76-2177-4201-bb05-291d7131c3c2,network=Network(a836313e-84ad-4a1a-b4de-5eee3652fe69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap195c1f76-21') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T14:44:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-665402946',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-665402946',id=15,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5+0WvIsBj/j06hqnLQTtyszC978RLwfd3h9HEdPSOIa95oKqiIYN4A38Sy3a+7cgbLZMWi+UAEuTUU0Ac4QtvbKoz0WHaDZr5IdnS4lgNL4nNT8pTAKn6FSUPOEVUEvg==',key_name='tempest-keypair-1133379299',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87bd9746a49c4efeaea2c4b38c1b42c6',ramdisk_id='',reservation_id='r-xxt96qh6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-954540052',owner_user_name='tempest-TaggedBootDevicesTest_v242-954540052-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:44:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='69f7b3722f784d4cb61ba6b0cf325912',uuid=35bdb2dd-d2d4-4a3d-9178-6892d478dfa3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e98a5996-f4ad-44fd-9fc9-591e411bbaa1", "address": "fa:16:3e:bc:51:b6", "network": {"id": "5f1efb98-21ff-48db-95aa-ab5f29e5ff45", "bridge": "br-int", "label": "tempest-device-tagging-net1-473596273", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape98a5996-f4", "ovs_interfaceid": "e98a5996-f4ad-44fd-9fc9-591e411bbaa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Converting VIF {"id": "e98a5996-f4ad-44fd-9fc9-591e411bbaa1", "address": "fa:16:3e:bc:51:b6", "network": {"id": "5f1efb98-21ff-48db-95aa-ab5f29e5ff45", "bridge": "br-int", "label": "tempest-device-tagging-net1-473596273", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape98a5996-f4", "ovs_interfaceid": "e98a5996-f4ad-44fd-9fc9-591e411bbaa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:51:b6,bridge_name='br-int',has_traffic_filtering=True,id=e98a5996-f4ad-44fd-9fc9-591e411bbaa1,network=Network(5f1efb98-21ff-48db-95aa-ab5f29e5ff45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape98a5996-f4') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T14:44:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-665402946',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-665402946',id=15,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5+0WvIsBj/j06hqnLQTtyszC978RLwfd3h9HEdPSOIa95oKqiIYN4A38Sy3a+7cgbLZMWi+UAEuTUU0Ac4QtvbKoz0WHaDZr5IdnS4lgNL4nNT8pTAKn6FSUPOEVUEvg==',key_name='tempest-keypair-1133379299',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87bd9746a49c4efeaea2c4b38c1b42c6',ramdisk_id='',reservation_id='r-xxt96qh6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-954540052',owner_user_name='tempest-TaggedBootDevicesTest_v242-954540052-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:44:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='69f7b3722f784d4cb61ba6b0cf325912',uuid=35bdb2dd-d2d4-4a3d-9178-6892d478dfa3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f108e5c9-68f4-4444-b686-18df097fa015", "address": "fa:16:3e:08:fb:b3", "network": {"id": "5f1efb98-21ff-48db-95aa-ab5f29e5ff45", "bridge": "br-int", "label": "tempest-device-tagging-net1-473596273", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf108e5c9-68", "ovs_interfaceid": "f108e5c9-68f4-4444-b686-18df097fa015", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Converting VIF {"id": "f108e5c9-68f4-4444-b686-18df097fa015", "address": "fa:16:3e:08:fb:b3", "network": {"id": "5f1efb98-21ff-48db-95aa-ab5f29e5ff45", "bridge": "br-int", "label": "tempest-device-tagging-net1-473596273", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf108e5c9-68", "ovs_interfaceid": "f108e5c9-68f4-4444-b686-18df097fa015", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:fb:b3,bridge_name='br-int',has_traffic_filtering=True,id=f108e5c9-68f4-4444-b686-18df097fa015,network=Network(5f1efb98-21ff-48db-95aa-ab5f29e5ff45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf108e5c9-68') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T14:44:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-665402946',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-665402946',id=15,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5+0WvIsBj/j06hqnLQTtyszC978RLwfd3h9HEdPSOIa95oKqiIYN4A38Sy3a+7cgbLZMWi+UAEuTUU0Ac4QtvbKoz0WHaDZr5IdnS4lgNL4nNT8pTAKn6FSUPOEVUEvg==',key_name='tempest-keypair-1133379299',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87bd9746a49c4efeaea2c4b38c1b42c6',ramdisk_id='',reservation_id='r-xxt96qh6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-954540052',owner_user_name='tempest-TaggedBootDevicesTest_v242-954540052-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:44:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='69f7b3722f784d4cb61ba6b0cf325912',uuid=35bdb2dd-d2d4-4a3d-9178-6892d478dfa3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a5aa889-f4ad-49dd-9741-ce0d161bc25f", "address": "fa:16:3e:65:cc:a7", "network": {"id": "5f1efb98-21ff-48db-95aa-ab5f29e5ff45", "bridge": "br-int", "label": "tempest-device-tagging-net1-473596273", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a5aa889-f4", "ovs_interfaceid": "0a5aa889-f4ad-49dd-9741-ce0d161bc25f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Converting VIF {"id": "0a5aa889-f4ad-49dd-9741-ce0d161bc25f", "address": "fa:16:3e:65:cc:a7", "network": {"id": "5f1efb98-21ff-48db-95aa-ab5f29e5ff45", "bridge": "br-int", "label": "tempest-device-tagging-net1-473596273", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a5aa889-f4", "ovs_interfaceid": "0a5aa889-f4ad-49dd-9741-ce0d161bc25f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:cc:a7,bridge_name='br-int',has_traffic_filtering=True,id=0a5aa889-f4ad-49dd-9741-ce0d161bc25f,network=Network(5f1efb98-21ff-48db-95aa-ab5f29e5ff45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a5aa889-f4') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T14:44:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-665402946',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-665402946',id=15,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5+0WvIsBj/j06hqnLQTtyszC978RLwfd3h9HEdPSOIa95oKqiIYN4A38Sy3a+7cgbLZMWi+UAEuTUU0Ac4QtvbKoz0WHaDZr5IdnS4lgNL4nNT8pTAKn6FSUPOEVUEvg==',key_name='tempest-keypair-1133379299',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87bd9746a49c4efeaea2c4b38c1b42c6',ramdisk_id='',reservation_id='r-xxt96qh6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-954540052',owner_user_name='tempest-TaggedBootDevicesTest_v242-954540052-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:44:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='69f7b3722f784d4cb61ba6b0cf325912',uuid=35bdb2dd-d2d4-4a3d-9178-6892d478dfa3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e35e8a0-e202-46d5-b854-9960de88edc2", "address": "fa:16:3e:cc:03:d5", "network": {"id": "5f1efb98-21ff-48db-95aa-ab5f29e5ff45", "bridge": "br-int", "label": "tempest-device-tagging-net1-473596273", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e35e8a0-e2", "ovs_interfaceid": "2e35e8a0-e202-46d5-b854-9960de88edc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Converting VIF {"id": "2e35e8a0-e202-46d5-b854-9960de88edc2", "address": "fa:16:3e:cc:03:d5", "network": {"id": "5f1efb98-21ff-48db-95aa-ab5f29e5ff45", "bridge": "br-int", "label": "tempest-device-tagging-net1-473596273", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e35e8a0-e2", "ovs_interfaceid": "2e35e8a0-e202-46d5-b854-9960de88edc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:03:d5,bridge_name='br-int',has_traffic_filtering=True,id=2e35e8a0-e202-46d5-b854-9960de88edc2,network=Network(5f1efb98-21ff-48db-95aa-ab5f29e5ff45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e35e8a0-e2') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T14:44:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-665402946',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-665402946',id=15,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5+0WvIsBj/j06hqnLQTtyszC978RLwfd3h9HEdPSOIa95oKqiIYN4A38Sy3a+7cgbLZMWi+UAEuTUU0Ac4QtvbKoz0WHaDZr5IdnS4lgNL4nNT8pTAKn6FSUPOEVUEvg==',key_name='tempest-keypair-1133379299',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87bd9746a49c4efeaea2c4b38c1b42c6',ramdisk_id='',reservation_id='r-xxt96qh6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-954540052',owner_user_name='tempest-TaggedBootDevicesTest_v242-954540052-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:44:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='69f7b3722f784d4cb61ba6b0cf325912',uuid=35bdb2dd-d2d4-4a3d-9178-6892d478dfa3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7334899f-e7c7-48d8-8c14-4fda63fea3b5", "address": "fa:16:3e:ae:d5:21", "network": {"id": "381d607e-5106-44f3-b3e0-8926c54e74f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-197405985", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7334899f-e7", "ovs_interfaceid": "7334899f-e7c7-48d8-8c14-4fda63fea3b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Converting VIF {"id": "7334899f-e7c7-48d8-8c14-4fda63fea3b5", "address": "fa:16:3e:ae:d5:21", "network": {"id": "381d607e-5106-44f3-b3e0-8926c54e74f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-197405985", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7334899f-e7", "ovs_interfaceid": "7334899f-e7c7-48d8-8c14-4fda63fea3b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:d5:21,bridge_name='br-int',has_traffic_filtering=True,id=7334899f-e7c7-48d8-8c14-4fda63fea3b5,network=Network(381d607e-5106-44f3-b3e0-8926c54e74f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7334899f-e7') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T14:44:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-665402946',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-665402946',id=15,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5+0WvIsBj/j06hqnLQTtyszC978RLwfd3h9HEdPSOIa95oKqiIYN4A38Sy3a+7cgbLZMWi+UAEuTUU0Ac4QtvbKoz0WHaDZr5IdnS4lgNL4nNT8pTAKn6FSUPOEVUEvg==',key_name='tempest-keypair-1133379299',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87bd9746a49c4efeaea2c4b38c1b42c6',ramdisk_id='',reservation_id='r-xxt96qh6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-954540052',owner_user_name='tempest-TaggedBootDevicesTest_v242-954540052-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:44:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='69f7b3722f784d4cb61ba6b0cf325912',uuid=35bdb2dd-d2d4-4a3d-9178-6892d478dfa3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c6793a3b-97da-4584-a326-f1caf598cd78", "address": "fa:16:3e:30:14:87", "network": {"id": "381d607e-5106-44f3-b3e0-8926c54e74f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-197405985", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6793a3b-97", "ovs_interfaceid": "c6793a3b-97da-4584-a326-f1caf598cd78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Converting VIF {"id": "c6793a3b-97da-4584-a326-f1caf598cd78", "address": "fa:16:3e:30:14:87", "network": {"id": "381d607e-5106-44f3-b3e0-8926c54e74f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-197405985", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6793a3b-97", "ovs_interfaceid": "c6793a3b-97da-4584-a326-f1caf598cd78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:14:87,bridge_name='br-int',has_traffic_filtering=True,id=c6793a3b-97da-4584-a326-f1caf598cd78,network=Network(381d607e-5106-44f3-b3e0-8926c54e74f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6793a3b-97') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG nova.objects.instance [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Lazy-loading 'pci_devices' on Instance uuid 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] End _get_guest_xml xml=<domain type="kvm">
Jul 29 14:45:27 user nova-compute[70924]:   <uuid>35bdb2dd-d2d4-4a3d-9178-6892d478dfa3</uuid>
Jul 29 14:45:27 user nova-compute[70924]:   <name>instance-0000000f</name>
Jul 29 14:45:27 user nova-compute[70924]:   <memory>524288</memory>
Jul 29 14:45:27 user nova-compute[70924]:   <vcpu>1</vcpu>
Jul 29 14:45:27 user nova-compute[70924]:   <metadata>
Jul 29 14:45:27 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 14:45:27 user nova-compute[70924]:       <nova:package version="0.0.0"/>
Jul 29 14:45:27 user nova-compute[70924]:       <nova:name>tempest-device-tagging-server-665402946</nova:name>
Jul 29 14:45:27 user nova-compute[70924]:       <nova:creationTime>2023-07-29 14:45:23</nova:creationTime>
Jul 29 14:45:27 user nova-compute[70924]:       <nova:flavor name="m1.tiny">
Jul 29 14:45:27 user nova-compute[70924]:         <nova:memory>512</nova:memory>
Jul 29 14:45:27 user nova-compute[70924]:         <nova:disk>1</nova:disk>
Jul 29 14:45:27 user nova-compute[70924]:         <nova:swap>0</nova:swap>
Jul 29 14:45:27 user nova-compute[70924]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 14:45:27 user nova-compute[70924]:         <nova:vcpus>1</nova:vcpus>
Jul 29 14:45:27 user nova-compute[70924]:       </nova:flavor>
Jul 29 14:45:27 user nova-compute[70924]:       <nova:owner>
Jul 29 14:45:27 user nova-compute[70924]:         <nova:user uuid="69f7b3722f784d4cb61ba6b0cf325912">tempest-TaggedBootDevicesTest_v242-954540052-project-member</nova:user>
Jul 29 14:45:27 user nova-compute[70924]:         <nova:project uuid="87bd9746a49c4efeaea2c4b38c1b42c6">tempest-TaggedBootDevicesTest_v242-954540052</nova:project>
Jul 29 14:45:27 user nova-compute[70924]:       </nova:owner>
Jul 29 14:45:27 user nova-compute[70924]:       <nova:root type="image" uuid="3aba2e73-6832-404b-8bd0-d0503ce82b8c"/>
Jul 29 14:45:27 user nova-compute[70924]:       <nova:ports>
Jul 29 14:45:27 user nova-compute[70924]:         <nova:port uuid="195c1f76-2177-4201-bb05-291d7131c3c2">
Jul 29 14:45:27 user nova-compute[70924]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 29 14:45:27 user nova-compute[70924]:         </nova:port>
Jul 29 14:45:27 user nova-compute[70924]:         <nova:port uuid="e98a5996-f4ad-44fd-9fc9-591e411bbaa1">
Jul 29 14:45:27 user nova-compute[70924]:           <nova:ip type="fixed" address="10.1.1.6" ipVersion="4"/>
Jul 29 14:45:27 user nova-compute[70924]:         </nova:port>
Jul 29 14:45:27 user nova-compute[70924]:         <nova:port uuid="f108e5c9-68f4-4444-b686-18df097fa015">
Jul 29 14:45:27 user nova-compute[70924]:           <nova:ip type="fixed" address="10.1.1.223" ipVersion="4"/>
Jul 29 14:45:27 user nova-compute[70924]:         </nova:port>
Jul 29 14:45:27 user nova-compute[70924]:         <nova:port uuid="0a5aa889-f4ad-49dd-9741-ce0d161bc25f">
Jul 29 14:45:27 user nova-compute[70924]:           <nova:ip type="fixed" address="10.1.1.154" ipVersion="4"/>
Jul 29 14:45:27 user nova-compute[70924]:         </nova:port>
Jul 29 14:45:27 user nova-compute[70924]:         <nova:port uuid="2e35e8a0-e202-46d5-b854-9960de88edc2">
Jul 29 14:45:27 user nova-compute[70924]:           <nova:ip type="fixed" address="10.1.1.193" ipVersion="4"/>
Jul 29 14:45:27 user nova-compute[70924]:         </nova:port>
Jul 29 14:45:27 user nova-compute[70924]:         <nova:port uuid="7334899f-e7c7-48d8-8c14-4fda63fea3b5">
Jul 29 14:45:27 user nova-compute[70924]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Jul 29 14:45:27 user nova-compute[70924]:         </nova:port>
Jul 29 14:45:27 user nova-compute[70924]:         <nova:port uuid="c6793a3b-97da-4584-a326-f1caf598cd78">
Jul 29 14:45:27 user nova-compute[70924]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Jul 29 14:45:27 user nova-compute[70924]:         </nova:port>
Jul 29 14:45:27 user nova-compute[70924]:       </nova:ports>
Jul 29 14:45:27 user nova-compute[70924]:     </nova:instance>
Jul 29 14:45:27 user nova-compute[70924]:   </metadata>
Jul 29 14:45:27 user nova-compute[70924]:   <sysinfo type="smbios">
Jul 29 14:45:27 user nova-compute[70924]:     <system>
Jul 29 14:45:27 user nova-compute[70924]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 14:45:27 user nova-compute[70924]:       <entry name="product">OpenStack Nova</entry>
Jul 29 14:45:27 user nova-compute[70924]:       <entry name="version">0.0.0</entry>
Jul 29 14:45:27 user nova-compute[70924]:       <entry name="serial">35bdb2dd-d2d4-4a3d-9178-6892d478dfa3</entry>
Jul 29 14:45:27 user nova-compute[70924]:       <entry name="uuid">35bdb2dd-d2d4-4a3d-9178-6892d478dfa3</entry>
Jul 29 14:45:27 user nova-compute[70924]:       <entry name="family">Virtual Machine</entry>
Jul 29 14:45:27 user nova-compute[70924]:     </system>
Jul 29 14:45:27 user nova-compute[70924]:   </sysinfo>
Jul 29 14:45:27 user nova-compute[70924]:   <os>
Jul 29 14:45:27 user nova-compute[70924]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 14:45:27 user nova-compute[70924]:     <boot dev="hd"/>
Jul 29 14:45:27 user nova-compute[70924]:     <smbios mode="sysinfo"/>
Jul 29 14:45:27 user nova-compute[70924]:   </os>
Jul 29 14:45:27 user nova-compute[70924]:   <features>
Jul 29 14:45:27 user nova-compute[70924]:     <acpi/>
Jul 29 14:45:27 user nova-compute[70924]:     <apic/>
Jul 29 14:45:27 user nova-compute[70924]:     <vmcoreinfo/>
Jul 29 14:45:27 user nova-compute[70924]:   </features>
Jul 29 14:45:27 user nova-compute[70924]:   <clock offset="utc">
Jul 29 14:45:27 user nova-compute[70924]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 14:45:27 user nova-compute[70924]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 14:45:27 user nova-compute[70924]:     <timer name="hpet" present="no"/>
Jul 29 14:45:27 user nova-compute[70924]:   </clock>
Jul 29 14:45:27 user nova-compute[70924]:   <cpu mode="custom" match="exact">
Jul 29 14:45:27 user nova-compute[70924]:     <model>Nehalem</model>
Jul 29 14:45:27 user nova-compute[70924]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 14:45:27 user nova-compute[70924]:   </cpu>
Jul 29 14:45:27 user nova-compute[70924]:   <devices>
Jul 29 14:45:27 user nova-compute[70924]:     <disk type="file" device="cdrom">
Jul 29 14:45:27 user nova-compute[70924]:       <driver name="qemu" type="raw" cache="none"/>
Jul 29 14:45:27 user nova-compute[70924]:       <source file="/opt/stack/data/nova/instances/35bdb2dd-d2d4-4a3d-9178-6892d478dfa3/disk.config"/>
Jul 29 14:45:27 user nova-compute[70924]:       <target dev="hda" bus="ide"/>
Jul 29 14:45:27 user nova-compute[70924]:     </disk>
Jul 29 14:45:27 user nova-compute[70924]:     <disk type="block" device="disk">
Jul 29 14:45:27 user nova-compute[70924]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:45:27 user nova-compute[70924]:       <source dev="/dev/sdd"/>
Jul 29 14:45:27 user nova-compute[70924]:       <target dev="vda" bus="virtio"/>
Jul 29 14:45:27 user nova-compute[70924]:       <serial>4a7d5e0c-d135-4dd9-be3f-8dd700523339</serial>
Jul 29 14:45:27 user nova-compute[70924]:     </disk>
Jul 29 14:45:27 user nova-compute[70924]:     <disk type="block" device="disk">
Jul 29 14:45:27 user nova-compute[70924]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:45:27 user nova-compute[70924]:       <source dev="/dev/sdf"/>
Jul 29 14:45:27 user nova-compute[70924]:       <target dev="vdb" bus="virtio"/>
Jul 29 14:45:27 user nova-compute[70924]:       <serial>0763aadd-e95f-4582-bb01-fcc7dc4681cb</serial>
Jul 29 14:45:27 user nova-compute[70924]:     </disk>
Jul 29 14:45:27 user nova-compute[70924]:     <disk type="block" device="disk">
Jul 29 14:45:27 user nova-compute[70924]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:45:27 user nova-compute[70924]:       <source dev="/dev/sdg"/>
Jul 29 14:45:27 user nova-compute[70924]:       <target dev="vdc" bus="virtio"/>
Jul 29 14:45:27 user nova-compute[70924]:       <serial>49b03148-7445-466e-b4dd-4b84dcaaa95a</serial>
Jul 29 14:45:27 user nova-compute[70924]:     </disk>
Jul 29 14:45:27 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 14:45:27 user nova-compute[70924]:       <mac address="fa:16:3e:15:a9:c3"/>
Jul 29 14:45:27 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:45:27 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 14:45:27 user nova-compute[70924]:       <target dev="tap195c1f76-21"/>
Jul 29 14:45:27 user nova-compute[70924]:     </interface>
Jul 29 14:45:27 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 14:45:27 user nova-compute[70924]:       <mac address="fa:16:3e:bc:51:b6"/>
Jul 29 14:45:27 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:45:27 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 14:45:27 user nova-compute[70924]:       <target dev="tape98a5996-f4"/>
Jul 29 14:45:27 user nova-compute[70924]:     </interface>
Jul 29 14:45:27 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 14:45:27 user nova-compute[70924]:       <mac address="fa:16:3e:08:fb:b3"/>
Jul 29 14:45:27 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:45:27 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 14:45:27 user nova-compute[70924]:       <target dev="tapf108e5c9-68"/>
Jul 29 14:45:27 user nova-compute[70924]:     </interface>
Jul 29 14:45:27 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 14:45:27 user nova-compute[70924]:       <mac address="fa:16:3e:65:cc:a7"/>
Jul 29 14:45:27 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:45:27 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 14:45:27 user nova-compute[70924]:       <target dev="tap0a5aa889-f4"/>
Jul 29 14:45:27 user nova-compute[70924]:     </interface>
Jul 29 14:45:27 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 14:45:27 user nova-compute[70924]:       <mac address="fa:16:3e:cc:03:d5"/>
Jul 29 14:45:27 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:45:27 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 14:45:27 user nova-compute[70924]:       <target dev="tap2e35e8a0-e2"/>
Jul 29 14:45:27 user nova-compute[70924]:     </interface>
Jul 29 14:45:27 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 14:45:27 user nova-compute[70924]:       <mac address="fa:16:3e:ae:d5:21"/>
Jul 29 14:45:27 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:45:27 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 14:45:27 user nova-compute[70924]:       <target dev="tap7334899f-e7"/>
Jul 29 14:45:27 user nova-compute[70924]:     </interface>
Jul 29 14:45:27 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 14:45:27 user nova-compute[70924]:       <mac address="fa:16:3e:30:14:87"/>
Jul 29 14:45:27 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:45:27 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 14:45:27 user nova-compute[70924]:       <target dev="tapc6793a3b-97"/>
Jul 29 14:45:27 user nova-compute[70924]:     </interface>
Jul 29 14:45:27 user nova-compute[70924]:     <serial type="pty">
Jul 29 14:45:27 user nova-compute[70924]:       <log file="/opt/stack/data/nova/instances/35bdb2dd-d2d4-4a3d-9178-6892d478dfa3/console.log" append="off"/>
Jul 29 14:45:27 user nova-compute[70924]:     </serial>
Jul 29 14:45:27 user nova-compute[70924]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 14:45:27 user nova-compute[70924]:     <video>
Jul 29 14:45:27 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:45:27 user nova-compute[70924]:     </video>
Jul 29 14:45:27 user nova-compute[70924]:     <rng model="virtio">
Jul 29 14:45:27 user nova-compute[70924]:       <backend model="random">/dev/urandom</backend>
Jul 29 14:45:27 user nova-compute[70924]:     </rng>
Jul 29 14:45:27 user nova-compute[70924]:     <controller type="usb" index="0" model="none"/>
Jul 29 14:45:27 user nova-compute[70924]:     <memballoon model="virtio">
Jul 29 14:45:27 user nova-compute[70924]:       <stats period="10"/>
Jul 29 14:45:27 user nova-compute[70924]:     </memballoon>
Jul 29 14:45:27 user nova-compute[70924]:   </devices>
Jul 29 14:45:27 user nova-compute[70924]: </domain>
Jul 29 14:45:27 user nova-compute[70924]:  {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T14:44:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-665402946',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-665402946',id=15,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5+0WvIsBj/j06hqnLQTtyszC978RLwfd3h9HEdPSOIa95oKqiIYN4A38Sy3a+7cgbLZMWi+UAEuTUU0Ac4QtvbKoz0WHaDZr5IdnS4lgNL4nNT8pTAKn6FSUPOEVUEvg==',key_name='tempest-keypair-1133379299',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87bd9746a49c4efeaea2c4b38c1b42c6',ramdisk_id='',reservation_id='r-xxt96qh6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-954540052',owner_user_name='tempest-TaggedBootDevicesTest_v242-954540052-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:44:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='69f7b3722f784d4cb61ba6b0cf325912',uuid=35bdb2dd-d2d4-4a3d-9178-6892d478dfa3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "195c1f76-2177-4201-bb05-291d7131c3c2", "address": "fa:16:3e:15:a9:c3", "network": {"id": "a836313e-84ad-4a1a-b4de-5eee3652fe69", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-368818776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195c1f76-21", "ovs_interfaceid": "195c1f76-2177-4201-bb05-291d7131c3c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Converting VIF {"id": "195c1f76-2177-4201-bb05-291d7131c3c2", "address": "fa:16:3e:15:a9:c3", "network": {"id": "a836313e-84ad-4a1a-b4de-5eee3652fe69", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-368818776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195c1f76-21", "ovs_interfaceid": "195c1f76-2177-4201-bb05-291d7131c3c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:a9:c3,bridge_name='br-int',has_traffic_filtering=True,id=195c1f76-2177-4201-bb05-291d7131c3c2,network=Network(a836313e-84ad-4a1a-b4de-5eee3652fe69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap195c1f76-21') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG os_vif [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:a9:c3,bridge_name='br-int',has_traffic_filtering=True,id=195c1f76-2177-4201-bb05-291d7131c3c2,network=Network(a836313e-84ad-4a1a-b4de-5eee3652fe69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap195c1f76-21') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap195c1f76-21, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap195c1f76-21, col_values=(('external_ids', {'iface-id': '195c1f76-2177-4201-bb05-291d7131c3c2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:a9:c3', 'vm-uuid': '35bdb2dd-d2d4-4a3d-9178-6892d478dfa3'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:27 user nova-compute[70924]: INFO os_vif [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:a9:c3,bridge_name='br-int',has_traffic_filtering=True,id=195c1f76-2177-4201-bb05-291d7131c3c2,network=Network(a836313e-84ad-4a1a-b4de-5eee3652fe69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap195c1f76-21')
Jul 29 14:45:27 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T14:44:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-665402946',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-665402946',id=15,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5+0WvIsBj/j06hqnLQTtyszC978RLwfd3h9HEdPSOIa95oKqiIYN4A38Sy3a+7cgbLZMWi+UAEuTUU0Ac4QtvbKoz0WHaDZr5IdnS4lgNL4nNT8pTAKn6FSUPOEVUEvg==',key_name='tempest-keypair-1133379299',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87bd9746a49c4efeaea2c4b38c1b42c6',ramdisk_id='',reservation_id='r-xxt96qh6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-954540052',owner_user_name='tempest-TaggedBootDevicesTest_v242-954540052-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:44:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='69f7b3722f784d4cb61ba6b0cf325912',uuid=35bdb2dd-d2d4-4a3d-9178-6892d478dfa3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e98a5996-f4ad-44fd-9fc9-591e411bbaa1", "address": "fa:16:3e:bc:51:b6", "network": {"id": "5f1efb98-21ff-48db-95aa-ab5f29e5ff45", "bridge": "br-int", "label": "tempest-device-tagging-net1-473596273", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape98a5996-f4", "ovs_interfaceid": "e98a5996-f4ad-44fd-9fc9-591e411bbaa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Converting VIF {"id": "e98a5996-f4ad-44fd-9fc9-591e411bbaa1", "address": "fa:16:3e:bc:51:b6", "network": {"id": "5f1efb98-21ff-48db-95aa-ab5f29e5ff45", "bridge": "br-int", "label": "tempest-device-tagging-net1-473596273", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape98a5996-f4", "ovs_interfaceid": "e98a5996-f4ad-44fd-9fc9-591e411bbaa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:51:b6,bridge_name='br-int',has_traffic_filtering=True,id=e98a5996-f4ad-44fd-9fc9-591e411bbaa1,network=Network(5f1efb98-21ff-48db-95aa-ab5f29e5ff45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape98a5996-f4') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG os_vif [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:51:b6,bridge_name='br-int',has_traffic_filtering=True,id=e98a5996-f4ad-44fd-9fc9-591e411bbaa1,network=Network(5f1efb98-21ff-48db-95aa-ab5f29e5ff45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape98a5996-f4') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape98a5996-f4, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape98a5996-f4, col_values=(('external_ids', {'iface-id': 'e98a5996-f4ad-44fd-9fc9-591e411bbaa1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:51:b6', 'vm-uuid': '35bdb2dd-d2d4-4a3d-9178-6892d478dfa3'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:27 user nova-compute[70924]: INFO os_vif [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:51:b6,bridge_name='br-int',has_traffic_filtering=True,id=e98a5996-f4ad-44fd-9fc9-591e411bbaa1,network=Network(5f1efb98-21ff-48db-95aa-ab5f29e5ff45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape98a5996-f4')
Jul 29 14:45:27 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T14:44:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-665402946',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-665402946',id=15,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5+0WvIsBj/j06hqnLQTtyszC978RLwfd3h9HEdPSOIa95oKqiIYN4A38Sy3a+7cgbLZMWi+UAEuTUU0Ac4QtvbKoz0WHaDZr5IdnS4lgNL4nNT8pTAKn6FSUPOEVUEvg==',key_name='tempest-keypair-1133379299',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87bd9746a49c4efeaea2c4b38c1b42c6',ramdisk_id='',reservation_id='r-xxt96qh6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-954540052',owner_user_name='tempest-TaggedBootDevicesTest_v242-954540052-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:44:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='69f7b3722f784d4cb61ba6b0cf325912',uuid=35bdb2dd-d2d4-4a3d-9178-6892d478dfa3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f108e5c9-68f4-4444-b686-18df097fa015", "address": "fa:16:3e:08:fb:b3", "network": {"id": "5f1efb98-21ff-48db-95aa-ab5f29e5ff45", "bridge": "br-int", "label": "tempest-device-tagging-net1-473596273", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf108e5c9-68", "ovs_interfaceid": "f108e5c9-68f4-4444-b686-18df097fa015", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Converting VIF {"id": "f108e5c9-68f4-4444-b686-18df097fa015", "address": "fa:16:3e:08:fb:b3", "network": {"id": "5f1efb98-21ff-48db-95aa-ab5f29e5ff45", "bridge": "br-int", "label": "tempest-device-tagging-net1-473596273", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf108e5c9-68", "ovs_interfaceid": "f108e5c9-68f4-4444-b686-18df097fa015", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:fb:b3,bridge_name='br-int',has_traffic_filtering=True,id=f108e5c9-68f4-4444-b686-18df097fa015,network=Network(5f1efb98-21ff-48db-95aa-ab5f29e5ff45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf108e5c9-68') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG os_vif [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:fb:b3,bridge_name='br-int',has_traffic_filtering=True,id=f108e5c9-68f4-4444-b686-18df097fa015,network=Network(5f1efb98-21ff-48db-95aa-ab5f29e5ff45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf108e5c9-68') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf108e5c9-68, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf108e5c9-68, col_values=(('external_ids', {'iface-id': 'f108e5c9-68f4-4444-b686-18df097fa015', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:fb:b3', 'vm-uuid': '35bdb2dd-d2d4-4a3d-9178-6892d478dfa3'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:27 user nova-compute[70924]: INFO os_vif [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:fb:b3,bridge_name='br-int',has_traffic_filtering=True,id=f108e5c9-68f4-4444-b686-18df097fa015,network=Network(5f1efb98-21ff-48db-95aa-ab5f29e5ff45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf108e5c9-68')
Jul 29 14:45:27 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T14:44:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-665402946',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-665402946',id=15,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5+0WvIsBj/j06hqnLQTtyszC978RLwfd3h9HEdPSOIa95oKqiIYN4A38Sy3a+7cgbLZMWi+UAEuTUU0Ac4QtvbKoz0WHaDZr5IdnS4lgNL4nNT8pTAKn6FSUPOEVUEvg==',key_name='tempest-keypair-1133379299',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87bd9746a49c4efeaea2c4b38c1b42c6',ramdisk_id='',reservation_id='r-xxt96qh6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-954540052',owner_user_name='tempest-TaggedBootDevicesTest_v242-954540052-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:44:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='69f7b3722f784d4cb61ba6b0cf325912',uuid=35bdb2dd-d2d4-4a3d-9178-6892d478dfa3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a5aa889-f4ad-49dd-9741-ce0d161bc25f", "address": "fa:16:3e:65:cc:a7", "network": {"id": "5f1efb98-21ff-48db-95aa-ab5f29e5ff45", "bridge": "br-int", "label": "tempest-device-tagging-net1-473596273", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a5aa889-f4", "ovs_interfaceid": "0a5aa889-f4ad-49dd-9741-ce0d161bc25f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Converting VIF {"id": "0a5aa889-f4ad-49dd-9741-ce0d161bc25f", "address": "fa:16:3e:65:cc:a7", "network": {"id": "5f1efb98-21ff-48db-95aa-ab5f29e5ff45", "bridge": "br-int", "label": "tempest-device-tagging-net1-473596273", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a5aa889-f4", "ovs_interfaceid": "0a5aa889-f4ad-49dd-9741-ce0d161bc25f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:cc:a7,bridge_name='br-int',has_traffic_filtering=True,id=0a5aa889-f4ad-49dd-9741-ce0d161bc25f,network=Network(5f1efb98-21ff-48db-95aa-ab5f29e5ff45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a5aa889-f4') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG os_vif [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:cc:a7,bridge_name='br-int',has_traffic_filtering=True,id=0a5aa889-f4ad-49dd-9741-ce0d161bc25f,network=Network(5f1efb98-21ff-48db-95aa-ab5f29e5ff45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a5aa889-f4') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0a5aa889-f4, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0a5aa889-f4, col_values=(('external_ids', {'iface-id': '0a5aa889-f4ad-49dd-9741-ce0d161bc25f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:cc:a7', 'vm-uuid': '35bdb2dd-d2d4-4a3d-9178-6892d478dfa3'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:27 user nova-compute[70924]: INFO os_vif [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:cc:a7,bridge_name='br-int',has_traffic_filtering=True,id=0a5aa889-f4ad-49dd-9741-ce0d161bc25f,network=Network(5f1efb98-21ff-48db-95aa-ab5f29e5ff45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a5aa889-f4')
Jul 29 14:45:27 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T14:44:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-665402946',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-665402946',id=15,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5+0WvIsBj/j06hqnLQTtyszC978RLwfd3h9HEdPSOIa95oKqiIYN4A38Sy3a+7cgbLZMWi+UAEuTUU0Ac4QtvbKoz0WHaDZr5IdnS4lgNL4nNT8pTAKn6FSUPOEVUEvg==',key_name='tempest-keypair-1133379299',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87bd9746a49c4efeaea2c4b38c1b42c6',ramdisk_id='',reservation_id='r-xxt96qh6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-954540052',owner_user_name='tempest-TaggedBootDevicesTest_v242-954540052-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:44:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='69f7b3722f784d4cb61ba6b0cf325912',uuid=35bdb2dd-d2d4-4a3d-9178-6892d478dfa3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e35e8a0-e202-46d5-b854-9960de88edc2", "address": "fa:16:3e:cc:03:d5", "network": {"id": "5f1efb98-21ff-48db-95aa-ab5f29e5ff45", "bridge": "br-int", "label": "tempest-device-tagging-net1-473596273", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e35e8a0-e2", "ovs_interfaceid": "2e35e8a0-e202-46d5-b854-9960de88edc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Converting VIF {"id": "2e35e8a0-e202-46d5-b854-9960de88edc2", "address": "fa:16:3e:cc:03:d5", "network": {"id": "5f1efb98-21ff-48db-95aa-ab5f29e5ff45", "bridge": "br-int", "label": "tempest-device-tagging-net1-473596273", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e35e8a0-e2", "ovs_interfaceid": "2e35e8a0-e202-46d5-b854-9960de88edc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:03:d5,bridge_name='br-int',has_traffic_filtering=True,id=2e35e8a0-e202-46d5-b854-9960de88edc2,network=Network(5f1efb98-21ff-48db-95aa-ab5f29e5ff45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e35e8a0-e2') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG os_vif [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:03:d5,bridge_name='br-int',has_traffic_filtering=True,id=2e35e8a0-e202-46d5-b854-9960de88edc2,network=Network(5f1efb98-21ff-48db-95aa-ab5f29e5ff45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e35e8a0-e2') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2e35e8a0-e2, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2e35e8a0-e2, col_values=(('external_ids', {'iface-id': '2e35e8a0-e202-46d5-b854-9960de88edc2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:03:d5', 'vm-uuid': '35bdb2dd-d2d4-4a3d-9178-6892d478dfa3'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:27 user nova-compute[70924]: INFO os_vif [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:03:d5,bridge_name='br-int',has_traffic_filtering=True,id=2e35e8a0-e202-46d5-b854-9960de88edc2,network=Network(5f1efb98-21ff-48db-95aa-ab5f29e5ff45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e35e8a0-e2')
Jul 29 14:45:27 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T14:44:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-665402946',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-665402946',id=15,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5+0WvIsBj/j06hqnLQTtyszC978RLwfd3h9HEdPSOIa95oKqiIYN4A38Sy3a+7cgbLZMWi+UAEuTUU0Ac4QtvbKoz0WHaDZr5IdnS4lgNL4nNT8pTAKn6FSUPOEVUEvg==',key_name='tempest-keypair-1133379299',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87bd9746a49c4efeaea2c4b38c1b42c6',ramdisk_id='',reservation_id='r-xxt96qh6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-954540052',owner_user_name='tempest-TaggedBootDevicesTest_v242-954540052-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:44:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='69f7b3722f784d4cb61ba6b0cf325912',uuid=35bdb2dd-d2d4-4a3d-9178-6892d478dfa3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7334899f-e7c7-48d8-8c14-4fda63fea3b5", "address": "fa:16:3e:ae:d5:21", "network": {"id": "381d607e-5106-44f3-b3e0-8926c54e74f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-197405985", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7334899f-e7", "ovs_interfaceid": "7334899f-e7c7-48d8-8c14-4fda63fea3b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Converting VIF {"id": "7334899f-e7c7-48d8-8c14-4fda63fea3b5", "address": "fa:16:3e:ae:d5:21", "network": {"id": "381d607e-5106-44f3-b3e0-8926c54e74f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-197405985", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7334899f-e7", "ovs_interfaceid": "7334899f-e7c7-48d8-8c14-4fda63fea3b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:d5:21,bridge_name='br-int',has_traffic_filtering=True,id=7334899f-e7c7-48d8-8c14-4fda63fea3b5,network=Network(381d607e-5106-44f3-b3e0-8926c54e74f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7334899f-e7') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG os_vif [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:d5:21,bridge_name='br-int',has_traffic_filtering=True,id=7334899f-e7c7-48d8-8c14-4fda63fea3b5,network=Network(381d607e-5106-44f3-b3e0-8926c54e74f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7334899f-e7') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7334899f-e7, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7334899f-e7, col_values=(('external_ids', {'iface-id': '7334899f-e7c7-48d8-8c14-4fda63fea3b5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:d5:21', 'vm-uuid': '35bdb2dd-d2d4-4a3d-9178-6892d478dfa3'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:27 user nova-compute[70924]: INFO os_vif [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:d5:21,bridge_name='br-int',has_traffic_filtering=True,id=7334899f-e7c7-48d8-8c14-4fda63fea3b5,network=Network(381d607e-5106-44f3-b3e0-8926c54e74f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7334899f-e7')
Jul 29 14:45:27 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T14:44:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-665402946',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-665402946',id=15,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5+0WvIsBj/j06hqnLQTtyszC978RLwfd3h9HEdPSOIa95oKqiIYN4A38Sy3a+7cgbLZMWi+UAEuTUU0Ac4QtvbKoz0WHaDZr5IdnS4lgNL4nNT8pTAKn6FSUPOEVUEvg==',key_name='tempest-keypair-1133379299',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87bd9746a49c4efeaea2c4b38c1b42c6',ramdisk_id='',reservation_id='r-xxt96qh6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-954540052',owner_user_name='tempest-TaggedBootDevicesTest_v242-954540052-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:44:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='69f7b3722f784d4cb61ba6b0cf325912',uuid=35bdb2dd-d2d4-4a3d-9178-6892d478dfa3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c6793a3b-97da-4584-a326-f1caf598cd78", "address": "fa:16:3e:30:14:87", "network": {"id": "381d607e-5106-44f3-b3e0-8926c54e74f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-197405985", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6793a3b-97", "ovs_interfaceid": "c6793a3b-97da-4584-a326-f1caf598cd78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Converting VIF {"id": "c6793a3b-97da-4584-a326-f1caf598cd78", "address": "fa:16:3e:30:14:87", "network": {"id": "381d607e-5106-44f3-b3e0-8926c54e74f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-197405985", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6793a3b-97", "ovs_interfaceid": "c6793a3b-97da-4584-a326-f1caf598cd78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:14:87,bridge_name='br-int',has_traffic_filtering=True,id=c6793a3b-97da-4584-a326-f1caf598cd78,network=Network(381d607e-5106-44f3-b3e0-8926c54e74f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6793a3b-97') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG os_vif [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:14:87,bridge_name='br-int',has_traffic_filtering=True,id=c6793a3b-97da-4584-a326-f1caf598cd78,network=Network(381d607e-5106-44f3-b3e0-8926c54e74f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6793a3b-97') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc6793a3b-97, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc6793a3b-97, col_values=(('external_ids', {'iface-id': 'c6793a3b-97da-4584-a326-f1caf598cd78', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:14:87', 'vm-uuid': '35bdb2dd-d2d4-4a3d-9178-6892d478dfa3'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:45:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:45:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:28 user nova-compute[70924]: INFO os_vif [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:14:87,bridge_name='br-int',has_traffic_filtering=True,id=c6793a3b-97da-4584-a326-f1caf598cd78,network=Network(381d607e-5106-44f3-b3e0-8926c54e74f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6793a3b-97')
Jul 29 14:45:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:28 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] No BDM found with device name hda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:45:28 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] No BDM found with device name vdc, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:45:28 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] No VIF found with MAC fa:16:3e:15:a9:c3, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:45:28 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] No VIF found with MAC fa:16:3e:cc:03:d5, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:45:28 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Using config drive
Jul 29 14:45:28 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Creating config drive at /opt/stack/data/nova/instances/35bdb2dd-d2d4-4a3d-9178-6892d478dfa3/disk.config
Jul 29 14:45:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/35bdb2dd-d2d4-4a3d-9178-6892d478dfa3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpi43fiz91 {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/35bdb2dd-d2d4-4a3d-9178-6892d478dfa3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpi43fiz91" returned: 0 in 0.083s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:29 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] Acquiring lock "79652140-c347-4d7b-9770-a4cc2d1a08e3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:45:29 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] Lock "79652140-c347-4d7b-9770-a4cc2d1a08e3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:45:29 user nova-compute[70924]: DEBUG nova.compute.manager [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] [instance: 79652140-c347-4d7b-9770-a4cc2d1a08e3] Starting instance... {{(pid=70924) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 14:45:29 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:45:29 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:45:29 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70924) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 14:45:29 user nova-compute[70924]: INFO nova.compute.claims [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] [instance: 79652140-c347-4d7b-9770-a4cc2d1a08e3] Claim successful on node user
Jul 29 14:45:29 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:30 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:45:30 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:45:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.657s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:30 user nova-compute[70924]: DEBUG nova.compute.manager [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] [instance: 79652140-c347-4d7b-9770-a4cc2d1a08e3] Start building networks asynchronously for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 14:45:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:30 user nova-compute[70924]: DEBUG nova.compute.manager [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] [instance: 79652140-c347-4d7b-9770-a4cc2d1a08e3] Allocating IP information in the background. {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 14:45:30 user nova-compute[70924]: DEBUG nova.network.neutron [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] [instance: 79652140-c347-4d7b-9770-a4cc2d1a08e3] allocate_for_instance() {{(pid=70924) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 14:45:30 user nova-compute[70924]: DEBUG nova.compute.manager [req-d024e2f6-9ab8-41d2-9fef-ee7fe7d5ec96 req-bcb49b46-554f-4e68-a039-3169f772c3e4 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received event network-vif-plugged-195c1f76-2177-4201-bb05-291d7131c3c2 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:45:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-d024e2f6-9ab8-41d2-9fef-ee7fe7d5ec96 req-bcb49b46-554f-4e68-a039-3169f772c3e4 service nova] Acquiring lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:45:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-d024e2f6-9ab8-41d2-9fef-ee7fe7d5ec96 req-bcb49b46-554f-4e68-a039-3169f772c3e4 service nova] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:45:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-d024e2f6-9ab8-41d2-9fef-ee7fe7d5ec96 req-bcb49b46-554f-4e68-a039-3169f772c3e4 service nova] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:30 user nova-compute[70924]: DEBUG nova.compute.manager [req-d024e2f6-9ab8-41d2-9fef-ee7fe7d5ec96 req-bcb49b46-554f-4e68-a039-3169f772c3e4 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] No waiting events found dispatching network-vif-plugged-195c1f76-2177-4201-bb05-291d7131c3c2 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:45:30 user nova-compute[70924]: WARNING nova.compute.manager [req-d024e2f6-9ab8-41d2-9fef-ee7fe7d5ec96 req-bcb49b46-554f-4e68-a039-3169f772c3e4 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received unexpected event network-vif-plugged-195c1f76-2177-4201-bb05-291d7131c3c2 for instance with vm_state building and task_state spawning.
Jul 29 14:45:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:30 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] [instance: 79652140-c347-4d7b-9770-a4cc2d1a08e3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 14:45:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:30 user nova-compute[70924]: DEBUG nova.compute.manager [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] [instance: 79652140-c347-4d7b-9770-a4cc2d1a08e3] Start building block device mappings for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 14:45:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:30 user nova-compute[70924]: DEBUG nova.compute.manager [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] [instance: 79652140-c347-4d7b-9770-a4cc2d1a08e3] Start spawning the instance on the hypervisor. {{(pid=70924) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 14:45:30 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] [instance: 79652140-c347-4d7b-9770-a4cc2d1a08e3] Creating instance directory {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 14:45:30 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] [instance: 79652140-c347-4d7b-9770-a4cc2d1a08e3] Creating image(s)
Jul 29 14:45:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] Acquiring lock "/opt/stack/data/nova/instances/79652140-c347-4d7b-9770-a4cc2d1a08e3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:45:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] Lock "/opt/stack/data/nova/instances/79652140-c347-4d7b-9770-a4cc2d1a08e3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:45:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] Lock "/opt/stack/data/nova/instances/79652140-c347-4d7b-9770-a4cc2d1a08e3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:30 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:30 user nova-compute[70924]: DEBUG nova.compute.manager [req-7d024953-02e7-4495-aab9-4972b9f67cda req-09fb2a1b-2a4b-46c7-9759-5b9e42717fc6 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received event network-vif-plugged-e98a5996-f4ad-44fd-9fc9-591e411bbaa1 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:45:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-7d024953-02e7-4495-aab9-4972b9f67cda req-09fb2a1b-2a4b-46c7-9759-5b9e42717fc6 service nova] Acquiring lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:45:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-7d024953-02e7-4495-aab9-4972b9f67cda req-09fb2a1b-2a4b-46c7-9759-5b9e42717fc6 service nova] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:45:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-7d024953-02e7-4495-aab9-4972b9f67cda req-09fb2a1b-2a4b-46c7-9759-5b9e42717fc6 service nova] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:30 user nova-compute[70924]: DEBUG nova.compute.manager [req-7d024953-02e7-4495-aab9-4972b9f67cda req-09fb2a1b-2a4b-46c7-9759-5b9e42717fc6 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] No waiting events found dispatching network-vif-plugged-e98a5996-f4ad-44fd-9fc9-591e411bbaa1 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:45:30 user nova-compute[70924]: WARNING nova.compute.manager [req-7d024953-02e7-4495-aab9-4972b9f67cda req-09fb2a1b-2a4b-46c7-9759-5b9e42717fc6 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received unexpected event network-vif-plugged-e98a5996-f4ad-44fd-9fc9-591e411bbaa1 for instance with vm_state building and task_state spawning.
Jul 29 14:45:30 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.169s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] Acquiring lock "bd72453517468710f1de26b27fb0ea28688e9009" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:45:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:45:30 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:30 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Creating instance directory {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 14:45:30 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Creating image(s)
Jul 29 14:45:30 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Did not create local disks {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 29 14:45:30 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Ensure instance console log exists: /opt/stack/data/nova/instances/9b4c76df-f74f-43b4-968f-b730cc5b0ec6/console.log {{(pid=70924) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 14:45:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:45:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:45:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:30 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Start _get_guest_xml network_info=[{"id": "325110be-cad2-4b73-9044-3028f80f3d37", "address": "fa:16:3e:68:19:c4", "network": {"id": "b6631336-b322-45e0-99b7-5e95539aa674", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2109271400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc2394c924af4a9aaa925d116b2117ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap325110be-ca", "ovs_interfaceid": "325110be-cad2-4b73-9044-3028f80f3d37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uNkATmgG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9b4c76df-f74f-43b4-968f-b730cc5b0ec6', 'attached_at': '', 'detached_at': '', 'volume_id': '45a218df-4554-4d68-ba78-d0232ff799b7', 'serial': '45a218df-4554-4d68-ba78-d0232ff799b7'}, 'attachment_id': '07d4e431-e43d-4e0f-9381-5c9478cd5f5f', 'volume_type': None} {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:31 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 29 14:45:31 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 29 14:45:31 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] CPU controller missing on host. {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] CPU controller found on host. {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70924) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T14:36:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Flavor limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Image limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Flavor pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Image pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Got 1 possible topologies {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG nova.objects.instance [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9b4c76df-f74f-43b4-968f-b730cc5b0ec6 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG nova.policy [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b32250a289d044bb9cd8971cf81e59df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad49619f9f14c87a32ebb20a2df5800', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70924) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Calling os-brick to attach iSCSI Volume {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uNkATmgG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:45:31 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 29 14:45:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:45:31 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 29 14:45:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:45:31 user nova-compute[70924]: INFO os_brick.initiator.connectors.iscsi [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 14:45:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 -p 172.16.0.220:3260 {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.197s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/79652140-c347-4d7b-9770-a4cc2d1a08e3/disk 1073741824 {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0510e73a-1c4f-4354-b35f-1de178717220]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 14:45:31 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 -p 172.16.0.220:3260 --interface default --op new {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/79652140-c347-4d7b-9770-a4cc2d1a08e3/disk 1073741824" returned: 0 in 0.068s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[925cb6ec-de7e-4bc4-9bea-db74295c5e40]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7] added\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7] added
Jul 29 14:45:31 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d72733b-4519-47df-b419-97578312313f]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.054s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5b15f2-5f04-464a-92ee-7a45798e21d8]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uNkATmgG {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uNkATmgG" returned: 0 in 0.035s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[844383e4-a3fc-4f91-9256-e7263734fe8c]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uNkATmgG'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b157cc20-f195-4653-90d1-a713fa0f327d]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.248s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] Checking if we can resize image /opt/stack/data/nova/instances/79652140-c347-4d7b-9770-a4cc2d1a08e3/disk. size=1073741824 {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79652140-c347-4d7b-9770-a4cc2d1a08e3/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4bb1acc-932f-44c0-b0ce-4e213c8ab4e8]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a7d5e0c-d135-4dd9-be3f-8dd700523339 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0763aadd-e95f-4582-bb01-fcc7dc4681cb (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49b03148-7445-466e-b4dd-4b84dcaaa95a (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:45:31 user nova-compute[70924]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)
Jul 29 14:45:31 user nova-compute[70924]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 (non-flash)
Jul 29 14:45:31 user nova-compute[70924]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a7d5e0c-d135-4dd9-be3f-8dd700523339 (non-flash)
Jul 29 14:45:31 user nova-compute[70924]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0763aadd-e95f-4582-bb01-fcc7dc4681cb (non-flash)
Jul 29 14:45:31 user nova-compute[70924]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49b03148-7445-466e-b4dd-4b84dcaaa95a (non-flash)
Jul 29 14:45:31 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:45:31 user nova-compute[70924]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)
Jul 29 14:45:31 user nova-compute[70924]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 (non-flash)
Jul 29 14:45:31 user nova-compute[70924]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a7d5e0c-d135-4dd9-be3f-8dd700523339 (non-flash)
Jul 29 14:45:31 user nova-compute[70924]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0763aadd-e95f-4582-bb01-fcc7dc4681cb (non-flash)
Jul 29 14:45:31 user nova-compute[70924]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49b03148-7445-466e-b4dd-4b84dcaaa95a (non-flash)
Jul 29 14:45:31 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG nova.compute.manager [req-e393190e-a311-414c-900b-4a59f74d83a2 req-101193d9-4cee-4123-917e-e1edeefe7843 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received event network-vif-plugged-0a5aa889-f4ad-49dd-9741-ce0d161bc25f {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-e393190e-a311-414c-900b-4a59f74d83a2 req-101193d9-4cee-4123-917e-e1edeefe7843 service nova] Acquiring lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-e393190e-a311-414c-900b-4a59f74d83a2 req-101193d9-4cee-4123-917e-e1edeefe7843 service nova] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-e393190e-a311-414c-900b-4a59f74d83a2 req-101193d9-4cee-4123-917e-e1edeefe7843 service nova] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG nova.compute.manager [req-e393190e-a311-414c-900b-4a59f74d83a2 req-101193d9-4cee-4123-917e-e1edeefe7843 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] No waiting events found dispatching network-vif-plugged-0a5aa889-f4ad-49dd-9741-ce0d161bc25f {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:45:31 user nova-compute[70924]: WARNING nova.compute.manager [req-e393190e-a311-414c-900b-4a59f74d83a2 req-101193d9-4cee-4123-917e-e1edeefe7843 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received unexpected event network-vif-plugged-0a5aa889-f4ad-49dd-9741-ce0d161bc25f for instance with vm_state building and task_state spawning.
Jul 29 14:45:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 -p 172.16.0.220:3260 --login {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1480d9d-da52-4f1a-a759-20f7bd5d15a6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7, portal: 172.16.0.220,3260]
Jul 29 14:45:31 user nova-compute[70924]: Login to [iface: default, target: iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7, portal: 172.16.0.220,3260] successful.
Jul 29 14:45:31 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79652140-c347-4d7b-9770-a4cc2d1a08e3/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] Cannot resize image /opt/stack/data/nova/instances/79652140-c347-4d7b-9770-a4cc2d1a08e3/disk to a smaller size. {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG nova.objects.instance [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] Lazy-loading 'migration_context' on Instance uuid 79652140-c347-4d7b-9770-a4cc2d1a08e3 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[890d08af-c820-403d-856f-73ba9068dc43]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] [instance: 79652140-c347-4d7b-9770-a4cc2d1a08e3] Created local disks {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] [instance: 79652140-c347-4d7b-9770-a4cc2d1a08e3] Ensure instance console log exists: /opt/stack/data/nova/instances/79652140-c347-4d7b-9770-a4cc2d1a08e3/console.log {{(pid=70924) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.047s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8bee07-c123-4e18-9069-7173796ce1a9]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a7d5e0c-d135-4dd9-be3f-8dd700523339 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0763aadd-e95f-4582-bb01-fcc7dc4681cb (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49b03148-7445-466e-b4dd-4b84dcaaa95a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:45:31 user nova-compute[70924]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)
Jul 29 14:45:31 user nova-compute[70924]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 (non-flash)
Jul 29 14:45:31 user nova-compute[70924]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a7d5e0c-d135-4dd9-be3f-8dd700523339 (non-flash)
Jul 29 14:45:31 user nova-compute[70924]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0763aadd-e95f-4582-bb01-fcc7dc4681cb (non-flash)
Jul 29 14:45:31 user nova-compute[70924]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49b03148-7445-466e-b4dd-4b84dcaaa95a (non-flash)
Jul 29 14:45:31 user nova-compute[70924]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:45:31 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:45:31 user nova-compute[70924]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)
Jul 29 14:45:31 user nova-compute[70924]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 (non-flash)
Jul 29 14:45:31 user nova-compute[70924]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a7d5e0c-d135-4dd9-be3f-8dd700523339 (non-flash)
Jul 29 14:45:31 user nova-compute[70924]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0763aadd-e95f-4582-bb01-fcc7dc4681cb (non-flash)
Jul 29 14:45:31 user nova-compute[70924]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49b03148-7445-466e-b4dd-4b84dcaaa95a (non-flash)
Jul 29 14:45:31 user nova-compute[70924]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:45:31 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.580s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Connected to 172.16.0.220:3260 {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] HCTL ('39', '-', '-', 0) found on session 21 with lun 0 {{(pid=70924) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=70924) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.026s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[793961a3-53a4-44c4-ae76-a687c172a412]: (4, ('- - 0', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Searching for a device in session 21 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uNkATmgG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:32 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:32 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:32 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:32 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:32 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:32 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:32 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:32 user nova-compute[70924]: DEBUG nova.compute.manager [req-3466f2fe-9914-41e5-ad96-2ab0d6bea413 req-c431254d-5606-4ad5-9cc7-388329ea625f service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received event network-vif-plugged-195c1f76-2177-4201-bb05-291d7131c3c2 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:45:32 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-3466f2fe-9914-41e5-ad96-2ab0d6bea413 req-c431254d-5606-4ad5-9cc7-388329ea625f service nova] Acquiring lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:45:32 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-3466f2fe-9914-41e5-ad96-2ab0d6bea413 req-c431254d-5606-4ad5-9cc7-388329ea625f service nova] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:45:32 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-3466f2fe-9914-41e5-ad96-2ab0d6bea413 req-c431254d-5606-4ad5-9cc7-388329ea625f service nova] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:32 user nova-compute[70924]: DEBUG nova.compute.manager [req-3466f2fe-9914-41e5-ad96-2ab0d6bea413 req-c431254d-5606-4ad5-9cc7-388329ea625f service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] No waiting events found dispatching network-vif-plugged-195c1f76-2177-4201-bb05-291d7131c3c2 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:45:32 user nova-compute[70924]: WARNING nova.compute.manager [req-3466f2fe-9914-41e5-ad96-2ab0d6bea413 req-c431254d-5606-4ad5-9cc7-388329ea625f service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received unexpected event network-vif-plugged-195c1f76-2177-4201-bb05-291d7131c3c2 for instance with vm_state building and task_state spawning.
Jul 29 14:45:32 user nova-compute[70924]: DEBUG nova.compute.manager [req-3466f2fe-9914-41e5-ad96-2ab0d6bea413 req-c431254d-5606-4ad5-9cc7-388329ea625f service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received event network-vif-plugged-f108e5c9-68f4-4444-b686-18df097fa015 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:45:32 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-3466f2fe-9914-41e5-ad96-2ab0d6bea413 req-c431254d-5606-4ad5-9cc7-388329ea625f service nova] Acquiring lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:45:32 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-3466f2fe-9914-41e5-ad96-2ab0d6bea413 req-c431254d-5606-4ad5-9cc7-388329ea625f service nova] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:45:32 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-3466f2fe-9914-41e5-ad96-2ab0d6bea413 req-c431254d-5606-4ad5-9cc7-388329ea625f service nova] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:32 user nova-compute[70924]: DEBUG nova.compute.manager [req-3466f2fe-9914-41e5-ad96-2ab0d6bea413 req-c431254d-5606-4ad5-9cc7-388329ea625f service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] No waiting events found dispatching network-vif-plugged-f108e5c9-68f4-4444-b686-18df097fa015 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:45:32 user nova-compute[70924]: WARNING nova.compute.manager [req-3466f2fe-9914-41e5-ad96-2ab0d6bea413 req-c431254d-5606-4ad5-9cc7-388329ea625f service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received unexpected event network-vif-plugged-f108e5c9-68f4-4444-b686-18df097fa015 for instance with vm_state building and task_state spawning.
Jul 29 14:45:32 user nova-compute[70924]: DEBUG nova.network.neutron [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] [instance: 79652140-c347-4d7b-9770-a4cc2d1a08e3] Successfully created port: bf1e6655-6811-4a5c-ac2d-e2cd6a3b8d02 {{(pid=70924) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 14:45:32 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.626s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:45:32 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] <== connect_volume: return (1627ms) {'type': 'block', 'scsi_wwn': '23731623232393037', 'path': '/dev/sdh'} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:45:32 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23731623232393037', 'path': '/dev/sdh'} {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 14:45:32 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:32 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:32 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-29T14:43:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-548861444',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-557172459',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIRtdSU+MVFf8qwfTK/HOmWFsyOji10ll1mwxkAqJoexyhER2LF96x27gUwwiTyRjXgCHH8B6MegN4zey5bLI+qd4irGAGZrC8bAT7qofxp4xjUAZePgyakCsMZxbHsjfw==',key_name='tempest-keypair-1008786546',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:43:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fc2394c924af4a9aaa925d116b2117ae',ramdisk_id='',reservation_id='r-8ju02t52',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1372699391',owner_user_name='tempest-ServerActionsV293TestJSON-1372699391-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:45:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b744bbecccf48d1833ea4810b2af2d0',uuid=9b4c76df-f74f-43b4-968f-b730cc5b0ec6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "325110be-cad2-4b73-9044-3028f80f3d37", "address": "fa:16:3e:68:19:c4", "network": {"id": "b6631336-b322-45e0-99b7-5e95539aa674", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2109271400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc2394c924af4a9aaa925d116b2117ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap325110be-ca", "ovs_interfaceid": "325110be-cad2-4b73-9044-3028f80f3d37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:45:32 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Converting VIF {"id": "325110be-cad2-4b73-9044-3028f80f3d37", "address": "fa:16:3e:68:19:c4", "network": {"id": "b6631336-b322-45e0-99b7-5e95539aa674", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2109271400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc2394c924af4a9aaa925d116b2117ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap325110be-ca", "ovs_interfaceid": "325110be-cad2-4b73-9044-3028f80f3d37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:45:32 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:19:c4,bridge_name='br-int',has_traffic_filtering=True,id=325110be-cad2-4b73-9044-3028f80f3d37,network=Network(b6631336-b322-45e0-99b7-5e95539aa674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap325110be-ca') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:45:32 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] End _get_guest_xml xml=<domain type="kvm">
Jul 29 14:45:32 user nova-compute[70924]:   <uuid>9b4c76df-f74f-43b4-968f-b730cc5b0ec6</uuid>
Jul 29 14:45:32 user nova-compute[70924]:   <name>instance-0000000b</name>
Jul 29 14:45:32 user nova-compute[70924]:   <memory>524288</memory>
Jul 29 14:45:32 user nova-compute[70924]:   <vcpu>1</vcpu>
Jul 29 14:45:32 user nova-compute[70924]:   <metadata>
Jul 29 14:45:32 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 14:45:32 user nova-compute[70924]:       <nova:package version="0.0.0"/>
Jul 29 14:45:32 user nova-compute[70924]:       <nova:name>tempest-ServerActionsV293TestJSON-server-548861444</nova:name>
Jul 29 14:45:32 user nova-compute[70924]:       <nova:creationTime>2023-07-29 14:45:31</nova:creationTime>
Jul 29 14:45:32 user nova-compute[70924]:       <nova:flavor name="m1.tiny">
Jul 29 14:45:32 user nova-compute[70924]:         <nova:memory>512</nova:memory>
Jul 29 14:45:32 user nova-compute[70924]:         <nova:disk>1</nova:disk>
Jul 29 14:45:32 user nova-compute[70924]:         <nova:swap>0</nova:swap>
Jul 29 14:45:32 user nova-compute[70924]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 14:45:32 user nova-compute[70924]:         <nova:vcpus>1</nova:vcpus>
Jul 29 14:45:32 user nova-compute[70924]:       </nova:flavor>
Jul 29 14:45:32 user nova-compute[70924]:       <nova:owner>
Jul 29 14:45:32 user nova-compute[70924]:         <nova:user uuid="0b744bbecccf48d1833ea4810b2af2d0">tempest-ServerActionsV293TestJSON-1372699391-project-member</nova:user>
Jul 29 14:45:32 user nova-compute[70924]:         <nova:project uuid="fc2394c924af4a9aaa925d116b2117ae">tempest-ServerActionsV293TestJSON-1372699391</nova:project>
Jul 29 14:45:32 user nova-compute[70924]:       </nova:owner>
Jul 29 14:45:32 user nova-compute[70924]:       <nova:ports>
Jul 29 14:45:32 user nova-compute[70924]:         <nova:port uuid="325110be-cad2-4b73-9044-3028f80f3d37">
Jul 29 14:45:32 user nova-compute[70924]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 29 14:45:32 user nova-compute[70924]:         </nova:port>
Jul 29 14:45:32 user nova-compute[70924]:       </nova:ports>
Jul 29 14:45:32 user nova-compute[70924]:     </nova:instance>
Jul 29 14:45:32 user nova-compute[70924]:   </metadata>
Jul 29 14:45:32 user nova-compute[70924]:   <sysinfo type="smbios">
Jul 29 14:45:32 user nova-compute[70924]:     <system>
Jul 29 14:45:32 user nova-compute[70924]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 14:45:32 user nova-compute[70924]:       <entry name="product">OpenStack Nova</entry>
Jul 29 14:45:32 user nova-compute[70924]:       <entry name="version">0.0.0</entry>
Jul 29 14:45:32 user nova-compute[70924]:       <entry name="serial">9b4c76df-f74f-43b4-968f-b730cc5b0ec6</entry>
Jul 29 14:45:32 user nova-compute[70924]:       <entry name="uuid">9b4c76df-f74f-43b4-968f-b730cc5b0ec6</entry>
Jul 29 14:45:32 user nova-compute[70924]:       <entry name="family">Virtual Machine</entry>
Jul 29 14:45:32 user nova-compute[70924]:     </system>
Jul 29 14:45:32 user nova-compute[70924]:   </sysinfo>
Jul 29 14:45:32 user nova-compute[70924]:   <os>
Jul 29 14:45:32 user nova-compute[70924]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 14:45:32 user nova-compute[70924]:     <boot dev="hd"/>
Jul 29 14:45:32 user nova-compute[70924]:     <smbios mode="sysinfo"/>
Jul 29 14:45:32 user nova-compute[70924]:   </os>
Jul 29 14:45:32 user nova-compute[70924]:   <features>
Jul 29 14:45:32 user nova-compute[70924]:     <acpi/>
Jul 29 14:45:32 user nova-compute[70924]:     <apic/>
Jul 29 14:45:32 user nova-compute[70924]:     <vmcoreinfo/>
Jul 29 14:45:32 user nova-compute[70924]:   </features>
Jul 29 14:45:32 user nova-compute[70924]:   <clock offset="utc">
Jul 29 14:45:32 user nova-compute[70924]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 14:45:32 user nova-compute[70924]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 14:45:32 user nova-compute[70924]:     <timer name="hpet" present="no"/>
Jul 29 14:45:32 user nova-compute[70924]:   </clock>
Jul 29 14:45:32 user nova-compute[70924]:   <cpu mode="custom" match="exact">
Jul 29 14:45:32 user nova-compute[70924]:     <model>Nehalem</model>
Jul 29 14:45:32 user nova-compute[70924]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 14:45:32 user nova-compute[70924]:   </cpu>
Jul 29 14:45:32 user nova-compute[70924]:   <devices>
Jul 29 14:45:32 user nova-compute[70924]:     <disk type="block" device="disk">
Jul 29 14:45:32 user nova-compute[70924]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:45:32 user nova-compute[70924]:       <source dev="/dev/sdh"/>
Jul 29 14:45:32 user nova-compute[70924]:       <target dev="vda" bus="virtio"/>
Jul 29 14:45:32 user nova-compute[70924]:       <serial>45a218df-4554-4d68-ba78-d0232ff799b7</serial>
Jul 29 14:45:32 user nova-compute[70924]:     </disk>
Jul 29 14:45:32 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 14:45:32 user nova-compute[70924]:       <mac address="fa:16:3e:68:19:c4"/>
Jul 29 14:45:32 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:45:32 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 14:45:32 user nova-compute[70924]:       <target dev="tap325110be-ca"/>
Jul 29 14:45:32 user nova-compute[70924]:     </interface>
Jul 29 14:45:32 user nova-compute[70924]:     <serial type="pty">
Jul 29 14:45:32 user nova-compute[70924]:       <log file="/opt/stack/data/nova/instances/9b4c76df-f74f-43b4-968f-b730cc5b0ec6/console.log" append="off"/>
Jul 29 14:45:32 user nova-compute[70924]:     </serial>
Jul 29 14:45:32 user nova-compute[70924]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 14:45:32 user nova-compute[70924]:     <video>
Jul 29 14:45:32 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:45:32 user nova-compute[70924]:     </video>
Jul 29 14:45:32 user nova-compute[70924]:     <rng model="virtio">
Jul 29 14:45:32 user nova-compute[70924]:       <backend model="random">/dev/urandom</backend>
Jul 29 14:45:32 user nova-compute[70924]:     </rng>
Jul 29 14:45:32 user nova-compute[70924]:     <controller type="usb" index="0" model="none"/>
Jul 29 14:45:32 user nova-compute[70924]:     <memballoon model="virtio">
Jul 29 14:45:32 user nova-compute[70924]:       <stats period="10"/>
Jul 29 14:45:32 user nova-compute[70924]:     </memballoon>
Jul 29 14:45:32 user nova-compute[70924]:   </devices>
Jul 29 14:45:32 user nova-compute[70924]: </domain>
Jul 29 14:45:32 user nova-compute[70924]:  {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 14:45:33 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-29T14:43:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-548861444',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-557172459',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIRtdSU+MVFf8qwfTK/HOmWFsyOji10ll1mwxkAqJoexyhER2LF96x27gUwwiTyRjXgCHH8B6MegN4zey5bLI+qd4irGAGZrC8bAT7qofxp4xjUAZePgyakCsMZxbHsjfw==',key_name='tempest-keypair-1008786546',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:43:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fc2394c924af4a9aaa925d116b2117ae',ramdisk_id='',reservation_id='r-8ju02t52',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1372699391',owner_user_name='tempest-ServerActionsV293TestJSON-1372699391-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:45:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b744bbecccf48d1833ea4810b2af2d0',uuid=9b4c76df-f74f-43b4-968f-b730cc5b0ec6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "325110be-cad2-4b73-9044-3028f80f3d37", "address": "fa:16:3e:68:19:c4", "network": {"id": "b6631336-b322-45e0-99b7-5e95539aa674", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2109271400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc2394c924af4a9aaa925d116b2117ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap325110be-ca", "ovs_interfaceid": "325110be-cad2-4b73-9044-3028f80f3d37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 14:45:33 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Converting VIF {"id": "325110be-cad2-4b73-9044-3028f80f3d37", "address": "fa:16:3e:68:19:c4", "network": {"id": "b6631336-b322-45e0-99b7-5e95539aa674", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2109271400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc2394c924af4a9aaa925d116b2117ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap325110be-ca", "ovs_interfaceid": "325110be-cad2-4b73-9044-3028f80f3d37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:45:33 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:19:c4,bridge_name='br-int',has_traffic_filtering=True,id=325110be-cad2-4b73-9044-3028f80f3d37,network=Network(b6631336-b322-45e0-99b7-5e95539aa674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap325110be-ca') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:45:33 user nova-compute[70924]: DEBUG os_vif [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:19:c4,bridge_name='br-int',has_traffic_filtering=True,id=325110be-cad2-4b73-9044-3028f80f3d37,network=Network(b6631336-b322-45e0-99b7-5e95539aa674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap325110be-ca') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 14:45:33 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:33 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:45:33 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 14:45:33 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:33 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap325110be-ca, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:45:33 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap325110be-ca, col_values=(('external_ids', {'iface-id': '325110be-cad2-4b73-9044-3028f80f3d37', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:19:c4', 'vm-uuid': '9b4c76df-f74f-43b4-968f-b730cc5b0ec6'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:45:33 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:33 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:45:33 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:33 user nova-compute[70924]: INFO os_vif [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:19:c4,bridge_name='br-int',has_traffic_filtering=True,id=325110be-cad2-4b73-9044-3028f80f3d37,network=Network(b6631336-b322-45e0-99b7-5e95539aa674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap325110be-ca')
Jul 29 14:45:33 user nova-compute[70924]: DEBUG nova.compute.manager [req-f3b3f66b-e101-497f-bcd5-6885f4d09e18 req-ebe3afd4-5ced-46c3-8af7-c47fa8ef3336 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received event network-vif-plugged-e98a5996-f4ad-44fd-9fc9-591e411bbaa1 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:45:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-f3b3f66b-e101-497f-bcd5-6885f4d09e18 req-ebe3afd4-5ced-46c3-8af7-c47fa8ef3336 service nova] Acquiring lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:45:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-f3b3f66b-e101-497f-bcd5-6885f4d09e18 req-ebe3afd4-5ced-46c3-8af7-c47fa8ef3336 service nova] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:45:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-f3b3f66b-e101-497f-bcd5-6885f4d09e18 req-ebe3afd4-5ced-46c3-8af7-c47fa8ef3336 service nova] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:33 user nova-compute[70924]: DEBUG nova.compute.manager [req-f3b3f66b-e101-497f-bcd5-6885f4d09e18 req-ebe3afd4-5ced-46c3-8af7-c47fa8ef3336 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] No waiting events found dispatching network-vif-plugged-e98a5996-f4ad-44fd-9fc9-591e411bbaa1 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:45:33 user nova-compute[70924]: WARNING nova.compute.manager [req-f3b3f66b-e101-497f-bcd5-6885f4d09e18 req-ebe3afd4-5ced-46c3-8af7-c47fa8ef3336 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received unexpected event network-vif-plugged-e98a5996-f4ad-44fd-9fc9-591e411bbaa1 for instance with vm_state building and task_state spawning.
Jul 29 14:45:33 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:33 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:45:33 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] No VIF found with MAC fa:16:3e:68:19:c4, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:45:33 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:33 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-d2b56587-9e48-437a-a6a9-f8ebf1be16d5 tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] Acquiring lock "9ba37020-824a-4ae5-9836-462fe4de476b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:45:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-d2b56587-9e48-437a-a6a9-f8ebf1be16d5 tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] Lock "9ba37020-824a-4ae5-9836-462fe4de476b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:45:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-d2b56587-9e48-437a-a6a9-f8ebf1be16d5 tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] Acquiring lock "9ba37020-824a-4ae5-9836-462fe4de476b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:45:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-d2b56587-9e48-437a-a6a9-f8ebf1be16d5 tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] Lock "9ba37020-824a-4ae5-9836-462fe4de476b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:45:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-d2b56587-9e48-437a-a6a9-f8ebf1be16d5 tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] Lock "9ba37020-824a-4ae5-9836-462fe4de476b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:33 user nova-compute[70924]: INFO nova.compute.manager [None req-d2b56587-9e48-437a-a6a9-f8ebf1be16d5 tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] [instance: 9ba37020-824a-4ae5-9836-462fe4de476b] Terminating instance
Jul 29 14:45:33 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d2b56587-9e48-437a-a6a9-f8ebf1be16d5 tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] [instance: 9ba37020-824a-4ae5-9836-462fe4de476b] Start destroying the instance on the hypervisor. {{(pid=70924) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 14:45:33 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:33 user nova-compute[70924]: DEBUG nova.compute.manager [req-099376d8-5252-4480-bc36-1cc66b930200 req-697aa6a2-ec32-45a8-9581-8032f7b1a7df service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received event network-vif-plugged-0a5aa889-f4ad-49dd-9741-ce0d161bc25f {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:45:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-099376d8-5252-4480-bc36-1cc66b930200 req-697aa6a2-ec32-45a8-9581-8032f7b1a7df service nova] Acquiring lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:45:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-099376d8-5252-4480-bc36-1cc66b930200 req-697aa6a2-ec32-45a8-9581-8032f7b1a7df service nova] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:45:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-099376d8-5252-4480-bc36-1cc66b930200 req-697aa6a2-ec32-45a8-9581-8032f7b1a7df service nova] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:33 user nova-compute[70924]: DEBUG nova.compute.manager [req-099376d8-5252-4480-bc36-1cc66b930200 req-697aa6a2-ec32-45a8-9581-8032f7b1a7df service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] No waiting events found dispatching network-vif-plugged-0a5aa889-f4ad-49dd-9741-ce0d161bc25f {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:45:33 user nova-compute[70924]: WARNING nova.compute.manager [req-099376d8-5252-4480-bc36-1cc66b930200 req-697aa6a2-ec32-45a8-9581-8032f7b1a7df service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received unexpected event network-vif-plugged-0a5aa889-f4ad-49dd-9741-ce0d161bc25f for instance with vm_state building and task_state spawning.
Jul 29 14:45:33 user nova-compute[70924]: DEBUG nova.compute.manager [req-099376d8-5252-4480-bc36-1cc66b930200 req-697aa6a2-ec32-45a8-9581-8032f7b1a7df service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received event network-vif-plugged-2e35e8a0-e202-46d5-b854-9960de88edc2 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:45:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-099376d8-5252-4480-bc36-1cc66b930200 req-697aa6a2-ec32-45a8-9581-8032f7b1a7df service nova] Acquiring lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:45:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-099376d8-5252-4480-bc36-1cc66b930200 req-697aa6a2-ec32-45a8-9581-8032f7b1a7df service nova] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:45:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-099376d8-5252-4480-bc36-1cc66b930200 req-697aa6a2-ec32-45a8-9581-8032f7b1a7df service nova] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:33 user nova-compute[70924]: DEBUG nova.compute.manager [req-099376d8-5252-4480-bc36-1cc66b930200 req-697aa6a2-ec32-45a8-9581-8032f7b1a7df service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] No waiting events found dispatching network-vif-plugged-2e35e8a0-e202-46d5-b854-9960de88edc2 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:45:33 user nova-compute[70924]: WARNING nova.compute.manager [req-099376d8-5252-4480-bc36-1cc66b930200 req-697aa6a2-ec32-45a8-9581-8032f7b1a7df service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received unexpected event network-vif-plugged-2e35e8a0-e202-46d5-b854-9960de88edc2 for instance with vm_state building and task_state spawning.
Jul 29 14:45:33 user nova-compute[70924]: DEBUG nova.compute.manager [req-099376d8-5252-4480-bc36-1cc66b930200 req-697aa6a2-ec32-45a8-9581-8032f7b1a7df service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received event network-vif-plugged-2e35e8a0-e202-46d5-b854-9960de88edc2 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:45:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-099376d8-5252-4480-bc36-1cc66b930200 req-697aa6a2-ec32-45a8-9581-8032f7b1a7df service nova] Acquiring lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:45:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-099376d8-5252-4480-bc36-1cc66b930200 req-697aa6a2-ec32-45a8-9581-8032f7b1a7df service nova] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:45:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-099376d8-5252-4480-bc36-1cc66b930200 req-697aa6a2-ec32-45a8-9581-8032f7b1a7df service nova] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:33 user nova-compute[70924]: DEBUG nova.compute.manager [req-099376d8-5252-4480-bc36-1cc66b930200 req-697aa6a2-ec32-45a8-9581-8032f7b1a7df service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] No waiting events found dispatching network-vif-plugged-2e35e8a0-e202-46d5-b854-9960de88edc2 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:45:33 user nova-compute[70924]: WARNING nova.compute.manager [req-099376d8-5252-4480-bc36-1cc66b930200 req-697aa6a2-ec32-45a8-9581-8032f7b1a7df service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received unexpected event network-vif-plugged-2e35e8a0-e202-46d5-b854-9960de88edc2 for instance with vm_state building and task_state spawning.
Jul 29 14:45:33 user nova-compute[70924]: DEBUG nova.compute.manager [req-099376d8-5252-4480-bc36-1cc66b930200 req-697aa6a2-ec32-45a8-9581-8032f7b1a7df service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received event network-vif-plugged-c6793a3b-97da-4584-a326-f1caf598cd78 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:45:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-099376d8-5252-4480-bc36-1cc66b930200 req-697aa6a2-ec32-45a8-9581-8032f7b1a7df service nova] Acquiring lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:45:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-099376d8-5252-4480-bc36-1cc66b930200 req-697aa6a2-ec32-45a8-9581-8032f7b1a7df service nova] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:45:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-099376d8-5252-4480-bc36-1cc66b930200 req-697aa6a2-ec32-45a8-9581-8032f7b1a7df service nova] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:33 user nova-compute[70924]: DEBUG nova.compute.manager [req-099376d8-5252-4480-bc36-1cc66b930200 req-697aa6a2-ec32-45a8-9581-8032f7b1a7df service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] No waiting events found dispatching network-vif-plugged-c6793a3b-97da-4584-a326-f1caf598cd78 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:45:33 user nova-compute[70924]: WARNING nova.compute.manager [req-099376d8-5252-4480-bc36-1cc66b930200 req-697aa6a2-ec32-45a8-9581-8032f7b1a7df service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received unexpected event network-vif-plugged-c6793a3b-97da-4584-a326-f1caf598cd78 for instance with vm_state building and task_state spawning.
Jul 29 14:45:33 user nova-compute[70924]: DEBUG nova.compute.manager [req-099376d8-5252-4480-bc36-1cc66b930200 req-697aa6a2-ec32-45a8-9581-8032f7b1a7df service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received event network-vif-plugged-c6793a3b-97da-4584-a326-f1caf598cd78 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:45:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-099376d8-5252-4480-bc36-1cc66b930200 req-697aa6a2-ec32-45a8-9581-8032f7b1a7df service nova] Acquiring lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:45:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-099376d8-5252-4480-bc36-1cc66b930200 req-697aa6a2-ec32-45a8-9581-8032f7b1a7df service nova] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:45:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-099376d8-5252-4480-bc36-1cc66b930200 req-697aa6a2-ec32-45a8-9581-8032f7b1a7df service nova] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:33 user nova-compute[70924]: DEBUG nova.compute.manager [req-099376d8-5252-4480-bc36-1cc66b930200 req-697aa6a2-ec32-45a8-9581-8032f7b1a7df service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] No waiting events found dispatching network-vif-plugged-c6793a3b-97da-4584-a326-f1caf598cd78 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:45:33 user nova-compute[70924]: WARNING nova.compute.manager [req-099376d8-5252-4480-bc36-1cc66b930200 req-697aa6a2-ec32-45a8-9581-8032f7b1a7df service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received unexpected event network-vif-plugged-c6793a3b-97da-4584-a326-f1caf598cd78 for instance with vm_state building and task_state spawning.
Jul 29 14:45:33 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:34 user nova-compute[70924]: DEBUG nova.network.neutron [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] [instance: 79652140-c347-4d7b-9770-a4cc2d1a08e3] Successfully updated port: bf1e6655-6811-4a5c-ac2d-e2cd6a3b8d02 {{(pid=70924) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 14:45:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] Acquiring lock "refresh_cache-79652140-c347-4d7b-9770-a4cc2d1a08e3" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:45:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] Acquired lock "refresh_cache-79652140-c347-4d7b-9770-a4cc2d1a08e3" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:45:34 user nova-compute[70924]: DEBUG nova.network.neutron [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] [instance: 79652140-c347-4d7b-9770-a4cc2d1a08e3] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 14:45:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:34 user nova-compute[70924]: DEBUG nova.network.neutron [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] [instance: 79652140-c347-4d7b-9770-a4cc2d1a08e3] Instance cache missing network info. {{(pid=70924) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 14:45:34 user nova-compute[70924]: DEBUG nova.compute.manager [req-af309852-7943-43ca-841a-a91500fbdc3d req-d9d1b332-4f1a-481d-92f5-830214c7d6a0 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received event network-vif-plugged-f108e5c9-68f4-4444-b686-18df097fa015 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:45:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-af309852-7943-43ca-841a-a91500fbdc3d req-d9d1b332-4f1a-481d-92f5-830214c7d6a0 service nova] Acquiring lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:45:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-af309852-7943-43ca-841a-a91500fbdc3d req-d9d1b332-4f1a-481d-92f5-830214c7d6a0 service nova] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:45:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-af309852-7943-43ca-841a-a91500fbdc3d req-d9d1b332-4f1a-481d-92f5-830214c7d6a0 service nova] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:34 user nova-compute[70924]: DEBUG nova.compute.manager [req-af309852-7943-43ca-841a-a91500fbdc3d req-d9d1b332-4f1a-481d-92f5-830214c7d6a0 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] No waiting events found dispatching network-vif-plugged-f108e5c9-68f4-4444-b686-18df097fa015 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:45:34 user nova-compute[70924]: WARNING nova.compute.manager [req-af309852-7943-43ca-841a-a91500fbdc3d req-d9d1b332-4f1a-481d-92f5-830214c7d6a0 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received unexpected event network-vif-plugged-f108e5c9-68f4-4444-b686-18df097fa015 for instance with vm_state building and task_state spawning.
Jul 29 14:45:34 user nova-compute[70924]: DEBUG nova.compute.manager [req-af309852-7943-43ca-841a-a91500fbdc3d req-d9d1b332-4f1a-481d-92f5-830214c7d6a0 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received event network-vif-plugged-7334899f-e7c7-48d8-8c14-4fda63fea3b5 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:45:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-af309852-7943-43ca-841a-a91500fbdc3d req-d9d1b332-4f1a-481d-92f5-830214c7d6a0 service nova] Acquiring lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:45:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-af309852-7943-43ca-841a-a91500fbdc3d req-d9d1b332-4f1a-481d-92f5-830214c7d6a0 service nova] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:45:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-af309852-7943-43ca-841a-a91500fbdc3d req-d9d1b332-4f1a-481d-92f5-830214c7d6a0 service nova] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:34 user nova-compute[70924]: DEBUG nova.compute.manager [req-af309852-7943-43ca-841a-a91500fbdc3d req-d9d1b332-4f1a-481d-92f5-830214c7d6a0 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] No waiting events found dispatching network-vif-plugged-7334899f-e7c7-48d8-8c14-4fda63fea3b5 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:45:34 user nova-compute[70924]: WARNING nova.compute.manager [req-af309852-7943-43ca-841a-a91500fbdc3d req-d9d1b332-4f1a-481d-92f5-830214c7d6a0 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received unexpected event network-vif-plugged-7334899f-e7c7-48d8-8c14-4fda63fea3b5 for instance with vm_state building and task_state spawning.
Jul 29 14:45:34 user nova-compute[70924]: DEBUG nova.compute.manager [req-af309852-7943-43ca-841a-a91500fbdc3d req-d9d1b332-4f1a-481d-92f5-830214c7d6a0 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received event network-vif-plugged-7334899f-e7c7-48d8-8c14-4fda63fea3b5 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:45:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-af309852-7943-43ca-841a-a91500fbdc3d req-d9d1b332-4f1a-481d-92f5-830214c7d6a0 service nova] Acquiring lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:45:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-af309852-7943-43ca-841a-a91500fbdc3d req-d9d1b332-4f1a-481d-92f5-830214c7d6a0 service nova] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:45:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-af309852-7943-43ca-841a-a91500fbdc3d req-d9d1b332-4f1a-481d-92f5-830214c7d6a0 service nova] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:34 user nova-compute[70924]: DEBUG nova.compute.manager [req-af309852-7943-43ca-841a-a91500fbdc3d req-d9d1b332-4f1a-481d-92f5-830214c7d6a0 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] No waiting events found dispatching network-vif-plugged-7334899f-e7c7-48d8-8c14-4fda63fea3b5 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:45:34 user nova-compute[70924]: WARNING nova.compute.manager [req-af309852-7943-43ca-841a-a91500fbdc3d req-d9d1b332-4f1a-481d-92f5-830214c7d6a0 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received unexpected event network-vif-plugged-7334899f-e7c7-48d8-8c14-4fda63fea3b5 for instance with vm_state building and task_state spawning.
Jul 29 14:45:34 user nova-compute[70924]: DEBUG nova.compute.manager [req-af309852-7943-43ca-841a-a91500fbdc3d req-d9d1b332-4f1a-481d-92f5-830214c7d6a0 service nova] [instance: 79652140-c347-4d7b-9770-a4cc2d1a08e3] Received event network-changed-bf1e6655-6811-4a5c-ac2d-e2cd6a3b8d02 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:45:34 user nova-compute[70924]: DEBUG nova.compute.manager [req-af309852-7943-43ca-841a-a91500fbdc3d req-d9d1b332-4f1a-481d-92f5-830214c7d6a0 service nova] [instance: 79652140-c347-4d7b-9770-a4cc2d1a08e3] Refreshing instance network info cache due to event network-changed-bf1e6655-6811-4a5c-ac2d-e2cd6a3b8d02. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:45:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-af309852-7943-43ca-841a-a91500fbdc3d req-d9d1b332-4f1a-481d-92f5-830214c7d6a0 service nova] Acquiring lock "refresh_cache-79652140-c347-4d7b-9770-a4cc2d1a08e3" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:45:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:34 user nova-compute[70924]: DEBUG nova.network.neutron [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] [instance: 79652140-c347-4d7b-9770-a4cc2d1a08e3] Updating instance_info_cache with network_info: [{"id": "bf1e6655-6811-4a5c-ac2d-e2cd6a3b8d02", "address": "fa:16:3e:45:10:2d", "network": {"id": "06747bb8-313c-4753-9bb6-c000da447639", "bridge": "br-int", "label": "tempest-VolumesActionsTest-167909986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cad49619f9f14c87a32ebb20a2df5800", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf1e6655-68", "ovs_interfaceid": "bf1e6655-6811-4a5c-ac2d-e2cd6a3b8d02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:45:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] Releasing lock "refresh_cache-79652140-c347-4d7b-9770-a4cc2d1a08e3" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:45:34 user nova-compute[70924]: DEBUG nova.compute.manager [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] [instance: 79652140-c347-4d7b-9770-a4cc2d1a08e3] Instance network_info: |[{"id": "bf1e6655-6811-4a5c-ac2d-e2cd6a3b8d02", "address": "fa:16:3e:45:10:2d", "network": {"id": "06747bb8-313c-4753-9bb6-c000da447639", "bridge": "br-int", "label": "tempest-VolumesActionsTest-167909986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cad49619f9f14c87a32ebb20a2df5800", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf1e6655-68", "ovs_interfaceid": "bf1e6655-6811-4a5c-ac2d-e2cd6a3b8d02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 14:45:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-af309852-7943-43ca-841a-a91500fbdc3d req-d9d1b332-4f1a-481d-92f5-830214c7d6a0 service nova] Acquired lock "refresh_cache-79652140-c347-4d7b-9770-a4cc2d1a08e3" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:45:34 user nova-compute[70924]: DEBUG nova.network.neutron [req-af309852-7943-43ca-841a-a91500fbdc3d req-d9d1b332-4f1a-481d-92f5-830214c7d6a0 service nova] [instance: 79652140-c347-4d7b-9770-a4cc2d1a08e3] Refreshing network info cache for port bf1e6655-6811-4a5c-ac2d-e2cd6a3b8d02 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:45:34 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] [instance: 79652140-c347-4d7b-9770-a4cc2d1a08e3] Start _get_guest_xml network_info=[{"id": "bf1e6655-6811-4a5c-ac2d-e2cd6a3b8d02", "address": "fa:16:3e:45:10:2d", "network": {"id": "06747bb8-313c-4753-9bb6-c000da447639", "bridge": "br-int", "label": "tempest-VolumesActionsTest-167909986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cad49619f9f14c87a32ebb20a2df5800", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf1e6655-68", "ovs_interfaceid": "bf1e6655-6811-4a5c-ac2d-e2cd6a3b8d02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '3aba2e73-6832-404b-8bd0-d0503ce82b8c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 14:45:34 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:45:34 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:45:34 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 14:45:34 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] CPU controller missing on host. {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 14:45:34 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 14:45:34 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] CPU controller found on host. {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 14:45:34 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70924) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 14:45:34 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T14:36:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 14:45:34 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] Flavor limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 14:45:34 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] Image limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 14:45:34 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] Flavor pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 14:45:34 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] Image pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 14:45:34 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 14:45:34 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 14:45:34 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 14:45:34 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] Got 1 possible topologies {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 14:45:34 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 14:45:34 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 14:45:34 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:45:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1818145690',display_name='tempest-VolumesActionsTest-instance-1818145690',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1818145690',id=16,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cad49619f9f14c87a32ebb20a2df5800',ramdisk_id='',reservation_id='r-3ncg384p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-981105107',owner_user_name='tempest-VolumesActionsTest-981105107-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:45:31Z,user_data=None,user_id='b32250a289d044bb9cd8971cf81e59df',uuid=79652140-c347-4d7b-9770-a4cc2d1a08e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf1e6655-6811-4a5c-ac2d-e2cd6a3b8d02", "address": "fa:16:3e:45:10:2d", "network": {"id": "06747bb8-313c-4753-9bb6-c000da447639", "bridge": "br-int", "label": "tempest-VolumesActionsTest-167909986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cad49619f9f14c87a32ebb20a2df5800", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf1e6655-68", "ovs_interfaceid": "bf1e6655-6811-4a5c-ac2d-e2cd6a3b8d02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:45:34 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] Converting VIF {"id": "bf1e6655-6811-4a5c-ac2d-e2cd6a3b8d02", "address": "fa:16:3e:45:10:2d", "network": {"id": "06747bb8-313c-4753-9bb6-c000da447639", "bridge": "br-int", "label": "tempest-VolumesActionsTest-167909986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cad49619f9f14c87a32ebb20a2df5800", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf1e6655-68", "ovs_interfaceid": "bf1e6655-6811-4a5c-ac2d-e2cd6a3b8d02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:45:34 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:10:2d,bridge_name='br-int',has_traffic_filtering=True,id=bf1e6655-6811-4a5c-ac2d-e2cd6a3b8d02,network=Network(06747bb8-313c-4753-9bb6-c000da447639),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf1e6655-68') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:45:34 user nova-compute[70924]: DEBUG nova.objects.instance [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] Lazy-loading 'pci_devices' on Instance uuid 79652140-c347-4d7b-9770-a4cc2d1a08e3 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:45:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:34 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] [instance: 79652140-c347-4d7b-9770-a4cc2d1a08e3] End _get_guest_xml xml=<domain type="kvm">
Jul 29 14:45:34 user nova-compute[70924]:   <uuid>79652140-c347-4d7b-9770-a4cc2d1a08e3</uuid>
Jul 29 14:45:34 user nova-compute[70924]:   <name>instance-00000010</name>
Jul 29 14:45:34 user nova-compute[70924]:   <memory>524288</memory>
Jul 29 14:45:34 user nova-compute[70924]:   <vcpu>1</vcpu>
Jul 29 14:45:34 user nova-compute[70924]:   <metadata>
Jul 29 14:45:34 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 14:45:34 user nova-compute[70924]:       <nova:package version="0.0.0"/>
Jul 29 14:45:34 user nova-compute[70924]:       <nova:name>tempest-VolumesActionsTest-instance-1818145690</nova:name>
Jul 29 14:45:34 user nova-compute[70924]:       <nova:creationTime>2023-07-29 14:45:34</nova:creationTime>
Jul 29 14:45:34 user nova-compute[70924]:       <nova:flavor name="m1.tiny">
Jul 29 14:45:34 user nova-compute[70924]:         <nova:memory>512</nova:memory>
Jul 29 14:45:34 user nova-compute[70924]:         <nova:disk>1</nova:disk>
Jul 29 14:45:34 user nova-compute[70924]:         <nova:swap>0</nova:swap>
Jul 29 14:45:34 user nova-compute[70924]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 14:45:34 user nova-compute[70924]:         <nova:vcpus>1</nova:vcpus>
Jul 29 14:45:34 user nova-compute[70924]:       </nova:flavor>
Jul 29 14:45:34 user nova-compute[70924]:       <nova:owner>
Jul 29 14:45:34 user nova-compute[70924]:         <nova:user uuid="b32250a289d044bb9cd8971cf81e59df">tempest-VolumesActionsTest-981105107-project-member</nova:user>
Jul 29 14:45:34 user nova-compute[70924]:         <nova:project uuid="cad49619f9f14c87a32ebb20a2df5800">tempest-VolumesActionsTest-981105107</nova:project>
Jul 29 14:45:34 user nova-compute[70924]:       </nova:owner>
Jul 29 14:45:34 user nova-compute[70924]:       <nova:root type="image" uuid="3aba2e73-6832-404b-8bd0-d0503ce82b8c"/>
Jul 29 14:45:34 user nova-compute[70924]:       <nova:ports>
Jul 29 14:45:34 user nova-compute[70924]:         <nova:port uuid="bf1e6655-6811-4a5c-ac2d-e2cd6a3b8d02">
Jul 29 14:45:34 user nova-compute[70924]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 29 14:45:34 user nova-compute[70924]:         </nova:port>
Jul 29 14:45:34 user nova-compute[70924]:       </nova:ports>
Jul 29 14:45:34 user nova-compute[70924]:     </nova:instance>
Jul 29 14:45:34 user nova-compute[70924]:   </metadata>
Jul 29 14:45:34 user nova-compute[70924]:   <sysinfo type="smbios">
Jul 29 14:45:34 user nova-compute[70924]:     <system>
Jul 29 14:45:34 user nova-compute[70924]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 14:45:34 user nova-compute[70924]:       <entry name="product">OpenStack Nova</entry>
Jul 29 14:45:34 user nova-compute[70924]:       <entry name="version">0.0.0</entry>
Jul 29 14:45:34 user nova-compute[70924]:       <entry name="serial">79652140-c347-4d7b-9770-a4cc2d1a08e3</entry>
Jul 29 14:45:34 user nova-compute[70924]:       <entry name="uuid">79652140-c347-4d7b-9770-a4cc2d1a08e3</entry>
Jul 29 14:45:34 user nova-compute[70924]:       <entry name="family">Virtual Machine</entry>
Jul 29 14:45:34 user nova-compute[70924]:     </system>
Jul 29 14:45:34 user nova-compute[70924]:   </sysinfo>
Jul 29 14:45:34 user nova-compute[70924]:   <os>
Jul 29 14:45:34 user nova-compute[70924]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 14:45:34 user nova-compute[70924]:     <boot dev="hd"/>
Jul 29 14:45:34 user nova-compute[70924]:     <smbios mode="sysinfo"/>
Jul 29 14:45:34 user nova-compute[70924]:   </os>
Jul 29 14:45:34 user nova-compute[70924]:   <features>
Jul 29 14:45:34 user nova-compute[70924]:     <acpi/>
Jul 29 14:45:34 user nova-compute[70924]:     <apic/>
Jul 29 14:45:34 user nova-compute[70924]:     <vmcoreinfo/>
Jul 29 14:45:34 user nova-compute[70924]:   </features>
Jul 29 14:45:34 user nova-compute[70924]:   <clock offset="utc">
Jul 29 14:45:34 user nova-compute[70924]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 14:45:34 user nova-compute[70924]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 14:45:34 user nova-compute[70924]:     <timer name="hpet" present="no"/>
Jul 29 14:45:34 user nova-compute[70924]:   </clock>
Jul 29 14:45:34 user nova-compute[70924]:   <cpu mode="custom" match="exact">
Jul 29 14:45:34 user nova-compute[70924]:     <model>Nehalem</model>
Jul 29 14:45:34 user nova-compute[70924]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 14:45:34 user nova-compute[70924]:   </cpu>
Jul 29 14:45:34 user nova-compute[70924]:   <devices>
Jul 29 14:45:34 user nova-compute[70924]:     <disk type="file" device="disk">
Jul 29 14:45:34 user nova-compute[70924]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 14:45:34 user nova-compute[70924]:       <source file="/opt/stack/data/nova/instances/79652140-c347-4d7b-9770-a4cc2d1a08e3/disk"/>
Jul 29 14:45:34 user nova-compute[70924]:       <target dev="vda" bus="virtio"/>
Jul 29 14:45:34 user nova-compute[70924]:     </disk>
Jul 29 14:45:34 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 14:45:34 user nova-compute[70924]:       <mac address="fa:16:3e:45:10:2d"/>
Jul 29 14:45:34 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:45:34 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 14:45:34 user nova-compute[70924]:       <target dev="tapbf1e6655-68"/>
Jul 29 14:45:34 user nova-compute[70924]:     </interface>
Jul 29 14:45:34 user nova-compute[70924]:     <serial type="pty">
Jul 29 14:45:34 user nova-compute[70924]:       <log file="/opt/stack/data/nova/instances/79652140-c347-4d7b-9770-a4cc2d1a08e3/console.log" append="off"/>
Jul 29 14:45:34 user nova-compute[70924]:     </serial>
Jul 29 14:45:34 user nova-compute[70924]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 14:45:34 user nova-compute[70924]:     <video>
Jul 29 14:45:34 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:45:34 user nova-compute[70924]:     </video>
Jul 29 14:45:34 user nova-compute[70924]:     <rng model="virtio">
Jul 29 14:45:34 user nova-compute[70924]:       <backend model="random">/dev/urandom</backend>
Jul 29 14:45:34 user nova-compute[70924]:     </rng>
Jul 29 14:45:34 user nova-compute[70924]:     <controller type="usb" index="0" model="none"/>
Jul 29 14:45:34 user nova-compute[70924]:     <memballoon model="virtio">
Jul 29 14:45:34 user nova-compute[70924]:       <stats period="10"/>
Jul 29 14:45:34 user nova-compute[70924]:     </memballoon>
Jul 29 14:45:34 user nova-compute[70924]:   </devices>
Jul 29 14:45:34 user nova-compute[70924]: </domain>
Jul 29 14:45:34 user nova-compute[70924]:  {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 14:45:34 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:45:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1818145690',display_name='tempest-VolumesActionsTest-instance-1818145690',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1818145690',id=16,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cad49619f9f14c87a32ebb20a2df5800',ramdisk_id='',reservation_id='r-3ncg384p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-981105107',owner_user_name='tempest-VolumesActionsTest-981105107-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:45:31Z,user_data=None,user_id='b32250a289d044bb9cd8971cf81e59df',uuid=79652140-c347-4d7b-9770-a4cc2d1a08e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf1e6655-6811-4a5c-ac2d-e2cd6a3b8d02", "address": "fa:16:3e:45:10:2d", "network": {"id": "06747bb8-313c-4753-9bb6-c000da447639", "bridge": "br-int", "label": "tempest-VolumesActionsTest-167909986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cad49619f9f14c87a32ebb20a2df5800", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf1e6655-68", "ovs_interfaceid": "bf1e6655-6811-4a5c-ac2d-e2cd6a3b8d02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 14:45:34 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] Converting VIF {"id": "bf1e6655-6811-4a5c-ac2d-e2cd6a3b8d02", "address": "fa:16:3e:45:10:2d", "network": {"id": "06747bb8-313c-4753-9bb6-c000da447639", "bridge": "br-int", "label": "tempest-VolumesActionsTest-167909986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cad49619f9f14c87a32ebb20a2df5800", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf1e6655-68", "ovs_interfaceid": "bf1e6655-6811-4a5c-ac2d-e2cd6a3b8d02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:45:34 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:10:2d,bridge_name='br-int',has_traffic_filtering=True,id=bf1e6655-6811-4a5c-ac2d-e2cd6a3b8d02,network=Network(06747bb8-313c-4753-9bb6-c000da447639),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf1e6655-68') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:45:34 user nova-compute[70924]: DEBUG os_vif [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:10:2d,bridge_name='br-int',has_traffic_filtering=True,id=bf1e6655-6811-4a5c-ac2d-e2cd6a3b8d02,network=Network(06747bb8-313c-4753-9bb6-c000da447639),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf1e6655-68') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 14:45:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:45:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 14:45:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbf1e6655-68, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:45:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbf1e6655-68, col_values=(('external_ids', {'iface-id': 'bf1e6655-6811-4a5c-ac2d-e2cd6a3b8d02', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:10:2d', 'vm-uuid': '79652140-c347-4d7b-9770-a4cc2d1a08e3'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:45:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:45:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:34 user nova-compute[70924]: INFO os_vif [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:10:2d,bridge_name='br-int',has_traffic_filtering=True,id=bf1e6655-6811-4a5c-ac2d-e2cd6a3b8d02,network=Network(06747bb8-313c-4753-9bb6-c000da447639),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf1e6655-68')
Jul 29 14:45:35 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:35 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 9ba37020-824a-4ae5-9836-462fe4de476b] Instance destroyed successfully.
Jul 29 14:45:35 user nova-compute[70924]: DEBUG nova.objects.instance [None req-d2b56587-9e48-437a-a6a9-f8ebf1be16d5 tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] Lazy-loading 'resources' on Instance uuid 9ba37020-824a-4ae5-9836-462fe4de476b {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:45:35 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:45:35 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] No VIF found with MAC fa:16:3e:45:10:2d, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:45:35 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-d2b56587-9e48-437a-a6a9-f8ebf1be16d5 tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:43:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-747691720',display_name='tempest-VolumesNegativeTest-instance-747691720',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-747691720',id=12,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:43:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0f1b30b901be4e57b34c74a8bbb2519b',ramdisk_id='',reservation_id='r-th159ex1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1472430635',owner_user_name='tempest-VolumesNegativeTest-1472430635-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:43:51Z,user_data=None,user_id='c04095cb42ad4a659cda5d22878b4445',uuid=9ba37020-824a-4ae5-9836-462fe4de476b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6a96191e-52fa-4efd-9c32-c5dec84b69ec", "address": "fa:16:3e:62:66:2f", "network": {"id": "7dca7036-5f4e-4888-becf-ffc2735302ed", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2256057123ba4f7181829a5b453f36be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a96191e-52", "ovs_interfaceid": "6a96191e-52fa-4efd-9c32-c5dec84b69ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 14:45:35 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-d2b56587-9e48-437a-a6a9-f8ebf1be16d5 tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] Converting VIF {"id": "6a96191e-52fa-4efd-9c32-c5dec84b69ec", "address": "fa:16:3e:62:66:2f", "network": {"id": "7dca7036-5f4e-4888-becf-ffc2735302ed", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2256057123ba4f7181829a5b453f36be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a96191e-52", "ovs_interfaceid": "6a96191e-52fa-4efd-9c32-c5dec84b69ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:45:35 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-d2b56587-9e48-437a-a6a9-f8ebf1be16d5 tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:66:2f,bridge_name='br-int',has_traffic_filtering=True,id=6a96191e-52fa-4efd-9c32-c5dec84b69ec,network=Network(7dca7036-5f4e-4888-becf-ffc2735302ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a96191e-52') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:45:35 user nova-compute[70924]: DEBUG os_vif [None req-d2b56587-9e48-437a-a6a9-f8ebf1be16d5 tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:66:2f,bridge_name='br-int',has_traffic_filtering=True,id=6a96191e-52fa-4efd-9c32-c5dec84b69ec,network=Network(7dca7036-5f4e-4888-becf-ffc2735302ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a96191e-52') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 14:45:35 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:35 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:35 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6a96191e-52, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:45:35 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:35 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:45:35 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:35 user nova-compute[70924]: INFO os_vif [None req-d2b56587-9e48-437a-a6a9-f8ebf1be16d5 tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:66:2f,bridge_name='br-int',has_traffic_filtering=True,id=6a96191e-52fa-4efd-9c32-c5dec84b69ec,network=Network(7dca7036-5f4e-4888-becf-ffc2735302ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a96191e-52')
Jul 29 14:45:35 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-d2b56587-9e48-437a-a6a9-f8ebf1be16d5 tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] [instance: 9ba37020-824a-4ae5-9836-462fe4de476b] Deleting instance files /opt/stack/data/nova/instances/9ba37020-824a-4ae5-9836-462fe4de476b_del
Jul 29 14:45:35 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-d2b56587-9e48-437a-a6a9-f8ebf1be16d5 tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] [instance: 9ba37020-824a-4ae5-9836-462fe4de476b] Deletion of /opt/stack/data/nova/instances/9ba37020-824a-4ae5-9836-462fe4de476b_del complete
Jul 29 14:45:35 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690641935.1651032, 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3 => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:45:35 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] VM Resumed (Lifecycle Event)
Jul 29 14:45:35 user nova-compute[70924]: DEBUG nova.compute.manager [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Instance event wait completed in 0 seconds for  {{(pid=70924) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 14:45:35 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Guest created on hypervisor {{(pid=70924) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 14:45:35 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Instance spawned successfully.
Jul 29 14:45:35 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 14:45:35 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:45:35 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:45:35 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Found default for hw_cdrom_bus of ide {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:45:35 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Found default for hw_disk_bus of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:45:35 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Found default for hw_input_bus of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:45:35 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Found default for hw_pointer_model of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:45:35 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Found default for hw_video_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:45:35 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Found default for hw_vif_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:45:35 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:45:35 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690641935.17021, 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3 => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:45:35 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] VM Started (Lifecycle Event)
Jul 29 14:45:35 user nova-compute[70924]: INFO nova.compute.manager [None req-d2b56587-9e48-437a-a6a9-f8ebf1be16d5 tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] [instance: 9ba37020-824a-4ae5-9836-462fe4de476b] Took 1.81 seconds to destroy the instance on the hypervisor.
Jul 29 14:45:35 user nova-compute[70924]: DEBUG oslo.service.loopingcall [None req-d2b56587-9e48-437a-a6a9-f8ebf1be16d5 tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70924) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 14:45:35 user nova-compute[70924]: DEBUG nova.compute.manager [-] [instance: 9ba37020-824a-4ae5-9836-462fe4de476b] Deallocating network for instance {{(pid=70924) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 14:45:35 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: 9ba37020-824a-4ae5-9836-462fe4de476b] deallocate_for_instance() {{(pid=70924) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 14:45:35 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:45:35 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:45:35 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:45:35 user nova-compute[70924]: INFO nova.compute.manager [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Took 12.33 seconds to spawn the instance on the hypervisor.
Jul 29 14:45:35 user nova-compute[70924]: DEBUG nova.compute.manager [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:45:35 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:35 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:35 user nova-compute[70924]: DEBUG nova.network.neutron [req-af309852-7943-43ca-841a-a91500fbdc3d req-d9d1b332-4f1a-481d-92f5-830214c7d6a0 service nova] [instance: 79652140-c347-4d7b-9770-a4cc2d1a08e3] Updated VIF entry in instance network info cache for port bf1e6655-6811-4a5c-ac2d-e2cd6a3b8d02. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:45:35 user nova-compute[70924]: DEBUG nova.network.neutron [req-af309852-7943-43ca-841a-a91500fbdc3d req-d9d1b332-4f1a-481d-92f5-830214c7d6a0 service nova] [instance: 79652140-c347-4d7b-9770-a4cc2d1a08e3] Updating instance_info_cache with network_info: [{"id": "bf1e6655-6811-4a5c-ac2d-e2cd6a3b8d02", "address": "fa:16:3e:45:10:2d", "network": {"id": "06747bb8-313c-4753-9bb6-c000da447639", "bridge": "br-int", "label": "tempest-VolumesActionsTest-167909986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cad49619f9f14c87a32ebb20a2df5800", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf1e6655-68", "ovs_interfaceid": "bf1e6655-6811-4a5c-ac2d-e2cd6a3b8d02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:45:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-af309852-7943-43ca-841a-a91500fbdc3d req-d9d1b332-4f1a-481d-92f5-830214c7d6a0 service nova] Releasing lock "refresh_cache-79652140-c347-4d7b-9770-a4cc2d1a08e3" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:45:35 user nova-compute[70924]: INFO nova.compute.manager [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Took 47.35 seconds to build instance.
Jul 29 14:45:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-b0bb8552-0a8a-4ea3-bd65-24c328b3c6ec tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 47.455s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:35 user nova-compute[70924]: DEBUG nova.compute.manager [req-8b29b13a-dc83-46fd-8109-42d4827600ff req-7cd65778-9d48-45c4-bac6-9784f38cc316 service nova] [instance: 9ba37020-824a-4ae5-9836-462fe4de476b] Received event network-vif-unplugged-6a96191e-52fa-4efd-9c32-c5dec84b69ec {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:45:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-8b29b13a-dc83-46fd-8109-42d4827600ff req-7cd65778-9d48-45c4-bac6-9784f38cc316 service nova] Acquiring lock "9ba37020-824a-4ae5-9836-462fe4de476b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:45:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-8b29b13a-dc83-46fd-8109-42d4827600ff req-7cd65778-9d48-45c4-bac6-9784f38cc316 service nova] Lock "9ba37020-824a-4ae5-9836-462fe4de476b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:45:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-8b29b13a-dc83-46fd-8109-42d4827600ff req-7cd65778-9d48-45c4-bac6-9784f38cc316 service nova] Lock "9ba37020-824a-4ae5-9836-462fe4de476b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:35 user nova-compute[70924]: DEBUG nova.compute.manager [req-8b29b13a-dc83-46fd-8109-42d4827600ff req-7cd65778-9d48-45c4-bac6-9784f38cc316 service nova] [instance: 9ba37020-824a-4ae5-9836-462fe4de476b] No waiting events found dispatching network-vif-unplugged-6a96191e-52fa-4efd-9c32-c5dec84b69ec {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:45:35 user nova-compute[70924]: DEBUG nova.compute.manager [req-8b29b13a-dc83-46fd-8109-42d4827600ff req-7cd65778-9d48-45c4-bac6-9784f38cc316 service nova] [instance: 9ba37020-824a-4ae5-9836-462fe4de476b] Received event network-vif-unplugged-6a96191e-52fa-4efd-9c32-c5dec84b69ec for instance with task_state deleting. {{(pid=70924) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 14:45:35 user nova-compute[70924]: DEBUG nova.compute.manager [req-8b29b13a-dc83-46fd-8109-42d4827600ff req-7cd65778-9d48-45c4-bac6-9784f38cc316 service nova] [instance: 9ba37020-824a-4ae5-9836-462fe4de476b] Received event network-vif-plugged-6a96191e-52fa-4efd-9c32-c5dec84b69ec {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:45:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-8b29b13a-dc83-46fd-8109-42d4827600ff req-7cd65778-9d48-45c4-bac6-9784f38cc316 service nova] Acquiring lock "9ba37020-824a-4ae5-9836-462fe4de476b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:45:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-8b29b13a-dc83-46fd-8109-42d4827600ff req-7cd65778-9d48-45c4-bac6-9784f38cc316 service nova] Lock "9ba37020-824a-4ae5-9836-462fe4de476b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:45:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-8b29b13a-dc83-46fd-8109-42d4827600ff req-7cd65778-9d48-45c4-bac6-9784f38cc316 service nova] Lock "9ba37020-824a-4ae5-9836-462fe4de476b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:35 user nova-compute[70924]: DEBUG nova.compute.manager [req-8b29b13a-dc83-46fd-8109-42d4827600ff req-7cd65778-9d48-45c4-bac6-9784f38cc316 service nova] [instance: 9ba37020-824a-4ae5-9836-462fe4de476b] No waiting events found dispatching network-vif-plugged-6a96191e-52fa-4efd-9c32-c5dec84b69ec {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:45:35 user nova-compute[70924]: WARNING nova.compute.manager [req-8b29b13a-dc83-46fd-8109-42d4827600ff req-7cd65778-9d48-45c4-bac6-9784f38cc316 service nova] [instance: 9ba37020-824a-4ae5-9836-462fe4de476b] Received unexpected event network-vif-plugged-6a96191e-52fa-4efd-9c32-c5dec84b69ec for instance with vm_state active and task_state deleting.
Jul 29 14:45:35 user nova-compute[70924]: DEBUG nova.compute.manager [req-1b7ce61e-fd4d-450d-8a8b-cd3039b82c21 req-ec62751d-19d9-4e66-9a9d-fe4195d9025d service nova] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Received event network-vif-plugged-325110be-cad2-4b73-9044-3028f80f3d37 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:45:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-1b7ce61e-fd4d-450d-8a8b-cd3039b82c21 req-ec62751d-19d9-4e66-9a9d-fe4195d9025d service nova] Acquiring lock "9b4c76df-f74f-43b4-968f-b730cc5b0ec6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:45:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-1b7ce61e-fd4d-450d-8a8b-cd3039b82c21 req-ec62751d-19d9-4e66-9a9d-fe4195d9025d service nova] Lock "9b4c76df-f74f-43b4-968f-b730cc5b0ec6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:45:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-1b7ce61e-fd4d-450d-8a8b-cd3039b82c21 req-ec62751d-19d9-4e66-9a9d-fe4195d9025d service nova] Lock "9b4c76df-f74f-43b4-968f-b730cc5b0ec6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:35 user nova-compute[70924]: DEBUG nova.compute.manager [req-1b7ce61e-fd4d-450d-8a8b-cd3039b82c21 req-ec62751d-19d9-4e66-9a9d-fe4195d9025d service nova] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] No waiting events found dispatching network-vif-plugged-325110be-cad2-4b73-9044-3028f80f3d37 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:45:35 user nova-compute[70924]: WARNING nova.compute.manager [req-1b7ce61e-fd4d-450d-8a8b-cd3039b82c21 req-ec62751d-19d9-4e66-9a9d-fe4195d9025d service nova] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Received unexpected event network-vif-plugged-325110be-cad2-4b73-9044-3028f80f3d37 for instance with vm_state active and task_state rebuild_spawning.
Jul 29 14:45:36 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:36 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:36 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:36 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:37 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: 9ba37020-824a-4ae5-9836-462fe4de476b] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:45:37 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: 9ba37020-824a-4ae5-9836-462fe4de476b] Took 1.83 seconds to deallocate network for instance.
Jul 29 14:45:37 user nova-compute[70924]: DEBUG nova.compute.manager [req-591f62b7-c476-4647-a0e3-2d4f4d3f9264 req-5d43dfe9-aaeb-418b-a882-e458fb96a187 service nova] [instance: 79652140-c347-4d7b-9770-a4cc2d1a08e3] Received event network-vif-plugged-bf1e6655-6811-4a5c-ac2d-e2cd6a3b8d02 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:45:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-591f62b7-c476-4647-a0e3-2d4f4d3f9264 req-5d43dfe9-aaeb-418b-a882-e458fb96a187 service nova] Acquiring lock "79652140-c347-4d7b-9770-a4cc2d1a08e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:45:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-591f62b7-c476-4647-a0e3-2d4f4d3f9264 req-5d43dfe9-aaeb-418b-a882-e458fb96a187 service nova] Lock "79652140-c347-4d7b-9770-a4cc2d1a08e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:45:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-591f62b7-c476-4647-a0e3-2d4f4d3f9264 req-5d43dfe9-aaeb-418b-a882-e458fb96a187 service nova] Lock "79652140-c347-4d7b-9770-a4cc2d1a08e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:37 user nova-compute[70924]: DEBUG nova.compute.manager [req-591f62b7-c476-4647-a0e3-2d4f4d3f9264 req-5d43dfe9-aaeb-418b-a882-e458fb96a187 service nova] [instance: 79652140-c347-4d7b-9770-a4cc2d1a08e3] No waiting events found dispatching network-vif-plugged-bf1e6655-6811-4a5c-ac2d-e2cd6a3b8d02 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:45:37 user nova-compute[70924]: WARNING nova.compute.manager [req-591f62b7-c476-4647-a0e3-2d4f4d3f9264 req-5d43dfe9-aaeb-418b-a882-e458fb96a187 service nova] [instance: 79652140-c347-4d7b-9770-a4cc2d1a08e3] Received unexpected event network-vif-plugged-bf1e6655-6811-4a5c-ac2d-e2cd6a3b8d02 for instance with vm_state building and task_state spawning.
Jul 29 14:45:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-d2b56587-9e48-437a-a6a9-f8ebf1be16d5 tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:45:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-d2b56587-9e48-437a-a6a9-f8ebf1be16d5 tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:45:37 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-d2b56587-9e48-437a-a6a9-f8ebf1be16d5 tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:45:37 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-d2b56587-9e48-437a-a6a9-f8ebf1be16d5 tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:45:37 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-d2b56587-9e48-437a-a6a9-f8ebf1be16d5 tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.506s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:37 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:37 user nova-compute[70924]: INFO nova.scheduler.client.report [None req-d2b56587-9e48-437a-a6a9-f8ebf1be16d5 tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] Deleted allocations for instance 9ba37020-824a-4ae5-9836-462fe4de476b
Jul 29 14:45:37 user nova-compute[70924]: DEBUG nova.compute.manager [req-7b0e4c8b-fed5-4f89-ad0c-f81bbdeab5ff req-0e575b53-b6a4-4a77-bfa2-9fb7d864b55a service nova] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Received event network-vif-plugged-325110be-cad2-4b73-9044-3028f80f3d37 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:45:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-7b0e4c8b-fed5-4f89-ad0c-f81bbdeab5ff req-0e575b53-b6a4-4a77-bfa2-9fb7d864b55a service nova] Acquiring lock "9b4c76df-f74f-43b4-968f-b730cc5b0ec6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:45:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-7b0e4c8b-fed5-4f89-ad0c-f81bbdeab5ff req-0e575b53-b6a4-4a77-bfa2-9fb7d864b55a service nova] Lock "9b4c76df-f74f-43b4-968f-b730cc5b0ec6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:45:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-7b0e4c8b-fed5-4f89-ad0c-f81bbdeab5ff req-0e575b53-b6a4-4a77-bfa2-9fb7d864b55a service nova] Lock "9b4c76df-f74f-43b4-968f-b730cc5b0ec6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:37 user nova-compute[70924]: DEBUG nova.compute.manager [req-7b0e4c8b-fed5-4f89-ad0c-f81bbdeab5ff req-0e575b53-b6a4-4a77-bfa2-9fb7d864b55a service nova] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] No waiting events found dispatching network-vif-plugged-325110be-cad2-4b73-9044-3028f80f3d37 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:45:37 user nova-compute[70924]: WARNING nova.compute.manager [req-7b0e4c8b-fed5-4f89-ad0c-f81bbdeab5ff req-0e575b53-b6a4-4a77-bfa2-9fb7d864b55a service nova] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Received unexpected event network-vif-plugged-325110be-cad2-4b73-9044-3028f80f3d37 for instance with vm_state active and task_state rebuild_spawning.
Jul 29 14:45:37 user nova-compute[70924]: DEBUG nova.compute.manager [req-7b0e4c8b-fed5-4f89-ad0c-f81bbdeab5ff req-0e575b53-b6a4-4a77-bfa2-9fb7d864b55a service nova] [instance: 9ba37020-824a-4ae5-9836-462fe4de476b] Received event network-vif-deleted-6a96191e-52fa-4efd-9c32-c5dec84b69ec {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:45:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-d2b56587-9e48-437a-a6a9-f8ebf1be16d5 tempest-VolumesNegativeTest-1472430635 tempest-VolumesNegativeTest-1472430635-project-member] Lock "9ba37020-824a-4ae5-9836-462fe4de476b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.405s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:38 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:38 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690641938.8208876, 9b4c76df-f74f-43b4-968f-b730cc5b0ec6 => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:45:38 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] VM Resumed (Lifecycle Event)
Jul 29 14:45:38 user nova-compute[70924]: DEBUG nova.compute.manager [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Instance event wait completed in 0 seconds for  {{(pid=70924) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 14:45:38 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Guest created on hypervisor {{(pid=70924) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 14:45:38 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Instance spawned successfully.
Jul 29 14:45:38 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 14:45:38 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:45:38 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:45:38 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Found default for hw_cdrom_bus of ide {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:45:38 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Found default for hw_disk_bus of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:45:38 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Found default for hw_input_bus of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:45:38 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Found default for hw_pointer_model of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:45:38 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Found default for hw_video_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:45:38 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Found default for hw_vif_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:45:38 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 29 14:45:38 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690641938.821052, 9b4c76df-f74f-43b4-968f-b730cc5b0ec6 => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:45:38 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] VM Started (Lifecycle Event)
Jul 29 14:45:38 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:45:38 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:45:38 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 29 14:45:38 user nova-compute[70924]: DEBUG nova.compute.manager [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:45:39 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:45:39 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:45:39 user nova-compute[70924]: DEBUG nova.objects.instance [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Trying to apply a migration context that does not seem to be set for this instance {{(pid=70924) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Jul 29 14:45:39 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-47c9ef51-80dc-44bc-ae0f-d094e6ae71de tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.083s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:39 user nova-compute[70924]: DEBUG nova.compute.manager [req-cfba7a4f-0a4b-4aa1-9856-e90bb9a69bae req-de4c7423-91ae-49e1-8104-300c04978fd9 service nova] [instance: 79652140-c347-4d7b-9770-a4cc2d1a08e3] Received event network-vif-plugged-bf1e6655-6811-4a5c-ac2d-e2cd6a3b8d02 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:45:39 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-cfba7a4f-0a4b-4aa1-9856-e90bb9a69bae req-de4c7423-91ae-49e1-8104-300c04978fd9 service nova] Acquiring lock "79652140-c347-4d7b-9770-a4cc2d1a08e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:45:39 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-cfba7a4f-0a4b-4aa1-9856-e90bb9a69bae req-de4c7423-91ae-49e1-8104-300c04978fd9 service nova] Lock "79652140-c347-4d7b-9770-a4cc2d1a08e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:45:39 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-cfba7a4f-0a4b-4aa1-9856-e90bb9a69bae req-de4c7423-91ae-49e1-8104-300c04978fd9 service nova] Lock "79652140-c347-4d7b-9770-a4cc2d1a08e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:39 user nova-compute[70924]: DEBUG nova.compute.manager [req-cfba7a4f-0a4b-4aa1-9856-e90bb9a69bae req-de4c7423-91ae-49e1-8104-300c04978fd9 service nova] [instance: 79652140-c347-4d7b-9770-a4cc2d1a08e3] No waiting events found dispatching network-vif-plugged-bf1e6655-6811-4a5c-ac2d-e2cd6a3b8d02 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:45:39 user nova-compute[70924]: WARNING nova.compute.manager [req-cfba7a4f-0a4b-4aa1-9856-e90bb9a69bae req-de4c7423-91ae-49e1-8104-300c04978fd9 service nova] [instance: 79652140-c347-4d7b-9770-a4cc2d1a08e3] Received unexpected event network-vif-plugged-bf1e6655-6811-4a5c-ac2d-e2cd6a3b8d02 for instance with vm_state building and task_state spawning.
Jul 29 14:45:39 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690641939.3516755, 79652140-c347-4d7b-9770-a4cc2d1a08e3 => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:45:39 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 79652140-c347-4d7b-9770-a4cc2d1a08e3] VM Resumed (Lifecycle Event)
Jul 29 14:45:39 user nova-compute[70924]: DEBUG nova.compute.manager [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] [instance: 79652140-c347-4d7b-9770-a4cc2d1a08e3] Instance event wait completed in 0 seconds for  {{(pid=70924) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 14:45:39 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] [instance: 79652140-c347-4d7b-9770-a4cc2d1a08e3] Guest created on hypervisor {{(pid=70924) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 14:45:39 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 79652140-c347-4d7b-9770-a4cc2d1a08e3] Instance spawned successfully.
Jul 29 14:45:39 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] [instance: 79652140-c347-4d7b-9770-a4cc2d1a08e3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 14:45:39 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 79652140-c347-4d7b-9770-a4cc2d1a08e3] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:45:39 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] [instance: 79652140-c347-4d7b-9770-a4cc2d1a08e3] Found default for hw_cdrom_bus of ide {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:45:39 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] [instance: 79652140-c347-4d7b-9770-a4cc2d1a08e3] Found default for hw_disk_bus of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:45:39 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] [instance: 79652140-c347-4d7b-9770-a4cc2d1a08e3] Found default for hw_input_bus of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:45:39 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] [instance: 79652140-c347-4d7b-9770-a4cc2d1a08e3] Found default for hw_pointer_model of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:45:39 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] [instance: 79652140-c347-4d7b-9770-a4cc2d1a08e3] Found default for hw_video_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:45:39 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] [instance: 79652140-c347-4d7b-9770-a4cc2d1a08e3] Found default for hw_vif_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:45:39 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 79652140-c347-4d7b-9770-a4cc2d1a08e3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:45:39 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 79652140-c347-4d7b-9770-a4cc2d1a08e3] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:45:39 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690641939.3542001, 79652140-c347-4d7b-9770-a4cc2d1a08e3 => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:45:39 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 79652140-c347-4d7b-9770-a4cc2d1a08e3] VM Started (Lifecycle Event)
Jul 29 14:45:39 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 79652140-c347-4d7b-9770-a4cc2d1a08e3] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:45:39 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 79652140-c347-4d7b-9770-a4cc2d1a08e3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:45:39 user nova-compute[70924]: INFO nova.compute.manager [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] [instance: 79652140-c347-4d7b-9770-a4cc2d1a08e3] Took 8.77 seconds to spawn the instance on the hypervisor.
Jul 29 14:45:39 user nova-compute[70924]: DEBUG nova.compute.manager [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] [instance: 79652140-c347-4d7b-9770-a4cc2d1a08e3] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:45:39 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 79652140-c347-4d7b-9770-a4cc2d1a08e3] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:45:39 user nova-compute[70924]: INFO nova.compute.manager [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] [instance: 79652140-c347-4d7b-9770-a4cc2d1a08e3] Took 9.98 seconds to build instance.
Jul 29 14:45:39 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-958b3f19-ecc4-4e40-85a0-ba09a116b02c tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] Lock "79652140-c347-4d7b-9770-a4cc2d1a08e3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.100s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:40 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:40 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:42 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:43 user nova-compute[70924]: INFO nova.compute.manager [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Rescuing
Jul 29 14:45:43 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Acquiring lock "refresh_cache-02c75b00-a1b4-4ef9-ae96-bc67d8038589" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:45:43 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Acquired lock "refresh_cache-02c75b00-a1b4-4ef9-ae96-bc67d8038589" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:45:43 user nova-compute[70924]: DEBUG nova.network.neutron [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 14:45:44 user nova-compute[70924]: DEBUG nova.network.neutron [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Updating instance_info_cache with network_info: [{"id": "25798da4-8f4d-4db1-afd2-7fb85693bc16", "address": "fa:16:3e:59:2c:bb", "network": {"id": "d5876e18-e2af-45c2-aab5-2d0d552ebfe4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2035085552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9e5c78c1684c359cfab4e32b9c213f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25798da4-8f", "ovs_interfaceid": "25798da4-8f4d-4db1-afd2-7fb85693bc16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:45:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Releasing lock "refresh_cache-02c75b00-a1b4-4ef9-ae96-bc67d8038589" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:45:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:44 user nova-compute[70924]: DEBUG nova.compute.manager [req-186d983c-9ca3-4be4-9a61-c0fc71556f8c req-b263c8b0-a072-43c9-968e-d340ab3d5498 service nova] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Received event network-vif-unplugged-25798da4-8f4d-4db1-afd2-7fb85693bc16 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:45:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-186d983c-9ca3-4be4-9a61-c0fc71556f8c req-b263c8b0-a072-43c9-968e-d340ab3d5498 service nova] Acquiring lock "02c75b00-a1b4-4ef9-ae96-bc67d8038589-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:45:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-186d983c-9ca3-4be4-9a61-c0fc71556f8c req-b263c8b0-a072-43c9-968e-d340ab3d5498 service nova] Lock "02c75b00-a1b4-4ef9-ae96-bc67d8038589-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:45:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-186d983c-9ca3-4be4-9a61-c0fc71556f8c req-b263c8b0-a072-43c9-968e-d340ab3d5498 service nova] Lock "02c75b00-a1b4-4ef9-ae96-bc67d8038589-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:44 user nova-compute[70924]: DEBUG nova.compute.manager [req-186d983c-9ca3-4be4-9a61-c0fc71556f8c req-b263c8b0-a072-43c9-968e-d340ab3d5498 service nova] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] No waiting events found dispatching network-vif-unplugged-25798da4-8f4d-4db1-afd2-7fb85693bc16 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:45:44 user nova-compute[70924]: WARNING nova.compute.manager [req-186d983c-9ca3-4be4-9a61-c0fc71556f8c req-b263c8b0-a072-43c9-968e-d340ab3d5498 service nova] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Received unexpected event network-vif-unplugged-25798da4-8f4d-4db1-afd2-7fb85693bc16 for instance with vm_state active and task_state rescuing.
Jul 29 14:45:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:45 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:45 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Instance destroyed successfully.
Jul 29 14:45:45 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Attempting a stable device rescue
Jul 29 14:45:45 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:45:45 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:45:45 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70924) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 14:45:45 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:45:45 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=70924) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 29 14:45:45 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Instance directory exists: not creating {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 29 14:45:45 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Creating image(s)
Jul 29 14:45:45 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Acquiring lock "/opt/stack/data/nova/instances/02c75b00-a1b4-4ef9-ae96-bc67d8038589/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:45:45 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "/opt/stack/data/nova/instances/02c75b00-a1b4-4ef9-ae96-bc67d8038589/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:45:45 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "/opt/stack/data/nova/instances/02c75b00-a1b4-4ef9-ae96-bc67d8038589/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:45 user nova-compute[70924]: DEBUG nova.objects.instance [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lazy-loading 'trusted_certs' on Instance uuid 02c75b00-a1b4-4ef9-ae96-bc67d8038589 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:45:45 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:45:45 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:45:45 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:45 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Auditing locally available compute resources for user (node: user) {{(pid=70924) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 14:45:45 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Acquiring lock "404bd66c04051371b804393710c50ebf87c0b4e5" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:45:45 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "404bd66c04051371b804393710c50ebf87c0b4e5" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:45:46 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/404bd66c04051371b804393710c50ebf87c0b4e5.part --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:46 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:46 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/404bd66c04051371b804393710c50ebf87c0b4e5.part --force-share --output=json" returned: 0 in 0.256s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:46 user nova-compute[70924]: DEBUG nova.virt.images [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] caf50a5b-c6ab-432a-91e2-d363a5f45eb9 was qcow2, converting to raw {{(pid=70924) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 29 14:45:46 user nova-compute[70924]: DEBUG nova.privsep.utils [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70924) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 29 14:45:46 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/404bd66c04051371b804393710c50ebf87c0b4e5.part /opt/stack/data/nova/instances/_base/404bd66c04051371b804393710c50ebf87c0b4e5.converted {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:46 user nova-compute[70924]: DEBUG nova.compute.manager [req-d9b66210-17d4-49b0-a113-bcc69fd607eb req-9a43f2fe-6d13-4745-95b0-fcd5de8a7b82 service nova] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Received event network-vif-plugged-25798da4-8f4d-4db1-afd2-7fb85693bc16 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:45:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-d9b66210-17d4-49b0-a113-bcc69fd607eb req-9a43f2fe-6d13-4745-95b0-fcd5de8a7b82 service nova] Acquiring lock "02c75b00-a1b4-4ef9-ae96-bc67d8038589-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:45:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-d9b66210-17d4-49b0-a113-bcc69fd607eb req-9a43f2fe-6d13-4745-95b0-fcd5de8a7b82 service nova] Lock "02c75b00-a1b4-4ef9-ae96-bc67d8038589-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:45:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-d9b66210-17d4-49b0-a113-bcc69fd607eb req-9a43f2fe-6d13-4745-95b0-fcd5de8a7b82 service nova] Lock "02c75b00-a1b4-4ef9-ae96-bc67d8038589-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:46 user nova-compute[70924]: DEBUG nova.compute.manager [req-d9b66210-17d4-49b0-a113-bcc69fd607eb req-9a43f2fe-6d13-4745-95b0-fcd5de8a7b82 service nova] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] No waiting events found dispatching network-vif-plugged-25798da4-8f4d-4db1-afd2-7fb85693bc16 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:45:46 user nova-compute[70924]: WARNING nova.compute.manager [req-d9b66210-17d4-49b0-a113-bcc69fd607eb req-9a43f2fe-6d13-4745-95b0-fcd5de8a7b82 service nova] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Received unexpected event network-vif-plugged-25798da4-8f4d-4db1-afd2-7fb85693bc16 for instance with vm_state active and task_state rescuing.
Jul 29 14:45:46 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:46 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:47 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:47 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 14:45:47 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 14:45:47 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 14:45:47 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 14:45:47 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 14:45:47 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79652140-c347-4d7b-9770-a4cc2d1a08e3/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:47 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/404bd66c04051371b804393710c50ebf87c0b4e5.part /opt/stack/data/nova/instances/_base/404bd66c04051371b804393710c50ebf87c0b4e5.converted" returned: 0 in 0.598s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:47 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/404bd66c04051371b804393710c50ebf87c0b4e5.converted --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:47 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79652140-c347-4d7b-9770-a4cc2d1a08e3/disk --force-share --output=json" returned: 0 in 0.289s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:47 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79652140-c347-4d7b-9770-a4cc2d1a08e3/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:47 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/404bd66c04051371b804393710c50ebf87c0b4e5.converted --force-share --output=json" returned: 0 in 0.210s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:47 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "404bd66c04051371b804393710c50ebf87c0b4e5" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.259s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:47 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Acquiring lock "404bd66c04051371b804393710c50ebf87c0b4e5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:45:47 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "404bd66c04051371b804393710c50ebf87c0b4e5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:45:47 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/404bd66c04051371b804393710c50ebf87c0b4e5 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:47 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79652140-c347-4d7b-9770-a4cc2d1a08e3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:47 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 14:45:47 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:47 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/404bd66c04051371b804393710c50ebf87c0b4e5 --force-share --output=json" returned: 0 in 0.152s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:47 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/404bd66c04051371b804393710c50ebf87c0b4e5,backing_fmt=raw /opt/stack/data/nova/instances/02c75b00-a1b4-4ef9-ae96-bc67d8038589/disk.rescue {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:47 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:47 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:47 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/404bd66c04051371b804393710c50ebf87c0b4e5,backing_fmt=raw /opt/stack/data/nova/instances/02c75b00-a1b4-4ef9-ae96-bc67d8038589/disk.rescue" returned: 0 in 0.101s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:47 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "404bd66c04051371b804393710c50ebf87c0b4e5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:47 user nova-compute[70924]: DEBUG nova.objects.instance [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lazy-loading 'migration_context' on Instance uuid 02c75b00-a1b4-4ef9-ae96-bc67d8038589 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Created local disks {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Start _get_guest_xml network_info=[{"id": "25798da4-8f4d-4db1-afd2-7fb85693bc16", "address": "fa:16:3e:59:2c:bb", "network": {"id": "d5876e18-e2af-45c2-aab5-2d0d552ebfe4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2035085552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2035085552-network", "vif_mac": "fa:16:3e:59:2c:bb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9e5c78c1684c359cfab4e32b9c213f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25798da4-8f", "ovs_interfaceid": "25798da4-8f4d-4db1-afd2-7fb85693bc16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'caf50a5b-c6ab-432a-91e2-d363a5f45eb9', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kNagZKpr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '02c75b00-a1b4-4ef9-ae96-bc67d8038589', 'attached_at': '', 'detached_at': '', 'volume_id': 'd8161c51-93db-4707-bf78-63cb674c3453', 'serial': 'd8161c51-93db-4707-bf78-63cb674c3453'}, 'attachment_id': '69fb18b5-b34a-4041-8752-a573d9535cc3', 'volume_type': None} {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG nova.objects.instance [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lazy-loading 'resources' on Instance uuid 02c75b00-a1b4-4ef9-ae96-bc67d8038589 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG nova.objects.instance [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lazy-loading 'numa_topology' on Instance uuid 02c75b00-a1b4-4ef9-ae96-bc67d8038589 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:45:48 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:45:48 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:45:48 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] CPU controller missing on host. {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] CPU controller found on host. {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70924) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T14:36:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Flavor limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Image limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Flavor pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Image pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Got 1 possible topologies {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG nova.objects.instance [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lazy-loading 'vcpu_model' on Instance uuid 02c75b00-a1b4-4ef9-ae96-bc67d8038589 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Calling os-brick to attach iSCSI Volume {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kNagZKpr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:45:48 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:45:48 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:45:48 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:45:48 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:45:48 user nova-compute[70924]: INFO os_brick.initiator.connectors.iscsi [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 14:45:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5929dcf-8594-4323-a6f5-a322aff7c881/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 -p 172.16.0.220:3260 {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8dfec9-7e7e-4eed-af28-af4dd6ed8ca9]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = kNagZKpr\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Jul 29 14:45:48 user nova-compute[70924]: node.name = iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453
Jul 29 14:45:48 user nova-compute[70924]: node.tpgt = -1
Jul 29 14:45:48 user nova-compute[70924]: node.startup = automatic
Jul 29 14:45:48 user nova-compute[70924]: node.leading_login = No
Jul 29 14:45:48 user nova-compute[70924]: iface.iscsi_ifacename = default
Jul 29 14:45:48 user nova-compute[70924]: iface.net_ifacename = <empty>
Jul 29 14:45:48 user nova-compute[70924]: iface.ipaddress = <empty>
Jul 29 14:45:48 user nova-compute[70924]: iface.prefix_len = 0
Jul 29 14:45:48 user nova-compute[70924]: iface.hwaddress = <empty>
Jul 29 14:45:48 user nova-compute[70924]: iface.transport_name = tcp
Jul 29 14:45:48 user nova-compute[70924]: iface.initiatorname = <empty>
Jul 29 14:45:48 user nova-compute[70924]: iface.state = <empty>
Jul 29 14:45:48 user nova-compute[70924]: iface.vlan_id = 0
Jul 29 14:45:48 user nova-compute[70924]: iface.vlan_priority = 0
Jul 29 14:45:48 user nova-compute[70924]: iface.vlan_state = <empty>
Jul 29 14:45:48 user nova-compute[70924]: iface.iface_num = 0
Jul 29 14:45:48 user nova-compute[70924]: iface.mtu = 0
Jul 29 14:45:48 user nova-compute[70924]: iface.port = 0
Jul 29 14:45:48 user nova-compute[70924]: iface.bootproto = <empty>
Jul 29 14:45:48 user nova-compute[70924]: iface.subnet_mask = <empty>
Jul 29 14:45:48 user nova-compute[70924]: iface.gateway = <empty>
Jul 29 14:45:48 user nova-compute[70924]: iface.dhcp_alt_client_id_state = <empty>
Jul 29 14:45:48 user nova-compute[70924]: iface.dhcp_alt_client_id = <empty>
Jul 29 14:45:48 user nova-compute[70924]: iface.dhcp_dns = <empty>
Jul 29 14:45:48 user nova-compute[70924]: iface.dhcp_learn_iqn = <empty>
Jul 29 14:45:48 user nova-compute[70924]: iface.dhcp_req_vendor_id_state = <empty>
Jul 29 14:45:48 user nova-compute[70924]: iface.dhcp_vendor_id_state = <empty>
Jul 29 14:45:48 user nova-compute[70924]: iface.dhcp_vendor_id = <empty>
Jul 29 14:45:48 user nova-compute[70924]: iface.dhcp_slp_da = <empty>
Jul 29 14:45:48 user nova-compute[70924]: iface.fragmentation = <empty>
Jul 29 14:45:48 user nova-compute[70924]: iface.gratuitous_arp = <empty>
Jul 29 14:45:48 user nova-compute[70924]: iface.incoming_forwarding = <empty>
Jul 29 14:45:48 user nova-compute[70924]: iface.tos_state = <empty>
Jul 29 14:45:48 user nova-compute[70924]: iface.tos = 0
Jul 29 14:45:48 user nova-compute[70924]: iface.ttl = 0
Jul 29 14:45:48 user nova-compute[70924]: iface.delayed_ack = <empty>
Jul 29 14:45:48 user nova-compute[70924]: iface.tcp_nagle = <empty>
Jul 29 14:45:48 user nova-compute[70924]: iface.tcp_wsf_state = <empty>
Jul 29 14:45:48 user nova-compute[70924]: iface.tcp_wsf = 0
Jul 29 14:45:48 user nova-compute[70924]: iface.tcp_timer_scale = 0
Jul 29 14:45:48 user nova-compute[70924]: iface.tcp_timestamp = <empty>
Jul 29 14:45:48 user nova-compute[70924]: iface.redirect = <empty>
Jul 29 14:45:48 user nova-compute[70924]: iface.def_task_mgmt_timeout = 0
Jul 29 14:45:48 user nova-compute[70924]: iface.header_digest = <empty>
Jul 29 14:45:48 user nova-compute[70924]: iface.data_digest = <empty>
Jul 29 14:45:48 user nova-compute[70924]: iface.immediate_data = <empty>
Jul 29 14:45:48 user nova-compute[70924]: iface.initial_r2t = <empty>
Jul 29 14:45:48 user nova-compute[70924]: iface.data_seq_inorder = <empty>
Jul 29 14:45:48 user nova-compute[70924]: iface.data_pdu_inorder = <empty>
Jul 29 14:45:48 user nova-compute[70924]: iface.erl = 0
Jul 29 14:45:48 user nova-compute[70924]: iface.max_receive_data_len = 0
Jul 29 14:45:48 user nova-compute[70924]: iface.first_burst_len = 0
Jul 29 14:45:48 user nova-compute[70924]: iface.max_outstanding_r2t = 0
Jul 29 14:45:48 user nova-compute[70924]: iface.max_burst_len = 0
Jul 29 14:45:48 user nova-compute[70924]: iface.chap_auth = <empty>
Jul 29 14:45:48 user nova-compute[70924]: iface.bidi_chap = <empty>
Jul 29 14:45:48 user nova-compute[70924]: iface.strict_login_compliance = <empty>
Jul 29 14:45:48 user nova-compute[70924]: iface.discovery_auth = <empty>
Jul 29 14:45:48 user nova-compute[70924]: iface.discovery_logout = <empty>
Jul 29 14:45:48 user nova-compute[70924]: node.discovery_address = <empty>
Jul 29 14:45:48 user nova-compute[70924]: node.discovery_port = 0
Jul 29 14:45:48 user nova-compute[70924]: node.discovery_type = static
Jul 29 14:45:48 user nova-compute[70924]: node.session.initial_cmdsn = 0
Jul 29 14:45:48 user nova-compute[70924]: node.session.initial_login_retry_max = 8
Jul 29 14:45:48 user nova-compute[70924]: node.session.xmit_thread_priority = -20
Jul 29 14:45:48 user nova-compute[70924]: node.session.cmds_max = 128
Jul 29 14:45:48 user nova-compute[70924]: node.session.queue_depth = 32
Jul 29 14:45:48 user nova-compute[70924]: node.session.nr_sessions = 1
Jul 29 14:45:48 user nova-compute[70924]: node.session.auth.authmethod = CHAP
Jul 29 14:45:48 user nova-compute[70924]: node.session.auth.username = kNagZKpr
Jul 29 14:45:48 user nova-compute[70924]: node.session.auth.password = ***
Jul 29 14:45:48 user nova-compute[70924]: node.session.auth.username_in = <empty>
Jul 29 14:45:48 user nova-compute[70924]: node.session.auth.password_in = <empty>
Jul 29 14:45:48 user nova-compute[70924]: node.session.auth.chap_algs = MD5
Jul 29 14:45:48 user nova-compute[70924]: node.session.timeo.replacement_timeout = 120
Jul 29 14:45:48 user nova-compute[70924]: node.session.err_timeo.abort_timeout = 15
Jul 29 14:45:48 user nova-compute[70924]: node.session.err_timeo.lu_reset_timeout = 30
Jul 29 14:45:48 user nova-compute[70924]: node.session.err_timeo.tgt_reset_timeout = 30
Jul 29 14:45:48 user nova-compute[70924]: node.session.err_timeo.host_reset_timeout = 60
Jul 29 14:45:48 user nova-compute[70924]: node.session.iscsi.FastAbort = Yes
Jul 29 14:45:48 user nova-compute[70924]: node.session.iscsi.InitialR2T = No
Jul 29 14:45:48 user nova-compute[70924]: node.session.iscsi.ImmediateData = Yes
Jul 29 14:45:48 user nova-compute[70924]: node.session.iscsi.FirstBurstLength = 262144
Jul 29 14:45:48 user nova-compute[70924]: node.session.iscsi.MaxBurstLength = 16776192
Jul 29 14:45:48 user nova-compute[70924]: node.session.iscsi.DefaultTime2Retain = 0
Jul 29 14:45:48 user nova-compute[70924]: node.session.iscsi.DefaultTime2Wait = 2
Jul 29 14:45:48 user nova-compute[70924]: node.session.iscsi.MaxConnections = 1
Jul 29 14:45:48 user nova-compute[70924]: node.session.iscsi.MaxOutstandingR2T = 1
Jul 29 14:45:48 user nova-compute[70924]: node.session.iscsi.ERL = 0
Jul 29 14:45:48 user nova-compute[70924]: node.session.scan = manual
Jul 29 14:45:48 user nova-compute[70924]: node.session.reopen_max = 0
Jul 29 14:45:48 user nova-compute[70924]: node.conn[0].address = 172.16.0.220
Jul 29 14:45:48 user nova-compute[70924]: node.conn[0].port = 3260
Jul 29 14:45:48 user nova-compute[70924]: node.conn[0].startup = manual
Jul 29 14:45:48 user nova-compute[70924]: node.conn[0].tcp.window_size = 524288
Jul 29 14:45:48 user nova-compute[70924]: node.conn[0].tcp.type_of_service = 0
Jul 29 14:45:48 user nova-compute[70924]: node.conn[0].timeo.logout_timeout = 15
Jul 29 14:45:48 user nova-compute[70924]: node.conn[0].timeo.login_timeout = 15
Jul 29 14:45:48 user nova-compute[70924]: node.conn[0].timeo.auth_timeout = 45
Jul 29 14:45:48 user nova-compute[70924]: node.conn[0].timeo.noop_out_interval = 5
Jul 29 14:45:48 user nova-compute[70924]: node.conn[0].timeo.noop_out_timeout = 5
Jul 29 14:45:48 user nova-compute[70924]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jul 29 14:45:48 user nova-compute[70924]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jul 29 14:45:48 user nova-compute[70924]: node.conn[0].iscsi.HeaderDigest = None
Jul 29 14:45:48 user nova-compute[70924]: node.conn[0].iscsi.DataDigest = None
Jul 29 14:45:48 user nova-compute[70924]: node.conn[0].iscsi.IFMarker = No
Jul 29 14:45:48 user nova-compute[70924]: node.conn[0].iscsi.OFMarker = No
Jul 29 14:45:48 user nova-compute[70924]: # END RECORD
Jul 29 14:45:48 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac90f7c-9514-43a7-9075-cf3ac16419f9]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba5501a-c637-42dc-927a-964b66e7856d]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kNagZKpr {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kNagZKpr" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c08ef1-66f1-4448-a1e1-9e5e5103d041]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kNagZKpr'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[619e7c53-49ab-47b5-825d-ac3ba072ae54]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5929dcf-8594-4323-a6f5-a322aff7c881/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5929dcf-8594-4323-a6f5-a322aff7c881/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.048s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[099fd3d1-f6e2-4169-8d94-d9aae713db28]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a7d5e0c-d135-4dd9-be3f-8dd700523339 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0763aadd-e95f-4582-bb01-fcc7dc4681cb (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49b03148-7445-466e-b4dd-4b84dcaaa95a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:45:48 user nova-compute[70924]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)
Jul 29 14:45:48 user nova-compute[70924]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 (non-flash)
Jul 29 14:45:48 user nova-compute[70924]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a7d5e0c-d135-4dd9-be3f-8dd700523339 (non-flash)
Jul 29 14:45:48 user nova-compute[70924]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0763aadd-e95f-4582-bb01-fcc7dc4681cb (non-flash)
Jul 29 14:45:48 user nova-compute[70924]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49b03148-7445-466e-b4dd-4b84dcaaa95a (non-flash)
Jul 29 14:45:48 user nova-compute[70924]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:45:48 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:45:48 user nova-compute[70924]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)
Jul 29 14:45:48 user nova-compute[70924]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 (non-flash)
Jul 29 14:45:48 user nova-compute[70924]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a7d5e0c-d135-4dd9-be3f-8dd700523339 (non-flash)
Jul 29 14:45:48 user nova-compute[70924]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0763aadd-e95f-4582-bb01-fcc7dc4681cb (non-flash)
Jul 29 14:45:48 user nova-compute[70924]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49b03148-7445-466e-b4dd-4b84dcaaa95a (non-flash)
Jul 29 14:45:48 user nova-compute[70924]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:45:48 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.244s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Connected to 172.16.0.220:3260 {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] HCTL ('33', '0', '0', 0) found on session 13 with lun 0 {{(pid=70924) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=70924) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a300319-779b-42a2-832f-bed304d7de10]: (4, ('0 0 0', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Searching for a device in session 13 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kNagZKpr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.284s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] <== connect_volume: return (285ms) {'type': 'block', 'scsi_wwn': '23730316336623066', 'path': '/dev/sdb'} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730316336623066', 'path': '/dev/sdb'} {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:43:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-796517517',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-796517517',id=13,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:44:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5a9e5c78c1684c359cfab4e32b9c213f',ramdisk_id='',reservation_id='r-zsivy5aj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2089253815',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:44:14Z,user_data=None,user_id='43582a8a85c54b5e9d16d11b12bf50d4',uuid=02c75b00-a1b4-4ef9-ae96-bc67d8038589,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "25798da4-8f4d-4db1-afd2-7fb85693bc16", "address": "fa:16:3e:59:2c:bb", "network": {"id": "d5876e18-e2af-45c2-aab5-2d0d552ebfe4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2035085552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2035085552-network", "vif_mac": "fa:16:3e:59:2c:bb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9e5c78c1684c359cfab4e32b9c213f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25798da4-8f", "ovs_interfaceid": "25798da4-8f4d-4db1-afd2-7fb85693bc16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Converting VIF {"id": "25798da4-8f4d-4db1-afd2-7fb85693bc16", "address": "fa:16:3e:59:2c:bb", "network": {"id": "d5876e18-e2af-45c2-aab5-2d0d552ebfe4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2035085552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2035085552-network", "vif_mac": "fa:16:3e:59:2c:bb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9e5c78c1684c359cfab4e32b9c213f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25798da4-8f", "ovs_interfaceid": "25798da4-8f4d-4db1-afd2-7fb85693bc16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:2c:bb,bridge_name='br-int',has_traffic_filtering=True,id=25798da4-8f4d-4db1-afd2-7fb85693bc16,network=Network(d5876e18-e2af-45c2-aab5-2d0d552ebfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25798da4-8f') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG nova.objects.instance [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lazy-loading 'pci_devices' on Instance uuid 02c75b00-a1b4-4ef9-ae96-bc67d8038589 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] End _get_guest_xml xml=<domain type="kvm">
Jul 29 14:45:48 user nova-compute[70924]:   <uuid>02c75b00-a1b4-4ef9-ae96-bc67d8038589</uuid>
Jul 29 14:45:48 user nova-compute[70924]:   <name>instance-0000000d</name>
Jul 29 14:45:48 user nova-compute[70924]:   <memory>524288</memory>
Jul 29 14:45:48 user nova-compute[70924]:   <vcpu>1</vcpu>
Jul 29 14:45:48 user nova-compute[70924]:   <metadata>
Jul 29 14:45:48 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 14:45:48 user nova-compute[70924]:       <nova:package version="0.0.0"/>
Jul 29 14:45:48 user nova-compute[70924]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-796517517</nova:name>
Jul 29 14:45:48 user nova-compute[70924]:       <nova:creationTime>2023-07-29 14:45:48</nova:creationTime>
Jul 29 14:45:48 user nova-compute[70924]:       <nova:flavor name="m1.tiny">
Jul 29 14:45:48 user nova-compute[70924]:         <nova:memory>512</nova:memory>
Jul 29 14:45:48 user nova-compute[70924]:         <nova:disk>1</nova:disk>
Jul 29 14:45:48 user nova-compute[70924]:         <nova:swap>0</nova:swap>
Jul 29 14:45:48 user nova-compute[70924]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 14:45:48 user nova-compute[70924]:         <nova:vcpus>1</nova:vcpus>
Jul 29 14:45:48 user nova-compute[70924]:       </nova:flavor>
Jul 29 14:45:48 user nova-compute[70924]:       <nova:owner>
Jul 29 14:45:48 user nova-compute[70924]:         <nova:user uuid="43582a8a85c54b5e9d16d11b12bf50d4">tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member</nova:user>
Jul 29 14:45:48 user nova-compute[70924]:         <nova:project uuid="5a9e5c78c1684c359cfab4e32b9c213f">tempest-ServerBootFromVolumeStableRescueTest-2089253815</nova:project>
Jul 29 14:45:48 user nova-compute[70924]:       </nova:owner>
Jul 29 14:45:48 user nova-compute[70924]:       <nova:root type="image" uuid="3aba2e73-6832-404b-8bd0-d0503ce82b8c"/>
Jul 29 14:45:48 user nova-compute[70924]:       <nova:ports>
Jul 29 14:45:48 user nova-compute[70924]:         <nova:port uuid="25798da4-8f4d-4db1-afd2-7fb85693bc16">
Jul 29 14:45:48 user nova-compute[70924]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 29 14:45:48 user nova-compute[70924]:         </nova:port>
Jul 29 14:45:48 user nova-compute[70924]:       </nova:ports>
Jul 29 14:45:48 user nova-compute[70924]:     </nova:instance>
Jul 29 14:45:48 user nova-compute[70924]:   </metadata>
Jul 29 14:45:48 user nova-compute[70924]:   <sysinfo type="smbios">
Jul 29 14:45:48 user nova-compute[70924]:     <system>
Jul 29 14:45:48 user nova-compute[70924]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 14:45:48 user nova-compute[70924]:       <entry name="product">OpenStack Nova</entry>
Jul 29 14:45:48 user nova-compute[70924]:       <entry name="version">0.0.0</entry>
Jul 29 14:45:48 user nova-compute[70924]:       <entry name="serial">02c75b00-a1b4-4ef9-ae96-bc67d8038589</entry>
Jul 29 14:45:48 user nova-compute[70924]:       <entry name="uuid">02c75b00-a1b4-4ef9-ae96-bc67d8038589</entry>
Jul 29 14:45:48 user nova-compute[70924]:       <entry name="family">Virtual Machine</entry>
Jul 29 14:45:48 user nova-compute[70924]:     </system>
Jul 29 14:45:48 user nova-compute[70924]:   </sysinfo>
Jul 29 14:45:48 user nova-compute[70924]:   <os>
Jul 29 14:45:48 user nova-compute[70924]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 14:45:48 user nova-compute[70924]:     <smbios mode="sysinfo"/>
Jul 29 14:45:48 user nova-compute[70924]:   </os>
Jul 29 14:45:48 user nova-compute[70924]:   <features>
Jul 29 14:45:48 user nova-compute[70924]:     <acpi/>
Jul 29 14:45:48 user nova-compute[70924]:     <apic/>
Jul 29 14:45:48 user nova-compute[70924]:     <vmcoreinfo/>
Jul 29 14:45:48 user nova-compute[70924]:   </features>
Jul 29 14:45:48 user nova-compute[70924]:   <clock offset="utc">
Jul 29 14:45:48 user nova-compute[70924]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 14:45:48 user nova-compute[70924]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 14:45:48 user nova-compute[70924]:     <timer name="hpet" present="no"/>
Jul 29 14:45:48 user nova-compute[70924]:   </clock>
Jul 29 14:45:48 user nova-compute[70924]:   <cpu mode="custom" match="exact">
Jul 29 14:45:48 user nova-compute[70924]:     <model>Nehalem</model>
Jul 29 14:45:48 user nova-compute[70924]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 14:45:48 user nova-compute[70924]:   </cpu>
Jul 29 14:45:48 user nova-compute[70924]:   <devices>
Jul 29 14:45:48 user nova-compute[70924]:     <disk type="block" device="disk">
Jul 29 14:45:48 user nova-compute[70924]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:45:48 user nova-compute[70924]:       <source dev="/dev/sdb"/>
Jul 29 14:45:48 user nova-compute[70924]:       <target dev="vda" bus="virtio"/>
Jul 29 14:45:48 user nova-compute[70924]:       <serial>d8161c51-93db-4707-bf78-63cb674c3453</serial>
Jul 29 14:45:48 user nova-compute[70924]:     </disk>
Jul 29 14:45:48 user nova-compute[70924]:     <disk type="file" device="disk">
Jul 29 14:45:48 user nova-compute[70924]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 14:45:48 user nova-compute[70924]:       <source file="/opt/stack/data/nova/instances/02c75b00-a1b4-4ef9-ae96-bc67d8038589/disk.rescue"/>
Jul 29 14:45:48 user nova-compute[70924]:       <target dev="vdb" bus="virtio"/>
Jul 29 14:45:48 user nova-compute[70924]:       <boot order="1"/>
Jul 29 14:45:48 user nova-compute[70924]:     </disk>
Jul 29 14:45:48 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 14:45:48 user nova-compute[70924]:       <mac address="fa:16:3e:59:2c:bb"/>
Jul 29 14:45:48 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:45:48 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 14:45:48 user nova-compute[70924]:       <target dev="tap25798da4-8f"/>
Jul 29 14:45:48 user nova-compute[70924]:     </interface>
Jul 29 14:45:48 user nova-compute[70924]:     <serial type="pty">
Jul 29 14:45:48 user nova-compute[70924]:       <log file="/opt/stack/data/nova/instances/02c75b00-a1b4-4ef9-ae96-bc67d8038589/console.log" append="off"/>
Jul 29 14:45:48 user nova-compute[70924]:     </serial>
Jul 29 14:45:48 user nova-compute[70924]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 14:45:48 user nova-compute[70924]:     <video>
Jul 29 14:45:48 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:45:48 user nova-compute[70924]:     </video>
Jul 29 14:45:48 user nova-compute[70924]:     <rng model="virtio">
Jul 29 14:45:48 user nova-compute[70924]:       <backend model="random">/dev/urandom</backend>
Jul 29 14:45:48 user nova-compute[70924]:     </rng>
Jul 29 14:45:48 user nova-compute[70924]:     <controller type="usb" index="0" model="none"/>
Jul 29 14:45:48 user nova-compute[70924]:     <memballoon model="virtio">
Jul 29 14:45:48 user nova-compute[70924]:       <stats period="10"/>
Jul 29 14:45:48 user nova-compute[70924]:     </memballoon>
Jul 29 14:45:48 user nova-compute[70924]:   </devices>
Jul 29 14:45:48 user nova-compute[70924]: </domain>
Jul 29 14:45:48 user nova-compute[70924]:  {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 14:45:48 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Instance destroyed successfully.
Jul 29 14:45:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5929dcf-8594-4323-a6f5-a322aff7c881/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5929dcf-8594-4323-a6f5-a322aff7c881/disk.rescue --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] No VIF found with MAC fa:16:3e:59:2c:bb, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5929dcf-8594-4323-a6f5-a322aff7c881/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5929dcf-8594-4323-a6f5-a322aff7c881/disk.rescue --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5929dcf-8594-4323-a6f5-a322aff7c881/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00231136-233f-4a1b-88ff-b678482ca5bb/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00231136-233f-4a1b-88ff-b678482ca5bb/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00231136-233f-4a1b-88ff-b678482ca5bb/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00231136-233f-4a1b-88ff-b678482ca5bb/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2250b0d6-5542-4a7f-90a9-93745a776fcc/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2250b0d6-5542-4a7f-90a9-93745a776fcc/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2250b0d6-5542-4a7f-90a9-93745a776fcc/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2250b0d6-5542-4a7f-90a9-93745a776fcc/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d2a0fe9-f17a-40b5-8252-6eff34fa618f/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d2a0fe9-f17a-40b5-8252-6eff34fa618f/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d2a0fe9-f17a-40b5-8252-6eff34fa618f/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:45:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d2a0fe9-f17a-40b5-8252-6eff34fa618f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:45:53 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:53 user nova-compute[70924]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690641935.0316014, 9ba37020-824a-4ae5-9836-462fe4de476b => Stopped> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:45:53 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: 9ba37020-824a-4ae5-9836-462fe4de476b] VM Stopped (Lifecycle Event)
Jul 29 14:45:53 user nova-compute[70924]: DEBUG nova.compute.manager [req-f009aff3-95d3-41d3-859e-cf71ae8b5db6 req-fc16c118-c3d8-4850-ab0d-23c6d6026954 service nova] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Received event network-vif-plugged-25798da4-8f4d-4db1-afd2-7fb85693bc16 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:45:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-f009aff3-95d3-41d3-859e-cf71ae8b5db6 req-fc16c118-c3d8-4850-ab0d-23c6d6026954 service nova] Acquiring lock "02c75b00-a1b4-4ef9-ae96-bc67d8038589-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:45:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-f009aff3-95d3-41d3-859e-cf71ae8b5db6 req-fc16c118-c3d8-4850-ab0d-23c6d6026954 service nova] Lock "02c75b00-a1b4-4ef9-ae96-bc67d8038589-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:45:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-f009aff3-95d3-41d3-859e-cf71ae8b5db6 req-fc16c118-c3d8-4850-ab0d-23c6d6026954 service nova] Lock "02c75b00-a1b4-4ef9-ae96-bc67d8038589-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:53 user nova-compute[70924]: DEBUG nova.compute.manager [req-f009aff3-95d3-41d3-859e-cf71ae8b5db6 req-fc16c118-c3d8-4850-ab0d-23c6d6026954 service nova] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] No waiting events found dispatching network-vif-plugged-25798da4-8f4d-4db1-afd2-7fb85693bc16 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:45:53 user nova-compute[70924]: WARNING nova.compute.manager [req-f009aff3-95d3-41d3-859e-cf71ae8b5db6 req-fc16c118-c3d8-4850-ab0d-23c6d6026954 service nova] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Received unexpected event network-vif-plugged-25798da4-8f4d-4db1-afd2-7fb85693bc16 for instance with vm_state active and task_state rescuing.
Jul 29 14:45:53 user nova-compute[70924]: DEBUG nova.compute.manager [req-1a858612-2a57-454f-b2ae-ee16249509ca req-0941511e-fe27-4d92-b04c-191568ba3ce9 service nova] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Received event network-vif-plugged-25798da4-8f4d-4db1-afd2-7fb85693bc16 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:45:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-1a858612-2a57-454f-b2ae-ee16249509ca req-0941511e-fe27-4d92-b04c-191568ba3ce9 service nova] Acquiring lock "02c75b00-a1b4-4ef9-ae96-bc67d8038589-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:45:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-1a858612-2a57-454f-b2ae-ee16249509ca req-0941511e-fe27-4d92-b04c-191568ba3ce9 service nova] Lock "02c75b00-a1b4-4ef9-ae96-bc67d8038589-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:45:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-1a858612-2a57-454f-b2ae-ee16249509ca req-0941511e-fe27-4d92-b04c-191568ba3ce9 service nova] Lock "02c75b00-a1b4-4ef9-ae96-bc67d8038589-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:53 user nova-compute[70924]: DEBUG nova.compute.manager [req-1a858612-2a57-454f-b2ae-ee16249509ca req-0941511e-fe27-4d92-b04c-191568ba3ce9 service nova] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] No waiting events found dispatching network-vif-plugged-25798da4-8f4d-4db1-afd2-7fb85693bc16 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:45:53 user nova-compute[70924]: WARNING nova.compute.manager [req-1a858612-2a57-454f-b2ae-ee16249509ca req-0941511e-fe27-4d92-b04c-191568ba3ce9 service nova] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Received unexpected event network-vif-plugged-25798da4-8f4d-4db1-afd2-7fb85693bc16 for instance with vm_state active and task_state rescuing.
Jul 29 14:45:53 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Removed pending event for 02c75b00-a1b4-4ef9-ae96-bc67d8038589 due to event {{(pid=70924) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 29 14:45:53 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690641952.9329164, 02c75b00-a1b4-4ef9-ae96-bc67d8038589 => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:45:53 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] VM Resumed (Lifecycle Event)
Jul 29 14:45:53 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:45:53 user nova-compute[70924]: DEBUG nova.compute.manager [None req-448ca73e-a377-4233-813e-ebcffd4a9138 None None] [instance: 9ba37020-824a-4ae5-9836-462fe4de476b] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:45:53 user nova-compute[70924]: DEBUG nova.compute.manager [None req-de7b85be-9dfb-422e-b068-45b962df77d2 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:45:53 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:45:53 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:45:53 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Hypervisor/Node resource view: name=user free_ram=7522MB free_disk=25.586750030517578GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70924) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 14:45:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:45:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:45:53 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:45:53 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:45:53 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 29 14:45:53 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690641952.9408236, 02c75b00-a1b4-4ef9-ae96-bc67d8038589 => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:45:53 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] VM Started (Lifecycle Event)
Jul 29 14:45:53 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:45:53 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:45:53 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance db656346-c4af-43da-9600-fd39f1b9e4dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:45:53 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 2250b0d6-5542-4a7f-90a9-93745a776fcc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:45:53 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance f5929dcf-8594-4323-a6f5-a322aff7c881 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:45:53 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 86ecc6cb-88a8-4572-8e41-d4c5859036a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:45:53 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 00231136-233f-4a1b-88ff-b678482ca5bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:45:53 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 9b4c76df-f74f-43b4-968f-b730cc5b0ec6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:45:53 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 02c75b00-a1b4-4ef9-ae96-bc67d8038589 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:45:53 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 0d2a0fe9-f17a-40b5-8252-6eff34fa618f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:45:53 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:45:53 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 79652140-c347-4d7b-9770-a4cc2d1a08e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:45:53 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 14:45:53 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 14:45:54 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:45:54 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:45:54 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Compute_service record updated for user:user {{(pid=70924) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 14:45:54 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.745s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:45:55 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:45:55 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Starting heal instance info cache {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 14:45:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "refresh_cache-86ecc6cb-88a8-4572-8e41-d4c5859036a6" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:45:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquired lock "refresh_cache-86ecc6cb-88a8-4572-8e41-d4c5859036a6" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:45:55 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Forcefully refreshing network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 29 14:45:56 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Updating instance_info_cache with network_info: [{"id": "4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3", "address": "fa:16:3e:d6:b6:d3", "network": {"id": "55c18d07-a341-4678-9d1c-2dff057a9b1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1092921088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b33d01ba458f466b99b6bc5bba88d8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cd05bcc-ca", "ovs_interfaceid": "4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:45:56 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Releasing lock "refresh_cache-86ecc6cb-88a8-4572-8e41-d4c5859036a6" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:45:56 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Updated the network info_cache for instance {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 29 14:45:56 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:45:56 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:45:56 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:45:56 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:45:56 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:45:58 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:45:58 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:00 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:03 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:03 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:04 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:07 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:11 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:13 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:13 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Acquiring lock "c86d8c87-6b21-4475-ab26-68ad706a4845" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:46:13 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Lock "c86d8c87-6b21-4475-ab26-68ad706a4845" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:46:13 user nova-compute[70924]: DEBUG nova.compute.manager [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: c86d8c87-6b21-4475-ab26-68ad706a4845] Starting instance... {{(pid=70924) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 14:46:13 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:46:13 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:46:13 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70924) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 14:46:13 user nova-compute[70924]: INFO nova.compute.claims [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: c86d8c87-6b21-4475-ab26-68ad706a4845] Claim successful on node user
Jul 29 14:46:13 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:13 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:46:13 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:46:13 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.460s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:46:13 user nova-compute[70924]: DEBUG nova.compute.manager [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: c86d8c87-6b21-4475-ab26-68ad706a4845] Start building networks asynchronously for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 14:46:13 user nova-compute[70924]: DEBUG nova.compute.manager [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: c86d8c87-6b21-4475-ab26-68ad706a4845] Allocating IP information in the background. {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 14:46:13 user nova-compute[70924]: DEBUG nova.network.neutron [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: c86d8c87-6b21-4475-ab26-68ad706a4845] allocate_for_instance() {{(pid=70924) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 14:46:13 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: c86d8c87-6b21-4475-ab26-68ad706a4845] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 14:46:13 user nova-compute[70924]: DEBUG nova.compute.manager [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: c86d8c87-6b21-4475-ab26-68ad706a4845] Start building block device mappings for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 14:46:14 user nova-compute[70924]: DEBUG nova.compute.manager [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: c86d8c87-6b21-4475-ab26-68ad706a4845] Start spawning the instance on the hypervisor. {{(pid=70924) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 14:46:14 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: c86d8c87-6b21-4475-ab26-68ad706a4845] Creating instance directory {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 14:46:14 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: c86d8c87-6b21-4475-ab26-68ad706a4845] Creating image(s)
Jul 29 14:46:14 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Acquiring lock "/opt/stack/data/nova/instances/c86d8c87-6b21-4475-ab26-68ad706a4845/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:46:14 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Lock "/opt/stack/data/nova/instances/c86d8c87-6b21-4475-ab26-68ad706a4845/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:46:14 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Lock "/opt/stack/data/nova/instances/c86d8c87-6b21-4475-ab26-68ad706a4845/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:46:14 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:46:14 user nova-compute[70924]: DEBUG nova.policy [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3b1d926fc4c646dba0bf9e852302a13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47334cc65f984a95b4c6c06d3d8d1d40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70924) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 14:46:14 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.194s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:46:14 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Acquiring lock "bd72453517468710f1de26b27fb0ea28688e9009" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:46:14 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:46:14 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:46:14 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.135s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:46:14 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/c86d8c87-6b21-4475-ab26-68ad706a4845/disk 1073741824 {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:46:14 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/c86d8c87-6b21-4475-ab26-68ad706a4845/disk 1073741824" returned: 0 in 0.061s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:46:14 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:46:14 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:46:14 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.137s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:46:14 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c86d8c87-6b21-4475-ab26-68ad706a4845/disk. size=1073741824 {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 14:46:14 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c86d8c87-6b21-4475-ab26-68ad706a4845/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:46:14 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c86d8c87-6b21-4475-ab26-68ad706a4845/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:46:14 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Cannot resize image /opt/stack/data/nova/instances/c86d8c87-6b21-4475-ab26-68ad706a4845/disk to a smaller size. {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 14:46:14 user nova-compute[70924]: DEBUG nova.objects.instance [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Lazy-loading 'migration_context' on Instance uuid c86d8c87-6b21-4475-ab26-68ad706a4845 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:46:14 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: c86d8c87-6b21-4475-ab26-68ad706a4845] Created local disks {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 14:46:14 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: c86d8c87-6b21-4475-ab26-68ad706a4845] Ensure instance console log exists: /opt/stack/data/nova/instances/c86d8c87-6b21-4475-ab26-68ad706a4845/console.log {{(pid=70924) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 14:46:14 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:46:14 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:46:14 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:46:15 user nova-compute[70924]: DEBUG nova.network.neutron [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: c86d8c87-6b21-4475-ab26-68ad706a4845] Successfully created port: 586735a0-4e44-4217-8840-335d8ff7c6e9 {{(pid=70924) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 14:46:16 user nova-compute[70924]: DEBUG nova.network.neutron [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: c86d8c87-6b21-4475-ab26-68ad706a4845] Successfully updated port: 586735a0-4e44-4217-8840-335d8ff7c6e9 {{(pid=70924) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 14:46:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Acquiring lock "refresh_cache-c86d8c87-6b21-4475-ab26-68ad706a4845" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:46:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Acquired lock "refresh_cache-c86d8c87-6b21-4475-ab26-68ad706a4845" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:46:16 user nova-compute[70924]: DEBUG nova.network.neutron [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: c86d8c87-6b21-4475-ab26-68ad706a4845] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 14:46:16 user nova-compute[70924]: DEBUG nova.network.neutron [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: c86d8c87-6b21-4475-ab26-68ad706a4845] Instance cache missing network info. {{(pid=70924) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 14:46:16 user nova-compute[70924]: DEBUG nova.compute.manager [req-728da5a1-6e95-4af5-8b9a-035495a52a25 req-ddebac6c-9c6c-414f-8662-2fc35f4da430 service nova] [instance: c86d8c87-6b21-4475-ab26-68ad706a4845] Received event network-changed-586735a0-4e44-4217-8840-335d8ff7c6e9 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:46:16 user nova-compute[70924]: DEBUG nova.compute.manager [req-728da5a1-6e95-4af5-8b9a-035495a52a25 req-ddebac6c-9c6c-414f-8662-2fc35f4da430 service nova] [instance: c86d8c87-6b21-4475-ab26-68ad706a4845] Refreshing instance network info cache due to event network-changed-586735a0-4e44-4217-8840-335d8ff7c6e9. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:46:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-728da5a1-6e95-4af5-8b9a-035495a52a25 req-ddebac6c-9c6c-414f-8662-2fc35f4da430 service nova] Acquiring lock "refresh_cache-c86d8c87-6b21-4475-ab26-68ad706a4845" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:46:16 user nova-compute[70924]: DEBUG nova.network.neutron [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: c86d8c87-6b21-4475-ab26-68ad706a4845] Updating instance_info_cache with network_info: [{"id": "586735a0-4e44-4217-8840-335d8ff7c6e9", "address": "fa:16:3e:e5:9b:88", "network": {"id": "0bec09f1-f460-4e97-917e-84769ed49901", "bridge": "br-int", "label": "tempest-VolumesActionsTest-956399393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47334cc65f984a95b4c6c06d3d8d1d40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap586735a0-4e", "ovs_interfaceid": "586735a0-4e44-4217-8840-335d8ff7c6e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:46:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Releasing lock "refresh_cache-c86d8c87-6b21-4475-ab26-68ad706a4845" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:46:16 user nova-compute[70924]: DEBUG nova.compute.manager [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: c86d8c87-6b21-4475-ab26-68ad706a4845] Instance network_info: |[{"id": "586735a0-4e44-4217-8840-335d8ff7c6e9", "address": "fa:16:3e:e5:9b:88", "network": {"id": "0bec09f1-f460-4e97-917e-84769ed49901", "bridge": "br-int", "label": "tempest-VolumesActionsTest-956399393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47334cc65f984a95b4c6c06d3d8d1d40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap586735a0-4e", "ovs_interfaceid": "586735a0-4e44-4217-8840-335d8ff7c6e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 14:46:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-728da5a1-6e95-4af5-8b9a-035495a52a25 req-ddebac6c-9c6c-414f-8662-2fc35f4da430 service nova] Acquired lock "refresh_cache-c86d8c87-6b21-4475-ab26-68ad706a4845" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:46:16 user nova-compute[70924]: DEBUG nova.network.neutron [req-728da5a1-6e95-4af5-8b9a-035495a52a25 req-ddebac6c-9c6c-414f-8662-2fc35f4da430 service nova] [instance: c86d8c87-6b21-4475-ab26-68ad706a4845] Refreshing network info cache for port 586735a0-4e44-4217-8840-335d8ff7c6e9 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:46:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: c86d8c87-6b21-4475-ab26-68ad706a4845] Start _get_guest_xml network_info=[{"id": "586735a0-4e44-4217-8840-335d8ff7c6e9", "address": "fa:16:3e:e5:9b:88", "network": {"id": "0bec09f1-f460-4e97-917e-84769ed49901", "bridge": "br-int", "label": "tempest-VolumesActionsTest-956399393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47334cc65f984a95b4c6c06d3d8d1d40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap586735a0-4e", "ovs_interfaceid": "586735a0-4e44-4217-8840-335d8ff7c6e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '3aba2e73-6832-404b-8bd0-d0503ce82b8c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 14:46:16 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:46:16 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:46:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 14:46:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] CPU controller missing on host. {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 14:46:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 14:46:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] CPU controller found on host. {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 14:46:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70924) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 14:46:16 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T14:36:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 14:46:16 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Flavor limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 14:46:16 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Image limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 14:46:16 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Flavor pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 14:46:16 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Image pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 14:46:16 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 14:46:16 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 14:46:16 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 14:46:16 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Got 1 possible topologies {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 14:46:16 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 14:46:16 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 14:46:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:46:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1542441009',display_name='tempest-VolumesActionsTest-instance-1542441009',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1542441009',id=17,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47334cc65f984a95b4c6c06d3d8d1d40',ramdisk_id='',reservation_id='r-6wndt43s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-325820960',owner_user_name='tempest-VolumesActionsTest-325820960-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:46:14Z,user_data=None,user_id='3b1d926fc4c646dba0bf9e852302a13b',uuid=c86d8c87-6b21-4475-ab26-68ad706a4845,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "586735a0-4e44-4217-8840-335d8ff7c6e9", "address": "fa:16:3e:e5:9b:88", "network": {"id": "0bec09f1-f460-4e97-917e-84769ed49901", "bridge": "br-int", "label": "tempest-VolumesActionsTest-956399393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47334cc65f984a95b4c6c06d3d8d1d40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap586735a0-4e", "ovs_interfaceid": "586735a0-4e44-4217-8840-335d8ff7c6e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:46:16 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Converting VIF {"id": "586735a0-4e44-4217-8840-335d8ff7c6e9", "address": "fa:16:3e:e5:9b:88", "network": {"id": "0bec09f1-f460-4e97-917e-84769ed49901", "bridge": "br-int", "label": "tempest-VolumesActionsTest-956399393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47334cc65f984a95b4c6c06d3d8d1d40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap586735a0-4e", "ovs_interfaceid": "586735a0-4e44-4217-8840-335d8ff7c6e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:46:16 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:9b:88,bridge_name='br-int',has_traffic_filtering=True,id=586735a0-4e44-4217-8840-335d8ff7c6e9,network=Network(0bec09f1-f460-4e97-917e-84769ed49901),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap586735a0-4e') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:46:16 user nova-compute[70924]: DEBUG nova.objects.instance [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Lazy-loading 'pci_devices' on Instance uuid c86d8c87-6b21-4475-ab26-68ad706a4845 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:46:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: c86d8c87-6b21-4475-ab26-68ad706a4845] End _get_guest_xml xml=<domain type="kvm">
Jul 29 14:46:16 user nova-compute[70924]:   <uuid>c86d8c87-6b21-4475-ab26-68ad706a4845</uuid>
Jul 29 14:46:16 user nova-compute[70924]:   <name>instance-00000011</name>
Jul 29 14:46:16 user nova-compute[70924]:   <memory>524288</memory>
Jul 29 14:46:16 user nova-compute[70924]:   <vcpu>1</vcpu>
Jul 29 14:46:16 user nova-compute[70924]:   <metadata>
Jul 29 14:46:16 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 14:46:16 user nova-compute[70924]:       <nova:package version="0.0.0"/>
Jul 29 14:46:16 user nova-compute[70924]:       <nova:name>tempest-VolumesActionsTest-instance-1542441009</nova:name>
Jul 29 14:46:16 user nova-compute[70924]:       <nova:creationTime>2023-07-29 14:46:16</nova:creationTime>
Jul 29 14:46:16 user nova-compute[70924]:       <nova:flavor name="m1.tiny">
Jul 29 14:46:16 user nova-compute[70924]:         <nova:memory>512</nova:memory>
Jul 29 14:46:16 user nova-compute[70924]:         <nova:disk>1</nova:disk>
Jul 29 14:46:16 user nova-compute[70924]:         <nova:swap>0</nova:swap>
Jul 29 14:46:16 user nova-compute[70924]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 14:46:16 user nova-compute[70924]:         <nova:vcpus>1</nova:vcpus>
Jul 29 14:46:16 user nova-compute[70924]:       </nova:flavor>
Jul 29 14:46:16 user nova-compute[70924]:       <nova:owner>
Jul 29 14:46:16 user nova-compute[70924]:         <nova:user uuid="3b1d926fc4c646dba0bf9e852302a13b">tempest-VolumesActionsTest-325820960-project-member</nova:user>
Jul 29 14:46:16 user nova-compute[70924]:         <nova:project uuid="47334cc65f984a95b4c6c06d3d8d1d40">tempest-VolumesActionsTest-325820960</nova:project>
Jul 29 14:46:16 user nova-compute[70924]:       </nova:owner>
Jul 29 14:46:16 user nova-compute[70924]:       <nova:root type="image" uuid="3aba2e73-6832-404b-8bd0-d0503ce82b8c"/>
Jul 29 14:46:16 user nova-compute[70924]:       <nova:ports>
Jul 29 14:46:16 user nova-compute[70924]:         <nova:port uuid="586735a0-4e44-4217-8840-335d8ff7c6e9">
Jul 29 14:46:16 user nova-compute[70924]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 29 14:46:16 user nova-compute[70924]:         </nova:port>
Jul 29 14:46:16 user nova-compute[70924]:       </nova:ports>
Jul 29 14:46:16 user nova-compute[70924]:     </nova:instance>
Jul 29 14:46:16 user nova-compute[70924]:   </metadata>
Jul 29 14:46:16 user nova-compute[70924]:   <sysinfo type="smbios">
Jul 29 14:46:16 user nova-compute[70924]:     <system>
Jul 29 14:46:16 user nova-compute[70924]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 14:46:16 user nova-compute[70924]:       <entry name="product">OpenStack Nova</entry>
Jul 29 14:46:16 user nova-compute[70924]:       <entry name="version">0.0.0</entry>
Jul 29 14:46:16 user nova-compute[70924]:       <entry name="serial">c86d8c87-6b21-4475-ab26-68ad706a4845</entry>
Jul 29 14:46:16 user nova-compute[70924]:       <entry name="uuid">c86d8c87-6b21-4475-ab26-68ad706a4845</entry>
Jul 29 14:46:16 user nova-compute[70924]:       <entry name="family">Virtual Machine</entry>
Jul 29 14:46:16 user nova-compute[70924]:     </system>
Jul 29 14:46:16 user nova-compute[70924]:   </sysinfo>
Jul 29 14:46:16 user nova-compute[70924]:   <os>
Jul 29 14:46:16 user nova-compute[70924]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 14:46:16 user nova-compute[70924]:     <boot dev="hd"/>
Jul 29 14:46:16 user nova-compute[70924]:     <smbios mode="sysinfo"/>
Jul 29 14:46:16 user nova-compute[70924]:   </os>
Jul 29 14:46:16 user nova-compute[70924]:   <features>
Jul 29 14:46:16 user nova-compute[70924]:     <acpi/>
Jul 29 14:46:16 user nova-compute[70924]:     <apic/>
Jul 29 14:46:16 user nova-compute[70924]:     <vmcoreinfo/>
Jul 29 14:46:16 user nova-compute[70924]:   </features>
Jul 29 14:46:16 user nova-compute[70924]:   <clock offset="utc">
Jul 29 14:46:16 user nova-compute[70924]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 14:46:16 user nova-compute[70924]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 14:46:16 user nova-compute[70924]:     <timer name="hpet" present="no"/>
Jul 29 14:46:16 user nova-compute[70924]:   </clock>
Jul 29 14:46:16 user nova-compute[70924]:   <cpu mode="custom" match="exact">
Jul 29 14:46:16 user nova-compute[70924]:     <model>Nehalem</model>
Jul 29 14:46:16 user nova-compute[70924]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 14:46:16 user nova-compute[70924]:   </cpu>
Jul 29 14:46:16 user nova-compute[70924]:   <devices>
Jul 29 14:46:16 user nova-compute[70924]:     <disk type="file" device="disk">
Jul 29 14:46:16 user nova-compute[70924]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 14:46:16 user nova-compute[70924]:       <source file="/opt/stack/data/nova/instances/c86d8c87-6b21-4475-ab26-68ad706a4845/disk"/>
Jul 29 14:46:16 user nova-compute[70924]:       <target dev="vda" bus="virtio"/>
Jul 29 14:46:16 user nova-compute[70924]:     </disk>
Jul 29 14:46:16 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 14:46:16 user nova-compute[70924]:       <mac address="fa:16:3e:e5:9b:88"/>
Jul 29 14:46:16 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:46:16 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 14:46:16 user nova-compute[70924]:       <target dev="tap586735a0-4e"/>
Jul 29 14:46:16 user nova-compute[70924]:     </interface>
Jul 29 14:46:16 user nova-compute[70924]:     <serial type="pty">
Jul 29 14:46:16 user nova-compute[70924]:       <log file="/opt/stack/data/nova/instances/c86d8c87-6b21-4475-ab26-68ad706a4845/console.log" append="off"/>
Jul 29 14:46:16 user nova-compute[70924]:     </serial>
Jul 29 14:46:16 user nova-compute[70924]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 14:46:16 user nova-compute[70924]:     <video>
Jul 29 14:46:16 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:46:16 user nova-compute[70924]:     </video>
Jul 29 14:46:16 user nova-compute[70924]:     <rng model="virtio">
Jul 29 14:46:16 user nova-compute[70924]:       <backend model="random">/dev/urandom</backend>
Jul 29 14:46:16 user nova-compute[70924]:     </rng>
Jul 29 14:46:16 user nova-compute[70924]:     <controller type="usb" index="0" model="none"/>
Jul 29 14:46:16 user nova-compute[70924]:     <memballoon model="virtio">
Jul 29 14:46:16 user nova-compute[70924]:       <stats period="10"/>
Jul 29 14:46:16 user nova-compute[70924]:     </memballoon>
Jul 29 14:46:16 user nova-compute[70924]:   </devices>
Jul 29 14:46:16 user nova-compute[70924]: </domain>
Jul 29 14:46:16 user nova-compute[70924]:  {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 14:46:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:46:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1542441009',display_name='tempest-VolumesActionsTest-instance-1542441009',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1542441009',id=17,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47334cc65f984a95b4c6c06d3d8d1d40',ramdisk_id='',reservation_id='r-6wndt43s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-325820960',owner_user_name='tempest-VolumesActionsTest-325820960-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:46:14Z,user_data=None,user_id='3b1d926fc4c646dba0bf9e852302a13b',uuid=c86d8c87-6b21-4475-ab26-68ad706a4845,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "586735a0-4e44-4217-8840-335d8ff7c6e9", "address": "fa:16:3e:e5:9b:88", "network": {"id": "0bec09f1-f460-4e97-917e-84769ed49901", "bridge": "br-int", "label": "tempest-VolumesActionsTest-956399393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47334cc65f984a95b4c6c06d3d8d1d40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap586735a0-4e", "ovs_interfaceid": "586735a0-4e44-4217-8840-335d8ff7c6e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 14:46:16 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Converting VIF {"id": "586735a0-4e44-4217-8840-335d8ff7c6e9", "address": "fa:16:3e:e5:9b:88", "network": {"id": "0bec09f1-f460-4e97-917e-84769ed49901", "bridge": "br-int", "label": "tempest-VolumesActionsTest-956399393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47334cc65f984a95b4c6c06d3d8d1d40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap586735a0-4e", "ovs_interfaceid": "586735a0-4e44-4217-8840-335d8ff7c6e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:46:16 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:9b:88,bridge_name='br-int',has_traffic_filtering=True,id=586735a0-4e44-4217-8840-335d8ff7c6e9,network=Network(0bec09f1-f460-4e97-917e-84769ed49901),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap586735a0-4e') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:46:16 user nova-compute[70924]: DEBUG os_vif [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:9b:88,bridge_name='br-int',has_traffic_filtering=True,id=586735a0-4e44-4217-8840-335d8ff7c6e9,network=Network(0bec09f1-f460-4e97-917e-84769ed49901),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap586735a0-4e') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 14:46:16 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:16 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:46:16 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 14:46:16 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:16 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap586735a0-4e, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:46:16 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap586735a0-4e, col_values=(('external_ids', {'iface-id': '586735a0-4e44-4217-8840-335d8ff7c6e9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:9b:88', 'vm-uuid': 'c86d8c87-6b21-4475-ab26-68ad706a4845'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:46:16 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:16 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:46:16 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:16 user nova-compute[70924]: INFO os_vif [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:9b:88,bridge_name='br-int',has_traffic_filtering=True,id=586735a0-4e44-4217-8840-335d8ff7c6e9,network=Network(0bec09f1-f460-4e97-917e-84769ed49901),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap586735a0-4e')
Jul 29 14:46:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:46:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] No VIF found with MAC fa:16:3e:e5:9b:88, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:46:16 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:17 user nova-compute[70924]: DEBUG nova.network.neutron [req-728da5a1-6e95-4af5-8b9a-035495a52a25 req-ddebac6c-9c6c-414f-8662-2fc35f4da430 service nova] [instance: c86d8c87-6b21-4475-ab26-68ad706a4845] Updated VIF entry in instance network info cache for port 586735a0-4e44-4217-8840-335d8ff7c6e9. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:46:17 user nova-compute[70924]: DEBUG nova.network.neutron [req-728da5a1-6e95-4af5-8b9a-035495a52a25 req-ddebac6c-9c6c-414f-8662-2fc35f4da430 service nova] [instance: c86d8c87-6b21-4475-ab26-68ad706a4845] Updating instance_info_cache with network_info: [{"id": "586735a0-4e44-4217-8840-335d8ff7c6e9", "address": "fa:16:3e:e5:9b:88", "network": {"id": "0bec09f1-f460-4e97-917e-84769ed49901", "bridge": "br-int", "label": "tempest-VolumesActionsTest-956399393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47334cc65f984a95b4c6c06d3d8d1d40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap586735a0-4e", "ovs_interfaceid": "586735a0-4e44-4217-8840-335d8ff7c6e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:46:17 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-728da5a1-6e95-4af5-8b9a-035495a52a25 req-ddebac6c-9c6c-414f-8662-2fc35f4da430 service nova] Releasing lock "refresh_cache-c86d8c87-6b21-4475-ab26-68ad706a4845" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:46:18 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:18 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:18 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:18 user nova-compute[70924]: DEBUG nova.compute.manager [req-6d5b73c8-d590-4311-b579-9b6614c0b4e4 req-8c18d83a-8279-4949-b39e-c0d3ed2661f8 service nova] [instance: c86d8c87-6b21-4475-ab26-68ad706a4845] Received event network-vif-plugged-586735a0-4e44-4217-8840-335d8ff7c6e9 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:46:18 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-6d5b73c8-d590-4311-b579-9b6614c0b4e4 req-8c18d83a-8279-4949-b39e-c0d3ed2661f8 service nova] Acquiring lock "c86d8c87-6b21-4475-ab26-68ad706a4845-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:46:18 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-6d5b73c8-d590-4311-b579-9b6614c0b4e4 req-8c18d83a-8279-4949-b39e-c0d3ed2661f8 service nova] Lock "c86d8c87-6b21-4475-ab26-68ad706a4845-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:46:18 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-6d5b73c8-d590-4311-b579-9b6614c0b4e4 req-8c18d83a-8279-4949-b39e-c0d3ed2661f8 service nova] Lock "c86d8c87-6b21-4475-ab26-68ad706a4845-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:46:18 user nova-compute[70924]: DEBUG nova.compute.manager [req-6d5b73c8-d590-4311-b579-9b6614c0b4e4 req-8c18d83a-8279-4949-b39e-c0d3ed2661f8 service nova] [instance: c86d8c87-6b21-4475-ab26-68ad706a4845] No waiting events found dispatching network-vif-plugged-586735a0-4e44-4217-8840-335d8ff7c6e9 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:46:18 user nova-compute[70924]: WARNING nova.compute.manager [req-6d5b73c8-d590-4311-b579-9b6614c0b4e4 req-8c18d83a-8279-4949-b39e-c0d3ed2661f8 service nova] [instance: c86d8c87-6b21-4475-ab26-68ad706a4845] Received unexpected event network-vif-plugged-586735a0-4e44-4217-8840-335d8ff7c6e9 for instance with vm_state building and task_state spawning.
Jul 29 14:46:18 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:18 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:20 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690641980.5350707, c86d8c87-6b21-4475-ab26-68ad706a4845 => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:46:20 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: c86d8c87-6b21-4475-ab26-68ad706a4845] VM Resumed (Lifecycle Event)
Jul 29 14:46:20 user nova-compute[70924]: DEBUG nova.compute.manager [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: c86d8c87-6b21-4475-ab26-68ad706a4845] Instance event wait completed in 0 seconds for  {{(pid=70924) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 14:46:20 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: c86d8c87-6b21-4475-ab26-68ad706a4845] Guest created on hypervisor {{(pid=70924) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 14:46:20 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: c86d8c87-6b21-4475-ab26-68ad706a4845] Instance spawned successfully.
Jul 29 14:46:20 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: c86d8c87-6b21-4475-ab26-68ad706a4845] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 14:46:20 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: c86d8c87-6b21-4475-ab26-68ad706a4845] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:46:20 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: c86d8c87-6b21-4475-ab26-68ad706a4845] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:46:20 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: c86d8c87-6b21-4475-ab26-68ad706a4845] Found default for hw_cdrom_bus of ide {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:46:20 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: c86d8c87-6b21-4475-ab26-68ad706a4845] Found default for hw_disk_bus of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:46:20 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: c86d8c87-6b21-4475-ab26-68ad706a4845] Found default for hw_input_bus of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:46:20 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: c86d8c87-6b21-4475-ab26-68ad706a4845] Found default for hw_pointer_model of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:46:20 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: c86d8c87-6b21-4475-ab26-68ad706a4845] Found default for hw_video_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:46:20 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: c86d8c87-6b21-4475-ab26-68ad706a4845] Found default for hw_vif_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:46:20 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: c86d8c87-6b21-4475-ab26-68ad706a4845] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:46:20 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690641980.5387058, c86d8c87-6b21-4475-ab26-68ad706a4845 => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:46:20 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: c86d8c87-6b21-4475-ab26-68ad706a4845] VM Started (Lifecycle Event)
Jul 29 14:46:20 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: c86d8c87-6b21-4475-ab26-68ad706a4845] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:46:20 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: c86d8c87-6b21-4475-ab26-68ad706a4845] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:46:20 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: c86d8c87-6b21-4475-ab26-68ad706a4845] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:46:20 user nova-compute[70924]: INFO nova.compute.manager [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: c86d8c87-6b21-4475-ab26-68ad706a4845] Took 6.72 seconds to spawn the instance on the hypervisor.
Jul 29 14:46:20 user nova-compute[70924]: DEBUG nova.compute.manager [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: c86d8c87-6b21-4475-ab26-68ad706a4845] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:46:20 user nova-compute[70924]: DEBUG nova.compute.manager [req-6b229b39-99e5-4c4c-934d-5a4e50389c5c req-3cc6f3f6-7870-46ea-8708-5b9748f83dc0 service nova] [instance: c86d8c87-6b21-4475-ab26-68ad706a4845] Received event network-vif-plugged-586735a0-4e44-4217-8840-335d8ff7c6e9 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:46:20 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-6b229b39-99e5-4c4c-934d-5a4e50389c5c req-3cc6f3f6-7870-46ea-8708-5b9748f83dc0 service nova] Acquiring lock "c86d8c87-6b21-4475-ab26-68ad706a4845-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:46:20 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-6b229b39-99e5-4c4c-934d-5a4e50389c5c req-3cc6f3f6-7870-46ea-8708-5b9748f83dc0 service nova] Lock "c86d8c87-6b21-4475-ab26-68ad706a4845-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:46:20 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-6b229b39-99e5-4c4c-934d-5a4e50389c5c req-3cc6f3f6-7870-46ea-8708-5b9748f83dc0 service nova] Lock "c86d8c87-6b21-4475-ab26-68ad706a4845-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:46:20 user nova-compute[70924]: DEBUG nova.compute.manager [req-6b229b39-99e5-4c4c-934d-5a4e50389c5c req-3cc6f3f6-7870-46ea-8708-5b9748f83dc0 service nova] [instance: c86d8c87-6b21-4475-ab26-68ad706a4845] No waiting events found dispatching network-vif-plugged-586735a0-4e44-4217-8840-335d8ff7c6e9 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:46:20 user nova-compute[70924]: WARNING nova.compute.manager [req-6b229b39-99e5-4c4c-934d-5a4e50389c5c req-3cc6f3f6-7870-46ea-8708-5b9748f83dc0 service nova] [instance: c86d8c87-6b21-4475-ab26-68ad706a4845] Received unexpected event network-vif-plugged-586735a0-4e44-4217-8840-335d8ff7c6e9 for instance with vm_state building and task_state spawning.
Jul 29 14:46:20 user nova-compute[70924]: INFO nova.compute.manager [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: c86d8c87-6b21-4475-ab26-68ad706a4845] Took 7.56 seconds to build instance.
Jul 29 14:46:20 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0818ed8c-1274-4eac-94df-5e9267be783f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Lock "c86d8c87-6b21-4475-ab26-68ad706a4845" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.654s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:46:21 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-01e66a05-689d-4c82-933a-3bf55bac1d59 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Acquiring lock "0d2a0fe9-f17a-40b5-8252-6eff34fa618f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:46:21 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-01e66a05-689d-4c82-933a-3bf55bac1d59 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Lock "0d2a0fe9-f17a-40b5-8252-6eff34fa618f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:46:21 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-01e66a05-689d-4c82-933a-3bf55bac1d59 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Acquiring lock "0d2a0fe9-f17a-40b5-8252-6eff34fa618f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:46:21 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-01e66a05-689d-4c82-933a-3bf55bac1d59 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Lock "0d2a0fe9-f17a-40b5-8252-6eff34fa618f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:46:21 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-01e66a05-689d-4c82-933a-3bf55bac1d59 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Lock "0d2a0fe9-f17a-40b5-8252-6eff34fa618f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:46:21 user nova-compute[70924]: INFO nova.compute.manager [None req-01e66a05-689d-4c82-933a-3bf55bac1d59 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] Terminating instance
Jul 29 14:46:21 user nova-compute[70924]: DEBUG nova.compute.manager [None req-01e66a05-689d-4c82-933a-3bf55bac1d59 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] Start destroying the instance on the hypervisor. {{(pid=70924) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 14:46:21 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:21 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:21 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:21 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:21 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:22 user nova-compute[70924]: DEBUG nova.compute.manager [req-8e79661a-386e-4d1e-a3c5-d7943db23415 req-8af7df66-773a-44cd-8969-5b9b1b64d511 service nova] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] Received event network-vif-unplugged-726bb311-0a74-419a-bbd7-007aca63f8ee {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:46:22 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-8e79661a-386e-4d1e-a3c5-d7943db23415 req-8af7df66-773a-44cd-8969-5b9b1b64d511 service nova] Acquiring lock "0d2a0fe9-f17a-40b5-8252-6eff34fa618f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:46:22 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-8e79661a-386e-4d1e-a3c5-d7943db23415 req-8af7df66-773a-44cd-8969-5b9b1b64d511 service nova] Lock "0d2a0fe9-f17a-40b5-8252-6eff34fa618f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:46:22 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-8e79661a-386e-4d1e-a3c5-d7943db23415 req-8af7df66-773a-44cd-8969-5b9b1b64d511 service nova] Lock "0d2a0fe9-f17a-40b5-8252-6eff34fa618f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:46:22 user nova-compute[70924]: DEBUG nova.compute.manager [req-8e79661a-386e-4d1e-a3c5-d7943db23415 req-8af7df66-773a-44cd-8969-5b9b1b64d511 service nova] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] No waiting events found dispatching network-vif-unplugged-726bb311-0a74-419a-bbd7-007aca63f8ee {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:46:22 user nova-compute[70924]: DEBUG nova.compute.manager [req-8e79661a-386e-4d1e-a3c5-d7943db23415 req-8af7df66-773a-44cd-8969-5b9b1b64d511 service nova] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] Received event network-vif-unplugged-726bb311-0a74-419a-bbd7-007aca63f8ee for instance with task_state deleting. {{(pid=70924) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 14:46:22 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] Instance destroyed successfully.
Jul 29 14:46:22 user nova-compute[70924]: DEBUG nova.objects.instance [None req-01e66a05-689d-4c82-933a-3bf55bac1d59 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Lazy-loading 'resources' on Instance uuid 0d2a0fe9-f17a-40b5-8252-6eff34fa618f {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:46:22 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-01e66a05-689d-4c82-933a-3bf55bac1d59 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:44:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-398399675',display_name='tempest-VolumesAdminNegativeTest-server-398399675',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-398399675',id=14,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:44:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4c7e4c0801264e7794b962f8856e5734',ramdisk_id='',reservation_id='r-hksbuuf6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-831352148',owner_user_name='tempest-VolumesAdminNegativeTest-831352148-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:44:29Z,user_data=None,user_id='e86112b87b2d47d88ac5fb9b6fccb31c',uuid=0d2a0fe9-f17a-40b5-8252-6eff34fa618f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "726bb311-0a74-419a-bbd7-007aca63f8ee", "address": "fa:16:3e:66:a3:9f", "network": {"id": "40edab25-ab3a-4874-b47f-1ffa2b5452ee", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1511348766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c7e4c0801264e7794b962f8856e5734", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap726bb311-0a", "ovs_interfaceid": "726bb311-0a74-419a-bbd7-007aca63f8ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 14:46:22 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-01e66a05-689d-4c82-933a-3bf55bac1d59 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Converting VIF {"id": "726bb311-0a74-419a-bbd7-007aca63f8ee", "address": "fa:16:3e:66:a3:9f", "network": {"id": "40edab25-ab3a-4874-b47f-1ffa2b5452ee", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1511348766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c7e4c0801264e7794b962f8856e5734", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap726bb311-0a", "ovs_interfaceid": "726bb311-0a74-419a-bbd7-007aca63f8ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:46:22 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-01e66a05-689d-4c82-933a-3bf55bac1d59 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:a3:9f,bridge_name='br-int',has_traffic_filtering=True,id=726bb311-0a74-419a-bbd7-007aca63f8ee,network=Network(40edab25-ab3a-4874-b47f-1ffa2b5452ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap726bb311-0a') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:46:22 user nova-compute[70924]: DEBUG os_vif [None req-01e66a05-689d-4c82-933a-3bf55bac1d59 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:a3:9f,bridge_name='br-int',has_traffic_filtering=True,id=726bb311-0a74-419a-bbd7-007aca63f8ee,network=Network(40edab25-ab3a-4874-b47f-1ffa2b5452ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap726bb311-0a') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 14:46:22 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:22 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap726bb311-0a, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:46:22 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:22 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:46:22 user nova-compute[70924]: INFO os_vif [None req-01e66a05-689d-4c82-933a-3bf55bac1d59 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:a3:9f,bridge_name='br-int',has_traffic_filtering=True,id=726bb311-0a74-419a-bbd7-007aca63f8ee,network=Network(40edab25-ab3a-4874-b47f-1ffa2b5452ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap726bb311-0a')
Jul 29 14:46:22 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-01e66a05-689d-4c82-933a-3bf55bac1d59 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] Deleting instance files /opt/stack/data/nova/instances/0d2a0fe9-f17a-40b5-8252-6eff34fa618f_del
Jul 29 14:46:22 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-01e66a05-689d-4c82-933a-3bf55bac1d59 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] Deletion of /opt/stack/data/nova/instances/0d2a0fe9-f17a-40b5-8252-6eff34fa618f_del complete
Jul 29 14:46:22 user nova-compute[70924]: INFO nova.compute.manager [None req-01e66a05-689d-4c82-933a-3bf55bac1d59 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] Took 1.37 seconds to destroy the instance on the hypervisor.
Jul 29 14:46:22 user nova-compute[70924]: DEBUG oslo.service.loopingcall [None req-01e66a05-689d-4c82-933a-3bf55bac1d59 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70924) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 14:46:22 user nova-compute[70924]: DEBUG nova.compute.manager [-] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] Deallocating network for instance {{(pid=70924) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 14:46:22 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] deallocate_for_instance() {{(pid=70924) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 14:46:23 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:24 user nova-compute[70924]: DEBUG nova.compute.manager [req-8aa255fd-66f0-4a39-ba02-591831c1e42c req-5995e60e-8307-4c02-bedb-261a47c769ca service nova] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] Received event network-vif-plugged-726bb311-0a74-419a-bbd7-007aca63f8ee {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:46:24 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-8aa255fd-66f0-4a39-ba02-591831c1e42c req-5995e60e-8307-4c02-bedb-261a47c769ca service nova] Acquiring lock "0d2a0fe9-f17a-40b5-8252-6eff34fa618f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:46:24 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-8aa255fd-66f0-4a39-ba02-591831c1e42c req-5995e60e-8307-4c02-bedb-261a47c769ca service nova] Lock "0d2a0fe9-f17a-40b5-8252-6eff34fa618f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:46:24 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-8aa255fd-66f0-4a39-ba02-591831c1e42c req-5995e60e-8307-4c02-bedb-261a47c769ca service nova] Lock "0d2a0fe9-f17a-40b5-8252-6eff34fa618f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:46:24 user nova-compute[70924]: DEBUG nova.compute.manager [req-8aa255fd-66f0-4a39-ba02-591831c1e42c req-5995e60e-8307-4c02-bedb-261a47c769ca service nova] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] No waiting events found dispatching network-vif-plugged-726bb311-0a74-419a-bbd7-007aca63f8ee {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:46:24 user nova-compute[70924]: WARNING nova.compute.manager [req-8aa255fd-66f0-4a39-ba02-591831c1e42c req-5995e60e-8307-4c02-bedb-261a47c769ca service nova] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] Received unexpected event network-vif-plugged-726bb311-0a74-419a-bbd7-007aca63f8ee for instance with vm_state active and task_state deleting.
Jul 29 14:46:24 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:46:24 user nova-compute[70924]: DEBUG nova.compute.manager [req-6565d1f1-a1e8-46ae-add8-10588e30b61e req-289ec71a-f35d-4db8-af9e-b7ee2c3f8296 service nova] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] Received event network-vif-deleted-726bb311-0a74-419a-bbd7-007aca63f8ee {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:46:24 user nova-compute[70924]: INFO nova.compute.manager [req-6565d1f1-a1e8-46ae-add8-10588e30b61e req-289ec71a-f35d-4db8-af9e-b7ee2c3f8296 service nova] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] Neutron deleted interface 726bb311-0a74-419a-bbd7-007aca63f8ee; detaching it from the instance and deleting it from the info cache
Jul 29 14:46:24 user nova-compute[70924]: DEBUG nova.network.neutron [req-6565d1f1-a1e8-46ae-add8-10588e30b61e req-289ec71a-f35d-4db8-af9e-b7ee2c3f8296 service nova] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:46:24 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] Took 1.51 seconds to deallocate network for instance.
Jul 29 14:46:24 user nova-compute[70924]: DEBUG nova.compute.manager [req-6565d1f1-a1e8-46ae-add8-10588e30b61e req-289ec71a-f35d-4db8-af9e-b7ee2c3f8296 service nova] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] Detach interface failed, port_id=726bb311-0a74-419a-bbd7-007aca63f8ee, reason: Instance 0d2a0fe9-f17a-40b5-8252-6eff34fa618f could not be found. {{(pid=70924) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 29 14:46:24 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-01e66a05-689d-4c82-933a-3bf55bac1d59 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:46:24 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-01e66a05-689d-4c82-933a-3bf55bac1d59 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:46:24 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-01e66a05-689d-4c82-933a-3bf55bac1d59 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:46:24 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-01e66a05-689d-4c82-933a-3bf55bac1d59 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:46:24 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-01e66a05-689d-4c82-933a-3bf55bac1d59 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.432s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:46:25 user nova-compute[70924]: INFO nova.scheduler.client.report [None req-01e66a05-689d-4c82-933a-3bf55bac1d59 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Deleted allocations for instance 0d2a0fe9-f17a-40b5-8252-6eff34fa618f
Jul 29 14:46:25 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-01e66a05-689d-4c82-933a-3bf55bac1d59 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Lock "0d2a0fe9-f17a-40b5-8252-6eff34fa618f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.551s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:46:25 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:31 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Acquiring lock "f5350fb5-9460-490b-a47e-74f88c8eb51c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:46:31 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Lock "f5350fb5-9460-490b-a47e-74f88c8eb51c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:46:31 user nova-compute[70924]: DEBUG nova.compute.manager [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Starting instance... {{(pid=70924) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 14:46:32 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:46:32 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:46:32 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70924) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 14:46:32 user nova-compute[70924]: INFO nova.compute.claims [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Claim successful on node user
Jul 29 14:46:32 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:46:32 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:46:32 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:32 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.522s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:46:32 user nova-compute[70924]: DEBUG nova.compute.manager [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Start building networks asynchronously for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 14:46:32 user nova-compute[70924]: DEBUG nova.compute.manager [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Allocating IP information in the background. {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 14:46:32 user nova-compute[70924]: DEBUG nova.network.neutron [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] allocate_for_instance() {{(pid=70924) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 14:46:32 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 14:46:32 user nova-compute[70924]: DEBUG nova.compute.manager [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Start building block device mappings for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 14:46:32 user nova-compute[70924]: DEBUG nova.policy [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6e2628064a66492e9f85e99332ac3ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd007df2b3e04ab784369809178e4240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70924) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 14:46:32 user nova-compute[70924]: DEBUG nova.compute.manager [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Start spawning the instance on the hypervisor. {{(pid=70924) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 14:46:32 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Creating instance directory {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 14:46:32 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Creating image(s)
Jul 29 14:46:32 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Acquiring lock "/opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:46:32 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Lock "/opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:46:32 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Lock "/opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:46:32 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:46:33 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.147s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:46:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Acquiring lock "bd72453517468710f1de26b27fb0ea28688e9009" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:46:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:46:33 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:46:33 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.150s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:46:33 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c/disk 1073741824 {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:46:33 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:33 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c/disk 1073741824" returned: 0 in 0.058s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:46:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.215s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:46:33 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:46:33 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.159s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:46:33 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c/disk. size=1073741824 {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 14:46:33 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:46:33 user nova-compute[70924]: DEBUG nova.network.neutron [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Successfully created port: c4a5a7c9-34d6-4040-87a3-78c4fd26b170 {{(pid=70924) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 14:46:33 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:46:33 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Cannot resize image /opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c/disk to a smaller size. {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 14:46:33 user nova-compute[70924]: DEBUG nova.objects.instance [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Lazy-loading 'migration_context' on Instance uuid f5350fb5-9460-490b-a47e-74f88c8eb51c {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:46:33 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Created local disks {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 14:46:33 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Ensure instance console log exists: /opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c/console.log {{(pid=70924) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 14:46:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:46:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:46:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:46:34 user nova-compute[70924]: DEBUG nova.network.neutron [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Successfully updated port: c4a5a7c9-34d6-4040-87a3-78c4fd26b170 {{(pid=70924) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 14:46:34 user nova-compute[70924]: DEBUG nova.compute.manager [req-b126adf1-fa02-4cdd-96db-828817c42523 req-51b13865-88d7-461e-8f22-684f8767e66b service nova] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Received event network-changed-c4a5a7c9-34d6-4040-87a3-78c4fd26b170 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:46:34 user nova-compute[70924]: DEBUG nova.compute.manager [req-b126adf1-fa02-4cdd-96db-828817c42523 req-51b13865-88d7-461e-8f22-684f8767e66b service nova] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Refreshing instance network info cache due to event network-changed-c4a5a7c9-34d6-4040-87a3-78c4fd26b170. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:46:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b126adf1-fa02-4cdd-96db-828817c42523 req-51b13865-88d7-461e-8f22-684f8767e66b service nova] Acquiring lock "refresh_cache-f5350fb5-9460-490b-a47e-74f88c8eb51c" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:46:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b126adf1-fa02-4cdd-96db-828817c42523 req-51b13865-88d7-461e-8f22-684f8767e66b service nova] Acquired lock "refresh_cache-f5350fb5-9460-490b-a47e-74f88c8eb51c" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:46:34 user nova-compute[70924]: DEBUG nova.network.neutron [req-b126adf1-fa02-4cdd-96db-828817c42523 req-51b13865-88d7-461e-8f22-684f8767e66b service nova] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Refreshing network info cache for port c4a5a7c9-34d6-4040-87a3-78c4fd26b170 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:46:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Acquiring lock "refresh_cache-f5350fb5-9460-490b-a47e-74f88c8eb51c" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:46:34 user nova-compute[70924]: DEBUG nova.network.neutron [req-b126adf1-fa02-4cdd-96db-828817c42523 req-51b13865-88d7-461e-8f22-684f8767e66b service nova] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Instance cache missing network info. {{(pid=70924) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 14:46:34 user nova-compute[70924]: DEBUG nova.network.neutron [req-b126adf1-fa02-4cdd-96db-828817c42523 req-51b13865-88d7-461e-8f22-684f8767e66b service nova] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:46:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b126adf1-fa02-4cdd-96db-828817c42523 req-51b13865-88d7-461e-8f22-684f8767e66b service nova] Releasing lock "refresh_cache-f5350fb5-9460-490b-a47e-74f88c8eb51c" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:46:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Acquired lock "refresh_cache-f5350fb5-9460-490b-a47e-74f88c8eb51c" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:46:34 user nova-compute[70924]: DEBUG nova.network.neutron [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 14:46:34 user nova-compute[70924]: DEBUG nova.network.neutron [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Instance cache missing network info. {{(pid=70924) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 14:46:34 user nova-compute[70924]: DEBUG nova.network.neutron [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Updating instance_info_cache with network_info: [{"id": "c4a5a7c9-34d6-4040-87a3-78c4fd26b170", "address": "fa:16:3e:90:f1:53", "network": {"id": "d87dd51f-8870-4dfa-b608-7c4b662219ca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1964327887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd007df2b3e04ab784369809178e4240", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a5a7c9-34", "ovs_interfaceid": "c4a5a7c9-34d6-4040-87a3-78c4fd26b170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:46:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Releasing lock "refresh_cache-f5350fb5-9460-490b-a47e-74f88c8eb51c" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:46:35 user nova-compute[70924]: DEBUG nova.compute.manager [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Instance network_info: |[{"id": "c4a5a7c9-34d6-4040-87a3-78c4fd26b170", "address": "fa:16:3e:90:f1:53", "network": {"id": "d87dd51f-8870-4dfa-b608-7c4b662219ca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1964327887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd007df2b3e04ab784369809178e4240", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a5a7c9-34", "ovs_interfaceid": "c4a5a7c9-34d6-4040-87a3-78c4fd26b170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 14:46:35 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Start _get_guest_xml network_info=[{"id": "c4a5a7c9-34d6-4040-87a3-78c4fd26b170", "address": "fa:16:3e:90:f1:53", "network": {"id": "d87dd51f-8870-4dfa-b608-7c4b662219ca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1964327887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd007df2b3e04ab784369809178e4240", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a5a7c9-34", "ovs_interfaceid": "c4a5a7c9-34d6-4040-87a3-78c4fd26b170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '3aba2e73-6832-404b-8bd0-d0503ce82b8c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 14:46:35 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:46:35 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:46:35 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 14:46:35 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] CPU controller missing on host. {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 14:46:35 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 14:46:35 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] CPU controller found on host. {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 14:46:35 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70924) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 14:46:35 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T14:36:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 14:46:35 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Flavor limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 14:46:35 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Image limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 14:46:35 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Flavor pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 14:46:35 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Image pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 14:46:35 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 14:46:35 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 14:46:35 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 14:46:35 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Got 1 possible topologies {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 14:46:35 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 14:46:35 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 14:46:35 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:46:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1255761132',display_name='tempest-ServerActionsTestOtherB-server-1255761132',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1255761132',id=18,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIBMm7U7DNUnZfHvCCwqmdK01H/F7FPPtGEiHdQU/UfZbvDiHS9WyDAl4KpLKXM2BWrjymDoAA5PpeT/LkSZzEFYL6ZRKv5TsemED0bunybXK/h2EPtICo6kFvAJz1A93g==',key_name='tempest-keypair-566023039',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd007df2b3e04ab784369809178e4240',ramdisk_id='',reservation_id='r-z4t1omey',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-298005467',owner_user_name='tempest-ServerActionsTestOtherB-298005467-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:46:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6e2628064a66492e9f85e99332ac3ceb',uuid=f5350fb5-9460-490b-a47e-74f88c8eb51c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c4a5a7c9-34d6-4040-87a3-78c4fd26b170", "address": "fa:16:3e:90:f1:53", "network": {"id": "d87dd51f-8870-4dfa-b608-7c4b662219ca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1964327887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd007df2b3e04ab784369809178e4240", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a5a7c9-34", "ovs_interfaceid": "c4a5a7c9-34d6-4040-87a3-78c4fd26b170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:46:35 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Converting VIF {"id": "c4a5a7c9-34d6-4040-87a3-78c4fd26b170", "address": "fa:16:3e:90:f1:53", "network": {"id": "d87dd51f-8870-4dfa-b608-7c4b662219ca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1964327887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd007df2b3e04ab784369809178e4240", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a5a7c9-34", "ovs_interfaceid": "c4a5a7c9-34d6-4040-87a3-78c4fd26b170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:46:35 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:f1:53,bridge_name='br-int',has_traffic_filtering=True,id=c4a5a7c9-34d6-4040-87a3-78c4fd26b170,network=Network(d87dd51f-8870-4dfa-b608-7c4b662219ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4a5a7c9-34') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:46:35 user nova-compute[70924]: DEBUG nova.objects.instance [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Lazy-loading 'pci_devices' on Instance uuid f5350fb5-9460-490b-a47e-74f88c8eb51c {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:46:35 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] End _get_guest_xml xml=<domain type="kvm">
Jul 29 14:46:35 user nova-compute[70924]:   <uuid>f5350fb5-9460-490b-a47e-74f88c8eb51c</uuid>
Jul 29 14:46:35 user nova-compute[70924]:   <name>instance-00000012</name>
Jul 29 14:46:35 user nova-compute[70924]:   <memory>524288</memory>
Jul 29 14:46:35 user nova-compute[70924]:   <vcpu>1</vcpu>
Jul 29 14:46:35 user nova-compute[70924]:   <metadata>
Jul 29 14:46:35 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 14:46:35 user nova-compute[70924]:       <nova:package version="0.0.0"/>
Jul 29 14:46:35 user nova-compute[70924]:       <nova:name>tempest-ServerActionsTestOtherB-server-1255761132</nova:name>
Jul 29 14:46:35 user nova-compute[70924]:       <nova:creationTime>2023-07-29 14:46:35</nova:creationTime>
Jul 29 14:46:35 user nova-compute[70924]:       <nova:flavor name="m1.tiny">
Jul 29 14:46:35 user nova-compute[70924]:         <nova:memory>512</nova:memory>
Jul 29 14:46:35 user nova-compute[70924]:         <nova:disk>1</nova:disk>
Jul 29 14:46:35 user nova-compute[70924]:         <nova:swap>0</nova:swap>
Jul 29 14:46:35 user nova-compute[70924]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 14:46:35 user nova-compute[70924]:         <nova:vcpus>1</nova:vcpus>
Jul 29 14:46:35 user nova-compute[70924]:       </nova:flavor>
Jul 29 14:46:35 user nova-compute[70924]:       <nova:owner>
Jul 29 14:46:35 user nova-compute[70924]:         <nova:user uuid="6e2628064a66492e9f85e99332ac3ceb">tempest-ServerActionsTestOtherB-298005467-project-member</nova:user>
Jul 29 14:46:35 user nova-compute[70924]:         <nova:project uuid="fd007df2b3e04ab784369809178e4240">tempest-ServerActionsTestOtherB-298005467</nova:project>
Jul 29 14:46:35 user nova-compute[70924]:       </nova:owner>
Jul 29 14:46:35 user nova-compute[70924]:       <nova:root type="image" uuid="3aba2e73-6832-404b-8bd0-d0503ce82b8c"/>
Jul 29 14:46:35 user nova-compute[70924]:       <nova:ports>
Jul 29 14:46:35 user nova-compute[70924]:         <nova:port uuid="c4a5a7c9-34d6-4040-87a3-78c4fd26b170">
Jul 29 14:46:35 user nova-compute[70924]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 29 14:46:35 user nova-compute[70924]:         </nova:port>
Jul 29 14:46:35 user nova-compute[70924]:       </nova:ports>
Jul 29 14:46:35 user nova-compute[70924]:     </nova:instance>
Jul 29 14:46:35 user nova-compute[70924]:   </metadata>
Jul 29 14:46:35 user nova-compute[70924]:   <sysinfo type="smbios">
Jul 29 14:46:35 user nova-compute[70924]:     <system>
Jul 29 14:46:35 user nova-compute[70924]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 14:46:35 user nova-compute[70924]:       <entry name="product">OpenStack Nova</entry>
Jul 29 14:46:35 user nova-compute[70924]:       <entry name="version">0.0.0</entry>
Jul 29 14:46:35 user nova-compute[70924]:       <entry name="serial">f5350fb5-9460-490b-a47e-74f88c8eb51c</entry>
Jul 29 14:46:35 user nova-compute[70924]:       <entry name="uuid">f5350fb5-9460-490b-a47e-74f88c8eb51c</entry>
Jul 29 14:46:35 user nova-compute[70924]:       <entry name="family">Virtual Machine</entry>
Jul 29 14:46:35 user nova-compute[70924]:     </system>
Jul 29 14:46:35 user nova-compute[70924]:   </sysinfo>
Jul 29 14:46:35 user nova-compute[70924]:   <os>
Jul 29 14:46:35 user nova-compute[70924]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 14:46:35 user nova-compute[70924]:     <boot dev="hd"/>
Jul 29 14:46:35 user nova-compute[70924]:     <smbios mode="sysinfo"/>
Jul 29 14:46:35 user nova-compute[70924]:   </os>
Jul 29 14:46:35 user nova-compute[70924]:   <features>
Jul 29 14:46:35 user nova-compute[70924]:     <acpi/>
Jul 29 14:46:35 user nova-compute[70924]:     <apic/>
Jul 29 14:46:35 user nova-compute[70924]:     <vmcoreinfo/>
Jul 29 14:46:35 user nova-compute[70924]:   </features>
Jul 29 14:46:35 user nova-compute[70924]:   <clock offset="utc">
Jul 29 14:46:35 user nova-compute[70924]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 14:46:35 user nova-compute[70924]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 14:46:35 user nova-compute[70924]:     <timer name="hpet" present="no"/>
Jul 29 14:46:35 user nova-compute[70924]:   </clock>
Jul 29 14:46:35 user nova-compute[70924]:   <cpu mode="custom" match="exact">
Jul 29 14:46:35 user nova-compute[70924]:     <model>Nehalem</model>
Jul 29 14:46:35 user nova-compute[70924]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 14:46:35 user nova-compute[70924]:   </cpu>
Jul 29 14:46:35 user nova-compute[70924]:   <devices>
Jul 29 14:46:35 user nova-compute[70924]:     <disk type="file" device="disk">
Jul 29 14:46:35 user nova-compute[70924]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 14:46:35 user nova-compute[70924]:       <source file="/opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c/disk"/>
Jul 29 14:46:35 user nova-compute[70924]:       <target dev="vda" bus="virtio"/>
Jul 29 14:46:35 user nova-compute[70924]:     </disk>
Jul 29 14:46:35 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 14:46:35 user nova-compute[70924]:       <mac address="fa:16:3e:90:f1:53"/>
Jul 29 14:46:35 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:46:35 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 14:46:35 user nova-compute[70924]:       <target dev="tapc4a5a7c9-34"/>
Jul 29 14:46:35 user nova-compute[70924]:     </interface>
Jul 29 14:46:35 user nova-compute[70924]:     <serial type="pty">
Jul 29 14:46:35 user nova-compute[70924]:       <log file="/opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c/console.log" append="off"/>
Jul 29 14:46:35 user nova-compute[70924]:     </serial>
Jul 29 14:46:35 user nova-compute[70924]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 14:46:35 user nova-compute[70924]:     <video>
Jul 29 14:46:35 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:46:35 user nova-compute[70924]:     </video>
Jul 29 14:46:35 user nova-compute[70924]:     <rng model="virtio">
Jul 29 14:46:35 user nova-compute[70924]:       <backend model="random">/dev/urandom</backend>
Jul 29 14:46:35 user nova-compute[70924]:     </rng>
Jul 29 14:46:35 user nova-compute[70924]:     <controller type="usb" index="0" model="none"/>
Jul 29 14:46:35 user nova-compute[70924]:     <memballoon model="virtio">
Jul 29 14:46:35 user nova-compute[70924]:       <stats period="10"/>
Jul 29 14:46:35 user nova-compute[70924]:     </memballoon>
Jul 29 14:46:35 user nova-compute[70924]:   </devices>
Jul 29 14:46:35 user nova-compute[70924]: </domain>
Jul 29 14:46:35 user nova-compute[70924]:  {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 14:46:35 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:46:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1255761132',display_name='tempest-ServerActionsTestOtherB-server-1255761132',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1255761132',id=18,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIBMm7U7DNUnZfHvCCwqmdK01H/F7FPPtGEiHdQU/UfZbvDiHS9WyDAl4KpLKXM2BWrjymDoAA5PpeT/LkSZzEFYL6ZRKv5TsemED0bunybXK/h2EPtICo6kFvAJz1A93g==',key_name='tempest-keypair-566023039',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd007df2b3e04ab784369809178e4240',ramdisk_id='',reservation_id='r-z4t1omey',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-298005467',owner_user_name='tempest-ServerActionsTestOtherB-298005467-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:46:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6e2628064a66492e9f85e99332ac3ceb',uuid=f5350fb5-9460-490b-a47e-74f88c8eb51c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c4a5a7c9-34d6-4040-87a3-78c4fd26b170", "address": "fa:16:3e:90:f1:53", "network": {"id": "d87dd51f-8870-4dfa-b608-7c4b662219ca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1964327887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd007df2b3e04ab784369809178e4240", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a5a7c9-34", "ovs_interfaceid": "c4a5a7c9-34d6-4040-87a3-78c4fd26b170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 14:46:35 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Converting VIF {"id": "c4a5a7c9-34d6-4040-87a3-78c4fd26b170", "address": "fa:16:3e:90:f1:53", "network": {"id": "d87dd51f-8870-4dfa-b608-7c4b662219ca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1964327887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd007df2b3e04ab784369809178e4240", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a5a7c9-34", "ovs_interfaceid": "c4a5a7c9-34d6-4040-87a3-78c4fd26b170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:46:35 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:f1:53,bridge_name='br-int',has_traffic_filtering=True,id=c4a5a7c9-34d6-4040-87a3-78c4fd26b170,network=Network(d87dd51f-8870-4dfa-b608-7c4b662219ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4a5a7c9-34') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:46:35 user nova-compute[70924]: DEBUG os_vif [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:f1:53,bridge_name='br-int',has_traffic_filtering=True,id=c4a5a7c9-34d6-4040-87a3-78c4fd26b170,network=Network(d87dd51f-8870-4dfa-b608-7c4b662219ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4a5a7c9-34') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 14:46:35 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:35 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:46:35 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 14:46:35 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:35 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc4a5a7c9-34, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:46:35 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc4a5a7c9-34, col_values=(('external_ids', {'iface-id': 'c4a5a7c9-34d6-4040-87a3-78c4fd26b170', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:f1:53', 'vm-uuid': 'f5350fb5-9460-490b-a47e-74f88c8eb51c'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:46:35 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:35 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:46:35 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:35 user nova-compute[70924]: INFO os_vif [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:f1:53,bridge_name='br-int',has_traffic_filtering=True,id=c4a5a7c9-34d6-4040-87a3-78c4fd26b170,network=Network(d87dd51f-8870-4dfa-b608-7c4b662219ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4a5a7c9-34')
Jul 29 14:46:35 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:46:35 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] No VIF found with MAC fa:16:3e:90:f1:53, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:46:36 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:36 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:36 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:36 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:36 user nova-compute[70924]: DEBUG nova.compute.manager [req-3b75d518-96f6-4cd0-8d93-f482f11f69b2 req-975bb022-d36b-4b4a-a1e8-b5e9e98d5821 service nova] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Received event network-vif-plugged-c4a5a7c9-34d6-4040-87a3-78c4fd26b170 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:46:36 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-3b75d518-96f6-4cd0-8d93-f482f11f69b2 req-975bb022-d36b-4b4a-a1e8-b5e9e98d5821 service nova] Acquiring lock "f5350fb5-9460-490b-a47e-74f88c8eb51c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:46:36 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-3b75d518-96f6-4cd0-8d93-f482f11f69b2 req-975bb022-d36b-4b4a-a1e8-b5e9e98d5821 service nova] Lock "f5350fb5-9460-490b-a47e-74f88c8eb51c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:46:36 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-3b75d518-96f6-4cd0-8d93-f482f11f69b2 req-975bb022-d36b-4b4a-a1e8-b5e9e98d5821 service nova] Lock "f5350fb5-9460-490b-a47e-74f88c8eb51c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:46:36 user nova-compute[70924]: DEBUG nova.compute.manager [req-3b75d518-96f6-4cd0-8d93-f482f11f69b2 req-975bb022-d36b-4b4a-a1e8-b5e9e98d5821 service nova] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] No waiting events found dispatching network-vif-plugged-c4a5a7c9-34d6-4040-87a3-78c4fd26b170 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:46:36 user nova-compute[70924]: WARNING nova.compute.manager [req-3b75d518-96f6-4cd0-8d93-f482f11f69b2 req-975bb022-d36b-4b4a-a1e8-b5e9e98d5821 service nova] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Received unexpected event network-vif-plugged-c4a5a7c9-34d6-4040-87a3-78c4fd26b170 for instance with vm_state building and task_state spawning.
Jul 29 14:46:37 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:37 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:37 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:37 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:37 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:37 user nova-compute[70924]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690641982.3733501, 0d2a0fe9-f17a-40b5-8252-6eff34fa618f => Stopped> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:46:37 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] VM Stopped (Lifecycle Event)
Jul 29 14:46:37 user nova-compute[70924]: DEBUG nova.compute.manager [None req-da2225d6-2856-43b5-be9c-6a0ce90310ce None None] [instance: 0d2a0fe9-f17a-40b5-8252-6eff34fa618f] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:46:38 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:38 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690641998.9423907, f5350fb5-9460-490b-a47e-74f88c8eb51c => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:46:38 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] VM Resumed (Lifecycle Event)
Jul 29 14:46:38 user nova-compute[70924]: DEBUG nova.compute.manager [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Instance event wait completed in 0 seconds for  {{(pid=70924) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 14:46:38 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Guest created on hypervisor {{(pid=70924) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 14:46:38 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Instance spawned successfully.
Jul 29 14:46:38 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 14:46:38 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:46:38 user nova-compute[70924]: DEBUG nova.compute.manager [req-4b7d9d7a-870d-4331-aa24-44efd21c51d8 req-519e5911-579d-4ae1-84f7-cf2ef1cf151d service nova] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Received event network-vif-plugged-c4a5a7c9-34d6-4040-87a3-78c4fd26b170 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:46:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-4b7d9d7a-870d-4331-aa24-44efd21c51d8 req-519e5911-579d-4ae1-84f7-cf2ef1cf151d service nova] Acquiring lock "f5350fb5-9460-490b-a47e-74f88c8eb51c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:46:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-4b7d9d7a-870d-4331-aa24-44efd21c51d8 req-519e5911-579d-4ae1-84f7-cf2ef1cf151d service nova] Lock "f5350fb5-9460-490b-a47e-74f88c8eb51c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:46:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-4b7d9d7a-870d-4331-aa24-44efd21c51d8 req-519e5911-579d-4ae1-84f7-cf2ef1cf151d service nova] Lock "f5350fb5-9460-490b-a47e-74f88c8eb51c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:46:38 user nova-compute[70924]: DEBUG nova.compute.manager [req-4b7d9d7a-870d-4331-aa24-44efd21c51d8 req-519e5911-579d-4ae1-84f7-cf2ef1cf151d service nova] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] No waiting events found dispatching network-vif-plugged-c4a5a7c9-34d6-4040-87a3-78c4fd26b170 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:46:38 user nova-compute[70924]: WARNING nova.compute.manager [req-4b7d9d7a-870d-4331-aa24-44efd21c51d8 req-519e5911-579d-4ae1-84f7-cf2ef1cf151d service nova] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Received unexpected event network-vif-plugged-c4a5a7c9-34d6-4040-87a3-78c4fd26b170 for instance with vm_state building and task_state spawning.
Jul 29 14:46:38 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:46:38 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Found default for hw_cdrom_bus of ide {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:46:38 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Found default for hw_disk_bus of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:46:38 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Found default for hw_input_bus of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:46:38 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Found default for hw_pointer_model of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:46:38 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Found default for hw_video_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:46:38 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Found default for hw_vif_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:46:39 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:46:39 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690641998.9439075, f5350fb5-9460-490b-a47e-74f88c8eb51c => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:46:39 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] VM Started (Lifecycle Event)
Jul 29 14:46:39 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:46:39 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:46:39 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:46:39 user nova-compute[70924]: INFO nova.compute.manager [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Took 6.21 seconds to spawn the instance on the hypervisor.
Jul 29 14:46:39 user nova-compute[70924]: DEBUG nova.compute.manager [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:46:39 user nova-compute[70924]: INFO nova.compute.manager [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Took 7.10 seconds to build instance.
Jul 29 14:46:39 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2c0bf51a-78b9-4b9f-89da-edf50ed69d8a tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Lock "f5350fb5-9460-490b-a47e-74f88c8eb51c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.218s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:46:39 user nova-compute[70924]: DEBUG nova.compute.manager [req-efae7a6d-5968-4866-a66a-1811e4b1a5ed req-e5590e04-1409-4985-b40d-7ceaa1e2e801 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received event network-changed-195c1f76-2177-4201-bb05-291d7131c3c2 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:46:39 user nova-compute[70924]: DEBUG nova.compute.manager [req-efae7a6d-5968-4866-a66a-1811e4b1a5ed req-e5590e04-1409-4985-b40d-7ceaa1e2e801 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Refreshing instance network info cache due to event network-changed-195c1f76-2177-4201-bb05-291d7131c3c2. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:46:39 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-efae7a6d-5968-4866-a66a-1811e4b1a5ed req-e5590e04-1409-4985-b40d-7ceaa1e2e801 service nova] Acquiring lock "refresh_cache-35bdb2dd-d2d4-4a3d-9178-6892d478dfa3" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:46:39 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-efae7a6d-5968-4866-a66a-1811e4b1a5ed req-e5590e04-1409-4985-b40d-7ceaa1e2e801 service nova] Acquired lock "refresh_cache-35bdb2dd-d2d4-4a3d-9178-6892d478dfa3" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:46:39 user nova-compute[70924]: DEBUG nova.network.neutron [req-efae7a6d-5968-4866-a66a-1811e4b1a5ed req-e5590e04-1409-4985-b40d-7ceaa1e2e801 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Refreshing network info cache for port 195c1f76-2177-4201-bb05-291d7131c3c2 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:46:39 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:46:39 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Cleaning up deleted instances {{(pid=70924) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 29 14:46:39 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] There are 0 instances to clean {{(pid=70924) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 29 14:46:39 user nova-compute[70924]: DEBUG nova.network.neutron [req-efae7a6d-5968-4866-a66a-1811e4b1a5ed req-e5590e04-1409-4985-b40d-7ceaa1e2e801 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Updated VIF entry in instance network info cache for port 195c1f76-2177-4201-bb05-291d7131c3c2. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:46:39 user nova-compute[70924]: DEBUG nova.network.neutron [req-efae7a6d-5968-4866-a66a-1811e4b1a5ed req-e5590e04-1409-4985-b40d-7ceaa1e2e801 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Updating instance_info_cache with network_info: [{"id": "195c1f76-2177-4201-bb05-291d7131c3c2", "address": "fa:16:3e:15:a9:c3", "network": {"id": "a836313e-84ad-4a1a-b4de-5eee3652fe69", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-368818776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195c1f76-21", "ovs_interfaceid": "195c1f76-2177-4201-bb05-291d7131c3c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e98a5996-f4ad-44fd-9fc9-591e411bbaa1", "address": "fa:16:3e:bc:51:b6", "network": {"id": "5f1efb98-21ff-48db-95aa-ab5f29e5ff45", "bridge": "br-int", "label": "tempest-device-tagging-net1-473596273", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape98a5996-f4", "ovs_interfaceid": "e98a5996-f4ad-44fd-9fc9-591e411bbaa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f108e5c9-68f4-4444-b686-18df097fa015", "address": "fa:16:3e:08:fb:b3", "network": {"id": "5f1efb98-21ff-48db-95aa-ab5f29e5ff45", "bridge": "br-int", "label": "tempest-device-tagging-net1-473596273", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf108e5c9-68", "ovs_interfaceid": "f108e5c9-68f4-4444-b686-18df097fa015", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0a5aa889-f4ad-49dd-9741-ce0d161bc25f", "address": "fa:16:3e:65:cc:a7", "network": {"id": "5f1efb98-21ff-48db-95aa-ab5f29e5ff45", "bridge": "br-int", "label": "tempest-device-tagging-net1-473596273", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a5aa889-f4", "ovs_interfaceid": "0a5aa889-f4ad-49dd-9741-ce0d161bc25f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2e35e8a0-e202-46d5-b854-9960de88edc2", "address": "fa:16:3e:cc:03:d5", "network": {"id": "5f1efb98-21ff-48db-95aa-ab5f29e5ff45", "bridge": "br-int", "label": "tempest-device-tagging-net1-473596273", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e35e8a0-e2", "ovs_interfaceid": "2e35e8a0-e202-46d5-b854-9960de88edc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7334899f-e7c7-48d8-8c14-4fda63fea3b5", "address": "fa:16:3e:ae:d5:21", "network": {"id": "381d607e-5106-44f3-b3e0-8926c54e74f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-197405985", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7334899f-e7", "ovs_interfaceid": "7334899f-e7c7-48d8-8c14-4fda63fea3b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c6793a3b-97da-4584-a326-f1caf598cd78", "address": "fa:16:3e:30:14:87", "network": {"id": "381d607e-5106-44f3-b3e0-8926c54e74f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-197405985", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6793a3b-97", "ovs_interfaceid": "c6793a3b-97da-4584-a326-f1caf598cd78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:46:40 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-efae7a6d-5968-4866-a66a-1811e4b1a5ed req-e5590e04-1409-4985-b40d-7ceaa1e2e801 service nova] Releasing lock "refresh_cache-35bdb2dd-d2d4-4a3d-9178-6892d478dfa3" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:46:40 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:40 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:46:42 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Acquiring lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:46:42 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:46:42 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Acquiring lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:46:42 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:46:42 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:46:42 user nova-compute[70924]: INFO nova.compute.manager [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Terminating instance
Jul 29 14:46:42 user nova-compute[70924]: DEBUG nova.compute.manager [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Start destroying the instance on the hypervisor. {{(pid=70924) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 14:46:42 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:42 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:42 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:42 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:42 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:42 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:42 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:42 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:42 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:42 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:42 user nova-compute[70924]: DEBUG nova.compute.manager [req-a4098e01-af72-4581-b830-0981f40892e2 req-3d11a5c9-aad4-4d50-9439-29545e408d14 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received event network-vif-unplugged-195c1f76-2177-4201-bb05-291d7131c3c2 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:46:42 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a4098e01-af72-4581-b830-0981f40892e2 req-3d11a5c9-aad4-4d50-9439-29545e408d14 service nova] Acquiring lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:46:42 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a4098e01-af72-4581-b830-0981f40892e2 req-3d11a5c9-aad4-4d50-9439-29545e408d14 service nova] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:46:42 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a4098e01-af72-4581-b830-0981f40892e2 req-3d11a5c9-aad4-4d50-9439-29545e408d14 service nova] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:46:42 user nova-compute[70924]: DEBUG nova.compute.manager [req-a4098e01-af72-4581-b830-0981f40892e2 req-3d11a5c9-aad4-4d50-9439-29545e408d14 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] No waiting events found dispatching network-vif-unplugged-195c1f76-2177-4201-bb05-291d7131c3c2 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:46:42 user nova-compute[70924]: DEBUG nova.compute.manager [req-a4098e01-af72-4581-b830-0981f40892e2 req-3d11a5c9-aad4-4d50-9439-29545e408d14 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received event network-vif-unplugged-195c1f76-2177-4201-bb05-291d7131c3c2 for instance with task_state deleting. {{(pid=70924) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 14:46:42 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:42 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:42 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:42 user nova-compute[70924]: DEBUG nova.compute.manager [req-29e63150-e02c-4226-a339-b8f7f29a316f req-805356de-e618-47e8-96a8-a3d99df07545 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received event network-vif-unplugged-e98a5996-f4ad-44fd-9fc9-591e411bbaa1 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:46:42 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-29e63150-e02c-4226-a339-b8f7f29a316f req-805356de-e618-47e8-96a8-a3d99df07545 service nova] Acquiring lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:46:42 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-29e63150-e02c-4226-a339-b8f7f29a316f req-805356de-e618-47e8-96a8-a3d99df07545 service nova] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:46:42 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-29e63150-e02c-4226-a339-b8f7f29a316f req-805356de-e618-47e8-96a8-a3d99df07545 service nova] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:46:42 user nova-compute[70924]: DEBUG nova.compute.manager [req-29e63150-e02c-4226-a339-b8f7f29a316f req-805356de-e618-47e8-96a8-a3d99df07545 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] No waiting events found dispatching network-vif-unplugged-e98a5996-f4ad-44fd-9fc9-591e411bbaa1 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:46:42 user nova-compute[70924]: DEBUG nova.compute.manager [req-29e63150-e02c-4226-a339-b8f7f29a316f req-805356de-e618-47e8-96a8-a3d99df07545 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received event network-vif-unplugged-e98a5996-f4ad-44fd-9fc9-591e411bbaa1 for instance with task_state deleting. {{(pid=70924) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 14:46:42 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:42 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:42 user nova-compute[70924]: DEBUG nova.compute.manager [req-dbb8179d-0260-4fe7-b45a-754b230d25ca req-becea5b4-6fbf-4c91-9f8c-8e20eb4949c3 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received event network-vif-unplugged-0a5aa889-f4ad-49dd-9741-ce0d161bc25f {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:46:42 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-dbb8179d-0260-4fe7-b45a-754b230d25ca req-becea5b4-6fbf-4c91-9f8c-8e20eb4949c3 service nova] Acquiring lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:46:42 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-dbb8179d-0260-4fe7-b45a-754b230d25ca req-becea5b4-6fbf-4c91-9f8c-8e20eb4949c3 service nova] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:46:42 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-dbb8179d-0260-4fe7-b45a-754b230d25ca req-becea5b4-6fbf-4c91-9f8c-8e20eb4949c3 service nova] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:46:42 user nova-compute[70924]: DEBUG nova.compute.manager [req-dbb8179d-0260-4fe7-b45a-754b230d25ca req-becea5b4-6fbf-4c91-9f8c-8e20eb4949c3 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] No waiting events found dispatching network-vif-unplugged-0a5aa889-f4ad-49dd-9741-ce0d161bc25f {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:46:42 user nova-compute[70924]: DEBUG nova.compute.manager [req-dbb8179d-0260-4fe7-b45a-754b230d25ca req-becea5b4-6fbf-4c91-9f8c-8e20eb4949c3 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received event network-vif-unplugged-0a5aa889-f4ad-49dd-9741-ce0d161bc25f for instance with task_state deleting. {{(pid=70924) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 14:46:42 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:42 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:43 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Instance destroyed successfully.
Jul 29 14:46:43 user nova-compute[70924]: DEBUG nova.objects.instance [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Lazy-loading 'resources' on Instance uuid 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T14:44:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-665402946',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-665402946',id=15,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5+0WvIsBj/j06hqnLQTtyszC978RLwfd3h9HEdPSOIa95oKqiIYN4A38Sy3a+7cgbLZMWi+UAEuTUU0Ac4QtvbKoz0WHaDZr5IdnS4lgNL4nNT8pTAKn6FSUPOEVUEvg==',key_name='tempest-keypair-1133379299',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:45:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='87bd9746a49c4efeaea2c4b38c1b42c6',ramdisk_id='',reservation_id='r-xxt96qh6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-954540052',owner_user_name='tempest-TaggedBootDevicesTest_v242-954540052-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:45:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='69f7b3722f784d4cb61ba6b0cf325912',uuid=35bdb2dd-d2d4-4a3d-9178-6892d478dfa3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "195c1f76-2177-4201-bb05-291d7131c3c2", "address": "fa:16:3e:15:a9:c3", "network": {"id": "a836313e-84ad-4a1a-b4de-5eee3652fe69", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-368818776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195c1f76-21", "ovs_interfaceid": "195c1f76-2177-4201-bb05-291d7131c3c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Converting VIF {"id": "195c1f76-2177-4201-bb05-291d7131c3c2", "address": "fa:16:3e:15:a9:c3", "network": {"id": "a836313e-84ad-4a1a-b4de-5eee3652fe69", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-368818776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195c1f76-21", "ovs_interfaceid": "195c1f76-2177-4201-bb05-291d7131c3c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:a9:c3,bridge_name='br-int',has_traffic_filtering=True,id=195c1f76-2177-4201-bb05-291d7131c3c2,network=Network(a836313e-84ad-4a1a-b4de-5eee3652fe69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap195c1f76-21') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG os_vif [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:a9:c3,bridge_name='br-int',has_traffic_filtering=True,id=195c1f76-2177-4201-bb05-291d7131c3c2,network=Network(a836313e-84ad-4a1a-b4de-5eee3652fe69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap195c1f76-21') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap195c1f76-21, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:44 user nova-compute[70924]: INFO os_vif [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:a9:c3,bridge_name='br-int',has_traffic_filtering=True,id=195c1f76-2177-4201-bb05-291d7131c3c2,network=Network(a836313e-84ad-4a1a-b4de-5eee3652fe69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap195c1f76-21')
Jul 29 14:46:44 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T14:44:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-665402946',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-665402946',id=15,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5+0WvIsBj/j06hqnLQTtyszC978RLwfd3h9HEdPSOIa95oKqiIYN4A38Sy3a+7cgbLZMWi+UAEuTUU0Ac4QtvbKoz0WHaDZr5IdnS4lgNL4nNT8pTAKn6FSUPOEVUEvg==',key_name='tempest-keypair-1133379299',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:45:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='87bd9746a49c4efeaea2c4b38c1b42c6',ramdisk_id='',reservation_id='r-xxt96qh6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-954540052',owner_user_name='tempest-TaggedBootDevicesTest_v242-954540052-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:45:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='69f7b3722f784d4cb61ba6b0cf325912',uuid=35bdb2dd-d2d4-4a3d-9178-6892d478dfa3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e98a5996-f4ad-44fd-9fc9-591e411bbaa1", "address": "fa:16:3e:bc:51:b6", "network": {"id": "5f1efb98-21ff-48db-95aa-ab5f29e5ff45", "bridge": "br-int", "label": "tempest-device-tagging-net1-473596273", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape98a5996-f4", "ovs_interfaceid": "e98a5996-f4ad-44fd-9fc9-591e411bbaa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Converting VIF {"id": "e98a5996-f4ad-44fd-9fc9-591e411bbaa1", "address": "fa:16:3e:bc:51:b6", "network": {"id": "5f1efb98-21ff-48db-95aa-ab5f29e5ff45", "bridge": "br-int", "label": "tempest-device-tagging-net1-473596273", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape98a5996-f4", "ovs_interfaceid": "e98a5996-f4ad-44fd-9fc9-591e411bbaa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:51:b6,bridge_name='br-int',has_traffic_filtering=True,id=e98a5996-f4ad-44fd-9fc9-591e411bbaa1,network=Network(5f1efb98-21ff-48db-95aa-ab5f29e5ff45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape98a5996-f4') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG os_vif [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:51:b6,bridge_name='br-int',has_traffic_filtering=True,id=e98a5996-f4ad-44fd-9fc9-591e411bbaa1,network=Network(5f1efb98-21ff-48db-95aa-ab5f29e5ff45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape98a5996-f4') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape98a5996-f4, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:44 user nova-compute[70924]: INFO os_vif [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:51:b6,bridge_name='br-int',has_traffic_filtering=True,id=e98a5996-f4ad-44fd-9fc9-591e411bbaa1,network=Network(5f1efb98-21ff-48db-95aa-ab5f29e5ff45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape98a5996-f4')
Jul 29 14:46:44 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T14:44:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-665402946',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-665402946',id=15,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5+0WvIsBj/j06hqnLQTtyszC978RLwfd3h9HEdPSOIa95oKqiIYN4A38Sy3a+7cgbLZMWi+UAEuTUU0Ac4QtvbKoz0WHaDZr5IdnS4lgNL4nNT8pTAKn6FSUPOEVUEvg==',key_name='tempest-keypair-1133379299',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:45:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='87bd9746a49c4efeaea2c4b38c1b42c6',ramdisk_id='',reservation_id='r-xxt96qh6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-954540052',owner_user_name='tempest-TaggedBootDevicesTest_v242-954540052-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:45:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='69f7b3722f784d4cb61ba6b0cf325912',uuid=35bdb2dd-d2d4-4a3d-9178-6892d478dfa3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f108e5c9-68f4-4444-b686-18df097fa015", "address": "fa:16:3e:08:fb:b3", "network": {"id": "5f1efb98-21ff-48db-95aa-ab5f29e5ff45", "bridge": "br-int", "label": "tempest-device-tagging-net1-473596273", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf108e5c9-68", "ovs_interfaceid": "f108e5c9-68f4-4444-b686-18df097fa015", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Converting VIF {"id": "f108e5c9-68f4-4444-b686-18df097fa015", "address": "fa:16:3e:08:fb:b3", "network": {"id": "5f1efb98-21ff-48db-95aa-ab5f29e5ff45", "bridge": "br-int", "label": "tempest-device-tagging-net1-473596273", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf108e5c9-68", "ovs_interfaceid": "f108e5c9-68f4-4444-b686-18df097fa015", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:fb:b3,bridge_name='br-int',has_traffic_filtering=True,id=f108e5c9-68f4-4444-b686-18df097fa015,network=Network(5f1efb98-21ff-48db-95aa-ab5f29e5ff45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf108e5c9-68') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG os_vif [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:fb:b3,bridge_name='br-int',has_traffic_filtering=True,id=f108e5c9-68f4-4444-b686-18df097fa015,network=Network(5f1efb98-21ff-48db-95aa-ab5f29e5ff45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf108e5c9-68') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf108e5c9-68, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:44 user nova-compute[70924]: INFO os_vif [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:fb:b3,bridge_name='br-int',has_traffic_filtering=True,id=f108e5c9-68f4-4444-b686-18df097fa015,network=Network(5f1efb98-21ff-48db-95aa-ab5f29e5ff45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf108e5c9-68')
Jul 29 14:46:44 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T14:44:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-665402946',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-665402946',id=15,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5+0WvIsBj/j06hqnLQTtyszC978RLwfd3h9HEdPSOIa95oKqiIYN4A38Sy3a+7cgbLZMWi+UAEuTUU0Ac4QtvbKoz0WHaDZr5IdnS4lgNL4nNT8pTAKn6FSUPOEVUEvg==',key_name='tempest-keypair-1133379299',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:45:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='87bd9746a49c4efeaea2c4b38c1b42c6',ramdisk_id='',reservation_id='r-xxt96qh6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-954540052',owner_user_name='tempest-TaggedBootDevicesTest_v242-954540052-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:45:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='69f7b3722f784d4cb61ba6b0cf325912',uuid=35bdb2dd-d2d4-4a3d-9178-6892d478dfa3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0a5aa889-f4ad-49dd-9741-ce0d161bc25f", "address": "fa:16:3e:65:cc:a7", "network": {"id": "5f1efb98-21ff-48db-95aa-ab5f29e5ff45", "bridge": "br-int", "label": "tempest-device-tagging-net1-473596273", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a5aa889-f4", "ovs_interfaceid": "0a5aa889-f4ad-49dd-9741-ce0d161bc25f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Converting VIF {"id": "0a5aa889-f4ad-49dd-9741-ce0d161bc25f", "address": "fa:16:3e:65:cc:a7", "network": {"id": "5f1efb98-21ff-48db-95aa-ab5f29e5ff45", "bridge": "br-int", "label": "tempest-device-tagging-net1-473596273", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a5aa889-f4", "ovs_interfaceid": "0a5aa889-f4ad-49dd-9741-ce0d161bc25f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:cc:a7,bridge_name='br-int',has_traffic_filtering=True,id=0a5aa889-f4ad-49dd-9741-ce0d161bc25f,network=Network(5f1efb98-21ff-48db-95aa-ab5f29e5ff45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a5aa889-f4') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG os_vif [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:cc:a7,bridge_name='br-int',has_traffic_filtering=True,id=0a5aa889-f4ad-49dd-9741-ce0d161bc25f,network=Network(5f1efb98-21ff-48db-95aa-ab5f29e5ff45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a5aa889-f4') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0a5aa889-f4, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:44 user nova-compute[70924]: INFO os_vif [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:cc:a7,bridge_name='br-int',has_traffic_filtering=True,id=0a5aa889-f4ad-49dd-9741-ce0d161bc25f,network=Network(5f1efb98-21ff-48db-95aa-ab5f29e5ff45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a5aa889-f4')
Jul 29 14:46:44 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T14:44:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-665402946',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-665402946',id=15,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5+0WvIsBj/j06hqnLQTtyszC978RLwfd3h9HEdPSOIa95oKqiIYN4A38Sy3a+7cgbLZMWi+UAEuTUU0Ac4QtvbKoz0WHaDZr5IdnS4lgNL4nNT8pTAKn6FSUPOEVUEvg==',key_name='tempest-keypair-1133379299',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:45:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='87bd9746a49c4efeaea2c4b38c1b42c6',ramdisk_id='',reservation_id='r-xxt96qh6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-954540052',owner_user_name='tempest-TaggedBootDevicesTest_v242-954540052-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:45:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='69f7b3722f784d4cb61ba6b0cf325912',uuid=35bdb2dd-d2d4-4a3d-9178-6892d478dfa3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e35e8a0-e202-46d5-b854-9960de88edc2", "address": "fa:16:3e:cc:03:d5", "network": {"id": "5f1efb98-21ff-48db-95aa-ab5f29e5ff45", "bridge": "br-int", "label": "tempest-device-tagging-net1-473596273", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e35e8a0-e2", "ovs_interfaceid": "2e35e8a0-e202-46d5-b854-9960de88edc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Converting VIF {"id": "2e35e8a0-e202-46d5-b854-9960de88edc2", "address": "fa:16:3e:cc:03:d5", "network": {"id": "5f1efb98-21ff-48db-95aa-ab5f29e5ff45", "bridge": "br-int", "label": "tempest-device-tagging-net1-473596273", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e35e8a0-e2", "ovs_interfaceid": "2e35e8a0-e202-46d5-b854-9960de88edc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:03:d5,bridge_name='br-int',has_traffic_filtering=True,id=2e35e8a0-e202-46d5-b854-9960de88edc2,network=Network(5f1efb98-21ff-48db-95aa-ab5f29e5ff45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e35e8a0-e2') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG os_vif [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:03:d5,bridge_name='br-int',has_traffic_filtering=True,id=2e35e8a0-e202-46d5-b854-9960de88edc2,network=Network(5f1efb98-21ff-48db-95aa-ab5f29e5ff45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e35e8a0-e2') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2e35e8a0-e2, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG nova.compute.manager [req-858c5731-4e3f-40e8-b517-aed665f1676c req-bb392481-5987-4700-bab8-e7f4cbc1a425 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received event network-vif-plugged-195c1f76-2177-4201-bb05-291d7131c3c2 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-858c5731-4e3f-40e8-b517-aed665f1676c req-bb392481-5987-4700-bab8-e7f4cbc1a425 service nova] Acquiring lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-858c5731-4e3f-40e8-b517-aed665f1676c req-bb392481-5987-4700-bab8-e7f4cbc1a425 service nova] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-858c5731-4e3f-40e8-b517-aed665f1676c req-bb392481-5987-4700-bab8-e7f4cbc1a425 service nova] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG nova.compute.manager [req-858c5731-4e3f-40e8-b517-aed665f1676c req-bb392481-5987-4700-bab8-e7f4cbc1a425 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] No waiting events found dispatching network-vif-plugged-195c1f76-2177-4201-bb05-291d7131c3c2 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:46:44 user nova-compute[70924]: WARNING nova.compute.manager [req-858c5731-4e3f-40e8-b517-aed665f1676c req-bb392481-5987-4700-bab8-e7f4cbc1a425 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received unexpected event network-vif-plugged-195c1f76-2177-4201-bb05-291d7131c3c2 for instance with vm_state active and task_state deleting.
Jul 29 14:46:44 user nova-compute[70924]: DEBUG nova.compute.manager [req-858c5731-4e3f-40e8-b517-aed665f1676c req-bb392481-5987-4700-bab8-e7f4cbc1a425 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received event network-vif-unplugged-f108e5c9-68f4-4444-b686-18df097fa015 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-858c5731-4e3f-40e8-b517-aed665f1676c req-bb392481-5987-4700-bab8-e7f4cbc1a425 service nova] Acquiring lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-858c5731-4e3f-40e8-b517-aed665f1676c req-bb392481-5987-4700-bab8-e7f4cbc1a425 service nova] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-858c5731-4e3f-40e8-b517-aed665f1676c req-bb392481-5987-4700-bab8-e7f4cbc1a425 service nova] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG nova.compute.manager [req-858c5731-4e3f-40e8-b517-aed665f1676c req-bb392481-5987-4700-bab8-e7f4cbc1a425 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] No waiting events found dispatching network-vif-unplugged-f108e5c9-68f4-4444-b686-18df097fa015 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG nova.compute.manager [req-858c5731-4e3f-40e8-b517-aed665f1676c req-bb392481-5987-4700-bab8-e7f4cbc1a425 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received event network-vif-unplugged-f108e5c9-68f4-4444-b686-18df097fa015 for instance with task_state deleting. {{(pid=70924) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG nova.compute.manager [req-858c5731-4e3f-40e8-b517-aed665f1676c req-bb392481-5987-4700-bab8-e7f4cbc1a425 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received event network-vif-plugged-f108e5c9-68f4-4444-b686-18df097fa015 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-858c5731-4e3f-40e8-b517-aed665f1676c req-bb392481-5987-4700-bab8-e7f4cbc1a425 service nova] Acquiring lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-858c5731-4e3f-40e8-b517-aed665f1676c req-bb392481-5987-4700-bab8-e7f4cbc1a425 service nova] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-858c5731-4e3f-40e8-b517-aed665f1676c req-bb392481-5987-4700-bab8-e7f4cbc1a425 service nova] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG nova.compute.manager [req-858c5731-4e3f-40e8-b517-aed665f1676c req-bb392481-5987-4700-bab8-e7f4cbc1a425 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] No waiting events found dispatching network-vif-plugged-f108e5c9-68f4-4444-b686-18df097fa015 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:46:44 user nova-compute[70924]: WARNING nova.compute.manager [req-858c5731-4e3f-40e8-b517-aed665f1676c req-bb392481-5987-4700-bab8-e7f4cbc1a425 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received unexpected event network-vif-plugged-f108e5c9-68f4-4444-b686-18df097fa015 for instance with vm_state active and task_state deleting.
Jul 29 14:46:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:44 user nova-compute[70924]: INFO os_vif [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:03:d5,bridge_name='br-int',has_traffic_filtering=True,id=2e35e8a0-e202-46d5-b854-9960de88edc2,network=Network(5f1efb98-21ff-48db-95aa-ab5f29e5ff45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e35e8a0-e2')
Jul 29 14:46:44 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T14:44:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-665402946',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-665402946',id=15,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5+0WvIsBj/j06hqnLQTtyszC978RLwfd3h9HEdPSOIa95oKqiIYN4A38Sy3a+7cgbLZMWi+UAEuTUU0Ac4QtvbKoz0WHaDZr5IdnS4lgNL4nNT8pTAKn6FSUPOEVUEvg==',key_name='tempest-keypair-1133379299',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:45:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='87bd9746a49c4efeaea2c4b38c1b42c6',ramdisk_id='',reservation_id='r-xxt96qh6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-954540052',owner_user_name='tempest-TaggedBootDevicesTest_v242-954540052-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:45:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='69f7b3722f784d4cb61ba6b0cf325912',uuid=35bdb2dd-d2d4-4a3d-9178-6892d478dfa3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7334899f-e7c7-48d8-8c14-4fda63fea3b5", "address": "fa:16:3e:ae:d5:21", "network": {"id": "381d607e-5106-44f3-b3e0-8926c54e74f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-197405985", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7334899f-e7", "ovs_interfaceid": "7334899f-e7c7-48d8-8c14-4fda63fea3b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Converting VIF {"id": "7334899f-e7c7-48d8-8c14-4fda63fea3b5", "address": "fa:16:3e:ae:d5:21", "network": {"id": "381d607e-5106-44f3-b3e0-8926c54e74f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-197405985", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7334899f-e7", "ovs_interfaceid": "7334899f-e7c7-48d8-8c14-4fda63fea3b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:d5:21,bridge_name='br-int',has_traffic_filtering=True,id=7334899f-e7c7-48d8-8c14-4fda63fea3b5,network=Network(381d607e-5106-44f3-b3e0-8926c54e74f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7334899f-e7') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG os_vif [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:d5:21,bridge_name='br-int',has_traffic_filtering=True,id=7334899f-e7c7-48d8-8c14-4fda63fea3b5,network=Network(381d607e-5106-44f3-b3e0-8926c54e74f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7334899f-e7') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7334899f-e7, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:44 user nova-compute[70924]: INFO os_vif [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:d5:21,bridge_name='br-int',has_traffic_filtering=True,id=7334899f-e7c7-48d8-8c14-4fda63fea3b5,network=Network(381d607e-5106-44f3-b3e0-8926c54e74f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7334899f-e7')
Jul 29 14:46:44 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T14:44:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-665402946',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-665402946',id=15,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5+0WvIsBj/j06hqnLQTtyszC978RLwfd3h9HEdPSOIa95oKqiIYN4A38Sy3a+7cgbLZMWi+UAEuTUU0Ac4QtvbKoz0WHaDZr5IdnS4lgNL4nNT8pTAKn6FSUPOEVUEvg==',key_name='tempest-keypair-1133379299',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:45:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='87bd9746a49c4efeaea2c4b38c1b42c6',ramdisk_id='',reservation_id='r-xxt96qh6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-954540052',owner_user_name='tempest-TaggedBootDevicesTest_v242-954540052-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:45:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='69f7b3722f784d4cb61ba6b0cf325912',uuid=35bdb2dd-d2d4-4a3d-9178-6892d478dfa3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c6793a3b-97da-4584-a326-f1caf598cd78", "address": "fa:16:3e:30:14:87", "network": {"id": "381d607e-5106-44f3-b3e0-8926c54e74f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-197405985", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6793a3b-97", "ovs_interfaceid": "c6793a3b-97da-4584-a326-f1caf598cd78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Converting VIF {"id": "c6793a3b-97da-4584-a326-f1caf598cd78", "address": "fa:16:3e:30:14:87", "network": {"id": "381d607e-5106-44f3-b3e0-8926c54e74f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-197405985", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6793a3b-97", "ovs_interfaceid": "c6793a3b-97da-4584-a326-f1caf598cd78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:14:87,bridge_name='br-int',has_traffic_filtering=True,id=c6793a3b-97da-4584-a326-f1caf598cd78,network=Network(381d607e-5106-44f3-b3e0-8926c54e74f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6793a3b-97') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG os_vif [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:14:87,bridge_name='br-int',has_traffic_filtering=True,id=c6793a3b-97da-4584-a326-f1caf598cd78,network=Network(381d607e-5106-44f3-b3e0-8926c54e74f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6793a3b-97') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc6793a3b-97, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:46:44 user nova-compute[70924]: INFO os_vif [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:14:87,bridge_name='br-int',has_traffic_filtering=True,id=c6793a3b-97da-4584-a326-f1caf598cd78,network=Network(381d607e-5106-44f3-b3e0-8926c54e74f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6793a3b-97')
Jul 29 14:46:44 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] calling os-brick to detach iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, {'target_iqns': ['iqn.2010-10.org.openstack:4a7d5e0c-d135-4dd9-be3f-8dd700523339'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IlACESVa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:46:44 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:46:44 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a7d5e0c-d135-4dd9-be3f-8dd700523339', 0)] {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[044a1169-eee7-421d-bcd8-d9fc41507e9b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0763aadd-e95f-4582-bb01-fcc7dc4681cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49b03148-7445-466e-b4dd-4b84dcaaa95a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a7d5e0c-d135-4dd9-be3f-8dd700523339\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6660ceee-3197-4c43-8f04-ea8103851011]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a7d5e0c-d135-4dd9-be3f-8dd700523339 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0763aadd-e95f-4582-bb01-fcc7dc4681cb (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49b03148-7445-466e-b4dd-4b84dcaaa95a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:46:44 user nova-compute[70924]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)
Jul 29 14:46:44 user nova-compute[70924]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 (non-flash)
Jul 29 14:46:44 user nova-compute[70924]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a7d5e0c-d135-4dd9-be3f-8dd700523339 (non-flash)
Jul 29 14:46:44 user nova-compute[70924]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0763aadd-e95f-4582-bb01-fcc7dc4681cb (non-flash)
Jul 29 14:46:44 user nova-compute[70924]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49b03148-7445-466e-b4dd-4b84dcaaa95a (non-flash)
Jul 29 14:46:44 user nova-compute[70924]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:46:44 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:46:44 user nova-compute[70924]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)
Jul 29 14:46:44 user nova-compute[70924]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 (non-flash)
Jul 29 14:46:44 user nova-compute[70924]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a7d5e0c-d135-4dd9-be3f-8dd700523339 (non-flash)
Jul 29 14:46:44 user nova-compute[70924]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0763aadd-e95f-4582-bb01-fcc7dc4681cb (non-flash)
Jul 29 14:46:44 user nova-compute[70924]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49b03148-7445-466e-b4dd-4b84dcaaa95a (non-flash)
Jul 29 14:46:44 user nova-compute[70924]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:46:44 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feecc68d900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a7d5e0c-d135-4dd9-be3f-8dd700523339'): ({'sdd'}, set())}) {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Removing single pathed devices sdd {{(pid=70924) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG nova.compute.manager [req-477ec937-2f54-4945-be6e-200eed6ec52a req-756c9ec6-0038-4171-909c-fb3568defff4 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received event network-vif-plugged-e98a5996-f4ad-44fd-9fc9-591e411bbaa1 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-477ec937-2f54-4945-be6e-200eed6ec52a req-756c9ec6-0038-4171-909c-fb3568defff4 service nova] Acquiring lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-477ec937-2f54-4945-be6e-200eed6ec52a req-756c9ec6-0038-4171-909c-fb3568defff4 service nova] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-477ec937-2f54-4945-be6e-200eed6ec52a req-756c9ec6-0038-4171-909c-fb3568defff4 service nova] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG nova.compute.manager [req-477ec937-2f54-4945-be6e-200eed6ec52a req-756c9ec6-0038-4171-909c-fb3568defff4 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] No waiting events found dispatching network-vif-plugged-e98a5996-f4ad-44fd-9fc9-591e411bbaa1 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:46:44 user nova-compute[70924]: WARNING nova.compute.manager [req-477ec937-2f54-4945-be6e-200eed6ec52a req-756c9ec6-0038-4171-909c-fb3568defff4 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received unexpected event network-vif-plugged-e98a5996-f4ad-44fd-9fc9-591e411bbaa1 for instance with vm_state active and task_state deleting.
Jul 29 14:46:44 user nova-compute[70924]: DEBUG nova.compute.manager [req-477ec937-2f54-4945-be6e-200eed6ec52a req-756c9ec6-0038-4171-909c-fb3568defff4 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received event network-vif-plugged-e98a5996-f4ad-44fd-9fc9-591e411bbaa1 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-477ec937-2f54-4945-be6e-200eed6ec52a req-756c9ec6-0038-4171-909c-fb3568defff4 service nova] Acquiring lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-477ec937-2f54-4945-be6e-200eed6ec52a req-756c9ec6-0038-4171-909c-fb3568defff4 service nova] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-477ec937-2f54-4945-be6e-200eed6ec52a req-756c9ec6-0038-4171-909c-fb3568defff4 service nova] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG nova.compute.manager [req-477ec937-2f54-4945-be6e-200eed6ec52a req-756c9ec6-0038-4171-909c-fb3568defff4 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] No waiting events found dispatching network-vif-plugged-e98a5996-f4ad-44fd-9fc9-591e411bbaa1 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:46:44 user nova-compute[70924]: WARNING nova.compute.manager [req-477ec937-2f54-4945-be6e-200eed6ec52a req-756c9ec6-0038-4171-909c-fb3568defff4 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received unexpected event network-vif-plugged-e98a5996-f4ad-44fd-9fc9-591e411bbaa1 for instance with vm_state active and task_state deleting.
Jul 29 14:46:44 user nova-compute[70924]: DEBUG nova.compute.manager [req-477ec937-2f54-4945-be6e-200eed6ec52a req-756c9ec6-0038-4171-909c-fb3568defff4 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received event network-vif-plugged-e98a5996-f4ad-44fd-9fc9-591e411bbaa1 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-477ec937-2f54-4945-be6e-200eed6ec52a req-756c9ec6-0038-4171-909c-fb3568defff4 service nova] Acquiring lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-477ec937-2f54-4945-be6e-200eed6ec52a req-756c9ec6-0038-4171-909c-fb3568defff4 service nova] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-477ec937-2f54-4945-be6e-200eed6ec52a req-756c9ec6-0038-4171-909c-fb3568defff4 service nova] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG nova.compute.manager [req-477ec937-2f54-4945-be6e-200eed6ec52a req-756c9ec6-0038-4171-909c-fb3568defff4 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] No waiting events found dispatching network-vif-plugged-e98a5996-f4ad-44fd-9fc9-591e411bbaa1 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:46:44 user nova-compute[70924]: WARNING nova.compute.manager [req-477ec937-2f54-4945-be6e-200eed6ec52a req-756c9ec6-0038-4171-909c-fb3568defff4 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received unexpected event network-vif-plugged-e98a5996-f4ad-44fd-9fc9-591e411bbaa1 for instance with vm_state active and task_state deleting.
Jul 29 14:46:44 user nova-compute[70924]: DEBUG nova.compute.manager [req-477ec937-2f54-4945-be6e-200eed6ec52a req-756c9ec6-0038-4171-909c-fb3568defff4 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received event network-vif-unplugged-e98a5996-f4ad-44fd-9fc9-591e411bbaa1 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-477ec937-2f54-4945-be6e-200eed6ec52a req-756c9ec6-0038-4171-909c-fb3568defff4 service nova] Acquiring lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-477ec937-2f54-4945-be6e-200eed6ec52a req-756c9ec6-0038-4171-909c-fb3568defff4 service nova] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-477ec937-2f54-4945-be6e-200eed6ec52a req-756c9ec6-0038-4171-909c-fb3568defff4 service nova] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG nova.compute.manager [req-477ec937-2f54-4945-be6e-200eed6ec52a req-756c9ec6-0038-4171-909c-fb3568defff4 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] No waiting events found dispatching network-vif-unplugged-e98a5996-f4ad-44fd-9fc9-591e411bbaa1 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG nova.compute.manager [req-477ec937-2f54-4945-be6e-200eed6ec52a req-756c9ec6-0038-4171-909c-fb3568defff4 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received event network-vif-unplugged-e98a5996-f4ad-44fd-9fc9-591e411bbaa1 for instance with task_state deleting. {{(pid=70924) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb21ec33-23dd-470f-a095-c619bb914882]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6e1002-8c29-404f-95a1-2990b41e6bbc]: (4, ('ok\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Flushing IO for device /dev/sdd {{(pid=70924) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce96ccfe-dfd7-4cf1-bc53-ba7c35d6b373]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70924) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG nova.compute.manager [req-a8fc2be7-a234-4128-b43e-24110ebdaf73 req-53aa9ff0-80af-47d5-83de-0e94b0bfc092 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received event network-vif-plugged-0a5aa889-f4ad-49dd-9741-ce0d161bc25f {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a8fc2be7-a234-4128-b43e-24110ebdaf73 req-53aa9ff0-80af-47d5-83de-0e94b0bfc092 service nova] Acquiring lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a8fc2be7-a234-4128-b43e-24110ebdaf73 req-53aa9ff0-80af-47d5-83de-0e94b0bfc092 service nova] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a8fc2be7-a234-4128-b43e-24110ebdaf73 req-53aa9ff0-80af-47d5-83de-0e94b0bfc092 service nova] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG nova.compute.manager [req-a8fc2be7-a234-4128-b43e-24110ebdaf73 req-53aa9ff0-80af-47d5-83de-0e94b0bfc092 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] No waiting events found dispatching network-vif-plugged-0a5aa889-f4ad-49dd-9741-ce0d161bc25f {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:46:44 user nova-compute[70924]: WARNING nova.compute.manager [req-a8fc2be7-a234-4128-b43e-24110ebdaf73 req-53aa9ff0-80af-47d5-83de-0e94b0bfc092 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received unexpected event network-vif-plugged-0a5aa889-f4ad-49dd-9741-ce0d161bc25f for instance with vm_state active and task_state deleting.
Jul 29 14:46:44 user nova-compute[70924]: DEBUG nova.compute.manager [req-a8fc2be7-a234-4128-b43e-24110ebdaf73 req-53aa9ff0-80af-47d5-83de-0e94b0bfc092 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received event network-vif-unplugged-2e35e8a0-e202-46d5-b854-9960de88edc2 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a8fc2be7-a234-4128-b43e-24110ebdaf73 req-53aa9ff0-80af-47d5-83de-0e94b0bfc092 service nova] Acquiring lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a8fc2be7-a234-4128-b43e-24110ebdaf73 req-53aa9ff0-80af-47d5-83de-0e94b0bfc092 service nova] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a8fc2be7-a234-4128-b43e-24110ebdaf73 req-53aa9ff0-80af-47d5-83de-0e94b0bfc092 service nova] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG nova.compute.manager [req-a8fc2be7-a234-4128-b43e-24110ebdaf73 req-53aa9ff0-80af-47d5-83de-0e94b0bfc092 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] No waiting events found dispatching network-vif-unplugged-2e35e8a0-e202-46d5-b854-9960de88edc2 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG nova.compute.manager [req-a8fc2be7-a234-4128-b43e-24110ebdaf73 req-53aa9ff0-80af-47d5-83de-0e94b0bfc092 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received event network-vif-unplugged-2e35e8a0-e202-46d5-b854-9960de88edc2 for instance with task_state deleting. {{(pid=70924) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG nova.compute.manager [req-a8fc2be7-a234-4128-b43e-24110ebdaf73 req-53aa9ff0-80af-47d5-83de-0e94b0bfc092 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received event network-vif-plugged-2e35e8a0-e202-46d5-b854-9960de88edc2 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a8fc2be7-a234-4128-b43e-24110ebdaf73 req-53aa9ff0-80af-47d5-83de-0e94b0bfc092 service nova] Acquiring lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a8fc2be7-a234-4128-b43e-24110ebdaf73 req-53aa9ff0-80af-47d5-83de-0e94b0bfc092 service nova] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a8fc2be7-a234-4128-b43e-24110ebdaf73 req-53aa9ff0-80af-47d5-83de-0e94b0bfc092 service nova] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG nova.compute.manager [req-a8fc2be7-a234-4128-b43e-24110ebdaf73 req-53aa9ff0-80af-47d5-83de-0e94b0bfc092 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] No waiting events found dispatching network-vif-plugged-2e35e8a0-e202-46d5-b854-9960de88edc2 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:46:44 user nova-compute[70924]: WARNING nova.compute.manager [req-a8fc2be7-a234-4128-b43e-24110ebdaf73 req-53aa9ff0-80af-47d5-83de-0e94b0bfc092 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received unexpected event network-vif-plugged-2e35e8a0-e202-46d5-b854-9960de88edc2 for instance with vm_state active and task_state deleting.
Jul 29 14:46:44 user nova-compute[70924]: DEBUG nova.compute.manager [req-a8fc2be7-a234-4128-b43e-24110ebdaf73 req-53aa9ff0-80af-47d5-83de-0e94b0bfc092 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received event network-vif-unplugged-c6793a3b-97da-4584-a326-f1caf598cd78 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a8fc2be7-a234-4128-b43e-24110ebdaf73 req-53aa9ff0-80af-47d5-83de-0e94b0bfc092 service nova] Acquiring lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a8fc2be7-a234-4128-b43e-24110ebdaf73 req-53aa9ff0-80af-47d5-83de-0e94b0bfc092 service nova] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a8fc2be7-a234-4128-b43e-24110ebdaf73 req-53aa9ff0-80af-47d5-83de-0e94b0bfc092 service nova] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG nova.compute.manager [req-a8fc2be7-a234-4128-b43e-24110ebdaf73 req-53aa9ff0-80af-47d5-83de-0e94b0bfc092 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] No waiting events found dispatching network-vif-unplugged-c6793a3b-97da-4584-a326-f1caf598cd78 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG nova.compute.manager [req-a8fc2be7-a234-4128-b43e-24110ebdaf73 req-53aa9ff0-80af-47d5-83de-0e94b0bfc092 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received event network-vif-unplugged-c6793a3b-97da-4584-a326-f1caf598cd78 for instance with task_state deleting. {{(pid=70924) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG nova.compute.manager [req-a8fc2be7-a234-4128-b43e-24110ebdaf73 req-53aa9ff0-80af-47d5-83de-0e94b0bfc092 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received event network-vif-plugged-c6793a3b-97da-4584-a326-f1caf598cd78 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a8fc2be7-a234-4128-b43e-24110ebdaf73 req-53aa9ff0-80af-47d5-83de-0e94b0bfc092 service nova] Acquiring lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a8fc2be7-a234-4128-b43e-24110ebdaf73 req-53aa9ff0-80af-47d5-83de-0e94b0bfc092 service nova] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a8fc2be7-a234-4128-b43e-24110ebdaf73 req-53aa9ff0-80af-47d5-83de-0e94b0bfc092 service nova] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG nova.compute.manager [req-a8fc2be7-a234-4128-b43e-24110ebdaf73 req-53aa9ff0-80af-47d5-83de-0e94b0bfc092 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] No waiting events found dispatching network-vif-plugged-c6793a3b-97da-4584-a326-f1caf598cd78 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:46:44 user nova-compute[70924]: WARNING nova.compute.manager [req-a8fc2be7-a234-4128-b43e-24110ebdaf73 req-53aa9ff0-80af-47d5-83de-0e94b0bfc092 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received unexpected event network-vif-plugged-c6793a3b-97da-4584-a326-f1caf598cd78 for instance with vm_state active and task_state deleting.
Jul 29 14:46:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.093s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2129712-c327-4018-8e09-f383960fa625]: (4, ('1', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] SCSI volumes sdd have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a7d5e0c-d135-4dd9-be3f-8dd700523339')] {{(pid=70924) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 14:46:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a7d5e0c-d135-4dd9-be3f-8dd700523339 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a7d5e0c-d135-4dd9-be3f-8dd700523339 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e730e02-a586-48d2-b39a-b68909bd9f4f]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a7d5e0c-d135-4dd9-be3f-8dd700523339 -p 172.16.0.220:3260 --logout {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a7d5e0c-d135-4dd9-be3f-8dd700523339 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[38536e23-a3fc-4f67-89c6-a304196e5338]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:4a7d5e0c-d135-4dd9-be3f-8dd700523339, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:4a7d5e0c-d135-4dd9-be3f-8dd700523339, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:4a7d5e0c-d135-4dd9-be3f-8dd700523339, portal: 172.16.0.220,3260]
Jul 29 14:46:45 user nova-compute[70924]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:4a7d5e0c-d135-4dd9-be3f-8dd700523339, portal: 172.16.0.220,3260] successful.
Jul 29 14:46:45 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a7d5e0c-d135-4dd9-be3f-8dd700523339 -p 172.16.0.220:3260 --op delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a7d5e0c-d135-4dd9-be3f-8dd700523339 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[436e05fa-a2b9-4ffd-9dee-f260e28dd83c]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.416s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] <== disconnect_volume: return (419ms) None {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Disconnected iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] calling os-brick to detach iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, {'target_iqns': ['iqn.2010-10.org.openstack:0763aadd-e95f-4582-bb01-fcc7dc4681cb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OfBQWvDo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:46:45 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:46:45 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0763aadd-e95f-4582-bb01-fcc7dc4681cb', 0)] {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[01724576-3d75-4755-a278-a3f50490f414]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0763aadd-e95f-4582-bb01-fcc7dc4681cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49b03148-7445-466e-b4dd-4b84dcaaa95a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f62ba9-27e8-4581-9324-971218c46b6c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0763aadd-e95f-4582-bb01-fcc7dc4681cb (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49b03148-7445-466e-b4dd-4b84dcaaa95a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:46:45 user nova-compute[70924]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)
Jul 29 14:46:45 user nova-compute[70924]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 (non-flash)
Jul 29 14:46:45 user nova-compute[70924]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0763aadd-e95f-4582-bb01-fcc7dc4681cb (non-flash)
Jul 29 14:46:45 user nova-compute[70924]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49b03148-7445-466e-b4dd-4b84dcaaa95a (non-flash)
Jul 29 14:46:45 user nova-compute[70924]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:46:45 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:46:45 user nova-compute[70924]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)
Jul 29 14:46:45 user nova-compute[70924]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 (non-flash)
Jul 29 14:46:45 user nova-compute[70924]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0763aadd-e95f-4582-bb01-fcc7dc4681cb (non-flash)
Jul 29 14:46:45 user nova-compute[70924]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49b03148-7445-466e-b4dd-4b84dcaaa95a (non-flash)
Jul 29 14:46:45 user nova-compute[70924]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:46:45 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feecc6ea5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0763aadd-e95f-4582-bb01-fcc7dc4681cb'): ({'sdf'}, set())}) {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Removing single pathed devices sdf {{(pid=70924) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a0c5f6-2a20-4a3b-9dda-e471b55c00e1]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[4970b7af-a5f4-40d1-8d9e-cdf3de5eed92]: (4, ('ok\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Flushing IO for device /dev/sdf {{(pid=70924) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c272774-c8c7-43be-bb35-4498335613a2]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=70924) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.050s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a74ea5-0f08-4b2d-ba2c-c6301fe56b25]: (4, ('1', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] SCSI volumes sdf have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0763aadd-e95f-4582-bb01-fcc7dc4681cb')] {{(pid=70924) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0763aadd-e95f-4582-bb01-fcc7dc4681cb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0763aadd-e95f-4582-bb01-fcc7dc4681cb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de73c38-1256-4808-9a9f-971715823420]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0763aadd-e95f-4582-bb01-fcc7dc4681cb -p 172.16.0.220:3260 --logout {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70924) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0763aadd-e95f-4582-bb01-fcc7dc4681cb -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec45ded-1c48-47eb-9621-79372496e9f8]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:0763aadd-e95f-4582-bb01-fcc7dc4681cb, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:0763aadd-e95f-4582-bb01-fcc7dc4681cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:0763aadd-e95f-4582-bb01-fcc7dc4681cb, portal: 172.16.0.220,3260]
Jul 29 14:46:45 user nova-compute[70924]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:0763aadd-e95f-4582-bb01-fcc7dc4681cb, portal: 172.16.0.220,3260] successful.
Jul 29 14:46:45 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0763aadd-e95f-4582-bb01-fcc7dc4681cb -p 172.16.0.220:3260 --op delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0763aadd-e95f-4582-bb01-fcc7dc4681cb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4dfd8d-238d-405a-b0be-365afe4f8c0a]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] <== disconnect_volume: return (356ms) None {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Disconnected iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] calling os-brick to detach iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, {'target_iqns': ['iqn.2010-10.org.openstack:49b03148-7445-466e-b4dd-4b84dcaaa95a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QTtlFgGX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:46:45 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:46:45 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49b03148-7445-466e-b4dd-4b84dcaaa95a', 0)] {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a049b2-d1d0-4545-8e01-aa6e60d13792]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49b03148-7445-466e-b4dd-4b84dcaaa95a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[7225a097-358c-4314-8081-79ab39f37093]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49b03148-7445-466e-b4dd-4b84dcaaa95a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:46:45 user nova-compute[70924]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)
Jul 29 14:46:45 user nova-compute[70924]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 (non-flash)
Jul 29 14:46:45 user nova-compute[70924]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49b03148-7445-466e-b4dd-4b84dcaaa95a (non-flash)
Jul 29 14:46:45 user nova-compute[70924]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:46:45 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:46:45 user nova-compute[70924]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)
Jul 29 14:46:45 user nova-compute[70924]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 (non-flash)
Jul 29 14:46:45 user nova-compute[70924]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49b03148-7445-466e-b4dd-4b84dcaaa95a (non-flash)
Jul 29 14:46:45 user nova-compute[70924]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:46:45 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feedc64aef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49b03148-7445-466e-b4dd-4b84dcaaa95a'): ({'sdg'}, set())}) {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Removing single pathed devices sdg {{(pid=70924) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[11916070-da64-4383-b866-4f542aff925b]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[65dd8dd3-9e06-4d48-9e39-fa9aac120e9d]: (4, ('ok\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Flushing IO for device /dev/sdg {{(pid=70924) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fad28a4-c7a1-4832-80ca-a01aa4ca9740]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=70924) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.042s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5d0038-9ad7-4a71-bc11-f2022967442f]: (4, ('1', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] SCSI volumes sdg have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49b03148-7445-466e-b4dd-4b84dcaaa95a')] {{(pid=70924) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49b03148-7445-466e-b4dd-4b84dcaaa95a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49b03148-7445-466e-b4dd-4b84dcaaa95a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[45661a9c-07db-48f3-96ed-77129fd35d5c]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49b03148-7445-466e-b4dd-4b84dcaaa95a -p 172.16.0.220:3260 --logout {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49b03148-7445-466e-b4dd-4b84dcaaa95a -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[724aeecf-e406-47fc-8afa-87a542f835bd]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:49b03148-7445-466e-b4dd-4b84dcaaa95a, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:49b03148-7445-466e-b4dd-4b84dcaaa95a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:49b03148-7445-466e-b4dd-4b84dcaaa95a, portal: 172.16.0.220,3260]
Jul 29 14:46:45 user nova-compute[70924]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:49b03148-7445-466e-b4dd-4b84dcaaa95a, portal: 172.16.0.220,3260] successful.
Jul 29 14:46:45 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49b03148-7445-466e-b4dd-4b84dcaaa95a -p 172.16.0.220:3260 --op delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49b03148-7445-466e-b4dd-4b84dcaaa95a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd98d11-f89b-4921-8c25-0c2af7cc3bac]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] <== disconnect_volume: return (324ms) None {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Disconnected iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 14:46:45 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Deleting instance files /opt/stack/data/nova/instances/35bdb2dd-d2d4-4a3d-9178-6892d478dfa3_del
Jul 29 14:46:45 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Deletion of /opt/stack/data/nova/instances/35bdb2dd-d2d4-4a3d-9178-6892d478dfa3_del complete
Jul 29 14:46:45 user nova-compute[70924]: INFO nova.compute.manager [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Took 3.84 seconds to destroy the instance on the hypervisor.
Jul 29 14:46:45 user nova-compute[70924]: DEBUG oslo.service.loopingcall [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70924) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG nova.compute.manager [-] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Deallocating network for instance {{(pid=70924) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 14:46:45 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] deallocate_for_instance() {{(pid=70924) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 14:46:46 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:46:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:46:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:46:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:46:46 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Auditing locally available compute resources for user (node: user) {{(pid=70924) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 14:46:46 user nova-compute[70924]: DEBUG nova.compute.manager [req-1fd5a8bf-626a-4d69-97c4-2911041cc70d req-82976f65-6a2a-45de-9a98-b676f206f656 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received event network-vif-unplugged-7334899f-e7c7-48d8-8c14-4fda63fea3b5 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:46:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-1fd5a8bf-626a-4d69-97c4-2911041cc70d req-82976f65-6a2a-45de-9a98-b676f206f656 service nova] Acquiring lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:46:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-1fd5a8bf-626a-4d69-97c4-2911041cc70d req-82976f65-6a2a-45de-9a98-b676f206f656 service nova] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:46:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-1fd5a8bf-626a-4d69-97c4-2911041cc70d req-82976f65-6a2a-45de-9a98-b676f206f656 service nova] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:46:46 user nova-compute[70924]: DEBUG nova.compute.manager [req-1fd5a8bf-626a-4d69-97c4-2911041cc70d req-82976f65-6a2a-45de-9a98-b676f206f656 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] No waiting events found dispatching network-vif-unplugged-7334899f-e7c7-48d8-8c14-4fda63fea3b5 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:46:46 user nova-compute[70924]: DEBUG nova.compute.manager [req-1fd5a8bf-626a-4d69-97c4-2911041cc70d req-82976f65-6a2a-45de-9a98-b676f206f656 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received event network-vif-unplugged-7334899f-e7c7-48d8-8c14-4fda63fea3b5 for instance with task_state deleting. {{(pid=70924) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 14:46:46 user nova-compute[70924]: DEBUG nova.compute.manager [req-1fd5a8bf-626a-4d69-97c4-2911041cc70d req-82976f65-6a2a-45de-9a98-b676f206f656 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received event network-vif-plugged-7334899f-e7c7-48d8-8c14-4fda63fea3b5 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:46:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-1fd5a8bf-626a-4d69-97c4-2911041cc70d req-82976f65-6a2a-45de-9a98-b676f206f656 service nova] Acquiring lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:46:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-1fd5a8bf-626a-4d69-97c4-2911041cc70d req-82976f65-6a2a-45de-9a98-b676f206f656 service nova] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:46:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-1fd5a8bf-626a-4d69-97c4-2911041cc70d req-82976f65-6a2a-45de-9a98-b676f206f656 service nova] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:46:46 user nova-compute[70924]: DEBUG nova.compute.manager [req-1fd5a8bf-626a-4d69-97c4-2911041cc70d req-82976f65-6a2a-45de-9a98-b676f206f656 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] No waiting events found dispatching network-vif-plugged-7334899f-e7c7-48d8-8c14-4fda63fea3b5 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:46:46 user nova-compute[70924]: WARNING nova.compute.manager [req-1fd5a8bf-626a-4d69-97c4-2911041cc70d req-82976f65-6a2a-45de-9a98-b676f206f656 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received unexpected event network-vif-plugged-7334899f-e7c7-48d8-8c14-4fda63fea3b5 for instance with vm_state active and task_state deleting.
Jul 29 14:46:46 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:46:46 user nova-compute[70924]: DEBUG nova.compute.manager [req-942d400f-5e59-464b-b41d-782d673f62dc req-c8162210-df4b-4f9e-8f88-1e5c6e5340c4 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received event network-vif-plugged-e98a5996-f4ad-44fd-9fc9-591e411bbaa1 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:46:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-942d400f-5e59-464b-b41d-782d673f62dc req-c8162210-df4b-4f9e-8f88-1e5c6e5340c4 service nova] Acquiring lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:46:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-942d400f-5e59-464b-b41d-782d673f62dc req-c8162210-df4b-4f9e-8f88-1e5c6e5340c4 service nova] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:46:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-942d400f-5e59-464b-b41d-782d673f62dc req-c8162210-df4b-4f9e-8f88-1e5c6e5340c4 service nova] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:46:46 user nova-compute[70924]: DEBUG nova.compute.manager [req-942d400f-5e59-464b-b41d-782d673f62dc req-c8162210-df4b-4f9e-8f88-1e5c6e5340c4 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] No waiting events found dispatching network-vif-plugged-e98a5996-f4ad-44fd-9fc9-591e411bbaa1 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:46:46 user nova-compute[70924]: WARNING nova.compute.manager [req-942d400f-5e59-464b-b41d-782d673f62dc req-c8162210-df4b-4f9e-8f88-1e5c6e5340c4 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received unexpected event network-vif-plugged-e98a5996-f4ad-44fd-9fc9-591e411bbaa1 for instance with vm_state active and task_state deleting.
Jul 29 14:46:46 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:46:46 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:46:47 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:46:47 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 14:46:47 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 14:46:47 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79652140-c347-4d7b-9770-a4cc2d1a08e3/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:46:47 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79652140-c347-4d7b-9770-a4cc2d1a08e3/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:46:47 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79652140-c347-4d7b-9770-a4cc2d1a08e3/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:46:47 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79652140-c347-4d7b-9770-a4cc2d1a08e3/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:46:47 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 14:46:47 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02c75b00-a1b4-4ef9-ae96-bc67d8038589/disk.rescue --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:46:47 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02c75b00-a1b4-4ef9-ae96-bc67d8038589/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:46:47 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02c75b00-a1b4-4ef9-ae96-bc67d8038589/disk.rescue --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:46:47 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02c75b00-a1b4-4ef9-ae96-bc67d8038589/disk.rescue --force-share --output=json" returned: 0 in 0.150s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:46:47 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:46:47 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:46:47 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:46:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:46:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c86d8c87-6b21-4475-ab26-68ad706a4845/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:46:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c86d8c87-6b21-4475-ab26-68ad706a4845/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:46:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c86d8c87-6b21-4475-ab26-68ad706a4845/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:46:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c86d8c87-6b21-4475-ab26-68ad706a4845/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:46:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5929dcf-8594-4323-a6f5-a322aff7c881/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:46:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5929dcf-8594-4323-a6f5-a322aff7c881/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:46:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5929dcf-8594-4323-a6f5-a322aff7c881/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:46:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5929dcf-8594-4323-a6f5-a322aff7c881/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:46:48 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 14:46:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5929dcf-8594-4323-a6f5-a322aff7c881/disk.rescue --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:46:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5929dcf-8594-4323-a6f5-a322aff7c881/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:46:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5929dcf-8594-4323-a6f5-a322aff7c881/disk.rescue --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:46:49 user nova-compute[70924]: DEBUG nova.compute.manager [req-279d3ace-479e-4001-a030-f5bf9f69b482 req-6e1fe22a-d116-4d45-b8d9-e4aedd126b4a service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received event network-vif-deleted-0a5aa889-f4ad-49dd-9741-ce0d161bc25f {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:46:49 user nova-compute[70924]: INFO nova.compute.manager [req-279d3ace-479e-4001-a030-f5bf9f69b482 req-6e1fe22a-d116-4d45-b8d9-e4aedd126b4a service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Neutron deleted interface 0a5aa889-f4ad-49dd-9741-ce0d161bc25f; detaching it from the instance and deleting it from the info cache
Jul 29 14:46:49 user nova-compute[70924]: DEBUG nova.network.neutron [req-279d3ace-479e-4001-a030-f5bf9f69b482 req-6e1fe22a-d116-4d45-b8d9-e4aedd126b4a service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Updating instance_info_cache with network_info: [{"id": "195c1f76-2177-4201-bb05-291d7131c3c2", "address": "fa:16:3e:15:a9:c3", "network": {"id": "a836313e-84ad-4a1a-b4de-5eee3652fe69", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-368818776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195c1f76-21", "ovs_interfaceid": "195c1f76-2177-4201-bb05-291d7131c3c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e98a5996-f4ad-44fd-9fc9-591e411bbaa1", "address": "fa:16:3e:bc:51:b6", "network": {"id": "5f1efb98-21ff-48db-95aa-ab5f29e5ff45", "bridge": "br-int", "label": "tempest-device-tagging-net1-473596273", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape98a5996-f4", "ovs_interfaceid": "e98a5996-f4ad-44fd-9fc9-591e411bbaa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f108e5c9-68f4-4444-b686-18df097fa015", "address": "fa:16:3e:08:fb:b3", "network": {"id": "5f1efb98-21ff-48db-95aa-ab5f29e5ff45", "bridge": "br-int", "label": "tempest-device-tagging-net1-473596273", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf108e5c9-68", "ovs_interfaceid": "f108e5c9-68f4-4444-b686-18df097fa015", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2e35e8a0-e202-46d5-b854-9960de88edc2", "address": "fa:16:3e:cc:03:d5", "network": {"id": "5f1efb98-21ff-48db-95aa-ab5f29e5ff45", "bridge": "br-int", "label": "tempest-device-tagging-net1-473596273", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e35e8a0-e2", "ovs_interfaceid": "2e35e8a0-e202-46d5-b854-9960de88edc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7334899f-e7c7-48d8-8c14-4fda63fea3b5", "address": "fa:16:3e:ae:d5:21", "network": {"id": "381d607e-5106-44f3-b3e0-8926c54e74f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-197405985", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7334899f-e7", "ovs_interfaceid": "7334899f-e7c7-48d8-8c14-4fda63fea3b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c6793a3b-97da-4584-a326-f1caf598cd78", "address": "fa:16:3e:30:14:87", "network": {"id": "381d607e-5106-44f3-b3e0-8926c54e74f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-197405985", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6793a3b-97", "ovs_interfaceid": "c6793a3b-97da-4584-a326-f1caf598cd78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:46:49 user nova-compute[70924]: DEBUG nova.compute.manager [req-279d3ace-479e-4001-a030-f5bf9f69b482 req-6e1fe22a-d116-4d45-b8d9-e4aedd126b4a service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Detach interface failed, port_id=0a5aa889-f4ad-49dd-9741-ce0d161bc25f, reason: Instance 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3 could not be found. {{(pid=70924) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 29 14:46:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5929dcf-8594-4323-a6f5-a322aff7c881/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:46:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00231136-233f-4a1b-88ff-b678482ca5bb/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:46:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00231136-233f-4a1b-88ff-b678482ca5bb/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:46:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00231136-233f-4a1b-88ff-b678482ca5bb/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:46:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00231136-233f-4a1b-88ff-b678482ca5bb/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:46:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2250b0d6-5542-4a7f-90a9-93745a776fcc/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:46:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2250b0d6-5542-4a7f-90a9-93745a776fcc/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:46:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2250b0d6-5542-4a7f-90a9-93745a776fcc/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:46:49 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2250b0d6-5542-4a7f-90a9-93745a776fcc/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:46:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:46:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:46:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:46:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:46:50 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:46:50 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:46:50 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Hypervisor/Node resource view: name=user free_ram=7144MB free_disk=25.44510269165039GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70924) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 14:46:50 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:46:50 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:46:50 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-11fd2253-8383-438d-9f56-be10304f0749 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Acquiring lock "9b4c76df-f74f-43b4-968f-b730cc5b0ec6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:46:50 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-11fd2253-8383-438d-9f56-be10304f0749 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Lock "9b4c76df-f74f-43b4-968f-b730cc5b0ec6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:46:50 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-11fd2253-8383-438d-9f56-be10304f0749 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Acquiring lock "9b4c76df-f74f-43b4-968f-b730cc5b0ec6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:46:50 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-11fd2253-8383-438d-9f56-be10304f0749 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Lock "9b4c76df-f74f-43b4-968f-b730cc5b0ec6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:46:50 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-11fd2253-8383-438d-9f56-be10304f0749 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Lock "9b4c76df-f74f-43b4-968f-b730cc5b0ec6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:46:50 user nova-compute[70924]: INFO nova.compute.manager [None req-11fd2253-8383-438d-9f56-be10304f0749 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Terminating instance
Jul 29 14:46:50 user nova-compute[70924]: DEBUG nova.compute.manager [None req-11fd2253-8383-438d-9f56-be10304f0749 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Start destroying the instance on the hypervisor. {{(pid=70924) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 14:46:50 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:50 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:50 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance db656346-c4af-43da-9600-fd39f1b9e4dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:46:50 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 2250b0d6-5542-4a7f-90a9-93745a776fcc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:46:50 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance f5929dcf-8594-4323-a6f5-a322aff7c881 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:46:50 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 86ecc6cb-88a8-4572-8e41-d4c5859036a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:46:50 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 00231136-233f-4a1b-88ff-b678482ca5bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:46:50 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 9b4c76df-f74f-43b4-968f-b730cc5b0ec6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:46:50 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 02c75b00-a1b4-4ef9-ae96-bc67d8038589 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:46:50 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:46:50 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 79652140-c347-4d7b-9770-a4cc2d1a08e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:46:50 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance c86d8c87-6b21-4475-ab26-68ad706a4845 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:46:50 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance f5350fb5-9460-490b-a47e-74f88c8eb51c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:46:50 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 14:46:50 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 14:46:51 user nova-compute[70924]: DEBUG nova.compute.manager [req-9b9c81cc-3fdc-4397-97cb-8e643587c4f9 req-a55f22bf-30e9-4855-9705-3611c03586f8 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received event network-vif-deleted-2e35e8a0-e202-46d5-b854-9960de88edc2 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:46:51 user nova-compute[70924]: INFO nova.compute.manager [req-9b9c81cc-3fdc-4397-97cb-8e643587c4f9 req-a55f22bf-30e9-4855-9705-3611c03586f8 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Neutron deleted interface 2e35e8a0-e202-46d5-b854-9960de88edc2; detaching it from the instance and deleting it from the info cache
Jul 29 14:46:51 user nova-compute[70924]: DEBUG nova.network.neutron [req-9b9c81cc-3fdc-4397-97cb-8e643587c4f9 req-a55f22bf-30e9-4855-9705-3611c03586f8 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Updating instance_info_cache with network_info: [{"id": "195c1f76-2177-4201-bb05-291d7131c3c2", "address": "fa:16:3e:15:a9:c3", "network": {"id": "a836313e-84ad-4a1a-b4de-5eee3652fe69", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-368818776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195c1f76-21", "ovs_interfaceid": "195c1f76-2177-4201-bb05-291d7131c3c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e98a5996-f4ad-44fd-9fc9-591e411bbaa1", "address": "fa:16:3e:bc:51:b6", "network": {"id": "5f1efb98-21ff-48db-95aa-ab5f29e5ff45", "bridge": "br-int", "label": "tempest-device-tagging-net1-473596273", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape98a5996-f4", "ovs_interfaceid": "e98a5996-f4ad-44fd-9fc9-591e411bbaa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f108e5c9-68f4-4444-b686-18df097fa015", "address": "fa:16:3e:08:fb:b3", "network": {"id": "5f1efb98-21ff-48db-95aa-ab5f29e5ff45", "bridge": "br-int", "label": "tempest-device-tagging-net1-473596273", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf108e5c9-68", "ovs_interfaceid": "f108e5c9-68f4-4444-b686-18df097fa015", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7334899f-e7c7-48d8-8c14-4fda63fea3b5", "address": "fa:16:3e:ae:d5:21", "network": {"id": "381d607e-5106-44f3-b3e0-8926c54e74f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-197405985", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7334899f-e7", "ovs_interfaceid": "7334899f-e7c7-48d8-8c14-4fda63fea3b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c6793a3b-97da-4584-a326-f1caf598cd78", "address": "fa:16:3e:30:14:87", "network": {"id": "381d607e-5106-44f3-b3e0-8926c54e74f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-197405985", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6793a3b-97", "ovs_interfaceid": "c6793a3b-97da-4584-a326-f1caf598cd78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:46:51 user nova-compute[70924]: DEBUG nova.compute.manager [req-9b9c81cc-3fdc-4397-97cb-8e643587c4f9 req-a55f22bf-30e9-4855-9705-3611c03586f8 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Detach interface failed, port_id=2e35e8a0-e202-46d5-b854-9960de88edc2, reason: Instance 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3 could not be found. {{(pid=70924) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 29 14:46:51 user nova-compute[70924]: DEBUG nova.compute.manager [req-9b9c81cc-3fdc-4397-97cb-8e643587c4f9 req-a55f22bf-30e9-4855-9705-3611c03586f8 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received event network-vif-deleted-c6793a3b-97da-4584-a326-f1caf598cd78 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:46:51 user nova-compute[70924]: INFO nova.compute.manager [req-9b9c81cc-3fdc-4397-97cb-8e643587c4f9 req-a55f22bf-30e9-4855-9705-3611c03586f8 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Neutron deleted interface c6793a3b-97da-4584-a326-f1caf598cd78; detaching it from the instance and deleting it from the info cache
Jul 29 14:46:51 user nova-compute[70924]: DEBUG nova.network.neutron [req-9b9c81cc-3fdc-4397-97cb-8e643587c4f9 req-a55f22bf-30e9-4855-9705-3611c03586f8 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Updating instance_info_cache with network_info: [{"id": "195c1f76-2177-4201-bb05-291d7131c3c2", "address": "fa:16:3e:15:a9:c3", "network": {"id": "a836313e-84ad-4a1a-b4de-5eee3652fe69", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-368818776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195c1f76-21", "ovs_interfaceid": "195c1f76-2177-4201-bb05-291d7131c3c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e98a5996-f4ad-44fd-9fc9-591e411bbaa1", "address": "fa:16:3e:bc:51:b6", "network": {"id": "5f1efb98-21ff-48db-95aa-ab5f29e5ff45", "bridge": "br-int", "label": "tempest-device-tagging-net1-473596273", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape98a5996-f4", "ovs_interfaceid": "e98a5996-f4ad-44fd-9fc9-591e411bbaa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f108e5c9-68f4-4444-b686-18df097fa015", "address": "fa:16:3e:08:fb:b3", "network": {"id": "5f1efb98-21ff-48db-95aa-ab5f29e5ff45", "bridge": "br-int", "label": "tempest-device-tagging-net1-473596273", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf108e5c9-68", "ovs_interfaceid": "f108e5c9-68f4-4444-b686-18df097fa015", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7334899f-e7c7-48d8-8c14-4fda63fea3b5", "address": "fa:16:3e:ae:d5:21", "network": {"id": "381d607e-5106-44f3-b3e0-8926c54e74f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-197405985", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7334899f-e7", "ovs_interfaceid": "7334899f-e7c7-48d8-8c14-4fda63fea3b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:46:51 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:51 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:51 user nova-compute[70924]: DEBUG nova.compute.manager [req-9b9c81cc-3fdc-4397-97cb-8e643587c4f9 req-a55f22bf-30e9-4855-9705-3611c03586f8 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Detach interface failed, port_id=c6793a3b-97da-4584-a326-f1caf598cd78, reason: Instance 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3 could not be found. {{(pid=70924) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 29 14:46:51 user nova-compute[70924]: DEBUG nova.compute.manager [req-9b9c81cc-3fdc-4397-97cb-8e643587c4f9 req-a55f22bf-30e9-4855-9705-3611c03586f8 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received event network-vif-deleted-7334899f-e7c7-48d8-8c14-4fda63fea3b5 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:46:51 user nova-compute[70924]: INFO nova.compute.manager [req-9b9c81cc-3fdc-4397-97cb-8e643587c4f9 req-a55f22bf-30e9-4855-9705-3611c03586f8 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Neutron deleted interface 7334899f-e7c7-48d8-8c14-4fda63fea3b5; detaching it from the instance and deleting it from the info cache
Jul 29 14:46:51 user nova-compute[70924]: DEBUG nova.network.neutron [req-9b9c81cc-3fdc-4397-97cb-8e643587c4f9 req-a55f22bf-30e9-4855-9705-3611c03586f8 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Updating instance_info_cache with network_info: [{"id": "195c1f76-2177-4201-bb05-291d7131c3c2", "address": "fa:16:3e:15:a9:c3", "network": {"id": "a836313e-84ad-4a1a-b4de-5eee3652fe69", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-368818776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195c1f76-21", "ovs_interfaceid": "195c1f76-2177-4201-bb05-291d7131c3c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e98a5996-f4ad-44fd-9fc9-591e411bbaa1", "address": "fa:16:3e:bc:51:b6", "network": {"id": "5f1efb98-21ff-48db-95aa-ab5f29e5ff45", "bridge": "br-int", "label": "tempest-device-tagging-net1-473596273", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape98a5996-f4", "ovs_interfaceid": "e98a5996-f4ad-44fd-9fc9-591e411bbaa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f108e5c9-68f4-4444-b686-18df097fa015", "address": "fa:16:3e:08:fb:b3", "network": {"id": "5f1efb98-21ff-48db-95aa-ab5f29e5ff45", "bridge": "br-int", "label": "tempest-device-tagging-net1-473596273", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "87bd9746a49c4efeaea2c4b38c1b42c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf108e5c9-68", "ovs_interfaceid": "f108e5c9-68f4-4444-b686-18df097fa015", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:46:51 user nova-compute[70924]: DEBUG nova.compute.manager [req-9b9c81cc-3fdc-4397-97cb-8e643587c4f9 req-a55f22bf-30e9-4855-9705-3611c03586f8 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Detach interface failed, port_id=7334899f-e7c7-48d8-8c14-4fda63fea3b5, reason: Instance 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3 could not be found. {{(pid=70924) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 29 14:46:51 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:46:51 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:46:51 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Compute_service record updated for user:user {{(pid=70924) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 14:46:51 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.662s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:46:51 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:46:51 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Cleaning up deleted instances with incomplete migration  {{(pid=70924) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 29 14:46:51 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Instance destroyed successfully.
Jul 29 14:46:51 user nova-compute[70924]: DEBUG nova.objects.instance [None req-11fd2253-8383-438d-9f56-be10304f0749 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Lazy-loading 'resources' on Instance uuid 9b4c76df-f74f-43b4-968f-b730cc5b0ec6 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:46:51 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-11fd2253-8383-438d-9f56-be10304f0749 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-29T14:43:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-548861444',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-557172459',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIRtdSU+MVFf8qwfTK/HOmWFsyOji10ll1mwxkAqJoexyhER2LF96x27gUwwiTyRjXgCHH8B6MegN4zey5bLI+qd4irGAGZrC8bAT7qofxp4xjUAZePgyakCsMZxbHsjfw==',key_name='tempest-keypair-1008786546',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:45:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fc2394c924af4a9aaa925d116b2117ae',ramdisk_id='',reservation_id='r-8ju02t52',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1372699391',owner_user_name='tempest-ServerActionsV293TestJSON-1372699391-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:45:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b744bbecccf48d1833ea4810b2af2d0',uuid=9b4c76df-f74f-43b4-968f-b730cc5b0ec6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "325110be-cad2-4b73-9044-3028f80f3d37", "address": "fa:16:3e:68:19:c4", "network": {"id": "b6631336-b322-45e0-99b7-5e95539aa674", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2109271400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc2394c924af4a9aaa925d116b2117ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap325110be-ca", "ovs_interfaceid": "325110be-cad2-4b73-9044-3028f80f3d37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 14:46:51 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-11fd2253-8383-438d-9f56-be10304f0749 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Converting VIF {"id": "325110be-cad2-4b73-9044-3028f80f3d37", "address": "fa:16:3e:68:19:c4", "network": {"id": "b6631336-b322-45e0-99b7-5e95539aa674", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2109271400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc2394c924af4a9aaa925d116b2117ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap325110be-ca", "ovs_interfaceid": "325110be-cad2-4b73-9044-3028f80f3d37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:46:51 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-11fd2253-8383-438d-9f56-be10304f0749 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:19:c4,bridge_name='br-int',has_traffic_filtering=True,id=325110be-cad2-4b73-9044-3028f80f3d37,network=Network(b6631336-b322-45e0-99b7-5e95539aa674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap325110be-ca') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:46:51 user nova-compute[70924]: DEBUG os_vif [None req-11fd2253-8383-438d-9f56-be10304f0749 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:19:c4,bridge_name='br-int',has_traffic_filtering=True,id=325110be-cad2-4b73-9044-3028f80f3d37,network=Network(b6631336-b322-45e0-99b7-5e95539aa674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap325110be-ca') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 14:46:51 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:51 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap325110be-ca, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:46:51 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:51 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:51 user nova-compute[70924]: INFO os_vif [None req-11fd2253-8383-438d-9f56-be10304f0749 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:19:c4,bridge_name='br-int',has_traffic_filtering=True,id=325110be-cad2-4b73-9044-3028f80f3d37,network=Network(b6631336-b322-45e0-99b7-5e95539aa674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap325110be-ca')
Jul 29 14:46:51 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11fd2253-8383-438d-9f56-be10304f0749 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] calling os-brick to detach iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 14:46:51 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-11fd2253-8383-438d-9f56-be10304f0749 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, {'target_iqns': ['iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uNkATmgG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:46:51 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-11fd2253-8383-438d-9f56-be10304f0749 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:46:51 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-11fd2253-8383-438d-9f56-be10304f0749 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:46:51 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-11fd2253-8383-438d-9f56-be10304f0749 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:46:51 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-11fd2253-8383-438d-9f56-be10304f0749 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7', 0)] {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 14:46:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:46:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.034s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:46:51 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9bb514c-6916-471e-972b-52b1e615b63d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:46:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:46:51 user nova-compute[70924]: INFO nova.compute.manager [None req-521e5221-da02-417c-ba04-4e15f6cb4989 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Unrescuing
Jul 29 14:46:51 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-521e5221-da02-417c-ba04-4e15f6cb4989 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Acquiring lock "refresh_cache-f5929dcf-8594-4323-a6f5-a322aff7c881" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:46:51 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-521e5221-da02-417c-ba04-4e15f6cb4989 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Acquired lock "refresh_cache-f5929dcf-8594-4323-a6f5-a322aff7c881" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:46:51 user nova-compute[70924]: DEBUG nova.network.neutron [None req-521e5221-da02-417c-ba04-4e15f6cb4989 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 14:46:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.048s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:46:51 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5847e145-7fcd-490c-ada3-be821eba3b32]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:46:51 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-11fd2253-8383-438d-9f56-be10304f0749 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:46:51 user nova-compute[70924]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)
Jul 29 14:46:51 user nova-compute[70924]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 (non-flash)
Jul 29 14:46:51 user nova-compute[70924]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:46:51 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:46:51 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-11fd2253-8383-438d-9f56-be10304f0749 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:46:51 user nova-compute[70924]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)
Jul 29 14:46:51 user nova-compute[70924]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 (non-flash)
Jul 29 14:46:51 user nova-compute[70924]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 (non-flash)
Jul 29 14:46:51 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:46:51 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-11fd2253-8383-438d-9f56-be10304f0749 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feee9a8bc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7'): ({'sdh'}, set())}) {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 14:46:51 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-11fd2253-8383-438d-9f56-be10304f0749 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Removing single pathed devices sdh {{(pid=70924) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 14:46:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:46:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:46:51 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[03926715-d95e-4e93-a7da-60b7a43d0c29]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:46:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:46:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:46:51 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bbbe461-88fb-4173-818f-18e1833b1628]: (4, ('ok\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:46:51 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-11fd2253-8383-438d-9f56-be10304f0749 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Flushing IO for device /dev/sdh {{(pid=70924) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 14:46:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:46:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:46:51 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad290237-600d-476a-84c0-d068978b7180]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:46:51 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-11fd2253-8383-438d-9f56-be10304f0749 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=70924) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 14:46:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:46:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.052s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:46:51 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b646bae-7935-4dba-b632-6a13eb3a1452]: (4, ('1', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:46:51 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-11fd2253-8383-438d-9f56-be10304f0749 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 14:46:51 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-11fd2253-8383-438d-9f56-be10304f0749 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] SCSI volumes sdh have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 14:46:51 user nova-compute[70924]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23731623232393037', '/dev/disk/by-id/scsi-1SCST_BIOada3b226-71b229078fde9d46', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_ada3b226') {{(pid=81998) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 29 14:46:51 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e005a7e-84c7-4478-b29c-fe3918c78c37]: (4, None) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:46:51 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-11fd2253-8383-438d-9f56-be10304f0749 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7')] {{(pid=70924) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 14:46:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:46:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:46:51 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1473c28d-ea76-44aa-b5bd-251378dc15df]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:46:51 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-11fd2253-8383-438d-9f56-be10304f0749 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:46:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 -p 172.16.0.220:3260 --logout {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:46:51 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:46:51 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Took 6.02 seconds to deallocate network for instance.
Jul 29 14:46:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:46:51 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[be32b5a7-a4b0-4a90-a1cd-05f3194a7dbd]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:46:51 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-11fd2253-8383-438d-9f56-be10304f0749 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7, portal: 172.16.0.220,3260]
Jul 29 14:46:51 user nova-compute[70924]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7, portal: 172.16.0.220,3260] successful.
Jul 29 14:46:51 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:46:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 -p 172.16.0.220:3260 --op delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:46:52 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45a218df-4554-4d68-ba78-d0232ff799b7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:46:52 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b7c459-9905-4fe5-a28a-48bc02b702fc]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:46:52 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-11fd2253-8383-438d-9f56-be10304f0749 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:46:52 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-11fd2253-8383-438d-9f56-be10304f0749 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.396s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:46:52 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-11fd2253-8383-438d-9f56-be10304f0749 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] <== disconnect_volume: return (397ms) None {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:46:52 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11fd2253-8383-438d-9f56-be10304f0749 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Disconnected iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 14:46:52 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-11fd2253-8383-438d-9f56-be10304f0749 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Deleting instance files /opt/stack/data/nova/instances/9b4c76df-f74f-43b4-968f-b730cc5b0ec6_del
Jul 29 14:46:52 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-11fd2253-8383-438d-9f56-be10304f0749 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Deletion of /opt/stack/data/nova/instances/9b4c76df-f74f-43b4-968f-b730cc5b0ec6_del complete
Jul 29 14:46:52 user nova-compute[70924]: INFO nova.compute.manager [None req-11fd2253-8383-438d-9f56-be10304f0749 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Took 1.36 seconds to destroy the instance on the hypervisor.
Jul 29 14:46:52 user nova-compute[70924]: DEBUG oslo.service.loopingcall [None req-11fd2253-8383-438d-9f56-be10304f0749 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70924) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 14:46:52 user nova-compute[70924]: DEBUG nova.compute.manager [-] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Deallocating network for instance {{(pid=70924) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 14:46:52 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] deallocate_for_instance() {{(pid=70924) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 14:46:52 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:46:52 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:46:52 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:46:52 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Starting heal instance info cache {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 14:46:52 user nova-compute[70924]: DEBUG nova.network.neutron [None req-521e5221-da02-417c-ba04-4e15f6cb4989 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Updating instance_info_cache with network_info: [{"id": "14b12f31-f886-4752-bac2-e4673c74ae85", "address": "fa:16:3e:0b:f1:80", "network": {"id": "4a3c2dab-e462-4e17-a2a3-f07747a26bbe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1820325619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b2ac23ab8cd48b390fa2047c1fd0e3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14b12f31-f8", "ovs_interfaceid": "14b12f31-f886-4752-bac2-e4673c74ae85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:46:52 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-521e5221-da02-417c-ba04-4e15f6cb4989 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Releasing lock "refresh_cache-f5929dcf-8594-4323-a6f5-a322aff7c881" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:46:52 user nova-compute[70924]: DEBUG nova.objects.instance [None req-521e5221-da02-417c-ba04-4e15f6cb4989 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Lazy-loading 'flavor' on Instance uuid f5929dcf-8594-4323-a6f5-a322aff7c881 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:46:52 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:52 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "refresh_cache-00231136-233f-4a1b-88ff-b678482ca5bb" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:46:52 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquired lock "refresh_cache-00231136-233f-4a1b-88ff-b678482ca5bb" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:46:52 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Forcefully refreshing network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 29 14:46:52 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:52 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:53 user nova-compute[70924]: DEBUG nova.compute.manager [req-9ce22a7b-9774-4cfa-92cb-611ac07a732f req-440556eb-8536-4b12-af28-0d2806dc08e2 service nova] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Received event network-vif-unplugged-325110be-cad2-4b73-9044-3028f80f3d37 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:46:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-9ce22a7b-9774-4cfa-92cb-611ac07a732f req-440556eb-8536-4b12-af28-0d2806dc08e2 service nova] Acquiring lock "9b4c76df-f74f-43b4-968f-b730cc5b0ec6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:46:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-9ce22a7b-9774-4cfa-92cb-611ac07a732f req-440556eb-8536-4b12-af28-0d2806dc08e2 service nova] Lock "9b4c76df-f74f-43b4-968f-b730cc5b0ec6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:46:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-9ce22a7b-9774-4cfa-92cb-611ac07a732f req-440556eb-8536-4b12-af28-0d2806dc08e2 service nova] Lock "9b4c76df-f74f-43b4-968f-b730cc5b0ec6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:46:53 user nova-compute[70924]: DEBUG nova.compute.manager [req-9ce22a7b-9774-4cfa-92cb-611ac07a732f req-440556eb-8536-4b12-af28-0d2806dc08e2 service nova] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] No waiting events found dispatching network-vif-unplugged-325110be-cad2-4b73-9044-3028f80f3d37 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:46:53 user nova-compute[70924]: DEBUG nova.compute.manager [req-9ce22a7b-9774-4cfa-92cb-611ac07a732f req-440556eb-8536-4b12-af28-0d2806dc08e2 service nova] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Received event network-vif-unplugged-325110be-cad2-4b73-9044-3028f80f3d37 for instance with task_state deleting. {{(pid=70924) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 14:46:53 user nova-compute[70924]: DEBUG nova.compute.manager [req-9ce22a7b-9774-4cfa-92cb-611ac07a732f req-440556eb-8536-4b12-af28-0d2806dc08e2 service nova] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Received event network-vif-plugged-325110be-cad2-4b73-9044-3028f80f3d37 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:46:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-9ce22a7b-9774-4cfa-92cb-611ac07a732f req-440556eb-8536-4b12-af28-0d2806dc08e2 service nova] Acquiring lock "9b4c76df-f74f-43b4-968f-b730cc5b0ec6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:46:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-9ce22a7b-9774-4cfa-92cb-611ac07a732f req-440556eb-8536-4b12-af28-0d2806dc08e2 service nova] Lock "9b4c76df-f74f-43b4-968f-b730cc5b0ec6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:46:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-9ce22a7b-9774-4cfa-92cb-611ac07a732f req-440556eb-8536-4b12-af28-0d2806dc08e2 service nova] Lock "9b4c76df-f74f-43b4-968f-b730cc5b0ec6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:46:53 user nova-compute[70924]: DEBUG nova.compute.manager [req-9ce22a7b-9774-4cfa-92cb-611ac07a732f req-440556eb-8536-4b12-af28-0d2806dc08e2 service nova] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] No waiting events found dispatching network-vif-plugged-325110be-cad2-4b73-9044-3028f80f3d37 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:46:53 user nova-compute[70924]: WARNING nova.compute.manager [req-9ce22a7b-9774-4cfa-92cb-611ac07a732f req-440556eb-8536-4b12-af28-0d2806dc08e2 service nova] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Received unexpected event network-vif-plugged-325110be-cad2-4b73-9044-3028f80f3d37 for instance with vm_state active and task_state deleting.
Jul 29 14:46:53 user nova-compute[70924]: DEBUG nova.compute.manager [req-9ce22a7b-9774-4cfa-92cb-611ac07a732f req-440556eb-8536-4b12-af28-0d2806dc08e2 service nova] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Received event network-vif-deleted-195c1f76-2177-4201-bb05-291d7131c3c2 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:46:53 user nova-compute[70924]: DEBUG nova.compute.manager [req-9ce22a7b-9774-4cfa-92cb-611ac07a732f req-440556eb-8536-4b12-af28-0d2806dc08e2 service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Received event network-vif-unplugged-14b12f31-f886-4752-bac2-e4673c74ae85 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:46:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-9ce22a7b-9774-4cfa-92cb-611ac07a732f req-440556eb-8536-4b12-af28-0d2806dc08e2 service nova] Acquiring lock "f5929dcf-8594-4323-a6f5-a322aff7c881-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:46:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-9ce22a7b-9774-4cfa-92cb-611ac07a732f req-440556eb-8536-4b12-af28-0d2806dc08e2 service nova] Lock "f5929dcf-8594-4323-a6f5-a322aff7c881-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:46:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-9ce22a7b-9774-4cfa-92cb-611ac07a732f req-440556eb-8536-4b12-af28-0d2806dc08e2 service nova] Lock "f5929dcf-8594-4323-a6f5-a322aff7c881-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:46:53 user nova-compute[70924]: DEBUG nova.compute.manager [req-9ce22a7b-9774-4cfa-92cb-611ac07a732f req-440556eb-8536-4b12-af28-0d2806dc08e2 service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] No waiting events found dispatching network-vif-unplugged-14b12f31-f886-4752-bac2-e4673c74ae85 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:46:53 user nova-compute[70924]: WARNING nova.compute.manager [req-9ce22a7b-9774-4cfa-92cb-611ac07a732f req-440556eb-8536-4b12-af28-0d2806dc08e2 service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Received unexpected event network-vif-unplugged-14b12f31-f886-4752-bac2-e4673c74ae85 for instance with vm_state rescued and task_state unrescuing.
Jul 29 14:46:53 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Updating instance_info_cache with network_info: [{"id": "6b392743-3314-4d79-babc-13089e99b60b", "address": "fa:16:3e:fd:b3:38", "network": {"id": "40edab25-ab3a-4874-b47f-1ffa2b5452ee", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1511348766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c7e4c0801264e7794b962f8856e5734", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b392743-33", "ovs_interfaceid": "6b392743-3314-4d79-babc-13089e99b60b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:46:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Releasing lock "refresh_cache-00231136-233f-4a1b-88ff-b678482ca5bb" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:46:53 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Updated the network info_cache for instance {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 29 14:46:53 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:46:53 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:46:53 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:46:53 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:46:53 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:46:53 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._sync_power_states {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:46:53 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Instance destroyed successfully.
Jul 29 14:46:53 user nova-compute[70924]: WARNING nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] While synchronizing instance power states, found 11 instances in the database and 9 instances on the hypervisor.
Jul 29 14:46:53 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Triggering sync for uuid db656346-c4af-43da-9600-fd39f1b9e4dc {{(pid=70924) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 29 14:46:53 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Triggering sync for uuid 2250b0d6-5542-4a7f-90a9-93745a776fcc {{(pid=70924) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 29 14:46:53 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Triggering sync for uuid f5929dcf-8594-4323-a6f5-a322aff7c881 {{(pid=70924) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 29 14:46:53 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Triggering sync for uuid 86ecc6cb-88a8-4572-8e41-d4c5859036a6 {{(pid=70924) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 29 14:46:53 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Triggering sync for uuid 00231136-233f-4a1b-88ff-b678482ca5bb {{(pid=70924) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 29 14:46:53 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Triggering sync for uuid 9b4c76df-f74f-43b4-968f-b730cc5b0ec6 {{(pid=70924) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 29 14:46:53 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Triggering sync for uuid 02c75b00-a1b4-4ef9-ae96-bc67d8038589 {{(pid=70924) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 29 14:46:53 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Triggering sync for uuid 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3 {{(pid=70924) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 29 14:46:53 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Triggering sync for uuid 79652140-c347-4d7b-9770-a4cc2d1a08e3 {{(pid=70924) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 29 14:46:53 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Triggering sync for uuid c86d8c87-6b21-4475-ab26-68ad706a4845 {{(pid=70924) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 29 14:46:53 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Triggering sync for uuid f5350fb5-9460-490b-a47e-74f88c8eb51c {{(pid=70924) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 29 14:46:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "db656346-c4af-43da-9600-fd39f1b9e4dc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:46:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "db656346-c4af-43da-9600-fd39f1b9e4dc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:46:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "2250b0d6-5542-4a7f-90a9-93745a776fcc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:46:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "2250b0d6-5542-4a7f-90a9-93745a776fcc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:46:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "f5929dcf-8594-4323-a6f5-a322aff7c881" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:46:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "f5929dcf-8594-4323-a6f5-a322aff7c881" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:46:53 user nova-compute[70924]: INFO nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 29 14:46:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "f5929dcf-8594-4323-a6f5-a322aff7c881" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:46:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "86ecc6cb-88a8-4572-8e41-d4c5859036a6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:46:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "86ecc6cb-88a8-4572-8e41-d4c5859036a6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:46:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "00231136-233f-4a1b-88ff-b678482ca5bb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:46:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "00231136-233f-4a1b-88ff-b678482ca5bb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:46:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "9b4c76df-f74f-43b4-968f-b730cc5b0ec6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:46:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "02c75b00-a1b4-4ef9-ae96-bc67d8038589" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:46:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "02c75b00-a1b4-4ef9-ae96-bc67d8038589" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:46:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:46:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "79652140-c347-4d7b-9770-a4cc2d1a08e3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:46:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "79652140-c347-4d7b-9770-a4cc2d1a08e3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:46:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "c86d8c87-6b21-4475-ab26-68ad706a4845" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:46:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "c86d8c87-6b21-4475-ab26-68ad706a4845" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:46:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "f5350fb5-9460-490b-a47e-74f88c8eb51c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:46:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "f5350fb5-9460-490b-a47e-74f88c8eb51c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:46:53 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "00231136-233f-4a1b-88ff-b678482ca5bb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.090s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:46:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "db656346-c4af-43da-9600-fd39f1b9e4dc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.103s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:46:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "86ecc6cb-88a8-4572-8e41-d4c5859036a6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.112s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:46:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "79652140-c347-4d7b-9770-a4cc2d1a08e3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.111s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:46:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "2250b0d6-5542-4a7f-90a9-93745a776fcc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.118s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:46:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "c86d8c87-6b21-4475-ab26-68ad706a4845" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.115s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:46:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "02c75b00-a1b4-4ef9-ae96-bc67d8038589" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.124s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:46:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "f5350fb5-9460-490b-a47e-74f88c8eb51c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.132s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:46:53 user nova-compute[70924]: DEBUG nova.compute.manager [req-d0de7af0-9480-4a88-87a9-af183c784b49 req-8a47adae-e442-4df3-84f9-fbef74d28762 service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Received event network-changed-14b12f31-f886-4752-bac2-e4673c74ae85 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:46:53 user nova-compute[70924]: DEBUG nova.compute.manager [req-d0de7af0-9480-4a88-87a9-af183c784b49 req-8a47adae-e442-4df3-84f9-fbef74d28762 service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Refreshing instance network info cache due to event network-changed-14b12f31-f886-4752-bac2-e4673c74ae85. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:46:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-d0de7af0-9480-4a88-87a9-af183c784b49 req-8a47adae-e442-4df3-84f9-fbef74d28762 service nova] Acquiring lock "refresh_cache-f5929dcf-8594-4323-a6f5-a322aff7c881" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:46:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-d0de7af0-9480-4a88-87a9-af183c784b49 req-8a47adae-e442-4df3-84f9-fbef74d28762 service nova] Acquired lock "refresh_cache-f5929dcf-8594-4323-a6f5-a322aff7c881" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:46:53 user nova-compute[70924]: DEBUG nova.network.neutron [req-d0de7af0-9480-4a88-87a9-af183c784b49 req-8a47adae-e442-4df3-84f9-fbef74d28762 service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Refreshing network info cache for port 14b12f31-f886-4752-bac2-e4673c74ae85 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:46:54 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:46:54 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Took 2.15 seconds to deallocate network for instance.
Jul 29 14:46:54 user nova-compute[70924]: INFO nova.compute.manager [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Took 2.65 seconds to detach 3 volumes for instance.
Jul 29 14:46:54 user nova-compute[70924]: DEBUG nova.network.neutron [req-d0de7af0-9480-4a88-87a9-af183c784b49 req-8a47adae-e442-4df3-84f9-fbef74d28762 service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Updated VIF entry in instance network info cache for port 14b12f31-f886-4752-bac2-e4673c74ae85. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:46:54 user nova-compute[70924]: DEBUG nova.network.neutron [req-d0de7af0-9480-4a88-87a9-af183c784b49 req-8a47adae-e442-4df3-84f9-fbef74d28762 service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Updating instance_info_cache with network_info: [{"id": "14b12f31-f886-4752-bac2-e4673c74ae85", "address": "fa:16:3e:0b:f1:80", "network": {"id": "4a3c2dab-e462-4e17-a2a3-f07747a26bbe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1820325619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b2ac23ab8cd48b390fa2047c1fd0e3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14b12f31-f8", "ovs_interfaceid": "14b12f31-f886-4752-bac2-e4673c74ae85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:46:54 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-d0de7af0-9480-4a88-87a9-af183c784b49 req-8a47adae-e442-4df3-84f9-fbef74d28762 service nova] Releasing lock "refresh_cache-f5929dcf-8594-4323-a6f5-a322aff7c881" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:46:54 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:46:54 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:46:54 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:54 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:54 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:54 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:55 user nova-compute[70924]: INFO nova.compute.manager [None req-11fd2253-8383-438d-9f56-be10304f0749 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Took 0.88 seconds to detach 1 volumes for instance.
Jul 29 14:46:55 user nova-compute[70924]: DEBUG nova.compute.manager [None req-11fd2253-8383-438d-9f56-be10304f0749 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Deleting volume: 45a218df-4554-4d68-ba78-d0232ff799b7 {{(pid=70924) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Jul 29 14:46:55 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:46:55 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:46:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.591s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:46:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-11fd2253-8383-438d-9f56-be10304f0749 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:46:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-11fd2253-8383-438d-9f56-be10304f0749 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:46:55 user nova-compute[70924]: INFO nova.scheduler.client.report [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Deleted allocations for instance 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3
Jul 29 14:46:55 user nova-compute[70924]: DEBUG nova.compute.manager [req-7ce62c22-d302-40e0-88d4-d53569d431f5 req-b30f45c5-8236-4b7d-9bcd-80bd49ebe8e2 service nova] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Received event network-vif-deleted-325110be-cad2-4b73-9044-3028f80f3d37 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:46:55 user nova-compute[70924]: DEBUG nova.compute.manager [req-7ce62c22-d302-40e0-88d4-d53569d431f5 req-b30f45c5-8236-4b7d-9bcd-80bd49ebe8e2 service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Received event network-vif-plugged-14b12f31-f886-4752-bac2-e4673c74ae85 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:46:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-7ce62c22-d302-40e0-88d4-d53569d431f5 req-b30f45c5-8236-4b7d-9bcd-80bd49ebe8e2 service nova] Acquiring lock "f5929dcf-8594-4323-a6f5-a322aff7c881-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:46:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-7ce62c22-d302-40e0-88d4-d53569d431f5 req-b30f45c5-8236-4b7d-9bcd-80bd49ebe8e2 service nova] Lock "f5929dcf-8594-4323-a6f5-a322aff7c881-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:46:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-7ce62c22-d302-40e0-88d4-d53569d431f5 req-b30f45c5-8236-4b7d-9bcd-80bd49ebe8e2 service nova] Lock "f5929dcf-8594-4323-a6f5-a322aff7c881-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:46:55 user nova-compute[70924]: DEBUG nova.compute.manager [req-7ce62c22-d302-40e0-88d4-d53569d431f5 req-b30f45c5-8236-4b7d-9bcd-80bd49ebe8e2 service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] No waiting events found dispatching network-vif-plugged-14b12f31-f886-4752-bac2-e4673c74ae85 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:46:55 user nova-compute[70924]: WARNING nova.compute.manager [req-7ce62c22-d302-40e0-88d4-d53569d431f5 req-b30f45c5-8236-4b7d-9bcd-80bd49ebe8e2 service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Received unexpected event network-vif-plugged-14b12f31-f886-4752-bac2-e4673c74ae85 for instance with vm_state rescued and task_state unrescuing.
Jul 29 14:46:55 user nova-compute[70924]: DEBUG nova.compute.manager [req-7ce62c22-d302-40e0-88d4-d53569d431f5 req-b30f45c5-8236-4b7d-9bcd-80bd49ebe8e2 service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Received event network-vif-plugged-14b12f31-f886-4752-bac2-e4673c74ae85 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:46:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-7ce62c22-d302-40e0-88d4-d53569d431f5 req-b30f45c5-8236-4b7d-9bcd-80bd49ebe8e2 service nova] Acquiring lock "f5929dcf-8594-4323-a6f5-a322aff7c881-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:46:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-7ce62c22-d302-40e0-88d4-d53569d431f5 req-b30f45c5-8236-4b7d-9bcd-80bd49ebe8e2 service nova] Lock "f5929dcf-8594-4323-a6f5-a322aff7c881-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:46:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-7ce62c22-d302-40e0-88d4-d53569d431f5 req-b30f45c5-8236-4b7d-9bcd-80bd49ebe8e2 service nova] Lock "f5929dcf-8594-4323-a6f5-a322aff7c881-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:46:55 user nova-compute[70924]: DEBUG nova.compute.manager [req-7ce62c22-d302-40e0-88d4-d53569d431f5 req-b30f45c5-8236-4b7d-9bcd-80bd49ebe8e2 service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] No waiting events found dispatching network-vif-plugged-14b12f31-f886-4752-bac2-e4673c74ae85 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:46:55 user nova-compute[70924]: WARNING nova.compute.manager [req-7ce62c22-d302-40e0-88d4-d53569d431f5 req-b30f45c5-8236-4b7d-9bcd-80bd49ebe8e2 service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Received unexpected event network-vif-plugged-14b12f31-f886-4752-bac2-e4673c74ae85 for instance with vm_state rescued and task_state unrescuing.
Jul 29 14:46:55 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-7b347c43-a382-4f43-9a93-4f91e3702a71 tempest-TaggedBootDevicesTest_v242-954540052 tempest-TaggedBootDevicesTest_v242-954540052-project-member] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.424s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:46:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 2.162s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:46:55 user nova-compute[70924]: INFO nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] During sync_power_state the instance has a pending task (deleting). Skip.
Jul 29 14:46:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "35bdb2dd-d2d4-4a3d-9178-6892d478dfa3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:46:55 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:55 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-11fd2253-8383-438d-9f56-be10304f0749 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:46:55 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-11fd2253-8383-438d-9f56-be10304f0749 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:46:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-11fd2253-8383-438d-9f56-be10304f0749 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.503s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:46:55 user nova-compute[70924]: INFO nova.scheduler.client.report [None req-11fd2253-8383-438d-9f56-be10304f0749 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Deleted allocations for instance 9b4c76df-f74f-43b4-968f-b730cc5b0ec6
Jul 29 14:46:55 user nova-compute[70924]: DEBUG nova.compute.manager [req-a9bff808-d237-42d3-9c29-f1636443346c req-a972ffe6-e9a0-4ccf-a46c-d2451ef679cf service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Received event network-changed-14b12f31-f886-4752-bac2-e4673c74ae85 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:46:55 user nova-compute[70924]: DEBUG nova.compute.manager [req-a9bff808-d237-42d3-9c29-f1636443346c req-a972ffe6-e9a0-4ccf-a46c-d2451ef679cf service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Refreshing instance network info cache due to event network-changed-14b12f31-f886-4752-bac2-e4673c74ae85. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:46:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a9bff808-d237-42d3-9c29-f1636443346c req-a972ffe6-e9a0-4ccf-a46c-d2451ef679cf service nova] Acquiring lock "refresh_cache-f5929dcf-8594-4323-a6f5-a322aff7c881" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:46:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a9bff808-d237-42d3-9c29-f1636443346c req-a972ffe6-e9a0-4ccf-a46c-d2451ef679cf service nova] Acquired lock "refresh_cache-f5929dcf-8594-4323-a6f5-a322aff7c881" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:46:55 user nova-compute[70924]: DEBUG nova.network.neutron [req-a9bff808-d237-42d3-9c29-f1636443346c req-a972ffe6-e9a0-4ccf-a46c-d2451ef679cf service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Refreshing network info cache for port 14b12f31-f886-4752-bac2-e4673c74ae85 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:46:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-11fd2253-8383-438d-9f56-be10304f0749 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Lock "9b4c76df-f74f-43b4-968f-b730cc5b0ec6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.256s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:46:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "9b4c76df-f74f-43b4-968f-b730cc5b0ec6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 2.648s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:46:55 user nova-compute[70924]: INFO nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] During sync_power_state the instance has a pending task (deleting). Skip.
Jul 29 14:46:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "9b4c76df-f74f-43b4-968f-b730cc5b0ec6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:46:56 user nova-compute[70924]: DEBUG nova.network.neutron [req-a9bff808-d237-42d3-9c29-f1636443346c req-a972ffe6-e9a0-4ccf-a46c-d2451ef679cf service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Updated VIF entry in instance network info cache for port 14b12f31-f886-4752-bac2-e4673c74ae85. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:46:56 user nova-compute[70924]: DEBUG nova.network.neutron [req-a9bff808-d237-42d3-9c29-f1636443346c req-a972ffe6-e9a0-4ccf-a46c-d2451ef679cf service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Updating instance_info_cache with network_info: [{"id": "14b12f31-f886-4752-bac2-e4673c74ae85", "address": "fa:16:3e:0b:f1:80", "network": {"id": "4a3c2dab-e462-4e17-a2a3-f07747a26bbe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1820325619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b2ac23ab8cd48b390fa2047c1fd0e3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14b12f31-f8", "ovs_interfaceid": "14b12f31-f886-4752-bac2-e4673c74ae85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:46:56 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a9bff808-d237-42d3-9c29-f1636443346c req-a972ffe6-e9a0-4ccf-a46c-d2451ef679cf service nova] Releasing lock "refresh_cache-f5929dcf-8594-4323-a6f5-a322aff7c881" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:46:56 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:57 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Removed pending event for f5929dcf-8594-4323-a6f5-a322aff7c881 due to event {{(pid=70924) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 29 14:46:57 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642017.0788825, f5929dcf-8594-4323-a6f5-a322aff7c881 => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:46:57 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] VM Resumed (Lifecycle Event)
Jul 29 14:46:57 user nova-compute[70924]: DEBUG nova.compute.manager [None req-521e5221-da02-417c-ba04-4e15f6cb4989 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:46:57 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:46:57 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:46:57 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 29 14:46:57 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642017.0804298, f5929dcf-8594-4323-a6f5-a322aff7c881 => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:46:57 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] VM Started (Lifecycle Event)
Jul 29 14:46:57 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:46:57 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:46:57 user nova-compute[70924]: DEBUG nova.compute.manager [req-13184ddf-443c-43a5-8296-ca72db581adc req-df0820b4-abf9-4464-978a-66c71b5fa399 service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Received event network-vif-plugged-14b12f31-f886-4752-bac2-e4673c74ae85 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:46:57 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-13184ddf-443c-43a5-8296-ca72db581adc req-df0820b4-abf9-4464-978a-66c71b5fa399 service nova] Acquiring lock "f5929dcf-8594-4323-a6f5-a322aff7c881-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:46:57 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-13184ddf-443c-43a5-8296-ca72db581adc req-df0820b4-abf9-4464-978a-66c71b5fa399 service nova] Lock "f5929dcf-8594-4323-a6f5-a322aff7c881-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:46:57 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-13184ddf-443c-43a5-8296-ca72db581adc req-df0820b4-abf9-4464-978a-66c71b5fa399 service nova] Lock "f5929dcf-8594-4323-a6f5-a322aff7c881-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:46:57 user nova-compute[70924]: DEBUG nova.compute.manager [req-13184ddf-443c-43a5-8296-ca72db581adc req-df0820b4-abf9-4464-978a-66c71b5fa399 service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] No waiting events found dispatching network-vif-plugged-14b12f31-f886-4752-bac2-e4673c74ae85 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:46:57 user nova-compute[70924]: WARNING nova.compute.manager [req-13184ddf-443c-43a5-8296-ca72db581adc req-df0820b4-abf9-4464-978a-66c71b5fa399 service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Received unexpected event network-vif-plugged-14b12f31-f886-4752-bac2-e4673c74ae85 for instance with vm_state active and task_state None.
Jul 29 14:46:58 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:46:58 user nova-compute[70924]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690642003.9890137, 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3 => Stopped> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:46:58 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] VM Stopped (Lifecycle Event)
Jul 29 14:46:59 user nova-compute[70924]: DEBUG nova.compute.manager [None req-bf1802ba-a5a0-49ac-98dc-347496b371ec None None] [instance: 35bdb2dd-d2d4-4a3d-9178-6892d478dfa3] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:47:01 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:47:03 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:47:05 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:47:06 user nova-compute[70924]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690642011.5505993, 9b4c76df-f74f-43b4-968f-b730cc5b0ec6 => Stopped> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:47:06 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] VM Stopped (Lifecycle Event)
Jul 29 14:47:06 user nova-compute[70924]: DEBUG nova.compute.manager [None req-bc7df69b-177c-4db3-aef5-043409d0889e None None] [instance: 9b4c76df-f74f-43b4-968f-b730cc5b0ec6] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:47:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:47:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:47:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:47:11 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:47:11 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:47:13 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:47:15 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:47:16 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:47:17 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5047c5c8-4762-4e39-a84a-8af2baf4ee73 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Acquiring lock "00231136-233f-4a1b-88ff-b678482ca5bb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:47:17 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5047c5c8-4762-4e39-a84a-8af2baf4ee73 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Lock "00231136-233f-4a1b-88ff-b678482ca5bb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:47:17 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5047c5c8-4762-4e39-a84a-8af2baf4ee73 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Acquiring lock "00231136-233f-4a1b-88ff-b678482ca5bb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:47:17 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5047c5c8-4762-4e39-a84a-8af2baf4ee73 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Lock "00231136-233f-4a1b-88ff-b678482ca5bb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:47:17 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5047c5c8-4762-4e39-a84a-8af2baf4ee73 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Lock "00231136-233f-4a1b-88ff-b678482ca5bb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:47:17 user nova-compute[70924]: INFO nova.compute.manager [None req-5047c5c8-4762-4e39-a84a-8af2baf4ee73 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Terminating instance
Jul 29 14:47:17 user nova-compute[70924]: DEBUG nova.compute.manager [None req-5047c5c8-4762-4e39-a84a-8af2baf4ee73 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Start destroying the instance on the hypervisor. {{(pid=70924) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 14:47:17 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:47:17 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:47:17 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:47:17 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:47:17 user nova-compute[70924]: DEBUG nova.compute.manager [req-640f3881-85eb-4db8-9960-92c54a142553 req-f63f2a67-2e29-4bee-825e-057108550960 service nova] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Received event network-vif-unplugged-6b392743-3314-4d79-babc-13089e99b60b {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:47:17 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-640f3881-85eb-4db8-9960-92c54a142553 req-f63f2a67-2e29-4bee-825e-057108550960 service nova] Acquiring lock "00231136-233f-4a1b-88ff-b678482ca5bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:47:17 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-640f3881-85eb-4db8-9960-92c54a142553 req-f63f2a67-2e29-4bee-825e-057108550960 service nova] Lock "00231136-233f-4a1b-88ff-b678482ca5bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:47:17 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-640f3881-85eb-4db8-9960-92c54a142553 req-f63f2a67-2e29-4bee-825e-057108550960 service nova] Lock "00231136-233f-4a1b-88ff-b678482ca5bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:47:17 user nova-compute[70924]: DEBUG nova.compute.manager [req-640f3881-85eb-4db8-9960-92c54a142553 req-f63f2a67-2e29-4bee-825e-057108550960 service nova] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] No waiting events found dispatching network-vif-unplugged-6b392743-3314-4d79-babc-13089e99b60b {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:47:17 user nova-compute[70924]: DEBUG nova.compute.manager [req-640f3881-85eb-4db8-9960-92c54a142553 req-f63f2a67-2e29-4bee-825e-057108550960 service nova] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Received event network-vif-unplugged-6b392743-3314-4d79-babc-13089e99b60b for instance with task_state deleting. {{(pid=70924) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 14:47:18 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:47:18 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Instance destroyed successfully.
Jul 29 14:47:18 user nova-compute[70924]: DEBUG nova.objects.instance [None req-5047c5c8-4762-4e39-a84a-8af2baf4ee73 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Lazy-loading 'resources' on Instance uuid 00231136-233f-4a1b-88ff-b678482ca5bb {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:47:18 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-5047c5c8-4762-4e39-a84a-8af2baf4ee73 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:41:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-631144130',display_name='tempest-VolumesAdminNegativeTest-server-631144130',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-631144130',id=7,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIs4Y9pR3wKHwvsLi8/V+TrqrZFo3+OUUKlS+FHCZD8md801Kid7eNLdJEGPjUa1HWw1CrzVoa+ujAU9oWmDcrbr82pO93zUjdCyGpbc1On4YBgs/5g6SAg5SHpzJN0a5A==',key_name='tempest-keypair-390236111',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:41:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4c7e4c0801264e7794b962f8856e5734',ramdisk_id='',reservation_id='r-0qq6nftp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-831352148',owner_user_name='tempest-VolumesAdminNegativeTest-831352148-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:41:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e86112b87b2d47d88ac5fb9b6fccb31c',uuid=00231136-233f-4a1b-88ff-b678482ca5bb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6b392743-3314-4d79-babc-13089e99b60b", "address": "fa:16:3e:fd:b3:38", "network": {"id": "40edab25-ab3a-4874-b47f-1ffa2b5452ee", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1511348766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c7e4c0801264e7794b962f8856e5734", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b392743-33", "ovs_interfaceid": "6b392743-3314-4d79-babc-13089e99b60b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 14:47:18 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-5047c5c8-4762-4e39-a84a-8af2baf4ee73 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Converting VIF {"id": "6b392743-3314-4d79-babc-13089e99b60b", "address": "fa:16:3e:fd:b3:38", "network": {"id": "40edab25-ab3a-4874-b47f-1ffa2b5452ee", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1511348766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c7e4c0801264e7794b962f8856e5734", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b392743-33", "ovs_interfaceid": "6b392743-3314-4d79-babc-13089e99b60b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:47:18 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-5047c5c8-4762-4e39-a84a-8af2baf4ee73 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fd:b3:38,bridge_name='br-int',has_traffic_filtering=True,id=6b392743-3314-4d79-babc-13089e99b60b,network=Network(40edab25-ab3a-4874-b47f-1ffa2b5452ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b392743-33') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:47:18 user nova-compute[70924]: DEBUG os_vif [None req-5047c5c8-4762-4e39-a84a-8af2baf4ee73 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:b3:38,bridge_name='br-int',has_traffic_filtering=True,id=6b392743-3314-4d79-babc-13089e99b60b,network=Network(40edab25-ab3a-4874-b47f-1ffa2b5452ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b392743-33') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 14:47:18 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:47:18 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6b392743-33, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:47:18 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:47:18 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:47:18 user nova-compute[70924]: INFO os_vif [None req-5047c5c8-4762-4e39-a84a-8af2baf4ee73 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:b3:38,bridge_name='br-int',has_traffic_filtering=True,id=6b392743-3314-4d79-babc-13089e99b60b,network=Network(40edab25-ab3a-4874-b47f-1ffa2b5452ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b392743-33')
Jul 29 14:47:18 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-5047c5c8-4762-4e39-a84a-8af2baf4ee73 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Deleting instance files /opt/stack/data/nova/instances/00231136-233f-4a1b-88ff-b678482ca5bb_del
Jul 29 14:47:18 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-5047c5c8-4762-4e39-a84a-8af2baf4ee73 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Deletion of /opt/stack/data/nova/instances/00231136-233f-4a1b-88ff-b678482ca5bb_del complete
Jul 29 14:47:18 user nova-compute[70924]: INFO nova.compute.manager [None req-5047c5c8-4762-4e39-a84a-8af2baf4ee73 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Took 0.96 seconds to destroy the instance on the hypervisor.
Jul 29 14:47:18 user nova-compute[70924]: DEBUG oslo.service.loopingcall [None req-5047c5c8-4762-4e39-a84a-8af2baf4ee73 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70924) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 14:47:18 user nova-compute[70924]: DEBUG nova.compute.manager [-] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Deallocating network for instance {{(pid=70924) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 14:47:18 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] deallocate_for_instance() {{(pid=70924) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 14:47:18 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:47:19 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:47:19 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Took 1.00 seconds to deallocate network for instance.
Jul 29 14:47:19 user nova-compute[70924]: DEBUG nova.compute.manager [req-7d0ada30-3fc9-4cb4-bdf2-836d2e8bcae1 req-49a80557-d7d9-4e2b-b7f2-17dea077a257 service nova] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Received event network-vif-deleted-6b392743-3314-4d79-babc-13089e99b60b {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:47:19 user nova-compute[70924]: INFO nova.compute.manager [req-7d0ada30-3fc9-4cb4-bdf2-836d2e8bcae1 req-49a80557-d7d9-4e2b-b7f2-17dea077a257 service nova] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Neutron deleted interface 6b392743-3314-4d79-babc-13089e99b60b; detaching it from the instance and deleting it from the info cache
Jul 29 14:47:19 user nova-compute[70924]: DEBUG nova.network.neutron [req-7d0ada30-3fc9-4cb4-bdf2-836d2e8bcae1 req-49a80557-d7d9-4e2b-b7f2-17dea077a257 service nova] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:47:19 user nova-compute[70924]: DEBUG nova.compute.manager [req-7d0ada30-3fc9-4cb4-bdf2-836d2e8bcae1 req-49a80557-d7d9-4e2b-b7f2-17dea077a257 service nova] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Detach interface failed, port_id=6b392743-3314-4d79-babc-13089e99b60b, reason: Instance 00231136-233f-4a1b-88ff-b678482ca5bb could not be found. {{(pid=70924) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 29 14:47:19 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5047c5c8-4762-4e39-a84a-8af2baf4ee73 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:47:19 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5047c5c8-4762-4e39-a84a-8af2baf4ee73 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:47:19 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-5047c5c8-4762-4e39-a84a-8af2baf4ee73 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Refreshing inventories for resource provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 29 14:47:19 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-5047c5c8-4762-4e39-a84a-8af2baf4ee73 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Updating ProviderTree inventory for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 29 14:47:19 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-5047c5c8-4762-4e39-a84a-8af2baf4ee73 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Updating inventory in ProviderTree for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 29 14:47:19 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-5047c5c8-4762-4e39-a84a-8af2baf4ee73 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Refreshing aggregate associations for resource provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832, aggregates: None {{(pid=70924) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 29 14:47:19 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-5047c5c8-4762-4e39-a84a-8af2baf4ee73 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Refreshing trait associations for resource provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832, traits: COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=70924) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 29 14:47:20 user nova-compute[70924]: DEBUG nova.compute.manager [req-865aaf96-bd7d-40b9-97d8-3a09ecf5cd33 req-002bad8a-adf8-4c6b-a5e0-6722cb0c1543 service nova] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Received event network-vif-plugged-6b392743-3314-4d79-babc-13089e99b60b {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:47:20 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-865aaf96-bd7d-40b9-97d8-3a09ecf5cd33 req-002bad8a-adf8-4c6b-a5e0-6722cb0c1543 service nova] Acquiring lock "00231136-233f-4a1b-88ff-b678482ca5bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:47:20 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-865aaf96-bd7d-40b9-97d8-3a09ecf5cd33 req-002bad8a-adf8-4c6b-a5e0-6722cb0c1543 service nova] Lock "00231136-233f-4a1b-88ff-b678482ca5bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:47:20 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-865aaf96-bd7d-40b9-97d8-3a09ecf5cd33 req-002bad8a-adf8-4c6b-a5e0-6722cb0c1543 service nova] Lock "00231136-233f-4a1b-88ff-b678482ca5bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:47:20 user nova-compute[70924]: DEBUG nova.compute.manager [req-865aaf96-bd7d-40b9-97d8-3a09ecf5cd33 req-002bad8a-adf8-4c6b-a5e0-6722cb0c1543 service nova] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] No waiting events found dispatching network-vif-plugged-6b392743-3314-4d79-babc-13089e99b60b {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:47:20 user nova-compute[70924]: WARNING nova.compute.manager [req-865aaf96-bd7d-40b9-97d8-3a09ecf5cd33 req-002bad8a-adf8-4c6b-a5e0-6722cb0c1543 service nova] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Received unexpected event network-vif-plugged-6b392743-3314-4d79-babc-13089e99b60b for instance with vm_state deleted and task_state None.
Jul 29 14:47:20 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-5047c5c8-4762-4e39-a84a-8af2baf4ee73 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:47:20 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-5047c5c8-4762-4e39-a84a-8af2baf4ee73 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:47:20 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5047c5c8-4762-4e39-a84a-8af2baf4ee73 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.680s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:47:20 user nova-compute[70924]: INFO nova.scheduler.client.report [None req-5047c5c8-4762-4e39-a84a-8af2baf4ee73 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Deleted allocations for instance 00231136-233f-4a1b-88ff-b678482ca5bb
Jul 29 14:47:20 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5047c5c8-4762-4e39-a84a-8af2baf4ee73 tempest-VolumesAdminNegativeTest-831352148 tempest-VolumesAdminNegativeTest-831352148-project-member] Lock "00231136-233f-4a1b-88ff-b678482ca5bb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.959s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:47:23 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:47:23 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:47:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Acquiring lock "1f7989ca-77e9-440f-bd2f-60e46e005557" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:47:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lock "1f7989ca-77e9-440f-bd2f-60e46e005557" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:47:23 user nova-compute[70924]: DEBUG nova.compute.manager [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Starting instance... {{(pid=70924) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 14:47:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:47:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:47:23 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70924) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 14:47:23 user nova-compute[70924]: INFO nova.compute.claims [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Claim successful on node user
Jul 29 14:47:24 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:47:24 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:47:24 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.404s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:47:24 user nova-compute[70924]: DEBUG nova.compute.manager [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Start building networks asynchronously for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 14:47:24 user nova-compute[70924]: DEBUG nova.compute.manager [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Allocating IP information in the background. {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 14:47:24 user nova-compute[70924]: DEBUG nova.network.neutron [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] allocate_for_instance() {{(pid=70924) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 14:47:24 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 14:47:24 user nova-compute[70924]: DEBUG nova.compute.manager [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Start building block device mappings for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 14:47:24 user nova-compute[70924]: DEBUG nova.policy [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '474262573a7c4fee90b9f991d2ec9c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a2f0557d16467f8f1c7f8a2890e9e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70924) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 14:47:24 user nova-compute[70924]: DEBUG nova.compute.manager [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Start spawning the instance on the hypervisor. {{(pid=70924) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 14:47:24 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Creating instance directory {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 14:47:24 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Creating image(s)
Jul 29 14:47:24 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Acquiring lock "/opt/stack/data/nova/instances/1f7989ca-77e9-440f-bd2f-60e46e005557/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:47:24 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lock "/opt/stack/data/nova/instances/1f7989ca-77e9-440f-bd2f-60e46e005557/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:47:24 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lock "/opt/stack/data/nova/instances/1f7989ca-77e9-440f-bd2f-60e46e005557/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:47:24 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:47:24 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.137s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:47:24 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Acquiring lock "bd72453517468710f1de26b27fb0ea28688e9009" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:47:24 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:47:24 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:47:24 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.137s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:47:24 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/1f7989ca-77e9-440f-bd2f-60e46e005557/disk 1073741824 {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:47:24 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/1f7989ca-77e9-440f-bd2f-60e46e005557/disk 1073741824" returned: 0 in 0.046s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:47:24 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.191s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:47:24 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:47:24 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.127s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:47:24 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1f7989ca-77e9-440f-bd2f-60e46e005557/disk. size=1073741824 {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 14:47:24 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f7989ca-77e9-440f-bd2f-60e46e005557/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:47:25 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f7989ca-77e9-440f-bd2f-60e46e005557/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:47:25 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Cannot resize image /opt/stack/data/nova/instances/1f7989ca-77e9-440f-bd2f-60e46e005557/disk to a smaller size. {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 14:47:25 user nova-compute[70924]: DEBUG nova.objects.instance [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lazy-loading 'migration_context' on Instance uuid 1f7989ca-77e9-440f-bd2f-60e46e005557 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:47:25 user nova-compute[70924]: DEBUG nova.network.neutron [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Successfully created port: 4fdb3c78-791e-4638-8def-ec63abfa254d {{(pid=70924) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 14:47:25 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Created local disks {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 14:47:25 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Ensure instance console log exists: /opt/stack/data/nova/instances/1f7989ca-77e9-440f-bd2f-60e46e005557/console.log {{(pid=70924) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 14:47:25 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:47:25 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:47:25 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:47:25 user nova-compute[70924]: DEBUG nova.network.neutron [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Successfully updated port: 4fdb3c78-791e-4638-8def-ec63abfa254d {{(pid=70924) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 14:47:25 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-09d68ae3-dd4a-4aee-900b-2e1d6330fa28 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Acquiring lock "f5929dcf-8594-4323-a6f5-a322aff7c881" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:47:25 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-09d68ae3-dd4a-4aee-900b-2e1d6330fa28 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Lock "f5929dcf-8594-4323-a6f5-a322aff7c881" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:47:25 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Acquiring lock "refresh_cache-1f7989ca-77e9-440f-bd2f-60e46e005557" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:47:25 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Acquired lock "refresh_cache-1f7989ca-77e9-440f-bd2f-60e46e005557" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:47:25 user nova-compute[70924]: DEBUG nova.network.neutron [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 14:47:25 user nova-compute[70924]: INFO nova.compute.manager [None req-09d68ae3-dd4a-4aee-900b-2e1d6330fa28 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Detaching volume 477164fc-6cb9-4ac2-af70-40460ad69c15
Jul 29 14:47:25 user nova-compute[70924]: DEBUG nova.compute.manager [req-cbcf3e17-559c-4850-91f1-984bab4d12a7 req-23d1ef19-a8a1-4e06-817a-d1e6b8ae30ba service nova] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Received event network-changed-4fdb3c78-791e-4638-8def-ec63abfa254d {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:47:25 user nova-compute[70924]: DEBUG nova.compute.manager [req-cbcf3e17-559c-4850-91f1-984bab4d12a7 req-23d1ef19-a8a1-4e06-817a-d1e6b8ae30ba service nova] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Refreshing instance network info cache due to event network-changed-4fdb3c78-791e-4638-8def-ec63abfa254d. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:47:25 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-cbcf3e17-559c-4850-91f1-984bab4d12a7 req-23d1ef19-a8a1-4e06-817a-d1e6b8ae30ba service nova] Acquiring lock "refresh_cache-1f7989ca-77e9-440f-bd2f-60e46e005557" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:47:25 user nova-compute[70924]: INFO nova.virt.block_device [None req-09d68ae3-dd4a-4aee-900b-2e1d6330fa28 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Attempting to driver detach volume 477164fc-6cb9-4ac2-af70-40460ad69c15 from mountpoint /dev/vdb
Jul 29 14:47:25 user nova-compute[70924]: DEBUG nova.network.neutron [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Instance cache missing network info. {{(pid=70924) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 14:47:25 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-09d68ae3-dd4a-4aee-900b-2e1d6330fa28 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Attempting to detach device vdb from instance f5929dcf-8594-4323-a6f5-a322aff7c881 from the persistent domain config. {{(pid=70924) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 29 14:47:25 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-09d68ae3-dd4a-4aee-900b-2e1d6330fa28 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 14:47:25 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:47:25 user nova-compute[70924]:   <source dev="/dev/sdc"/>
Jul 29 14:47:25 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 14:47:25 user nova-compute[70924]:   <serial>477164fc-6cb9-4ac2-af70-40460ad69c15</serial>
Jul 29 14:47:25 user nova-compute[70924]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 14:47:25 user nova-compute[70924]: </disk>
Jul 29 14:47:25 user nova-compute[70924]:  {{(pid=70924) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 14:47:25 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-09d68ae3-dd4a-4aee-900b-2e1d6330fa28 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Successfully detached device vdb from instance f5929dcf-8594-4323-a6f5-a322aff7c881 from the persistent domain config.
Jul 29 14:47:25 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-09d68ae3-dd4a-4aee-900b-2e1d6330fa28 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f5929dcf-8594-4323-a6f5-a322aff7c881 from the live domain config. {{(pid=70924) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 29 14:47:25 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-09d68ae3-dd4a-4aee-900b-2e1d6330fa28 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 14:47:25 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:47:25 user nova-compute[70924]:   <source dev="/dev/sdc"/>
Jul 29 14:47:25 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 14:47:25 user nova-compute[70924]:   <serial>477164fc-6cb9-4ac2-af70-40460ad69c15</serial>
Jul 29 14:47:25 user nova-compute[70924]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 14:47:25 user nova-compute[70924]: </disk>
Jul 29 14:47:25 user nova-compute[70924]:  {{(pid=70924) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Received event <DeviceRemovedEvent: 1690642046.4294956, f5929dcf-8594-4323-a6f5-a322aff7c881 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70924) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-09d68ae3-dd4a-4aee-900b-2e1d6330fa28 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f5929dcf-8594-4323-a6f5-a322aff7c881 {{(pid=70924) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 29 14:47:26 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-09d68ae3-dd4a-4aee-900b-2e1d6330fa28 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Successfully detached device vdb from instance f5929dcf-8594-4323-a6f5-a322aff7c881 from the live domain config.
Jul 29 14:47:26 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09d68ae3-dd4a-4aee-900b-2e1d6330fa28 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] calling os-brick to detach iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d68ae3-dd4a-4aee-900b-2e1d6330fa28 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, {'target_iqns': ['iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fabqzNKw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:47:26 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-09d68ae3-dd4a-4aee-900b-2e1d6330fa28 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:47:26 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-09d68ae3-dd4a-4aee-900b-2e1d6330fa28 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-09d68ae3-dd4a-4aee-900b-2e1d6330fa28 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d68ae3-dd4a-4aee-900b-2e1d6330fa28 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15', 0)] {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98419ad-5989-47c2-9c16-8c7174ec8d5d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e23f5cd-a8a1-4c43-8327-588d5a18d1c9]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d68ae3-dd4a-4aee-900b-2e1d6330fa28 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:47:26 user nova-compute[70924]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)
Jul 29 14:47:26 user nova-compute[70924]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 (non-flash)
Jul 29 14:47:26 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d68ae3-dd4a-4aee-900b-2e1d6330fa28 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:47:26 user nova-compute[70924]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 (non-flash)
Jul 29 14:47:26 user nova-compute[70924]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 (non-flash)
Jul 29 14:47:26 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d68ae3-dd4a-4aee-900b-2e1d6330fa28 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feedc57ecb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15'): ({'sdc'}, set())}) {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-09d68ae3-dd4a-4aee-900b-2e1d6330fa28 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Removing single pathed devices sdc {{(pid=70924) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf74e348-2d8c-4a48-a6d1-6ece628c40de]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2da783d-0e44-454f-b8f5-3f5ad088f82f]: (4, ('ok\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-09d68ae3-dd4a-4aee-900b-2e1d6330fa28 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Flushing IO for device /dev/sdc {{(pid=70924) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[125866be-d5ee-4a1d-ad64-42cb65481ae4]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-09d68ae3-dd4a-4aee-900b-2e1d6330fa28 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70924) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG nova.network.neutron [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Updating instance_info_cache with network_info: [{"id": "4fdb3c78-791e-4638-8def-ec63abfa254d", "address": "fa:16:3e:09:43:b7", "network": {"id": "14a35b1f-254b-4eae-8c5f-d18ab7e0cb3c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1329518083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4a2f0557d16467f8f1c7f8a2890e9e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fdb3c78-79", "ovs_interfaceid": "4fdb3c78-791e-4638-8def-ec63abfa254d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Releasing lock "refresh_cache-1f7989ca-77e9-440f-bd2f-60e46e005557" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG nova.compute.manager [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Instance network_info: |[{"id": "4fdb3c78-791e-4638-8def-ec63abfa254d", "address": "fa:16:3e:09:43:b7", "network": {"id": "14a35b1f-254b-4eae-8c5f-d18ab7e0cb3c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1329518083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4a2f0557d16467f8f1c7f8a2890e9e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fdb3c78-79", "ovs_interfaceid": "4fdb3c78-791e-4638-8def-ec63abfa254d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[11199e22-e825-4e6e-a809-2244e88793a0]: (4, ('1', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-cbcf3e17-559c-4850-91f1-984bab4d12a7 req-23d1ef19-a8a1-4e06-817a-d1e6b8ae30ba service nova] Acquired lock "refresh_cache-1f7989ca-77e9-440f-bd2f-60e46e005557" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG nova.network.neutron [req-cbcf3e17-559c-4850-91f1-984bab4d12a7 req-23d1ef19-a8a1-4e06-817a-d1e6b8ae30ba service nova] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Refreshing network info cache for port 4fdb3c78-791e-4638-8def-ec63abfa254d {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Start _get_guest_xml network_info=[{"id": "4fdb3c78-791e-4638-8def-ec63abfa254d", "address": "fa:16:3e:09:43:b7", "network": {"id": "14a35b1f-254b-4eae-8c5f-d18ab7e0cb3c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1329518083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4a2f0557d16467f8f1c7f8a2890e9e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fdb3c78-79", "ovs_interfaceid": "4fdb3c78-791e-4638-8def-ec63abfa254d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '3aba2e73-6832-404b-8bd0-d0503ce82b8c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-09d68ae3-dd4a-4aee-900b-2e1d6330fa28 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-09d68ae3-dd4a-4aee-900b-2e1d6330fa28 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] SCSI volumes sdc have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d68ae3-dd4a-4aee-900b-2e1d6330fa28 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15')] {{(pid=70924) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:47:26 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:47:26 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:47:26 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] CPU controller missing on host. {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] CPU controller found on host. {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70924) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T14:36:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Flavor limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Image limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Flavor pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Image pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Got 1 possible topologies {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:47:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1035627137',display_name='tempest-SnapshotDataIntegrityTests-server-1035627137',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1035627137',id=19,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOW4Vb7Fde2KN5KBYzR7NXCPI46n57IZiqdlNijlO8O55HSkwbteWcppPciLWtVPwInqoGDWxxTHZcydj+yeq8s17OmPiiCShvdNC6vFLWbM1xOkA0q6mHBPs+hZyb927g==',key_name='tempest-keypair-1948217579',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b4a2f0557d16467f8f1c7f8a2890e9e8',ramdisk_id='',reservation_id='r-tsdr4fhw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-444803474',owner_user_name='tempest-SnapshotDataIntegrityTests-444803474-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:47:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='474262573a7c4fee90b9f991d2ec9c01',uuid=1f7989ca-77e9-440f-bd2f-60e46e005557,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4fdb3c78-791e-4638-8def-ec63abfa254d", "address": "fa:16:3e:09:43:b7", "network": {"id": "14a35b1f-254b-4eae-8c5f-d18ab7e0cb3c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1329518083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4a2f0557d16467f8f1c7f8a2890e9e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fdb3c78-79", "ovs_interfaceid": "4fdb3c78-791e-4638-8def-ec63abfa254d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Converting VIF {"id": "4fdb3c78-791e-4638-8def-ec63abfa254d", "address": "fa:16:3e:09:43:b7", "network": {"id": "14a35b1f-254b-4eae-8c5f-d18ab7e0cb3c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1329518083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4a2f0557d16467f8f1c7f8a2890e9e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fdb3c78-79", "ovs_interfaceid": "4fdb3c78-791e-4638-8def-ec63abfa254d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:43:b7,bridge_name='br-int',has_traffic_filtering=True,id=4fdb3c78-791e-4638-8def-ec63abfa254d,network=Network(14a35b1f-254b-4eae-8c5f-d18ab7e0cb3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fdb3c78-79') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG nova.objects.instance [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lazy-loading 'pci_devices' on Instance uuid 1f7989ca-77e9-440f-bd2f-60e46e005557 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0238d740-6329-4093-abb4-583ca75bc17c]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d68ae3-dd4a-4aee-900b-2e1d6330fa28 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 -p 172.16.0.220:3260 --logout {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] End _get_guest_xml xml=<domain type="kvm">
Jul 29 14:47:26 user nova-compute[70924]:   <uuid>1f7989ca-77e9-440f-bd2f-60e46e005557</uuid>
Jul 29 14:47:26 user nova-compute[70924]:   <name>instance-00000013</name>
Jul 29 14:47:26 user nova-compute[70924]:   <memory>524288</memory>
Jul 29 14:47:26 user nova-compute[70924]:   <vcpu>1</vcpu>
Jul 29 14:47:26 user nova-compute[70924]:   <metadata>
Jul 29 14:47:26 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 14:47:26 user nova-compute[70924]:       <nova:package version="0.0.0"/>
Jul 29 14:47:26 user nova-compute[70924]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1035627137</nova:name>
Jul 29 14:47:26 user nova-compute[70924]:       <nova:creationTime>2023-07-29 14:47:26</nova:creationTime>
Jul 29 14:47:26 user nova-compute[70924]:       <nova:flavor name="m1.tiny">
Jul 29 14:47:26 user nova-compute[70924]:         <nova:memory>512</nova:memory>
Jul 29 14:47:26 user nova-compute[70924]:         <nova:disk>1</nova:disk>
Jul 29 14:47:26 user nova-compute[70924]:         <nova:swap>0</nova:swap>
Jul 29 14:47:26 user nova-compute[70924]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 14:47:26 user nova-compute[70924]:         <nova:vcpus>1</nova:vcpus>
Jul 29 14:47:26 user nova-compute[70924]:       </nova:flavor>
Jul 29 14:47:26 user nova-compute[70924]:       <nova:owner>
Jul 29 14:47:26 user nova-compute[70924]:         <nova:user uuid="474262573a7c4fee90b9f991d2ec9c01">tempest-SnapshotDataIntegrityTests-444803474-project-member</nova:user>
Jul 29 14:47:26 user nova-compute[70924]:         <nova:project uuid="b4a2f0557d16467f8f1c7f8a2890e9e8">tempest-SnapshotDataIntegrityTests-444803474</nova:project>
Jul 29 14:47:26 user nova-compute[70924]:       </nova:owner>
Jul 29 14:47:26 user nova-compute[70924]:       <nova:root type="image" uuid="3aba2e73-6832-404b-8bd0-d0503ce82b8c"/>
Jul 29 14:47:26 user nova-compute[70924]:       <nova:ports>
Jul 29 14:47:26 user nova-compute[70924]:         <nova:port uuid="4fdb3c78-791e-4638-8def-ec63abfa254d">
Jul 29 14:47:26 user nova-compute[70924]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 29 14:47:26 user nova-compute[70924]:         </nova:port>
Jul 29 14:47:26 user nova-compute[70924]:       </nova:ports>
Jul 29 14:47:26 user nova-compute[70924]:     </nova:instance>
Jul 29 14:47:26 user nova-compute[70924]:   </metadata>
Jul 29 14:47:26 user nova-compute[70924]:   <sysinfo type="smbios">
Jul 29 14:47:26 user nova-compute[70924]:     <system>
Jul 29 14:47:26 user nova-compute[70924]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 14:47:26 user nova-compute[70924]:       <entry name="product">OpenStack Nova</entry>
Jul 29 14:47:26 user nova-compute[70924]:       <entry name="version">0.0.0</entry>
Jul 29 14:47:26 user nova-compute[70924]:       <entry name="serial">1f7989ca-77e9-440f-bd2f-60e46e005557</entry>
Jul 29 14:47:26 user nova-compute[70924]:       <entry name="uuid">1f7989ca-77e9-440f-bd2f-60e46e005557</entry>
Jul 29 14:47:26 user nova-compute[70924]:       <entry name="family">Virtual Machine</entry>
Jul 29 14:47:26 user nova-compute[70924]:     </system>
Jul 29 14:47:26 user nova-compute[70924]:   </sysinfo>
Jul 29 14:47:26 user nova-compute[70924]:   <os>
Jul 29 14:47:26 user nova-compute[70924]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 14:47:26 user nova-compute[70924]:     <boot dev="hd"/>
Jul 29 14:47:26 user nova-compute[70924]:     <smbios mode="sysinfo"/>
Jul 29 14:47:26 user nova-compute[70924]:   </os>
Jul 29 14:47:26 user nova-compute[70924]:   <features>
Jul 29 14:47:26 user nova-compute[70924]:     <acpi/>
Jul 29 14:47:26 user nova-compute[70924]:     <apic/>
Jul 29 14:47:26 user nova-compute[70924]:     <vmcoreinfo/>
Jul 29 14:47:26 user nova-compute[70924]:   </features>
Jul 29 14:47:26 user nova-compute[70924]:   <clock offset="utc">
Jul 29 14:47:26 user nova-compute[70924]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 14:47:26 user nova-compute[70924]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 14:47:26 user nova-compute[70924]:     <timer name="hpet" present="no"/>
Jul 29 14:47:26 user nova-compute[70924]:   </clock>
Jul 29 14:47:26 user nova-compute[70924]:   <cpu mode="custom" match="exact">
Jul 29 14:47:26 user nova-compute[70924]:     <model>Nehalem</model>
Jul 29 14:47:26 user nova-compute[70924]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 14:47:26 user nova-compute[70924]:   </cpu>
Jul 29 14:47:26 user nova-compute[70924]:   <devices>
Jul 29 14:47:26 user nova-compute[70924]:     <disk type="file" device="disk">
Jul 29 14:47:26 user nova-compute[70924]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 14:47:26 user nova-compute[70924]:       <source file="/opt/stack/data/nova/instances/1f7989ca-77e9-440f-bd2f-60e46e005557/disk"/>
Jul 29 14:47:26 user nova-compute[70924]:       <target dev="vda" bus="virtio"/>
Jul 29 14:47:26 user nova-compute[70924]:     </disk>
Jul 29 14:47:26 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 14:47:26 user nova-compute[70924]:       <mac address="fa:16:3e:09:43:b7"/>
Jul 29 14:47:26 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:47:26 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 14:47:26 user nova-compute[70924]:       <target dev="tap4fdb3c78-79"/>
Jul 29 14:47:26 user nova-compute[70924]:     </interface>
Jul 29 14:47:26 user nova-compute[70924]:     <serial type="pty">
Jul 29 14:47:26 user nova-compute[70924]:       <log file="/opt/stack/data/nova/instances/1f7989ca-77e9-440f-bd2f-60e46e005557/console.log" append="off"/>
Jul 29 14:47:26 user nova-compute[70924]:     </serial>
Jul 29 14:47:26 user nova-compute[70924]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 14:47:26 user nova-compute[70924]:     <video>
Jul 29 14:47:26 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:47:26 user nova-compute[70924]:     </video>
Jul 29 14:47:26 user nova-compute[70924]:     <rng model="virtio">
Jul 29 14:47:26 user nova-compute[70924]:       <backend model="random">/dev/urandom</backend>
Jul 29 14:47:26 user nova-compute[70924]:     </rng>
Jul 29 14:47:26 user nova-compute[70924]:     <controller type="usb" index="0" model="none"/>
Jul 29 14:47:26 user nova-compute[70924]:     <memballoon model="virtio">
Jul 29 14:47:26 user nova-compute[70924]:       <stats period="10"/>
Jul 29 14:47:26 user nova-compute[70924]:     </memballoon>
Jul 29 14:47:26 user nova-compute[70924]:   </devices>
Jul 29 14:47:26 user nova-compute[70924]: </domain>
Jul 29 14:47:26 user nova-compute[70924]:  {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:47:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1035627137',display_name='tempest-SnapshotDataIntegrityTests-server-1035627137',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1035627137',id=19,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOW4Vb7Fde2KN5KBYzR7NXCPI46n57IZiqdlNijlO8O55HSkwbteWcppPciLWtVPwInqoGDWxxTHZcydj+yeq8s17OmPiiCShvdNC6vFLWbM1xOkA0q6mHBPs+hZyb927g==',key_name='tempest-keypair-1948217579',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b4a2f0557d16467f8f1c7f8a2890e9e8',ramdisk_id='',reservation_id='r-tsdr4fhw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-444803474',owner_user_name='tempest-SnapshotDataIntegrityTests-444803474-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:47:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='474262573a7c4fee90b9f991d2ec9c01',uuid=1f7989ca-77e9-440f-bd2f-60e46e005557,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4fdb3c78-791e-4638-8def-ec63abfa254d", "address": "fa:16:3e:09:43:b7", "network": {"id": "14a35b1f-254b-4eae-8c5f-d18ab7e0cb3c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1329518083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4a2f0557d16467f8f1c7f8a2890e9e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fdb3c78-79", "ovs_interfaceid": "4fdb3c78-791e-4638-8def-ec63abfa254d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Converting VIF {"id": "4fdb3c78-791e-4638-8def-ec63abfa254d", "address": "fa:16:3e:09:43:b7", "network": {"id": "14a35b1f-254b-4eae-8c5f-d18ab7e0cb3c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1329518083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4a2f0557d16467f8f1c7f8a2890e9e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fdb3c78-79", "ovs_interfaceid": "4fdb3c78-791e-4638-8def-ec63abfa254d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:43:b7,bridge_name='br-int',has_traffic_filtering=True,id=4fdb3c78-791e-4638-8def-ec63abfa254d,network=Network(14a35b1f-254b-4eae-8c5f-d18ab7e0cb3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fdb3c78-79') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG os_vif [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:43:b7,bridge_name='br-int',has_traffic_filtering=True,id=4fdb3c78-791e-4638-8def-ec63abfa254d,network=Network(14a35b1f-254b-4eae-8c5f-d18ab7e0cb3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fdb3c78-79') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4fdb3c78-79, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4fdb3c78-79, col_values=(('external_ids', {'iface-id': '4fdb3c78-791e-4638-8def-ec63abfa254d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:43:b7', 'vm-uuid': '1f7989ca-77e9-440f-bd2f-60e46e005557'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:47:26 user nova-compute[70924]: INFO os_vif [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:43:b7,bridge_name='br-int',has_traffic_filtering=True,id=4fdb3c78-791e-4638-8def-ec63abfa254d,network=Network(14a35b1f-254b-4eae-8c5f-d18ab7e0cb3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fdb3c78-79')
Jul 29 14:47:26 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77444b9-f3e4-4ad5-b253-3b9d6504338d]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d68ae3-dd4a-4aee-900b-2e1d6330fa28 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15, portal: 172.16.0.220,3260]
Jul 29 14:47:26 user nova-compute[70924]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15, portal: 172.16.0.220,3260] successful.
Jul 29 14:47:26 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 -p 172.16.0.220:3260 --op delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:477164fc-6cb9-4ac2-af70-40460ad69c15 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e22275d-55d2-469c-9828-fa57573b53d3]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d68ae3-dd4a-4aee-900b-2e1d6330fa28 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-09d68ae3-dd4a-4aee-900b-2e1d6330fa28 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d68ae3-dd4a-4aee-900b-2e1d6330fa28 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] <== disconnect_volume: return (357ms) None {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09d68ae3-dd4a-4aee-900b-2e1d6330fa28 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Disconnected iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:47:26 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] No VIF found with MAC fa:16:3e:09:43:b7, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:47:27 user nova-compute[70924]: DEBUG nova.network.neutron [req-cbcf3e17-559c-4850-91f1-984bab4d12a7 req-23d1ef19-a8a1-4e06-817a-d1e6b8ae30ba service nova] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Updated VIF entry in instance network info cache for port 4fdb3c78-791e-4638-8def-ec63abfa254d. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:47:27 user nova-compute[70924]: DEBUG nova.network.neutron [req-cbcf3e17-559c-4850-91f1-984bab4d12a7 req-23d1ef19-a8a1-4e06-817a-d1e6b8ae30ba service nova] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Updating instance_info_cache with network_info: [{"id": "4fdb3c78-791e-4638-8def-ec63abfa254d", "address": "fa:16:3e:09:43:b7", "network": {"id": "14a35b1f-254b-4eae-8c5f-d18ab7e0cb3c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1329518083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4a2f0557d16467f8f1c7f8a2890e9e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fdb3c78-79", "ovs_interfaceid": "4fdb3c78-791e-4638-8def-ec63abfa254d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:47:27 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-cbcf3e17-559c-4850-91f1-984bab4d12a7 req-23d1ef19-a8a1-4e06-817a-d1e6b8ae30ba service nova] Releasing lock "refresh_cache-1f7989ca-77e9-440f-bd2f-60e46e005557" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:47:27 user nova-compute[70924]: DEBUG nova.objects.instance [None req-09d68ae3-dd4a-4aee-900b-2e1d6330fa28 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Lazy-loading 'flavor' on Instance uuid f5929dcf-8594-4323-a6f5-a322aff7c881 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:47:27 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-09d68ae3-dd4a-4aee-900b-2e1d6330fa28 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Lock "f5929dcf-8594-4323-a6f5-a322aff7c881" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.794s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:47:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:47:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:47:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:47:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:47:28 user nova-compute[70924]: DEBUG nova.compute.manager [req-b610a913-1ba2-45d2-aed8-f7dbcc48e50b req-2dc6f2e7-1972-4663-b675-5adc3dc877cc service nova] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Received event network-vif-plugged-4fdb3c78-791e-4638-8def-ec63abfa254d {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:47:28 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b610a913-1ba2-45d2-aed8-f7dbcc48e50b req-2dc6f2e7-1972-4663-b675-5adc3dc877cc service nova] Acquiring lock "1f7989ca-77e9-440f-bd2f-60e46e005557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:47:28 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b610a913-1ba2-45d2-aed8-f7dbcc48e50b req-2dc6f2e7-1972-4663-b675-5adc3dc877cc service nova] Lock "1f7989ca-77e9-440f-bd2f-60e46e005557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:47:28 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b610a913-1ba2-45d2-aed8-f7dbcc48e50b req-2dc6f2e7-1972-4663-b675-5adc3dc877cc service nova] Lock "1f7989ca-77e9-440f-bd2f-60e46e005557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:47:28 user nova-compute[70924]: DEBUG nova.compute.manager [req-b610a913-1ba2-45d2-aed8-f7dbcc48e50b req-2dc6f2e7-1972-4663-b675-5adc3dc877cc service nova] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] No waiting events found dispatching network-vif-plugged-4fdb3c78-791e-4638-8def-ec63abfa254d {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:47:28 user nova-compute[70924]: WARNING nova.compute.manager [req-b610a913-1ba2-45d2-aed8-f7dbcc48e50b req-2dc6f2e7-1972-4663-b675-5adc3dc877cc service nova] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Received unexpected event network-vif-plugged-4fdb3c78-791e-4638-8def-ec63abfa254d for instance with vm_state building and task_state spawning.
Jul 29 14:47:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:47:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:47:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:47:29 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-f6a98ccb-d8b1-4ab6-883b-b0a44ede91c5 tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] Acquiring lock "79652140-c347-4d7b-9770-a4cc2d1a08e3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:47:29 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-f6a98ccb-d8b1-4ab6-883b-b0a44ede91c5 tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] Lock "79652140-c347-4d7b-9770-a4cc2d1a08e3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:47:29 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-f6a98ccb-d8b1-4ab6-883b-b0a44ede91c5 tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] Acquiring lock "79652140-c347-4d7b-9770-a4cc2d1a08e3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:47:29 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-f6a98ccb-d8b1-4ab6-883b-b0a44ede91c5 tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] Lock "79652140-c347-4d7b-9770-a4cc2d1a08e3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:47:29 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-f6a98ccb-d8b1-4ab6-883b-b0a44ede91c5 tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] Lock "79652140-c347-4d7b-9770-a4cc2d1a08e3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:47:29 user nova-compute[70924]: INFO nova.compute.manager [None req-f6a98ccb-d8b1-4ab6-883b-b0a44ede91c5 tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] [instance: 79652140-c347-4d7b-9770-a4cc2d1a08e3] Terminating instance
Jul 29 14:47:29 user nova-compute[70924]: DEBUG nova.compute.manager [None req-f6a98ccb-d8b1-4ab6-883b-b0a44ede91c5 tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] [instance: 79652140-c347-4d7b-9770-a4cc2d1a08e3] Start destroying the instance on the hypervisor. {{(pid=70924) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 14:47:29 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:47:29 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:47:29 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:47:29 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:47:30 user nova-compute[70924]: DEBUG nova.compute.manager [req-6b699e81-981e-4227-b69b-dbd7b8ea0e94 req-58b51b19-3b3f-48ed-ab01-fe0096f967ae service nova] [instance: 79652140-c347-4d7b-9770-a4cc2d1a08e3] Received event network-vif-unplugged-bf1e6655-6811-4a5c-ac2d-e2cd6a3b8d02 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:47:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-6b699e81-981e-4227-b69b-dbd7b8ea0e94 req-58b51b19-3b3f-48ed-ab01-fe0096f967ae service nova] Acquiring lock "79652140-c347-4d7b-9770-a4cc2d1a08e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:47:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-6b699e81-981e-4227-b69b-dbd7b8ea0e94 req-58b51b19-3b3f-48ed-ab01-fe0096f967ae service nova] Lock "79652140-c347-4d7b-9770-a4cc2d1a08e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:47:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-6b699e81-981e-4227-b69b-dbd7b8ea0e94 req-58b51b19-3b3f-48ed-ab01-fe0096f967ae service nova] Lock "79652140-c347-4d7b-9770-a4cc2d1a08e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:47:30 user nova-compute[70924]: DEBUG nova.compute.manager [req-6b699e81-981e-4227-b69b-dbd7b8ea0e94 req-58b51b19-3b3f-48ed-ab01-fe0096f967ae service nova] [instance: 79652140-c347-4d7b-9770-a4cc2d1a08e3] No waiting events found dispatching network-vif-unplugged-bf1e6655-6811-4a5c-ac2d-e2cd6a3b8d02 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:47:30 user nova-compute[70924]: DEBUG nova.compute.manager [req-6b699e81-981e-4227-b69b-dbd7b8ea0e94 req-58b51b19-3b3f-48ed-ab01-fe0096f967ae service nova] [instance: 79652140-c347-4d7b-9770-a4cc2d1a08e3] Received event network-vif-unplugged-bf1e6655-6811-4a5c-ac2d-e2cd6a3b8d02 for instance with task_state deleting. {{(pid=70924) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 14:47:30 user nova-compute[70924]: DEBUG nova.compute.manager [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Instance event wait completed in 0 seconds for  {{(pid=70924) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 14:47:30 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Guest created on hypervisor {{(pid=70924) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 14:47:30 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642050.3388038, 1f7989ca-77e9-440f-bd2f-60e46e005557 => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:47:30 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] VM Resumed (Lifecycle Event)
Jul 29 14:47:30 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Instance spawned successfully.
Jul 29 14:47:30 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 14:47:30 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:47:30 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:47:30 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Found default for hw_cdrom_bus of ide {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:47:30 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Found default for hw_disk_bus of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:47:30 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Found default for hw_input_bus of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:47:30 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Found default for hw_pointer_model of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:47:30 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Found default for hw_video_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:47:30 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Found default for hw_vif_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:47:30 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:47:30 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642050.3390918, 1f7989ca-77e9-440f-bd2f-60e46e005557 => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:47:30 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] VM Started (Lifecycle Event)
Jul 29 14:47:30 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 79652140-c347-4d7b-9770-a4cc2d1a08e3] Instance destroyed successfully.
Jul 29 14:47:30 user nova-compute[70924]: DEBUG nova.objects.instance [None req-f6a98ccb-d8b1-4ab6-883b-b0a44ede91c5 tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] Lazy-loading 'resources' on Instance uuid 79652140-c347-4d7b-9770-a4cc2d1a08e3 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:47:30 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:47:30 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-f6a98ccb-d8b1-4ab6-883b-b0a44ede91c5 tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:45:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1818145690',display_name='tempest-VolumesActionsTest-instance-1818145690',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1818145690',id=16,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:45:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cad49619f9f14c87a32ebb20a2df5800',ramdisk_id='',reservation_id='r-3ncg384p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-981105107',owner_user_name='tempest-VolumesActionsTest-981105107-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:45:40Z,user_data=None,user_id='b32250a289d044bb9cd8971cf81e59df',uuid=79652140-c347-4d7b-9770-a4cc2d1a08e3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf1e6655-6811-4a5c-ac2d-e2cd6a3b8d02", "address": "fa:16:3e:45:10:2d", "network": {"id": "06747bb8-313c-4753-9bb6-c000da447639", "bridge": "br-int", "label": "tempest-VolumesActionsTest-167909986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cad49619f9f14c87a32ebb20a2df5800", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf1e6655-68", "ovs_interfaceid": "bf1e6655-6811-4a5c-ac2d-e2cd6a3b8d02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 14:47:30 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-f6a98ccb-d8b1-4ab6-883b-b0a44ede91c5 tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] Converting VIF {"id": "bf1e6655-6811-4a5c-ac2d-e2cd6a3b8d02", "address": "fa:16:3e:45:10:2d", "network": {"id": "06747bb8-313c-4753-9bb6-c000da447639", "bridge": "br-int", "label": "tempest-VolumesActionsTest-167909986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cad49619f9f14c87a32ebb20a2df5800", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf1e6655-68", "ovs_interfaceid": "bf1e6655-6811-4a5c-ac2d-e2cd6a3b8d02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:47:30 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-f6a98ccb-d8b1-4ab6-883b-b0a44ede91c5 tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:10:2d,bridge_name='br-int',has_traffic_filtering=True,id=bf1e6655-6811-4a5c-ac2d-e2cd6a3b8d02,network=Network(06747bb8-313c-4753-9bb6-c000da447639),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf1e6655-68') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:47:30 user nova-compute[70924]: DEBUG os_vif [None req-f6a98ccb-d8b1-4ab6-883b-b0a44ede91c5 tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:10:2d,bridge_name='br-int',has_traffic_filtering=True,id=bf1e6655-6811-4a5c-ac2d-e2cd6a3b8d02,network=Network(06747bb8-313c-4753-9bb6-c000da447639),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf1e6655-68') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 14:47:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:47:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbf1e6655-68, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:47:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:47:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:47:30 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:47:30 user nova-compute[70924]: INFO os_vif [None req-f6a98ccb-d8b1-4ab6-883b-b0a44ede91c5 tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:10:2d,bridge_name='br-int',has_traffic_filtering=True,id=bf1e6655-6811-4a5c-ac2d-e2cd6a3b8d02,network=Network(06747bb8-313c-4753-9bb6-c000da447639),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf1e6655-68')
Jul 29 14:47:30 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-f6a98ccb-d8b1-4ab6-883b-b0a44ede91c5 tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] [instance: 79652140-c347-4d7b-9770-a4cc2d1a08e3] Deleting instance files /opt/stack/data/nova/instances/79652140-c347-4d7b-9770-a4cc2d1a08e3_del
Jul 29 14:47:30 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-f6a98ccb-d8b1-4ab6-883b-b0a44ede91c5 tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] [instance: 79652140-c347-4d7b-9770-a4cc2d1a08e3] Deletion of /opt/stack/data/nova/instances/79652140-c347-4d7b-9770-a4cc2d1a08e3_del complete
Jul 29 14:47:30 user nova-compute[70924]: DEBUG nova.compute.manager [req-c459b8f5-fd70-4eff-a16c-b31c2cde67f4 req-0c32df4a-ad45-4347-bf4c-3bf5d0faff37 service nova] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Received event network-vif-plugged-4fdb3c78-791e-4638-8def-ec63abfa254d {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:47:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c459b8f5-fd70-4eff-a16c-b31c2cde67f4 req-0c32df4a-ad45-4347-bf4c-3bf5d0faff37 service nova] Acquiring lock "1f7989ca-77e9-440f-bd2f-60e46e005557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:47:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c459b8f5-fd70-4eff-a16c-b31c2cde67f4 req-0c32df4a-ad45-4347-bf4c-3bf5d0faff37 service nova] Lock "1f7989ca-77e9-440f-bd2f-60e46e005557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:47:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c459b8f5-fd70-4eff-a16c-b31c2cde67f4 req-0c32df4a-ad45-4347-bf4c-3bf5d0faff37 service nova] Lock "1f7989ca-77e9-440f-bd2f-60e46e005557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:47:30 user nova-compute[70924]: DEBUG nova.compute.manager [req-c459b8f5-fd70-4eff-a16c-b31c2cde67f4 req-0c32df4a-ad45-4347-bf4c-3bf5d0faff37 service nova] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] No waiting events found dispatching network-vif-plugged-4fdb3c78-791e-4638-8def-ec63abfa254d {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:47:30 user nova-compute[70924]: WARNING nova.compute.manager [req-c459b8f5-fd70-4eff-a16c-b31c2cde67f4 req-0c32df4a-ad45-4347-bf4c-3bf5d0faff37 service nova] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Received unexpected event network-vif-plugged-4fdb3c78-791e-4638-8def-ec63abfa254d for instance with vm_state building and task_state spawning.
Jul 29 14:47:30 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:47:30 user nova-compute[70924]: INFO nova.compute.manager [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Took 6.15 seconds to spawn the instance on the hypervisor.
Jul 29 14:47:30 user nova-compute[70924]: DEBUG nova.compute.manager [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:47:30 user nova-compute[70924]: INFO nova.compute.manager [None req-f6a98ccb-d8b1-4ab6-883b-b0a44ede91c5 tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] [instance: 79652140-c347-4d7b-9770-a4cc2d1a08e3] Took 0.89 seconds to destroy the instance on the hypervisor.
Jul 29 14:47:30 user nova-compute[70924]: DEBUG oslo.service.loopingcall [None req-f6a98ccb-d8b1-4ab6-883b-b0a44ede91c5 tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70924) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 14:47:30 user nova-compute[70924]: DEBUG nova.compute.manager [-] [instance: 79652140-c347-4d7b-9770-a4cc2d1a08e3] Deallocating network for instance {{(pid=70924) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 14:47:30 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: 79652140-c347-4d7b-9770-a4cc2d1a08e3] deallocate_for_instance() {{(pid=70924) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 14:47:30 user nova-compute[70924]: INFO nova.compute.manager [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Took 6.89 seconds to build instance.
Jul 29 14:47:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-008ff7e9-c99a-4f33-8018-61671b16823b tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lock "1f7989ca-77e9-440f-bd2f-60e46e005557" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.015s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:47:31 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: 79652140-c347-4d7b-9770-a4cc2d1a08e3] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:47:31 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: 79652140-c347-4d7b-9770-a4cc2d1a08e3] Took 0.56 seconds to deallocate network for instance.
Jul 29 14:47:31 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-f6a98ccb-d8b1-4ab6-883b-b0a44ede91c5 tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:47:31 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-f6a98ccb-d8b1-4ab6-883b-b0a44ede91c5 tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:47:31 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-f6a98ccb-d8b1-4ab6-883b-b0a44ede91c5 tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:47:31 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-f6a98ccb-d8b1-4ab6-883b-b0a44ede91c5 tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:47:31 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-f6a98ccb-d8b1-4ab6-883b-b0a44ede91c5 tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.409s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:47:31 user nova-compute[70924]: INFO nova.scheduler.client.report [None req-f6a98ccb-d8b1-4ab6-883b-b0a44ede91c5 tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] Deleted allocations for instance 79652140-c347-4d7b-9770-a4cc2d1a08e3
Jul 29 14:47:31 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-f6a98ccb-d8b1-4ab6-883b-b0a44ede91c5 tempest-VolumesActionsTest-981105107 tempest-VolumesActionsTest-981105107-project-member] Lock "79652140-c347-4d7b-9770-a4cc2d1a08e3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.102s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:47:32 user nova-compute[70924]: DEBUG nova.compute.manager [req-a4d79707-c5a6-4028-85ff-49d779f086e4 req-9fc8670b-01d0-421b-b923-317d78d4db74 service nova] [instance: 79652140-c347-4d7b-9770-a4cc2d1a08e3] Received event network-vif-plugged-bf1e6655-6811-4a5c-ac2d-e2cd6a3b8d02 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:47:32 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a4d79707-c5a6-4028-85ff-49d779f086e4 req-9fc8670b-01d0-421b-b923-317d78d4db74 service nova] Acquiring lock "79652140-c347-4d7b-9770-a4cc2d1a08e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:47:32 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a4d79707-c5a6-4028-85ff-49d779f086e4 req-9fc8670b-01d0-421b-b923-317d78d4db74 service nova] Lock "79652140-c347-4d7b-9770-a4cc2d1a08e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:47:32 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a4d79707-c5a6-4028-85ff-49d779f086e4 req-9fc8670b-01d0-421b-b923-317d78d4db74 service nova] Lock "79652140-c347-4d7b-9770-a4cc2d1a08e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:47:32 user nova-compute[70924]: DEBUG nova.compute.manager [req-a4d79707-c5a6-4028-85ff-49d779f086e4 req-9fc8670b-01d0-421b-b923-317d78d4db74 service nova] [instance: 79652140-c347-4d7b-9770-a4cc2d1a08e3] No waiting events found dispatching network-vif-plugged-bf1e6655-6811-4a5c-ac2d-e2cd6a3b8d02 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:47:32 user nova-compute[70924]: WARNING nova.compute.manager [req-a4d79707-c5a6-4028-85ff-49d779f086e4 req-9fc8670b-01d0-421b-b923-317d78d4db74 service nova] [instance: 79652140-c347-4d7b-9770-a4cc2d1a08e3] Received unexpected event network-vif-plugged-bf1e6655-6811-4a5c-ac2d-e2cd6a3b8d02 for instance with vm_state deleted and task_state None.
Jul 29 14:47:32 user nova-compute[70924]: DEBUG nova.compute.manager [req-a4d79707-c5a6-4028-85ff-49d779f086e4 req-9fc8670b-01d0-421b-b923-317d78d4db74 service nova] [instance: 79652140-c347-4d7b-9770-a4cc2d1a08e3] Received event network-vif-deleted-bf1e6655-6811-4a5c-ac2d-e2cd6a3b8d02 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:47:33 user nova-compute[70924]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690642038.3611698, 00231136-233f-4a1b-88ff-b678482ca5bb => Stopped> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:47:33 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] VM Stopped (Lifecycle Event)
Jul 29 14:47:33 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:47:33 user nova-compute[70924]: DEBUG nova.compute.manager [None req-704c2fa5-5918-4960-b42a-0d4ac85feda2 None None] [instance: 00231136-233f-4a1b-88ff-b678482ca5bb] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:47:34 user nova-compute[70924]: INFO nova.compute.manager [None req-9683f3f8-0e89-4fba-9437-bd9330fa18cc tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Unrescuing
Jul 29 14:47:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9683f3f8-0e89-4fba-9437-bd9330fa18cc tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Acquiring lock "refresh_cache-02c75b00-a1b4-4ef9-ae96-bc67d8038589" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:47:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9683f3f8-0e89-4fba-9437-bd9330fa18cc tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Acquired lock "refresh_cache-02c75b00-a1b4-4ef9-ae96-bc67d8038589" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:47:34 user nova-compute[70924]: DEBUG nova.network.neutron [None req-9683f3f8-0e89-4fba-9437-bd9330fa18cc tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 14:47:35 user nova-compute[70924]: DEBUG nova.network.neutron [None req-9683f3f8-0e89-4fba-9437-bd9330fa18cc tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Updating instance_info_cache with network_info: [{"id": "25798da4-8f4d-4db1-afd2-7fb85693bc16", "address": "fa:16:3e:59:2c:bb", "network": {"id": "d5876e18-e2af-45c2-aab5-2d0d552ebfe4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2035085552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9e5c78c1684c359cfab4e32b9c213f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25798da4-8f", "ovs_interfaceid": "25798da4-8f4d-4db1-afd2-7fb85693bc16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:47:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9683f3f8-0e89-4fba-9437-bd9330fa18cc tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Releasing lock "refresh_cache-02c75b00-a1b4-4ef9-ae96-bc67d8038589" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:47:35 user nova-compute[70924]: DEBUG nova.objects.instance [None req-9683f3f8-0e89-4fba-9437-bd9330fa18cc tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lazy-loading 'flavor' on Instance uuid 02c75b00-a1b4-4ef9-ae96-bc67d8038589 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:47:35 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:47:35 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:47:35 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:47:35 user nova-compute[70924]: DEBUG nova.compute.manager [req-662af585-a6b5-4859-aa15-f1ad5af88b1f req-cafee271-f947-48db-9453-dc38cbefac50 service nova] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Received event network-vif-unplugged-25798da4-8f4d-4db1-afd2-7fb85693bc16 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:47:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-662af585-a6b5-4859-aa15-f1ad5af88b1f req-cafee271-f947-48db-9453-dc38cbefac50 service nova] Acquiring lock "02c75b00-a1b4-4ef9-ae96-bc67d8038589-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:47:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-662af585-a6b5-4859-aa15-f1ad5af88b1f req-cafee271-f947-48db-9453-dc38cbefac50 service nova] Lock "02c75b00-a1b4-4ef9-ae96-bc67d8038589-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:47:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-662af585-a6b5-4859-aa15-f1ad5af88b1f req-cafee271-f947-48db-9453-dc38cbefac50 service nova] Lock "02c75b00-a1b4-4ef9-ae96-bc67d8038589-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:47:35 user nova-compute[70924]: DEBUG nova.compute.manager [req-662af585-a6b5-4859-aa15-f1ad5af88b1f req-cafee271-f947-48db-9453-dc38cbefac50 service nova] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] No waiting events found dispatching network-vif-unplugged-25798da4-8f4d-4db1-afd2-7fb85693bc16 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:47:35 user nova-compute[70924]: WARNING nova.compute.manager [req-662af585-a6b5-4859-aa15-f1ad5af88b1f req-cafee271-f947-48db-9453-dc38cbefac50 service nova] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Received unexpected event network-vif-unplugged-25798da4-8f4d-4db1-afd2-7fb85693bc16 for instance with vm_state rescued and task_state unrescuing.
Jul 29 14:47:35 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:47:35 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:47:35 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:47:36 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Instance destroyed successfully.
Jul 29 14:47:37 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:47:37 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:47:37 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:47:37 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:47:37 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:47:37 user nova-compute[70924]: DEBUG nova.compute.manager [req-361dd75f-d7c4-4c7b-a7a0-d24101882195 req-ec7c4392-92d2-4044-98d7-a2679f8945b0 service nova] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Received event network-vif-plugged-25798da4-8f4d-4db1-afd2-7fb85693bc16 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:47:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-361dd75f-d7c4-4c7b-a7a0-d24101882195 req-ec7c4392-92d2-4044-98d7-a2679f8945b0 service nova] Acquiring lock "02c75b00-a1b4-4ef9-ae96-bc67d8038589-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:47:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-361dd75f-d7c4-4c7b-a7a0-d24101882195 req-ec7c4392-92d2-4044-98d7-a2679f8945b0 service nova] Lock "02c75b00-a1b4-4ef9-ae96-bc67d8038589-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:47:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-361dd75f-d7c4-4c7b-a7a0-d24101882195 req-ec7c4392-92d2-4044-98d7-a2679f8945b0 service nova] Lock "02c75b00-a1b4-4ef9-ae96-bc67d8038589-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.010s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:47:37 user nova-compute[70924]: DEBUG nova.compute.manager [req-361dd75f-d7c4-4c7b-a7a0-d24101882195 req-ec7c4392-92d2-4044-98d7-a2679f8945b0 service nova] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] No waiting events found dispatching network-vif-plugged-25798da4-8f4d-4db1-afd2-7fb85693bc16 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:47:37 user nova-compute[70924]: WARNING nova.compute.manager [req-361dd75f-d7c4-4c7b-a7a0-d24101882195 req-ec7c4392-92d2-4044-98d7-a2679f8945b0 service nova] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Received unexpected event network-vif-plugged-25798da4-8f4d-4db1-afd2-7fb85693bc16 for instance with vm_state rescued and task_state unrescuing.
Jul 29 14:47:37 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:47:37 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:47:38 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:47:39 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Removed pending event for 02c75b00-a1b4-4ef9-ae96-bc67d8038589 due to event {{(pid=70924) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 29 14:47:39 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642059.7723322, 02c75b00-a1b4-4ef9-ae96-bc67d8038589 => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:47:39 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] VM Resumed (Lifecycle Event)
Jul 29 14:47:39 user nova-compute[70924]: DEBUG nova.compute.manager [None req-9683f3f8-0e89-4fba-9437-bd9330fa18cc tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:47:39 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:47:39 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:47:39 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 29 14:47:39 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642059.7770872, 02c75b00-a1b4-4ef9-ae96-bc67d8038589 => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:47:39 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] VM Started (Lifecycle Event)
Jul 29 14:47:39 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:47:39 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:47:39 user nova-compute[70924]: DEBUG nova.compute.manager [req-18f4f7f3-5f8c-4e92-817f-e80d3f00e177 req-da7e1b05-53bb-4a97-96ff-831279bba4d0 service nova] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Received event network-vif-plugged-25798da4-8f4d-4db1-afd2-7fb85693bc16 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:47:39 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-18f4f7f3-5f8c-4e92-817f-e80d3f00e177 req-da7e1b05-53bb-4a97-96ff-831279bba4d0 service nova] Acquiring lock "02c75b00-a1b4-4ef9-ae96-bc67d8038589-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:47:39 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-18f4f7f3-5f8c-4e92-817f-e80d3f00e177 req-da7e1b05-53bb-4a97-96ff-831279bba4d0 service nova] Lock "02c75b00-a1b4-4ef9-ae96-bc67d8038589-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:47:39 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-18f4f7f3-5f8c-4e92-817f-e80d3f00e177 req-da7e1b05-53bb-4a97-96ff-831279bba4d0 service nova] Lock "02c75b00-a1b4-4ef9-ae96-bc67d8038589-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:47:39 user nova-compute[70924]: DEBUG nova.compute.manager [req-18f4f7f3-5f8c-4e92-817f-e80d3f00e177 req-da7e1b05-53bb-4a97-96ff-831279bba4d0 service nova] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] No waiting events found dispatching network-vif-plugged-25798da4-8f4d-4db1-afd2-7fb85693bc16 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:47:39 user nova-compute[70924]: WARNING nova.compute.manager [req-18f4f7f3-5f8c-4e92-817f-e80d3f00e177 req-da7e1b05-53bb-4a97-96ff-831279bba4d0 service nova] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Received unexpected event network-vif-plugged-25798da4-8f4d-4db1-afd2-7fb85693bc16 for instance with vm_state active and task_state None.
Jul 29 14:47:39 user nova-compute[70924]: DEBUG nova.compute.manager [req-18f4f7f3-5f8c-4e92-817f-e80d3f00e177 req-da7e1b05-53bb-4a97-96ff-831279bba4d0 service nova] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Received event network-vif-plugged-25798da4-8f4d-4db1-afd2-7fb85693bc16 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:47:39 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-18f4f7f3-5f8c-4e92-817f-e80d3f00e177 req-da7e1b05-53bb-4a97-96ff-831279bba4d0 service nova] Acquiring lock "02c75b00-a1b4-4ef9-ae96-bc67d8038589-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:47:39 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-18f4f7f3-5f8c-4e92-817f-e80d3f00e177 req-da7e1b05-53bb-4a97-96ff-831279bba4d0 service nova] Lock "02c75b00-a1b4-4ef9-ae96-bc67d8038589-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:47:39 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-18f4f7f3-5f8c-4e92-817f-e80d3f00e177 req-da7e1b05-53bb-4a97-96ff-831279bba4d0 service nova] Lock "02c75b00-a1b4-4ef9-ae96-bc67d8038589-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:47:39 user nova-compute[70924]: DEBUG nova.compute.manager [req-18f4f7f3-5f8c-4e92-817f-e80d3f00e177 req-da7e1b05-53bb-4a97-96ff-831279bba4d0 service nova] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] No waiting events found dispatching network-vif-plugged-25798da4-8f4d-4db1-afd2-7fb85693bc16 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:47:39 user nova-compute[70924]: WARNING nova.compute.manager [req-18f4f7f3-5f8c-4e92-817f-e80d3f00e177 req-da7e1b05-53bb-4a97-96ff-831279bba4d0 service nova] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Received unexpected event network-vif-plugged-25798da4-8f4d-4db1-afd2-7fb85693bc16 for instance with vm_state active and task_state None.
Jul 29 14:47:40 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:47:41 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-85c84667-1405-4501-8fd6-3256eb734ac8 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Acquiring lock "2250b0d6-5542-4a7f-90a9-93745a776fcc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:47:41 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-85c84667-1405-4501-8fd6-3256eb734ac8 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Lock "2250b0d6-5542-4a7f-90a9-93745a776fcc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:47:41 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-85c84667-1405-4501-8fd6-3256eb734ac8 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Acquiring lock "2250b0d6-5542-4a7f-90a9-93745a776fcc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:47:41 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-85c84667-1405-4501-8fd6-3256eb734ac8 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Lock "2250b0d6-5542-4a7f-90a9-93745a776fcc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:47:41 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-85c84667-1405-4501-8fd6-3256eb734ac8 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Lock "2250b0d6-5542-4a7f-90a9-93745a776fcc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:47:41 user nova-compute[70924]: INFO nova.compute.manager [None req-85c84667-1405-4501-8fd6-3256eb734ac8 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] Terminating instance
Jul 29 14:47:41 user nova-compute[70924]: DEBUG nova.compute.manager [None req-85c84667-1405-4501-8fd6-3256eb734ac8 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] Start destroying the instance on the hypervisor. {{(pid=70924) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 14:47:41 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:47:41 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:47:41 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:47:41 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:47:42 user nova-compute[70924]: DEBUG nova.compute.manager [req-a80f0d47-ba35-464c-86d6-907619e4376a req-2a53b550-ffce-42f8-a468-cb43ea9b8c0c service nova] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] Received event network-vif-unplugged-72829b2d-d54b-4792-bb99-ea15bf5149a6 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:47:42 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a80f0d47-ba35-464c-86d6-907619e4376a req-2a53b550-ffce-42f8-a468-cb43ea9b8c0c service nova] Acquiring lock "2250b0d6-5542-4a7f-90a9-93745a776fcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:47:42 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a80f0d47-ba35-464c-86d6-907619e4376a req-2a53b550-ffce-42f8-a468-cb43ea9b8c0c service nova] Lock "2250b0d6-5542-4a7f-90a9-93745a776fcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:47:42 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a80f0d47-ba35-464c-86d6-907619e4376a req-2a53b550-ffce-42f8-a468-cb43ea9b8c0c service nova] Lock "2250b0d6-5542-4a7f-90a9-93745a776fcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:47:42 user nova-compute[70924]: DEBUG nova.compute.manager [req-a80f0d47-ba35-464c-86d6-907619e4376a req-2a53b550-ffce-42f8-a468-cb43ea9b8c0c service nova] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] No waiting events found dispatching network-vif-unplugged-72829b2d-d54b-4792-bb99-ea15bf5149a6 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:47:42 user nova-compute[70924]: DEBUG nova.compute.manager [req-a80f0d47-ba35-464c-86d6-907619e4376a req-2a53b550-ffce-42f8-a468-cb43ea9b8c0c service nova] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] Received event network-vif-unplugged-72829b2d-d54b-4792-bb99-ea15bf5149a6 for instance with task_state deleting. {{(pid=70924) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 14:47:42 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] Instance destroyed successfully.
Jul 29 14:47:42 user nova-compute[70924]: DEBUG nova.objects.instance [None req-85c84667-1405-4501-8fd6-3256eb734ac8 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Lazy-loading 'resources' on Instance uuid 2250b0d6-5542-4a7f-90a9-93745a776fcc {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:47:42 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-85c84667-1405-4501-8fd6-3256eb734ac8 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:40:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-77734653',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-77734653',id=3,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJvkNFMJOrHzNEhMPNt6g+PXKeIoQVhAmKLkP+hqyoJjCjv1XYedRIh/Q8XrDZt8SrZqXeWAbWjyzwVnHh38r8KNF01wuSEVdv2mNYVqRyrKHTZ//f8Ew8pg86ANu4Ob7Q==',key_name='tempest-keypair-248340173',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:41:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fc2394c924af4a9aaa925d116b2117ae',ramdisk_id='',reservation_id='r-oqzwhxq2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1372699391',owner_user_name='tempest-ServerActionsV293TestJSON-1372699391-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:41:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b744bbecccf48d1833ea4810b2af2d0',uuid=2250b0d6-5542-4a7f-90a9-93745a776fcc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "72829b2d-d54b-4792-bb99-ea15bf5149a6", "address": "fa:16:3e:b7:e0:eb", "network": {"id": "b6631336-b322-45e0-99b7-5e95539aa674", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2109271400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc2394c924af4a9aaa925d116b2117ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72829b2d-d5", "ovs_interfaceid": "72829b2d-d54b-4792-bb99-ea15bf5149a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 14:47:42 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-85c84667-1405-4501-8fd6-3256eb734ac8 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Converting VIF {"id": "72829b2d-d54b-4792-bb99-ea15bf5149a6", "address": "fa:16:3e:b7:e0:eb", "network": {"id": "b6631336-b322-45e0-99b7-5e95539aa674", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2109271400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc2394c924af4a9aaa925d116b2117ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72829b2d-d5", "ovs_interfaceid": "72829b2d-d54b-4792-bb99-ea15bf5149a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:47:42 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-85c84667-1405-4501-8fd6-3256eb734ac8 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b7:e0:eb,bridge_name='br-int',has_traffic_filtering=True,id=72829b2d-d54b-4792-bb99-ea15bf5149a6,network=Network(b6631336-b322-45e0-99b7-5e95539aa674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72829b2d-d5') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:47:42 user nova-compute[70924]: DEBUG os_vif [None req-85c84667-1405-4501-8fd6-3256eb734ac8 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:e0:eb,bridge_name='br-int',has_traffic_filtering=True,id=72829b2d-d54b-4792-bb99-ea15bf5149a6,network=Network(b6631336-b322-45e0-99b7-5e95539aa674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72829b2d-d5') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 14:47:42 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:47:42 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap72829b2d-d5, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:47:42 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:47:42 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:47:42 user nova-compute[70924]: INFO os_vif [None req-85c84667-1405-4501-8fd6-3256eb734ac8 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:e0:eb,bridge_name='br-int',has_traffic_filtering=True,id=72829b2d-d54b-4792-bb99-ea15bf5149a6,network=Network(b6631336-b322-45e0-99b7-5e95539aa674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72829b2d-d5')
Jul 29 14:47:42 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-85c84667-1405-4501-8fd6-3256eb734ac8 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] Deleting instance files /opt/stack/data/nova/instances/2250b0d6-5542-4a7f-90a9-93745a776fcc_del
Jul 29 14:47:42 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-85c84667-1405-4501-8fd6-3256eb734ac8 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] Deletion of /opt/stack/data/nova/instances/2250b0d6-5542-4a7f-90a9-93745a776fcc_del complete
Jul 29 14:47:42 user nova-compute[70924]: INFO nova.compute.manager [None req-85c84667-1405-4501-8fd6-3256eb734ac8 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] Took 0.70 seconds to destroy the instance on the hypervisor.
Jul 29 14:47:42 user nova-compute[70924]: DEBUG oslo.service.loopingcall [None req-85c84667-1405-4501-8fd6-3256eb734ac8 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70924) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 14:47:42 user nova-compute[70924]: DEBUG nova.compute.manager [-] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] Deallocating network for instance {{(pid=70924) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 14:47:42 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] deallocate_for_instance() {{(pid=70924) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 14:47:43 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:47:43 user nova-compute[70924]: DEBUG nova.compute.manager [req-a1ca9a43-b327-4c7c-b936-aff1cc9a422c req-067e94b8-99af-4cc6-985e-5030a8e3630b service nova] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] Received event network-vif-deleted-72829b2d-d54b-4792-bb99-ea15bf5149a6 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:47:43 user nova-compute[70924]: INFO nova.compute.manager [req-a1ca9a43-b327-4c7c-b936-aff1cc9a422c req-067e94b8-99af-4cc6-985e-5030a8e3630b service nova] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] Neutron deleted interface 72829b2d-d54b-4792-bb99-ea15bf5149a6; detaching it from the instance and deleting it from the info cache
Jul 29 14:47:43 user nova-compute[70924]: DEBUG nova.network.neutron [req-a1ca9a43-b327-4c7c-b936-aff1cc9a422c req-067e94b8-99af-4cc6-985e-5030a8e3630b service nova] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:47:43 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] Took 0.98 seconds to deallocate network for instance.
Jul 29 14:47:43 user nova-compute[70924]: DEBUG nova.compute.manager [req-a1ca9a43-b327-4c7c-b936-aff1cc9a422c req-067e94b8-99af-4cc6-985e-5030a8e3630b service nova] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] Detach interface failed, port_id=72829b2d-d54b-4792-bb99-ea15bf5149a6, reason: Instance 2250b0d6-5542-4a7f-90a9-93745a776fcc could not be found. {{(pid=70924) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 29 14:47:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:47:43 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-85c84667-1405-4501-8fd6-3256eb734ac8 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:47:43 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-85c84667-1405-4501-8fd6-3256eb734ac8 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:47:43 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-85c84667-1405-4501-8fd6-3256eb734ac8 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:47:43 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-85c84667-1405-4501-8fd6-3256eb734ac8 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:47:43 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-85c84667-1405-4501-8fd6-3256eb734ac8 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.297s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:47:43 user nova-compute[70924]: INFO nova.scheduler.client.report [None req-85c84667-1405-4501-8fd6-3256eb734ac8 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Deleted allocations for instance 2250b0d6-5542-4a7f-90a9-93745a776fcc
Jul 29 14:47:43 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-85c84667-1405-4501-8fd6-3256eb734ac8 tempest-ServerActionsV293TestJSON-1372699391 tempest-ServerActionsV293TestJSON-1372699391-project-member] Lock "2250b0d6-5542-4a7f-90a9-93745a776fcc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.259s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:47:44 user nova-compute[70924]: DEBUG nova.compute.manager [req-39849951-aaae-4dc6-950e-29c7dd0b98d4 req-1434b5f2-ccc7-437c-8662-d7ddb596c231 service nova] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] Received event network-vif-plugged-72829b2d-d54b-4792-bb99-ea15bf5149a6 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:47:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-39849951-aaae-4dc6-950e-29c7dd0b98d4 req-1434b5f2-ccc7-437c-8662-d7ddb596c231 service nova] Acquiring lock "2250b0d6-5542-4a7f-90a9-93745a776fcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:47:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-39849951-aaae-4dc6-950e-29c7dd0b98d4 req-1434b5f2-ccc7-437c-8662-d7ddb596c231 service nova] Lock "2250b0d6-5542-4a7f-90a9-93745a776fcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:47:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-39849951-aaae-4dc6-950e-29c7dd0b98d4 req-1434b5f2-ccc7-437c-8662-d7ddb596c231 service nova] Lock "2250b0d6-5542-4a7f-90a9-93745a776fcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:47:44 user nova-compute[70924]: DEBUG nova.compute.manager [req-39849951-aaae-4dc6-950e-29c7dd0b98d4 req-1434b5f2-ccc7-437c-8662-d7ddb596c231 service nova] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] No waiting events found dispatching network-vif-plugged-72829b2d-d54b-4792-bb99-ea15bf5149a6 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:47:44 user nova-compute[70924]: WARNING nova.compute.manager [req-39849951-aaae-4dc6-950e-29c7dd0b98d4 req-1434b5f2-ccc7-437c-8662-d7ddb596c231 service nova] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] Received unexpected event network-vif-plugged-72829b2d-d54b-4792-bb99-ea15bf5149a6 for instance with vm_state deleted and task_state None.
Jul 29 14:47:45 user nova-compute[70924]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690642050.4159727, 79652140-c347-4d7b-9770-a4cc2d1a08e3 => Stopped> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:47:45 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: 79652140-c347-4d7b-9770-a4cc2d1a08e3] VM Stopped (Lifecycle Event)
Jul 29 14:47:45 user nova-compute[70924]: DEBUG nova.compute.manager [None req-3da42cf6-2b93-4502-8f4d-d55e437d745d None None] [instance: 79652140-c347-4d7b-9770-a4cc2d1a08e3] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:47:46 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:47:46 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70924) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 14:47:47 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:47:47 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:47:47 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:47:47 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:47:47 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:47:47 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:47:47 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Auditing locally available compute resources for user (node: user) {{(pid=70924) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 14:47:47 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:47:47 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:47:47 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:47:47 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:47:47 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 14:47:47 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 14:47:47 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:47:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:47:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:47:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:47:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c86d8c87-6b21-4475-ab26-68ad706a4845/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:47:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c86d8c87-6b21-4475-ab26-68ad706a4845/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:47:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c86d8c87-6b21-4475-ab26-68ad706a4845/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:47:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:47:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c86d8c87-6b21-4475-ab26-68ad706a4845/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:47:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5929dcf-8594-4323-a6f5-a322aff7c881/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:47:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5929dcf-8594-4323-a6f5-a322aff7c881/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:47:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5929dcf-8594-4323-a6f5-a322aff7c881/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:47:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5929dcf-8594-4323-a6f5-a322aff7c881/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:47:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f7989ca-77e9-440f-bd2f-60e46e005557/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:47:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f7989ca-77e9-440f-bd2f-60e46e005557/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:47:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f7989ca-77e9-440f-bd2f-60e46e005557/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:47:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f7989ca-77e9-440f-bd2f-60e46e005557/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:47:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:47:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:47:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:47:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:47:49 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:47:49 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:47:49 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Hypervisor/Node resource view: name=user free_ram=7593MB free_disk=25.446002960205078GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70924) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 14:47:49 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:47:49 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:47:49 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance db656346-c4af-43da-9600-fd39f1b9e4dc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:47:49 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance f5929dcf-8594-4323-a6f5-a322aff7c881 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:47:49 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 86ecc6cb-88a8-4572-8e41-d4c5859036a6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:47:49 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 02c75b00-a1b4-4ef9-ae96-bc67d8038589 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:47:49 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance c86d8c87-6b21-4475-ab26-68ad706a4845 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:47:49 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance f5350fb5-9460-490b-a47e-74f88c8eb51c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:47:49 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 1f7989ca-77e9-440f-bd2f-60e46e005557 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:47:49 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 14:47:49 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 14:47:50 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:47:50 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:47:50 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Compute_service record updated for user:user {{(pid=70924) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 14:47:50 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.402s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:47:51 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:47:51 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:47:51 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Starting heal instance info cache {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 14:47:51 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Didn't find any instances for network info cache update. {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 29 14:47:51 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:47:51 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:47:51 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:47:51 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:47:52 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:47:53 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:47:53 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:47:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ab3d3ba5-e437-4258-9cc7-5a6069158472 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Acquiring lock "86ecc6cb-88a8-4572-8e41-d4c5859036a6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:47:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ab3d3ba5-e437-4258-9cc7-5a6069158472 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "86ecc6cb-88a8-4572-8e41-d4c5859036a6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:47:55 user nova-compute[70924]: INFO nova.compute.manager [None req-ab3d3ba5-e437-4258-9cc7-5a6069158472 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Detaching volume 45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59
Jul 29 14:47:55 user nova-compute[70924]: INFO nova.virt.block_device [None req-ab3d3ba5-e437-4258-9cc7-5a6069158472 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Attempting to driver detach volume 45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 from mountpoint /dev/vdb
Jul 29 14:47:55 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-ab3d3ba5-e437-4258-9cc7-5a6069158472 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Attempting to detach device vdb from instance 86ecc6cb-88a8-4572-8e41-d4c5859036a6 from the persistent domain config. {{(pid=70924) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 29 14:47:55 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-ab3d3ba5-e437-4258-9cc7-5a6069158472 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 14:47:55 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:47:55 user nova-compute[70924]:   <source dev="/dev/sde"/>
Jul 29 14:47:55 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 14:47:55 user nova-compute[70924]:   <serial>45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59</serial>
Jul 29 14:47:55 user nova-compute[70924]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 29 14:47:55 user nova-compute[70924]: </disk>
Jul 29 14:47:55 user nova-compute[70924]:  {{(pid=70924) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 14:47:55 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-ab3d3ba5-e437-4258-9cc7-5a6069158472 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Successfully detached device vdb from instance 86ecc6cb-88a8-4572-8e41-d4c5859036a6 from the persistent domain config.
Jul 29 14:47:55 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-ab3d3ba5-e437-4258-9cc7-5a6069158472 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 86ecc6cb-88a8-4572-8e41-d4c5859036a6 from the live domain config. {{(pid=70924) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 29 14:47:55 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-ab3d3ba5-e437-4258-9cc7-5a6069158472 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 14:47:55 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:47:55 user nova-compute[70924]:   <source dev="/dev/sde"/>
Jul 29 14:47:55 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 14:47:55 user nova-compute[70924]:   <serial>45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59</serial>
Jul 29 14:47:55 user nova-compute[70924]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 29 14:47:55 user nova-compute[70924]: </disk>
Jul 29 14:47:55 user nova-compute[70924]:  {{(pid=70924) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 14:47:55 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Received event <DeviceRemovedEvent: 1690642075.7101445, 86ecc6cb-88a8-4572-8e41-d4c5859036a6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70924) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 29 14:47:55 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-ab3d3ba5-e437-4258-9cc7-5a6069158472 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 86ecc6cb-88a8-4572-8e41-d4c5859036a6 {{(pid=70924) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 29 14:47:55 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-ab3d3ba5-e437-4258-9cc7-5a6069158472 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Successfully detached device vdb from instance 86ecc6cb-88a8-4572-8e41-d4c5859036a6 from the live domain config.
Jul 29 14:47:55 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab3d3ba5-e437-4258-9cc7-5a6069158472 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] calling os-brick to detach iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 14:47:55 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab3d3ba5-e437-4258-9cc7-5a6069158472 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, {'target_iqns': ['iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uaenIoSC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:47:55 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-ab3d3ba5-e437-4258-9cc7-5a6069158472 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:47:55 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-ab3d3ba5-e437-4258-9cc7-5a6069158472 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:47:55 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-ab3d3ba5-e437-4258-9cc7-5a6069158472 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:47:55 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab3d3ba5-e437-4258-9cc7-5a6069158472 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59', 0)] {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 14:47:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:47:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:47:55 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[04573a87-9c07-4b34-b57c-bdd8108c3262]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:47:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:47:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:47:55 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1086504-0ef1-4de9-b976-b11afa386107]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:47:55 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab3d3ba5-e437-4258-9cc7-5a6069158472 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:47:55 user nova-compute[70924]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 (non-flash)
Jul 29 14:47:55 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:47:55 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab3d3ba5-e437-4258-9cc7-5a6069158472 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:47:55 user nova-compute[70924]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 (non-flash)
Jul 29 14:47:55 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:47:55 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab3d3ba5-e437-4258-9cc7-5a6069158472 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feedc524790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59'): ({'sde'}, set())}) {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 14:47:55 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-ab3d3ba5-e437-4258-9cc7-5a6069158472 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Removing single pathed devices sde {{(pid=70924) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 14:47:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:47:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:47:55 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[514f6517-fe93-4857-a02f-3063075c1801]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:47:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:47:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:47:55 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[030ed391-54d3-4052-8f2d-bae52d57e688]: (4, ('ok\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:47:55 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-ab3d3ba5-e437-4258-9cc7-5a6069158472 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Flushing IO for device /dev/sde {{(pid=70924) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 14:47:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:47:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:47:55 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2c463e-a792-4ff7-b370-52ca86f6b2c7]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:47:55 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-ab3d3ba5-e437-4258-9cc7-5a6069158472 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70924) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 14:47:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:47:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.036s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:47:55 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ebeec5-ae5d-4156-a1d5-4bc5216f0061]: (4, ('1', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:47:55 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-ab3d3ba5-e437-4258-9cc7-5a6069158472 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 14:47:55 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-ab3d3ba5-e437-4258-9cc7-5a6069158472 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] SCSI volumes sde have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 14:47:55 user nova-compute[70924]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_885309db', '/dev/disk/by-id/scsi-23361356530333131', '/dev/disk/by-id/scsi-1SCST_BIO885309db-3a5e0311ab0de47c') {{(pid=81998) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 29 14:47:55 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecde5a40-5d63-42e5-a69d-a79a5ea57509]: (4, None) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:47:55 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab3d3ba5-e437-4258-9cc7-5a6069158472 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59')] {{(pid=70924) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 14:47:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:47:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:47:55 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[317408ba-1439-4991-8da7-dede23aceb1c]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:47:55 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab3d3ba5-e437-4258-9cc7-5a6069158472 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:47:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 -p 172.16.0.220:3260 --logout {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:47:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:47:55 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc403298-1cdb-4c8d-897d-e123f05e769f]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:47:55 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab3d3ba5-e437-4258-9cc7-5a6069158472 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59, portal: 172.16.0.220,3260]
Jul 29 14:47:55 user nova-compute[70924]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59, portal: 172.16.0.220,3260] successful.
Jul 29 14:47:55 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:47:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 -p 172.16.0.220:3260 --op delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:47:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45ceaa45-7cbb-4cb4-b84a-5bf5a2e59f59 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:47:55 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ea3768-f16c-403a-8a06-16cc3fa3733c]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:47:55 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab3d3ba5-e437-4258-9cc7-5a6069158472 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:47:55 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-ab3d3ba5-e437-4258-9cc7-5a6069158472 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.255s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:47:55 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab3d3ba5-e437-4258-9cc7-5a6069158472 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] <== disconnect_volume: return (256ms) None {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:47:55 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab3d3ba5-e437-4258-9cc7-5a6069158472 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Disconnected iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 14:47:56 user nova-compute[70924]: DEBUG nova.objects.instance [None req-ab3d3ba5-e437-4258-9cc7-5a6069158472 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lazy-loading 'flavor' on Instance uuid 86ecc6cb-88a8-4572-8e41-d4c5859036a6 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:47:56 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ab3d3ba5-e437-4258-9cc7-5a6069158472 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "86ecc6cb-88a8-4572-8e41-d4c5859036a6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.557s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:47:57 user nova-compute[70924]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690642062.208537, 2250b0d6-5542-4a7f-90a9-93745a776fcc => Stopped> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:47:57 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] VM Stopped (Lifecycle Event)
Jul 29 14:47:57 user nova-compute[70924]: DEBUG nova.compute.manager [None req-7bb74578-ade4-4827-970c-62a6f2d422d6 None None] [instance: 2250b0d6-5542-4a7f-90a9-93745a776fcc] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:47:57 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:47:57 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:47:58 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:02 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:03 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1f882cd8-2dcb-40ce-b6de-071ec79ed58f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Acquiring lock "c86d8c87-6b21-4475-ab26-68ad706a4845" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:48:03 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1f882cd8-2dcb-40ce-b6de-071ec79ed58f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Lock "c86d8c87-6b21-4475-ab26-68ad706a4845" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:48:03 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1f882cd8-2dcb-40ce-b6de-071ec79ed58f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Acquiring lock "c86d8c87-6b21-4475-ab26-68ad706a4845-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:48:03 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1f882cd8-2dcb-40ce-b6de-071ec79ed58f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Lock "c86d8c87-6b21-4475-ab26-68ad706a4845-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:48:03 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1f882cd8-2dcb-40ce-b6de-071ec79ed58f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Lock "c86d8c87-6b21-4475-ab26-68ad706a4845-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:48:03 user nova-compute[70924]: INFO nova.compute.manager [None req-1f882cd8-2dcb-40ce-b6de-071ec79ed58f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: c86d8c87-6b21-4475-ab26-68ad706a4845] Terminating instance
Jul 29 14:48:03 user nova-compute[70924]: DEBUG nova.compute.manager [None req-1f882cd8-2dcb-40ce-b6de-071ec79ed58f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: c86d8c87-6b21-4475-ab26-68ad706a4845] Start destroying the instance on the hypervisor. {{(pid=70924) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 14:48:03 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:03 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:03 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:03 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:03 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:04 user nova-compute[70924]: DEBUG nova.compute.manager [req-94e39bb3-c6d3-4292-a9b1-6ddb5e0e0f9d req-a062a8f7-b533-4a37-8989-8f33819a9b64 service nova] [instance: c86d8c87-6b21-4475-ab26-68ad706a4845] Received event network-vif-unplugged-586735a0-4e44-4217-8840-335d8ff7c6e9 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:48:04 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-94e39bb3-c6d3-4292-a9b1-6ddb5e0e0f9d req-a062a8f7-b533-4a37-8989-8f33819a9b64 service nova] Acquiring lock "c86d8c87-6b21-4475-ab26-68ad706a4845-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:48:04 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-94e39bb3-c6d3-4292-a9b1-6ddb5e0e0f9d req-a062a8f7-b533-4a37-8989-8f33819a9b64 service nova] Lock "c86d8c87-6b21-4475-ab26-68ad706a4845-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:48:04 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-94e39bb3-c6d3-4292-a9b1-6ddb5e0e0f9d req-a062a8f7-b533-4a37-8989-8f33819a9b64 service nova] Lock "c86d8c87-6b21-4475-ab26-68ad706a4845-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:48:04 user nova-compute[70924]: DEBUG nova.compute.manager [req-94e39bb3-c6d3-4292-a9b1-6ddb5e0e0f9d req-a062a8f7-b533-4a37-8989-8f33819a9b64 service nova] [instance: c86d8c87-6b21-4475-ab26-68ad706a4845] No waiting events found dispatching network-vif-unplugged-586735a0-4e44-4217-8840-335d8ff7c6e9 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:48:04 user nova-compute[70924]: DEBUG nova.compute.manager [req-94e39bb3-c6d3-4292-a9b1-6ddb5e0e0f9d req-a062a8f7-b533-4a37-8989-8f33819a9b64 service nova] [instance: c86d8c87-6b21-4475-ab26-68ad706a4845] Received event network-vif-unplugged-586735a0-4e44-4217-8840-335d8ff7c6e9 for instance with task_state deleting. {{(pid=70924) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 14:48:04 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:04 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:04 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: c86d8c87-6b21-4475-ab26-68ad706a4845] Instance destroyed successfully.
Jul 29 14:48:04 user nova-compute[70924]: DEBUG nova.objects.instance [None req-1f882cd8-2dcb-40ce-b6de-071ec79ed58f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Lazy-loading 'resources' on Instance uuid c86d8c87-6b21-4475-ab26-68ad706a4845 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:48:04 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-1f882cd8-2dcb-40ce-b6de-071ec79ed58f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:46:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1542441009',display_name='tempest-VolumesActionsTest-instance-1542441009',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1542441009',id=17,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:46:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47334cc65f984a95b4c6c06d3d8d1d40',ramdisk_id='',reservation_id='r-6wndt43s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-325820960',owner_user_name='tempest-VolumesActionsTest-325820960-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:46:21Z,user_data=None,user_id='3b1d926fc4c646dba0bf9e852302a13b',uuid=c86d8c87-6b21-4475-ab26-68ad706a4845,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "586735a0-4e44-4217-8840-335d8ff7c6e9", "address": "fa:16:3e:e5:9b:88", "network": {"id": "0bec09f1-f460-4e97-917e-84769ed49901", "bridge": "br-int", "label": "tempest-VolumesActionsTest-956399393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47334cc65f984a95b4c6c06d3d8d1d40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap586735a0-4e", "ovs_interfaceid": "586735a0-4e44-4217-8840-335d8ff7c6e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 14:48:04 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-1f882cd8-2dcb-40ce-b6de-071ec79ed58f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Converting VIF {"id": "586735a0-4e44-4217-8840-335d8ff7c6e9", "address": "fa:16:3e:e5:9b:88", "network": {"id": "0bec09f1-f460-4e97-917e-84769ed49901", "bridge": "br-int", "label": "tempest-VolumesActionsTest-956399393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47334cc65f984a95b4c6c06d3d8d1d40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap586735a0-4e", "ovs_interfaceid": "586735a0-4e44-4217-8840-335d8ff7c6e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:48:04 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-1f882cd8-2dcb-40ce-b6de-071ec79ed58f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:9b:88,bridge_name='br-int',has_traffic_filtering=True,id=586735a0-4e44-4217-8840-335d8ff7c6e9,network=Network(0bec09f1-f460-4e97-917e-84769ed49901),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap586735a0-4e') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:48:04 user nova-compute[70924]: DEBUG os_vif [None req-1f882cd8-2dcb-40ce-b6de-071ec79ed58f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:9b:88,bridge_name='br-int',has_traffic_filtering=True,id=586735a0-4e44-4217-8840-335d8ff7c6e9,network=Network(0bec09f1-f460-4e97-917e-84769ed49901),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap586735a0-4e') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 14:48:04 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:04 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap586735a0-4e, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:48:04 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:04 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:48:04 user nova-compute[70924]: INFO os_vif [None req-1f882cd8-2dcb-40ce-b6de-071ec79ed58f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:9b:88,bridge_name='br-int',has_traffic_filtering=True,id=586735a0-4e44-4217-8840-335d8ff7c6e9,network=Network(0bec09f1-f460-4e97-917e-84769ed49901),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap586735a0-4e')
Jul 29 14:48:04 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-1f882cd8-2dcb-40ce-b6de-071ec79ed58f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: c86d8c87-6b21-4475-ab26-68ad706a4845] Deleting instance files /opt/stack/data/nova/instances/c86d8c87-6b21-4475-ab26-68ad706a4845_del
Jul 29 14:48:04 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-1f882cd8-2dcb-40ce-b6de-071ec79ed58f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: c86d8c87-6b21-4475-ab26-68ad706a4845] Deletion of /opt/stack/data/nova/instances/c86d8c87-6b21-4475-ab26-68ad706a4845_del complete
Jul 29 14:48:04 user nova-compute[70924]: INFO nova.compute.manager [None req-1f882cd8-2dcb-40ce-b6de-071ec79ed58f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: c86d8c87-6b21-4475-ab26-68ad706a4845] Took 0.64 seconds to destroy the instance on the hypervisor.
Jul 29 14:48:04 user nova-compute[70924]: DEBUG oslo.service.loopingcall [None req-1f882cd8-2dcb-40ce-b6de-071ec79ed58f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70924) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 14:48:04 user nova-compute[70924]: DEBUG nova.compute.manager [-] [instance: c86d8c87-6b21-4475-ab26-68ad706a4845] Deallocating network for instance {{(pid=70924) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 14:48:04 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: c86d8c87-6b21-4475-ab26-68ad706a4845] deallocate_for_instance() {{(pid=70924) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 14:48:04 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:04 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: c86d8c87-6b21-4475-ab26-68ad706a4845] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:48:04 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: c86d8c87-6b21-4475-ab26-68ad706a4845] Took 0.54 seconds to deallocate network for instance.
Jul 29 14:48:04 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1f882cd8-2dcb-40ce-b6de-071ec79ed58f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:48:04 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1f882cd8-2dcb-40ce-b6de-071ec79ed58f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:48:05 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-1f882cd8-2dcb-40ce-b6de-071ec79ed58f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:48:05 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-1f882cd8-2dcb-40ce-b6de-071ec79ed58f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:48:05 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1f882cd8-2dcb-40ce-b6de-071ec79ed58f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.269s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:48:05 user nova-compute[70924]: INFO nova.scheduler.client.report [None req-1f882cd8-2dcb-40ce-b6de-071ec79ed58f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Deleted allocations for instance c86d8c87-6b21-4475-ab26-68ad706a4845
Jul 29 14:48:05 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1f882cd8-2dcb-40ce-b6de-071ec79ed58f tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Lock "c86d8c87-6b21-4475-ab26-68ad706a4845" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.620s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:48:06 user nova-compute[70924]: DEBUG nova.compute.manager [req-6e60f605-ff66-45dd-b0a9-205c5aef95ec req-f3fc4e60-0d98-4144-ba50-11c5c9559ef1 service nova] [instance: c86d8c87-6b21-4475-ab26-68ad706a4845] Received event network-vif-plugged-586735a0-4e44-4217-8840-335d8ff7c6e9 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:48:06 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-6e60f605-ff66-45dd-b0a9-205c5aef95ec req-f3fc4e60-0d98-4144-ba50-11c5c9559ef1 service nova] Acquiring lock "c86d8c87-6b21-4475-ab26-68ad706a4845-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:48:06 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-6e60f605-ff66-45dd-b0a9-205c5aef95ec req-f3fc4e60-0d98-4144-ba50-11c5c9559ef1 service nova] Lock "c86d8c87-6b21-4475-ab26-68ad706a4845-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:48:06 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-6e60f605-ff66-45dd-b0a9-205c5aef95ec req-f3fc4e60-0d98-4144-ba50-11c5c9559ef1 service nova] Lock "c86d8c87-6b21-4475-ab26-68ad706a4845-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:48:06 user nova-compute[70924]: DEBUG nova.compute.manager [req-6e60f605-ff66-45dd-b0a9-205c5aef95ec req-f3fc4e60-0d98-4144-ba50-11c5c9559ef1 service nova] [instance: c86d8c87-6b21-4475-ab26-68ad706a4845] No waiting events found dispatching network-vif-plugged-586735a0-4e44-4217-8840-335d8ff7c6e9 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:48:06 user nova-compute[70924]: WARNING nova.compute.manager [req-6e60f605-ff66-45dd-b0a9-205c5aef95ec req-f3fc4e60-0d98-4144-ba50-11c5c9559ef1 service nova] [instance: c86d8c87-6b21-4475-ab26-68ad706a4845] Received unexpected event network-vif-plugged-586735a0-4e44-4217-8840-335d8ff7c6e9 for instance with vm_state deleted and task_state None.
Jul 29 14:48:06 user nova-compute[70924]: DEBUG nova.compute.manager [req-6e60f605-ff66-45dd-b0a9-205c5aef95ec req-f3fc4e60-0d98-4144-ba50-11c5c9559ef1 service nova] [instance: c86d8c87-6b21-4475-ab26-68ad706a4845] Received event network-vif-deleted-586735a0-4e44-4217-8840-335d8ff7c6e9 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:48:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Acquiring lock "7cb12b3e-de44-4887-ab74-2a68164b5f7d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:48:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "7cb12b3e-de44-4887-ab74-2a68164b5f7d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:48:09 user nova-compute[70924]: DEBUG nova.compute.manager [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Starting instance... {{(pid=70924) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 14:48:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:48:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:48:09 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70924) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 14:48:09 user nova-compute[70924]: INFO nova.compute.claims [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Claim successful on node user
Jul 29 14:48:09 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:48:09 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:48:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.328s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:48:09 user nova-compute[70924]: DEBUG nova.compute.manager [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Start building networks asynchronously for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 14:48:09 user nova-compute[70924]: DEBUG nova.compute.manager [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Allocating IP information in the background. {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 14:48:09 user nova-compute[70924]: DEBUG nova.network.neutron [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] allocate_for_instance() {{(pid=70924) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 14:48:09 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 14:48:10 user nova-compute[70924]: DEBUG nova.compute.manager [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Start building block device mappings for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 14:48:10 user nova-compute[70924]: DEBUG nova.policy [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '761e4287afb94bf4ad93c09a43bada1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0388bcf487e492082e85b183f38765c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70924) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 14:48:10 user nova-compute[70924]: DEBUG nova.compute.manager [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Start spawning the instance on the hypervisor. {{(pid=70924) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 14:48:10 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Creating instance directory {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 14:48:10 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Creating image(s)
Jul 29 14:48:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Acquiring lock "/opt/stack/data/nova/instances/7cb12b3e-de44-4887-ab74-2a68164b5f7d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:48:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "/opt/stack/data/nova/instances/7cb12b3e-de44-4887-ab74-2a68164b5f7d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:48:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "/opt/stack/data/nova/instances/7cb12b3e-de44-4887-ab74-2a68164b5f7d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:48:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:48:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.133s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:48:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Acquiring lock "bd72453517468710f1de26b27fb0ea28688e9009" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:48:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:48:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:48:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.134s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:48:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/7cb12b3e-de44-4887-ab74-2a68164b5f7d/disk 1073741824 {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:48:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/7cb12b3e-de44-4887-ab74-2a68164b5f7d/disk 1073741824" returned: 0 in 0.050s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:48:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:48:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:48:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.148s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:48:10 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7cb12b3e-de44-4887-ab74-2a68164b5f7d/disk. size=1073741824 {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 14:48:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cb12b3e-de44-4887-ab74-2a68164b5f7d/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:48:10 user nova-compute[70924]: DEBUG nova.network.neutron [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Successfully created port: e41d642f-f559-4294-b5ff-5ec478fb3438 {{(pid=70924) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 14:48:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cb12b3e-de44-4887-ab74-2a68164b5f7d/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:48:10 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Cannot resize image /opt/stack/data/nova/instances/7cb12b3e-de44-4887-ab74-2a68164b5f7d/disk to a smaller size. {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 14:48:10 user nova-compute[70924]: DEBUG nova.objects.instance [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lazy-loading 'migration_context' on Instance uuid 7cb12b3e-de44-4887-ab74-2a68164b5f7d {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:48:10 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Created local disks {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 14:48:10 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Ensure instance console log exists: /opt/stack/data/nova/instances/7cb12b3e-de44-4887-ab74-2a68164b5f7d/console.log {{(pid=70924) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 14:48:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:48:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:48:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:48:11 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:11 user nova-compute[70924]: DEBUG nova.network.neutron [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Successfully updated port: e41d642f-f559-4294-b5ff-5ec478fb3438 {{(pid=70924) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 14:48:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Acquiring lock "refresh_cache-7cb12b3e-de44-4887-ab74-2a68164b5f7d" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:48:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Acquired lock "refresh_cache-7cb12b3e-de44-4887-ab74-2a68164b5f7d" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:48:11 user nova-compute[70924]: DEBUG nova.network.neutron [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 14:48:11 user nova-compute[70924]: DEBUG nova.compute.manager [req-be1cab44-451c-47d8-9972-079ce20fa941 req-c7fd4dad-7e88-4184-9cdb-07817d6d0ab0 service nova] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Received event network-changed-e41d642f-f559-4294-b5ff-5ec478fb3438 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:48:11 user nova-compute[70924]: DEBUG nova.compute.manager [req-be1cab44-451c-47d8-9972-079ce20fa941 req-c7fd4dad-7e88-4184-9cdb-07817d6d0ab0 service nova] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Refreshing instance network info cache due to event network-changed-e41d642f-f559-4294-b5ff-5ec478fb3438. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:48:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-be1cab44-451c-47d8-9972-079ce20fa941 req-c7fd4dad-7e88-4184-9cdb-07817d6d0ab0 service nova] Acquiring lock "refresh_cache-7cb12b3e-de44-4887-ab74-2a68164b5f7d" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:48:11 user nova-compute[70924]: DEBUG nova.network.neutron [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Instance cache missing network info. {{(pid=70924) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 14:48:12 user nova-compute[70924]: DEBUG nova.network.neutron [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Updating instance_info_cache with network_info: [{"id": "e41d642f-f559-4294-b5ff-5ec478fb3438", "address": "fa:16:3e:f7:ee:73", "network": {"id": "46d2cfde-13db-4cf3-af0e-4d6742f37044", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1642265305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0388bcf487e492082e85b183f38765c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape41d642f-f5", "ovs_interfaceid": "e41d642f-f559-4294-b5ff-5ec478fb3438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:48:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Releasing lock "refresh_cache-7cb12b3e-de44-4887-ab74-2a68164b5f7d" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:48:12 user nova-compute[70924]: DEBUG nova.compute.manager [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Instance network_info: |[{"id": "e41d642f-f559-4294-b5ff-5ec478fb3438", "address": "fa:16:3e:f7:ee:73", "network": {"id": "46d2cfde-13db-4cf3-af0e-4d6742f37044", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1642265305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0388bcf487e492082e85b183f38765c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape41d642f-f5", "ovs_interfaceid": "e41d642f-f559-4294-b5ff-5ec478fb3438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 14:48:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-be1cab44-451c-47d8-9972-079ce20fa941 req-c7fd4dad-7e88-4184-9cdb-07817d6d0ab0 service nova] Acquired lock "refresh_cache-7cb12b3e-de44-4887-ab74-2a68164b5f7d" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:48:12 user nova-compute[70924]: DEBUG nova.network.neutron [req-be1cab44-451c-47d8-9972-079ce20fa941 req-c7fd4dad-7e88-4184-9cdb-07817d6d0ab0 service nova] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Refreshing network info cache for port e41d642f-f559-4294-b5ff-5ec478fb3438 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:48:12 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Start _get_guest_xml network_info=[{"id": "e41d642f-f559-4294-b5ff-5ec478fb3438", "address": "fa:16:3e:f7:ee:73", "network": {"id": "46d2cfde-13db-4cf3-af0e-4d6742f37044", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1642265305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0388bcf487e492082e85b183f38765c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape41d642f-f5", "ovs_interfaceid": "e41d642f-f559-4294-b5ff-5ec478fb3438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '3aba2e73-6832-404b-8bd0-d0503ce82b8c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 14:48:12 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:48:12 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:48:12 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 14:48:12 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] CPU controller missing on host. {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 14:48:12 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 14:48:12 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] CPU controller found on host. {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 14:48:12 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70924) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 14:48:12 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T14:36:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 14:48:12 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Flavor limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 14:48:12 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Image limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 14:48:12 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Flavor pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 14:48:12 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Image pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 14:48:12 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 14:48:12 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 14:48:12 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 14:48:12 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Got 1 possible topologies {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 14:48:12 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 14:48:12 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 14:48:12 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:48:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1090583774',display_name='tempest-AttachVolumeTestJSON-server-1090583774',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1090583774',id=20,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxYeAuUdgBDENKjW9KGfUkDITpquweWjsClM8apGgMwschv+svyuQ0OvGCeunIrF1Cf2sPzGMDx0GWfQ+3b5oeX2ZZAH8S+9X0B99z5roSd+MxfrhgBDxbU7z4pZrnyqA==',key_name='tempest-keypair-571943859',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0388bcf487e492082e85b183f38765c',ramdisk_id='',reservation_id='r-4dtac58j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-651630277',owner_user_name='tempest-AttachVolumeTestJSON-651630277-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:48:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='761e4287afb94bf4ad93c09a43bada1f',uuid=7cb12b3e-de44-4887-ab74-2a68164b5f7d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e41d642f-f559-4294-b5ff-5ec478fb3438", "address": "fa:16:3e:f7:ee:73", "network": {"id": "46d2cfde-13db-4cf3-af0e-4d6742f37044", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1642265305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0388bcf487e492082e85b183f38765c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape41d642f-f5", "ovs_interfaceid": "e41d642f-f559-4294-b5ff-5ec478fb3438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:48:12 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Converting VIF {"id": "e41d642f-f559-4294-b5ff-5ec478fb3438", "address": "fa:16:3e:f7:ee:73", "network": {"id": "46d2cfde-13db-4cf3-af0e-4d6742f37044", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1642265305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0388bcf487e492082e85b183f38765c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape41d642f-f5", "ovs_interfaceid": "e41d642f-f559-4294-b5ff-5ec478fb3438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:48:12 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:ee:73,bridge_name='br-int',has_traffic_filtering=True,id=e41d642f-f559-4294-b5ff-5ec478fb3438,network=Network(46d2cfde-13db-4cf3-af0e-4d6742f37044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape41d642f-f5') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:48:12 user nova-compute[70924]: DEBUG nova.objects.instance [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lazy-loading 'pci_devices' on Instance uuid 7cb12b3e-de44-4887-ab74-2a68164b5f7d {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:48:12 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] End _get_guest_xml xml=<domain type="kvm">
Jul 29 14:48:12 user nova-compute[70924]:   <uuid>7cb12b3e-de44-4887-ab74-2a68164b5f7d</uuid>
Jul 29 14:48:12 user nova-compute[70924]:   <name>instance-00000014</name>
Jul 29 14:48:12 user nova-compute[70924]:   <memory>524288</memory>
Jul 29 14:48:12 user nova-compute[70924]:   <vcpu>1</vcpu>
Jul 29 14:48:12 user nova-compute[70924]:   <metadata>
Jul 29 14:48:12 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 14:48:12 user nova-compute[70924]:       <nova:package version="0.0.0"/>
Jul 29 14:48:12 user nova-compute[70924]:       <nova:name>tempest-AttachVolumeTestJSON-server-1090583774</nova:name>
Jul 29 14:48:12 user nova-compute[70924]:       <nova:creationTime>2023-07-29 14:48:12</nova:creationTime>
Jul 29 14:48:12 user nova-compute[70924]:       <nova:flavor name="m1.tiny">
Jul 29 14:48:12 user nova-compute[70924]:         <nova:memory>512</nova:memory>
Jul 29 14:48:12 user nova-compute[70924]:         <nova:disk>1</nova:disk>
Jul 29 14:48:12 user nova-compute[70924]:         <nova:swap>0</nova:swap>
Jul 29 14:48:12 user nova-compute[70924]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 14:48:12 user nova-compute[70924]:         <nova:vcpus>1</nova:vcpus>
Jul 29 14:48:12 user nova-compute[70924]:       </nova:flavor>
Jul 29 14:48:12 user nova-compute[70924]:       <nova:owner>
Jul 29 14:48:12 user nova-compute[70924]:         <nova:user uuid="761e4287afb94bf4ad93c09a43bada1f">tempest-AttachVolumeTestJSON-651630277-project-member</nova:user>
Jul 29 14:48:12 user nova-compute[70924]:         <nova:project uuid="a0388bcf487e492082e85b183f38765c">tempest-AttachVolumeTestJSON-651630277</nova:project>
Jul 29 14:48:12 user nova-compute[70924]:       </nova:owner>
Jul 29 14:48:12 user nova-compute[70924]:       <nova:root type="image" uuid="3aba2e73-6832-404b-8bd0-d0503ce82b8c"/>
Jul 29 14:48:12 user nova-compute[70924]:       <nova:ports>
Jul 29 14:48:12 user nova-compute[70924]:         <nova:port uuid="e41d642f-f559-4294-b5ff-5ec478fb3438">
Jul 29 14:48:12 user nova-compute[70924]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 29 14:48:12 user nova-compute[70924]:         </nova:port>
Jul 29 14:48:12 user nova-compute[70924]:       </nova:ports>
Jul 29 14:48:12 user nova-compute[70924]:     </nova:instance>
Jul 29 14:48:12 user nova-compute[70924]:   </metadata>
Jul 29 14:48:12 user nova-compute[70924]:   <sysinfo type="smbios">
Jul 29 14:48:12 user nova-compute[70924]:     <system>
Jul 29 14:48:12 user nova-compute[70924]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 14:48:12 user nova-compute[70924]:       <entry name="product">OpenStack Nova</entry>
Jul 29 14:48:12 user nova-compute[70924]:       <entry name="version">0.0.0</entry>
Jul 29 14:48:12 user nova-compute[70924]:       <entry name="serial">7cb12b3e-de44-4887-ab74-2a68164b5f7d</entry>
Jul 29 14:48:12 user nova-compute[70924]:       <entry name="uuid">7cb12b3e-de44-4887-ab74-2a68164b5f7d</entry>
Jul 29 14:48:12 user nova-compute[70924]:       <entry name="family">Virtual Machine</entry>
Jul 29 14:48:12 user nova-compute[70924]:     </system>
Jul 29 14:48:12 user nova-compute[70924]:   </sysinfo>
Jul 29 14:48:12 user nova-compute[70924]:   <os>
Jul 29 14:48:12 user nova-compute[70924]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 14:48:12 user nova-compute[70924]:     <boot dev="hd"/>
Jul 29 14:48:12 user nova-compute[70924]:     <smbios mode="sysinfo"/>
Jul 29 14:48:12 user nova-compute[70924]:   </os>
Jul 29 14:48:12 user nova-compute[70924]:   <features>
Jul 29 14:48:12 user nova-compute[70924]:     <acpi/>
Jul 29 14:48:12 user nova-compute[70924]:     <apic/>
Jul 29 14:48:12 user nova-compute[70924]:     <vmcoreinfo/>
Jul 29 14:48:12 user nova-compute[70924]:   </features>
Jul 29 14:48:12 user nova-compute[70924]:   <clock offset="utc">
Jul 29 14:48:12 user nova-compute[70924]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 14:48:12 user nova-compute[70924]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 14:48:12 user nova-compute[70924]:     <timer name="hpet" present="no"/>
Jul 29 14:48:12 user nova-compute[70924]:   </clock>
Jul 29 14:48:12 user nova-compute[70924]:   <cpu mode="custom" match="exact">
Jul 29 14:48:12 user nova-compute[70924]:     <model>Nehalem</model>
Jul 29 14:48:12 user nova-compute[70924]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 14:48:12 user nova-compute[70924]:   </cpu>
Jul 29 14:48:12 user nova-compute[70924]:   <devices>
Jul 29 14:48:12 user nova-compute[70924]:     <disk type="file" device="disk">
Jul 29 14:48:12 user nova-compute[70924]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 14:48:12 user nova-compute[70924]:       <source file="/opt/stack/data/nova/instances/7cb12b3e-de44-4887-ab74-2a68164b5f7d/disk"/>
Jul 29 14:48:12 user nova-compute[70924]:       <target dev="vda" bus="virtio"/>
Jul 29 14:48:12 user nova-compute[70924]:     </disk>
Jul 29 14:48:12 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 14:48:12 user nova-compute[70924]:       <mac address="fa:16:3e:f7:ee:73"/>
Jul 29 14:48:12 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:48:12 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 14:48:12 user nova-compute[70924]:       <target dev="tape41d642f-f5"/>
Jul 29 14:48:12 user nova-compute[70924]:     </interface>
Jul 29 14:48:12 user nova-compute[70924]:     <serial type="pty">
Jul 29 14:48:12 user nova-compute[70924]:       <log file="/opt/stack/data/nova/instances/7cb12b3e-de44-4887-ab74-2a68164b5f7d/console.log" append="off"/>
Jul 29 14:48:12 user nova-compute[70924]:     </serial>
Jul 29 14:48:12 user nova-compute[70924]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 14:48:12 user nova-compute[70924]:     <video>
Jul 29 14:48:12 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:48:12 user nova-compute[70924]:     </video>
Jul 29 14:48:12 user nova-compute[70924]:     <rng model="virtio">
Jul 29 14:48:12 user nova-compute[70924]:       <backend model="random">/dev/urandom</backend>
Jul 29 14:48:12 user nova-compute[70924]:     </rng>
Jul 29 14:48:12 user nova-compute[70924]:     <controller type="usb" index="0" model="none"/>
Jul 29 14:48:12 user nova-compute[70924]:     <memballoon model="virtio">
Jul 29 14:48:12 user nova-compute[70924]:       <stats period="10"/>
Jul 29 14:48:12 user nova-compute[70924]:     </memballoon>
Jul 29 14:48:12 user nova-compute[70924]:   </devices>
Jul 29 14:48:12 user nova-compute[70924]: </domain>
Jul 29 14:48:12 user nova-compute[70924]:  {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 14:48:12 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:48:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1090583774',display_name='tempest-AttachVolumeTestJSON-server-1090583774',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1090583774',id=20,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxYeAuUdgBDENKjW9KGfUkDITpquweWjsClM8apGgMwschv+svyuQ0OvGCeunIrF1Cf2sPzGMDx0GWfQ+3b5oeX2ZZAH8S+9X0B99z5roSd+MxfrhgBDxbU7z4pZrnyqA==',key_name='tempest-keypair-571943859',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0388bcf487e492082e85b183f38765c',ramdisk_id='',reservation_id='r-4dtac58j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-651630277',owner_user_name='tempest-AttachVolumeTestJSON-651630277-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:48:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='761e4287afb94bf4ad93c09a43bada1f',uuid=7cb12b3e-de44-4887-ab74-2a68164b5f7d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e41d642f-f559-4294-b5ff-5ec478fb3438", "address": "fa:16:3e:f7:ee:73", "network": {"id": "46d2cfde-13db-4cf3-af0e-4d6742f37044", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1642265305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0388bcf487e492082e85b183f38765c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape41d642f-f5", "ovs_interfaceid": "e41d642f-f559-4294-b5ff-5ec478fb3438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 14:48:12 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Converting VIF {"id": "e41d642f-f559-4294-b5ff-5ec478fb3438", "address": "fa:16:3e:f7:ee:73", "network": {"id": "46d2cfde-13db-4cf3-af0e-4d6742f37044", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1642265305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0388bcf487e492082e85b183f38765c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape41d642f-f5", "ovs_interfaceid": "e41d642f-f559-4294-b5ff-5ec478fb3438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:48:12 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:ee:73,bridge_name='br-int',has_traffic_filtering=True,id=e41d642f-f559-4294-b5ff-5ec478fb3438,network=Network(46d2cfde-13db-4cf3-af0e-4d6742f37044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape41d642f-f5') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:48:12 user nova-compute[70924]: DEBUG os_vif [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:ee:73,bridge_name='br-int',has_traffic_filtering=True,id=e41d642f-f559-4294-b5ff-5ec478fb3438,network=Network(46d2cfde-13db-4cf3-af0e-4d6742f37044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape41d642f-f5') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 14:48:12 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:12 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:48:12 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 14:48:12 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:12 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape41d642f-f5, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:48:12 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape41d642f-f5, col_values=(('external_ids', {'iface-id': 'e41d642f-f559-4294-b5ff-5ec478fb3438', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:ee:73', 'vm-uuid': '7cb12b3e-de44-4887-ab74-2a68164b5f7d'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:48:12 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:12 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:48:12 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:12 user nova-compute[70924]: INFO os_vif [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:ee:73,bridge_name='br-int',has_traffic_filtering=True,id=e41d642f-f559-4294-b5ff-5ec478fb3438,network=Network(46d2cfde-13db-4cf3-af0e-4d6742f37044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape41d642f-f5')
Jul 29 14:48:12 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:48:12 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] No VIF found with MAC fa:16:3e:f7:ee:73, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:48:12 user nova-compute[70924]: DEBUG nova.network.neutron [req-be1cab44-451c-47d8-9972-079ce20fa941 req-c7fd4dad-7e88-4184-9cdb-07817d6d0ab0 service nova] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Updated VIF entry in instance network info cache for port e41d642f-f559-4294-b5ff-5ec478fb3438. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:48:12 user nova-compute[70924]: DEBUG nova.network.neutron [req-be1cab44-451c-47d8-9972-079ce20fa941 req-c7fd4dad-7e88-4184-9cdb-07817d6d0ab0 service nova] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Updating instance_info_cache with network_info: [{"id": "e41d642f-f559-4294-b5ff-5ec478fb3438", "address": "fa:16:3e:f7:ee:73", "network": {"id": "46d2cfde-13db-4cf3-af0e-4d6742f37044", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1642265305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0388bcf487e492082e85b183f38765c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape41d642f-f5", "ovs_interfaceid": "e41d642f-f559-4294-b5ff-5ec478fb3438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:48:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-be1cab44-451c-47d8-9972-079ce20fa941 req-c7fd4dad-7e88-4184-9cdb-07817d6d0ab0 service nova] Releasing lock "refresh_cache-7cb12b3e-de44-4887-ab74-2a68164b5f7d" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:48:13 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:13 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:13 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:14 user nova-compute[70924]: DEBUG nova.compute.manager [req-c73deabc-d73f-48e0-9671-3ffc882d3db3 req-0d5bc965-1338-4571-94cb-02c623cd587e service nova] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Received event network-vif-plugged-e41d642f-f559-4294-b5ff-5ec478fb3438 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:48:14 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c73deabc-d73f-48e0-9671-3ffc882d3db3 req-0d5bc965-1338-4571-94cb-02c623cd587e service nova] Acquiring lock "7cb12b3e-de44-4887-ab74-2a68164b5f7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:48:14 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c73deabc-d73f-48e0-9671-3ffc882d3db3 req-0d5bc965-1338-4571-94cb-02c623cd587e service nova] Lock "7cb12b3e-de44-4887-ab74-2a68164b5f7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:48:14 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c73deabc-d73f-48e0-9671-3ffc882d3db3 req-0d5bc965-1338-4571-94cb-02c623cd587e service nova] Lock "7cb12b3e-de44-4887-ab74-2a68164b5f7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:48:14 user nova-compute[70924]: DEBUG nova.compute.manager [req-c73deabc-d73f-48e0-9671-3ffc882d3db3 req-0d5bc965-1338-4571-94cb-02c623cd587e service nova] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] No waiting events found dispatching network-vif-plugged-e41d642f-f559-4294-b5ff-5ec478fb3438 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:48:14 user nova-compute[70924]: WARNING nova.compute.manager [req-c73deabc-d73f-48e0-9671-3ffc882d3db3 req-0d5bc965-1338-4571-94cb-02c623cd587e service nova] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Received unexpected event network-vif-plugged-e41d642f-f559-4294-b5ff-5ec478fb3438 for instance with vm_state building and task_state spawning.
Jul 29 14:48:14 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:14 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:14 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:14 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:15 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:15 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642095.772008, 7cb12b3e-de44-4887-ab74-2a68164b5f7d => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:48:15 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] VM Resumed (Lifecycle Event)
Jul 29 14:48:15 user nova-compute[70924]: DEBUG nova.compute.manager [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Instance event wait completed in 0 seconds for  {{(pid=70924) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 14:48:15 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Guest created on hypervisor {{(pid=70924) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 14:48:15 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Instance spawned successfully.
Jul 29 14:48:15 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 14:48:15 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:48:15 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:48:15 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Found default for hw_cdrom_bus of ide {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:48:15 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Found default for hw_disk_bus of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:48:15 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Found default for hw_input_bus of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:48:15 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Found default for hw_pointer_model of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:48:15 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Found default for hw_video_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:48:15 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Found default for hw_vif_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:48:15 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:48:15 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642095.774016, 7cb12b3e-de44-4887-ab74-2a68164b5f7d => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:48:15 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] VM Started (Lifecycle Event)
Jul 29 14:48:15 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:48:15 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:48:15 user nova-compute[70924]: INFO nova.compute.manager [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Took 5.76 seconds to spawn the instance on the hypervisor.
Jul 29 14:48:15 user nova-compute[70924]: DEBUG nova.compute.manager [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:48:15 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:48:15 user nova-compute[70924]: INFO nova.compute.manager [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Took 6.43 seconds to build instance.
Jul 29 14:48:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9ef0bc8e-090b-403b-8942-76e956fcdd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "7cb12b3e-de44-4887-ab74-2a68164b5f7d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.517s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:48:16 user nova-compute[70924]: DEBUG nova.compute.manager [req-11894774-b67a-4cc5-99d6-6ec88a0748a3 req-70540802-183d-451d-af18-f76479ef52e8 service nova] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Received event network-vif-plugged-e41d642f-f559-4294-b5ff-5ec478fb3438 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:48:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-11894774-b67a-4cc5-99d6-6ec88a0748a3 req-70540802-183d-451d-af18-f76479ef52e8 service nova] Acquiring lock "7cb12b3e-de44-4887-ab74-2a68164b5f7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:48:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-11894774-b67a-4cc5-99d6-6ec88a0748a3 req-70540802-183d-451d-af18-f76479ef52e8 service nova] Lock "7cb12b3e-de44-4887-ab74-2a68164b5f7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:48:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-11894774-b67a-4cc5-99d6-6ec88a0748a3 req-70540802-183d-451d-af18-f76479ef52e8 service nova] Lock "7cb12b3e-de44-4887-ab74-2a68164b5f7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:48:16 user nova-compute[70924]: DEBUG nova.compute.manager [req-11894774-b67a-4cc5-99d6-6ec88a0748a3 req-70540802-183d-451d-af18-f76479ef52e8 service nova] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] No waiting events found dispatching network-vif-plugged-e41d642f-f559-4294-b5ff-5ec478fb3438 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:48:16 user nova-compute[70924]: WARNING nova.compute.manager [req-11894774-b67a-4cc5-99d6-6ec88a0748a3 req-70540802-183d-451d-af18-f76479ef52e8 service nova] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Received unexpected event network-vif-plugged-e41d642f-f559-4294-b5ff-5ec478fb3438 for instance with vm_state active and task_state None.
Jul 29 14:48:17 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:18 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:19 user nova-compute[70924]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690642084.2004771, c86d8c87-6b21-4475-ab26-68ad706a4845 => Stopped> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:48:19 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: c86d8c87-6b21-4475-ab26-68ad706a4845] VM Stopped (Lifecycle Event)
Jul 29 14:48:19 user nova-compute[70924]: DEBUG nova.compute.manager [None req-e23fd36f-5904-4068-91e5-685610ef2f7b None None] [instance: c86d8c87-6b21-4475-ab26-68ad706a4845] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:48:20 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-daaa1eba-40f0-4b1d-87d5-cdf6e2eeee34 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Acquiring lock "f5929dcf-8594-4323-a6f5-a322aff7c881" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:48:20 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-daaa1eba-40f0-4b1d-87d5-cdf6e2eeee34 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Lock "f5929dcf-8594-4323-a6f5-a322aff7c881" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:48:20 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-daaa1eba-40f0-4b1d-87d5-cdf6e2eeee34 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Acquiring lock "f5929dcf-8594-4323-a6f5-a322aff7c881-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:48:20 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-daaa1eba-40f0-4b1d-87d5-cdf6e2eeee34 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Lock "f5929dcf-8594-4323-a6f5-a322aff7c881-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:48:20 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-daaa1eba-40f0-4b1d-87d5-cdf6e2eeee34 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Lock "f5929dcf-8594-4323-a6f5-a322aff7c881-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:48:20 user nova-compute[70924]: INFO nova.compute.manager [None req-daaa1eba-40f0-4b1d-87d5-cdf6e2eeee34 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Terminating instance
Jul 29 14:48:20 user nova-compute[70924]: DEBUG nova.compute.manager [None req-daaa1eba-40f0-4b1d-87d5-cdf6e2eeee34 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Start destroying the instance on the hypervisor. {{(pid=70924) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 14:48:20 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:20 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:20 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:21 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:21 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:21 user nova-compute[70924]: DEBUG nova.compute.manager [req-f02cdacb-fe5f-49b3-8c79-028918b657b1 req-5833e7ca-2a4a-4a06-9758-029ea81646ee service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Received event network-vif-unplugged-14b12f31-f886-4752-bac2-e4673c74ae85 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:48:21 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-f02cdacb-fe5f-49b3-8c79-028918b657b1 req-5833e7ca-2a4a-4a06-9758-029ea81646ee service nova] Acquiring lock "f5929dcf-8594-4323-a6f5-a322aff7c881-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:48:21 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-f02cdacb-fe5f-49b3-8c79-028918b657b1 req-5833e7ca-2a4a-4a06-9758-029ea81646ee service nova] Lock "f5929dcf-8594-4323-a6f5-a322aff7c881-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:48:21 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-f02cdacb-fe5f-49b3-8c79-028918b657b1 req-5833e7ca-2a4a-4a06-9758-029ea81646ee service nova] Lock "f5929dcf-8594-4323-a6f5-a322aff7c881-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:48:21 user nova-compute[70924]: DEBUG nova.compute.manager [req-f02cdacb-fe5f-49b3-8c79-028918b657b1 req-5833e7ca-2a4a-4a06-9758-029ea81646ee service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] No waiting events found dispatching network-vif-unplugged-14b12f31-f886-4752-bac2-e4673c74ae85 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:48:21 user nova-compute[70924]: DEBUG nova.compute.manager [req-f02cdacb-fe5f-49b3-8c79-028918b657b1 req-5833e7ca-2a4a-4a06-9758-029ea81646ee service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Received event network-vif-unplugged-14b12f31-f886-4752-bac2-e4673c74ae85 for instance with task_state deleting. {{(pid=70924) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 14:48:21 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Instance destroyed successfully.
Jul 29 14:48:21 user nova-compute[70924]: DEBUG nova.objects.instance [None req-daaa1eba-40f0-4b1d-87d5-cdf6e2eeee34 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Lazy-loading 'resources' on Instance uuid f5929dcf-8594-4323-a6f5-a322aff7c881 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:48:21 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-daaa1eba-40f0-4b1d-87d5-cdf6e2eeee34 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:40:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1109941832',display_name='tempest-ServerStableDeviceRescueTest-server-1109941832',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1109941832',id=4,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDbdP6qGTfEYwkvD4KR81+NGcmQ5kesde3Do7g0iEjKlNSihoatuFiO0botBQ2I+jEu+EJEYmwNNO9AuJw1Z33NLdKhJ+GqI2KS8DPqodG22nTbacKe8+28M7qz7hHEmA==',key_name='tempest-keypair-1327088183',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:45:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7b2ac23ab8cd48b390fa2047c1fd0e3a',ramdisk_id='',reservation_id='r-uz3xh7j4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1945714992',owner_user_name='tempest-ServerStableDeviceRescueTest-1945714992-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:46:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d93ef8af16ed4907897254f0ef7dc4f8',uuid=f5929dcf-8594-4323-a6f5-a322aff7c881,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "14b12f31-f886-4752-bac2-e4673c74ae85", "address": "fa:16:3e:0b:f1:80", "network": {"id": "4a3c2dab-e462-4e17-a2a3-f07747a26bbe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1820325619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b2ac23ab8cd48b390fa2047c1fd0e3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14b12f31-f8", "ovs_interfaceid": "14b12f31-f886-4752-bac2-e4673c74ae85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 14:48:21 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-daaa1eba-40f0-4b1d-87d5-cdf6e2eeee34 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Converting VIF {"id": "14b12f31-f886-4752-bac2-e4673c74ae85", "address": "fa:16:3e:0b:f1:80", "network": {"id": "4a3c2dab-e462-4e17-a2a3-f07747a26bbe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1820325619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b2ac23ab8cd48b390fa2047c1fd0e3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14b12f31-f8", "ovs_interfaceid": "14b12f31-f886-4752-bac2-e4673c74ae85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:48:21 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-daaa1eba-40f0-4b1d-87d5-cdf6e2eeee34 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0b:f1:80,bridge_name='br-int',has_traffic_filtering=True,id=14b12f31-f886-4752-bac2-e4673c74ae85,network=Network(4a3c2dab-e462-4e17-a2a3-f07747a26bbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14b12f31-f8') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:48:21 user nova-compute[70924]: DEBUG os_vif [None req-daaa1eba-40f0-4b1d-87d5-cdf6e2eeee34 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:f1:80,bridge_name='br-int',has_traffic_filtering=True,id=14b12f31-f886-4752-bac2-e4673c74ae85,network=Network(4a3c2dab-e462-4e17-a2a3-f07747a26bbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14b12f31-f8') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 14:48:21 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:21 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap14b12f31-f8, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:48:21 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:21 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:48:21 user nova-compute[70924]: INFO os_vif [None req-daaa1eba-40f0-4b1d-87d5-cdf6e2eeee34 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:f1:80,bridge_name='br-int',has_traffic_filtering=True,id=14b12f31-f886-4752-bac2-e4673c74ae85,network=Network(4a3c2dab-e462-4e17-a2a3-f07747a26bbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14b12f31-f8')
Jul 29 14:48:21 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-daaa1eba-40f0-4b1d-87d5-cdf6e2eeee34 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Deleting instance files /opt/stack/data/nova/instances/f5929dcf-8594-4323-a6f5-a322aff7c881_del
Jul 29 14:48:21 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-daaa1eba-40f0-4b1d-87d5-cdf6e2eeee34 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Deletion of /opt/stack/data/nova/instances/f5929dcf-8594-4323-a6f5-a322aff7c881_del complete
Jul 29 14:48:21 user nova-compute[70924]: INFO nova.compute.manager [None req-daaa1eba-40f0-4b1d-87d5-cdf6e2eeee34 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Took 0.90 seconds to destroy the instance on the hypervisor.
Jul 29 14:48:21 user nova-compute[70924]: DEBUG oslo.service.loopingcall [None req-daaa1eba-40f0-4b1d-87d5-cdf6e2eeee34 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70924) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 14:48:21 user nova-compute[70924]: DEBUG nova.compute.manager [-] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Deallocating network for instance {{(pid=70924) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 14:48:21 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] deallocate_for_instance() {{(pid=70924) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 14:48:22 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:23 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:48:23 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Took 1.52 seconds to deallocate network for instance.
Jul 29 14:48:23 user nova-compute[70924]: DEBUG nova.compute.manager [req-e0907031-179d-416a-9ecc-c77460fc5cc5 req-b1571df4-7e83-4f39-8a5a-28ebfa7c151c service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Received event network-vif-deleted-14b12f31-f886-4752-bac2-e4673c74ae85 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:48:23 user nova-compute[70924]: INFO nova.compute.manager [req-e0907031-179d-416a-9ecc-c77460fc5cc5 req-b1571df4-7e83-4f39-8a5a-28ebfa7c151c service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Neutron deleted interface 14b12f31-f886-4752-bac2-e4673c74ae85; detaching it from the instance and deleting it from the info cache
Jul 29 14:48:23 user nova-compute[70924]: DEBUG nova.network.neutron [req-e0907031-179d-416a-9ecc-c77460fc5cc5 req-b1571df4-7e83-4f39-8a5a-28ebfa7c151c service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:48:23 user nova-compute[70924]: DEBUG nova.compute.manager [req-e0907031-179d-416a-9ecc-c77460fc5cc5 req-b1571df4-7e83-4f39-8a5a-28ebfa7c151c service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Detach interface failed, port_id=14b12f31-f886-4752-bac2-e4673c74ae85, reason: Instance f5929dcf-8594-4323-a6f5-a322aff7c881 could not be found. {{(pid=70924) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 29 14:48:23 user nova-compute[70924]: DEBUG nova.compute.manager [req-cd58cb3a-7182-436b-a2dd-098c25f21604 req-d017c415-d625-4385-a266-cca7d73798cf service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Received event network-vif-plugged-14b12f31-f886-4752-bac2-e4673c74ae85 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:48:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-cd58cb3a-7182-436b-a2dd-098c25f21604 req-d017c415-d625-4385-a266-cca7d73798cf service nova] Acquiring lock "f5929dcf-8594-4323-a6f5-a322aff7c881-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:48:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-cd58cb3a-7182-436b-a2dd-098c25f21604 req-d017c415-d625-4385-a266-cca7d73798cf service nova] Lock "f5929dcf-8594-4323-a6f5-a322aff7c881-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:48:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-cd58cb3a-7182-436b-a2dd-098c25f21604 req-d017c415-d625-4385-a266-cca7d73798cf service nova] Lock "f5929dcf-8594-4323-a6f5-a322aff7c881-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:48:23 user nova-compute[70924]: DEBUG nova.compute.manager [req-cd58cb3a-7182-436b-a2dd-098c25f21604 req-d017c415-d625-4385-a266-cca7d73798cf service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] No waiting events found dispatching network-vif-plugged-14b12f31-f886-4752-bac2-e4673c74ae85 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:48:23 user nova-compute[70924]: WARNING nova.compute.manager [req-cd58cb3a-7182-436b-a2dd-098c25f21604 req-d017c415-d625-4385-a266-cca7d73798cf service nova] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Received unexpected event network-vif-plugged-14b12f31-f886-4752-bac2-e4673c74ae85 for instance with vm_state active and task_state deleting.
Jul 29 14:48:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-daaa1eba-40f0-4b1d-87d5-cdf6e2eeee34 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:48:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-daaa1eba-40f0-4b1d-87d5-cdf6e2eeee34 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:48:23 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:23 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-daaa1eba-40f0-4b1d-87d5-cdf6e2eeee34 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:48:23 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-daaa1eba-40f0-4b1d-87d5-cdf6e2eeee34 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:48:23 user nova-compute[70924]: DEBUG nova.compute.manager [req-fb93bbb2-797f-44cd-bffc-a36c269ce94a req-7ee42d23-7cf6-49d6-8f32-31730ddc3765 service nova] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Received event network-changed-c4a5a7c9-34d6-4040-87a3-78c4fd26b170 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:48:23 user nova-compute[70924]: DEBUG nova.compute.manager [req-fb93bbb2-797f-44cd-bffc-a36c269ce94a req-7ee42d23-7cf6-49d6-8f32-31730ddc3765 service nova] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Refreshing instance network info cache due to event network-changed-c4a5a7c9-34d6-4040-87a3-78c4fd26b170. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:48:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-fb93bbb2-797f-44cd-bffc-a36c269ce94a req-7ee42d23-7cf6-49d6-8f32-31730ddc3765 service nova] Acquiring lock "refresh_cache-f5350fb5-9460-490b-a47e-74f88c8eb51c" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:48:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-fb93bbb2-797f-44cd-bffc-a36c269ce94a req-7ee42d23-7cf6-49d6-8f32-31730ddc3765 service nova] Acquired lock "refresh_cache-f5350fb5-9460-490b-a47e-74f88c8eb51c" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:48:23 user nova-compute[70924]: DEBUG nova.network.neutron [req-fb93bbb2-797f-44cd-bffc-a36c269ce94a req-7ee42d23-7cf6-49d6-8f32-31730ddc3765 service nova] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Refreshing network info cache for port c4a5a7c9-34d6-4040-87a3-78c4fd26b170 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:48:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-daaa1eba-40f0-4b1d-87d5-cdf6e2eeee34 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.419s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:48:23 user nova-compute[70924]: INFO nova.scheduler.client.report [None req-daaa1eba-40f0-4b1d-87d5-cdf6e2eeee34 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Deleted allocations for instance f5929dcf-8594-4323-a6f5-a322aff7c881
Jul 29 14:48:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-daaa1eba-40f0-4b1d-87d5-cdf6e2eeee34 tempest-ServerStableDeviceRescueTest-1945714992 tempest-ServerStableDeviceRescueTest-1945714992-project-member] Lock "f5929dcf-8594-4323-a6f5-a322aff7c881" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.089s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:48:24 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:25 user nova-compute[70924]: DEBUG nova.network.neutron [req-fb93bbb2-797f-44cd-bffc-a36c269ce94a req-7ee42d23-7cf6-49d6-8f32-31730ddc3765 service nova] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Updated VIF entry in instance network info cache for port c4a5a7c9-34d6-4040-87a3-78c4fd26b170. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:48:25 user nova-compute[70924]: DEBUG nova.network.neutron [req-fb93bbb2-797f-44cd-bffc-a36c269ce94a req-7ee42d23-7cf6-49d6-8f32-31730ddc3765 service nova] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Updating instance_info_cache with network_info: [{"id": "c4a5a7c9-34d6-4040-87a3-78c4fd26b170", "address": "fa:16:3e:90:f1:53", "network": {"id": "d87dd51f-8870-4dfa-b608-7c4b662219ca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1964327887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd007df2b3e04ab784369809178e4240", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a5a7c9-34", "ovs_interfaceid": "c4a5a7c9-34d6-4040-87a3-78c4fd26b170", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:48:25 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-fb93bbb2-797f-44cd-bffc-a36c269ce94a req-7ee42d23-7cf6-49d6-8f32-31730ddc3765 service nova] Releasing lock "refresh_cache-f5350fb5-9460-490b-a47e-74f88c8eb51c" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:48:26 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:26 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Acquiring lock "7171083a-00aa-4faf-9732-88cab8a0d83d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:48:26 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Lock "7171083a-00aa-4faf-9732-88cab8a0d83d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:48:27 user nova-compute[70924]: DEBUG nova.compute.manager [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] Starting instance... {{(pid=70924) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 14:48:27 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:48:27 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:48:27 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70924) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 14:48:27 user nova-compute[70924]: INFO nova.compute.claims [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] Claim successful on node user
Jul 29 14:48:27 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:48:27 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:48:27 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.334s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:48:27 user nova-compute[70924]: DEBUG nova.compute.manager [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] Start building networks asynchronously for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 14:48:27 user nova-compute[70924]: DEBUG nova.compute.manager [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] Allocating IP information in the background. {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 14:48:27 user nova-compute[70924]: DEBUG nova.network.neutron [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] allocate_for_instance() {{(pid=70924) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 14:48:27 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 14:48:27 user nova-compute[70924]: DEBUG nova.compute.manager [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] Start building block device mappings for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 14:48:27 user nova-compute[70924]: DEBUG nova.policy [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0fe49a3ddecb49d78f668df836df4ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5793d2e5b9451f9ef38fa61cb877d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70924) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 14:48:27 user nova-compute[70924]: DEBUG nova.compute.manager [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] Start spawning the instance on the hypervisor. {{(pid=70924) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 14:48:27 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] Creating instance directory {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 14:48:27 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] Creating image(s)
Jul 29 14:48:27 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Acquiring lock "/opt/stack/data/nova/instances/7171083a-00aa-4faf-9732-88cab8a0d83d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:48:27 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Lock "/opt/stack/data/nova/instances/7171083a-00aa-4faf-9732-88cab8a0d83d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:48:27 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Lock "/opt/stack/data/nova/instances/7171083a-00aa-4faf-9732-88cab8a0d83d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:48:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:48:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.153s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:48:27 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Acquiring lock "bd72453517468710f1de26b27fb0ea28688e9009" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:48:27 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:48:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:48:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.156s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:48:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/7171083a-00aa-4faf-9732-88cab8a0d83d/disk 1073741824 {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:48:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/7171083a-00aa-4faf-9732-88cab8a0d83d/disk 1073741824" returned: 0 in 0.049s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:48:28 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.214s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:48:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:48:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.144s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:48:28 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7171083a-00aa-4faf-9732-88cab8a0d83d/disk. size=1073741824 {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 14:48:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7171083a-00aa-4faf-9732-88cab8a0d83d/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:48:28 user nova-compute[70924]: DEBUG nova.network.neutron [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] Successfully created port: 67386daa-d99b-4cd2-aec9-5df2b4d957f0 {{(pid=70924) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 14:48:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7171083a-00aa-4faf-9732-88cab8a0d83d/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:48:28 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Cannot resize image /opt/stack/data/nova/instances/7171083a-00aa-4faf-9732-88cab8a0d83d/disk to a smaller size. {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 14:48:28 user nova-compute[70924]: DEBUG nova.objects.instance [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Lazy-loading 'migration_context' on Instance uuid 7171083a-00aa-4faf-9732-88cab8a0d83d {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:48:28 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] Created local disks {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 14:48:28 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] Ensure instance console log exists: /opt/stack/data/nova/instances/7171083a-00aa-4faf-9732-88cab8a0d83d/console.log {{(pid=70924) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 14:48:28 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:48:28 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:48:28 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:48:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:29 user nova-compute[70924]: DEBUG nova.network.neutron [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] Successfully updated port: 67386daa-d99b-4cd2-aec9-5df2b4d957f0 {{(pid=70924) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 14:48:29 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Acquiring lock "refresh_cache-7171083a-00aa-4faf-9732-88cab8a0d83d" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:48:29 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Acquired lock "refresh_cache-7171083a-00aa-4faf-9732-88cab8a0d83d" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:48:29 user nova-compute[70924]: DEBUG nova.network.neutron [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 14:48:29 user nova-compute[70924]: DEBUG nova.compute.manager [req-3e94d057-0456-4cb1-99ff-fcbe41e12321 req-a4d88c18-e50f-4d9c-9cbb-db1054ad6c06 service nova] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] Received event network-changed-67386daa-d99b-4cd2-aec9-5df2b4d957f0 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:48:29 user nova-compute[70924]: DEBUG nova.compute.manager [req-3e94d057-0456-4cb1-99ff-fcbe41e12321 req-a4d88c18-e50f-4d9c-9cbb-db1054ad6c06 service nova] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] Refreshing instance network info cache due to event network-changed-67386daa-d99b-4cd2-aec9-5df2b4d957f0. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:48:29 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-3e94d057-0456-4cb1-99ff-fcbe41e12321 req-a4d88c18-e50f-4d9c-9cbb-db1054ad6c06 service nova] Acquiring lock "refresh_cache-7171083a-00aa-4faf-9732-88cab8a0d83d" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:48:29 user nova-compute[70924]: DEBUG nova.network.neutron [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] Instance cache missing network info. {{(pid=70924) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 14:48:29 user nova-compute[70924]: DEBUG nova.network.neutron [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] Updating instance_info_cache with network_info: [{"id": "67386daa-d99b-4cd2-aec9-5df2b4d957f0", "address": "fa:16:3e:04:89:76", "network": {"id": "cb1ab4d5-0cba-4628-bca8-015a7acce83b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-875103426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d5793d2e5b9451f9ef38fa61cb877d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67386daa-d9", "ovs_interfaceid": "67386daa-d99b-4cd2-aec9-5df2b4d957f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:48:29 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Releasing lock "refresh_cache-7171083a-00aa-4faf-9732-88cab8a0d83d" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:48:29 user nova-compute[70924]: DEBUG nova.compute.manager [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] Instance network_info: |[{"id": "67386daa-d99b-4cd2-aec9-5df2b4d957f0", "address": "fa:16:3e:04:89:76", "network": {"id": "cb1ab4d5-0cba-4628-bca8-015a7acce83b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-875103426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d5793d2e5b9451f9ef38fa61cb877d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67386daa-d9", "ovs_interfaceid": "67386daa-d99b-4cd2-aec9-5df2b4d957f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 14:48:29 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-3e94d057-0456-4cb1-99ff-fcbe41e12321 req-a4d88c18-e50f-4d9c-9cbb-db1054ad6c06 service nova] Acquired lock "refresh_cache-7171083a-00aa-4faf-9732-88cab8a0d83d" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:48:29 user nova-compute[70924]: DEBUG nova.network.neutron [req-3e94d057-0456-4cb1-99ff-fcbe41e12321 req-a4d88c18-e50f-4d9c-9cbb-db1054ad6c06 service nova] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] Refreshing network info cache for port 67386daa-d99b-4cd2-aec9-5df2b4d957f0 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:48:29 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] Start _get_guest_xml network_info=[{"id": "67386daa-d99b-4cd2-aec9-5df2b4d957f0", "address": "fa:16:3e:04:89:76", "network": {"id": "cb1ab4d5-0cba-4628-bca8-015a7acce83b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-875103426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d5793d2e5b9451f9ef38fa61cb877d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67386daa-d9", "ovs_interfaceid": "67386daa-d99b-4cd2-aec9-5df2b4d957f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '3aba2e73-6832-404b-8bd0-d0503ce82b8c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 14:48:29 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:48:29 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:48:29 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 14:48:29 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] CPU controller missing on host. {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 14:48:29 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 14:48:29 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] CPU controller found on host. {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 14:48:29 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70924) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 14:48:29 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T14:36:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 14:48:29 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Flavor limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 14:48:29 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Image limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 14:48:29 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Flavor pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 14:48:29 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Image pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 14:48:29 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 14:48:29 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 14:48:29 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 14:48:29 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Got 1 possible topologies {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 14:48:29 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 14:48:29 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 14:48:29 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:48:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1159256951',display_name='tempest-ServersNegativeTestJSON-server-1159256951',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1159256951',id=21,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d5793d2e5b9451f9ef38fa61cb877d5',ramdisk_id='',reservation_id='r-7vcr36ib',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1209083119',owner_user_name='tempest-ServersNegativeTestJSON-1209083119-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:48:28Z,user_data=None,user_id='0fe49a3ddecb49d78f668df836df4ce8',uuid=7171083a-00aa-4faf-9732-88cab8a0d83d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67386daa-d99b-4cd2-aec9-5df2b4d957f0", "address": "fa:16:3e:04:89:76", "network": {"id": "cb1ab4d5-0cba-4628-bca8-015a7acce83b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-875103426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d5793d2e5b9451f9ef38fa61cb877d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67386daa-d9", "ovs_interfaceid": "67386daa-d99b-4cd2-aec9-5df2b4d957f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:48:29 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Converting VIF {"id": "67386daa-d99b-4cd2-aec9-5df2b4d957f0", "address": "fa:16:3e:04:89:76", "network": {"id": "cb1ab4d5-0cba-4628-bca8-015a7acce83b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-875103426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d5793d2e5b9451f9ef38fa61cb877d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67386daa-d9", "ovs_interfaceid": "67386daa-d99b-4cd2-aec9-5df2b4d957f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:48:29 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:89:76,bridge_name='br-int',has_traffic_filtering=True,id=67386daa-d99b-4cd2-aec9-5df2b4d957f0,network=Network(cb1ab4d5-0cba-4628-bca8-015a7acce83b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67386daa-d9') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:48:29 user nova-compute[70924]: DEBUG nova.objects.instance [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Lazy-loading 'pci_devices' on Instance uuid 7171083a-00aa-4faf-9732-88cab8a0d83d {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:48:29 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] End _get_guest_xml xml=<domain type="kvm">
Jul 29 14:48:29 user nova-compute[70924]:   <uuid>7171083a-00aa-4faf-9732-88cab8a0d83d</uuid>
Jul 29 14:48:29 user nova-compute[70924]:   <name>instance-00000015</name>
Jul 29 14:48:29 user nova-compute[70924]:   <memory>524288</memory>
Jul 29 14:48:29 user nova-compute[70924]:   <vcpu>1</vcpu>
Jul 29 14:48:29 user nova-compute[70924]:   <metadata>
Jul 29 14:48:29 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 14:48:29 user nova-compute[70924]:       <nova:package version="0.0.0"/>
Jul 29 14:48:29 user nova-compute[70924]:       <nova:name>tempest-ServersNegativeTestJSON-server-1159256951</nova:name>
Jul 29 14:48:29 user nova-compute[70924]:       <nova:creationTime>2023-07-29 14:48:29</nova:creationTime>
Jul 29 14:48:29 user nova-compute[70924]:       <nova:flavor name="m1.tiny">
Jul 29 14:48:29 user nova-compute[70924]:         <nova:memory>512</nova:memory>
Jul 29 14:48:29 user nova-compute[70924]:         <nova:disk>1</nova:disk>
Jul 29 14:48:29 user nova-compute[70924]:         <nova:swap>0</nova:swap>
Jul 29 14:48:29 user nova-compute[70924]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 14:48:29 user nova-compute[70924]:         <nova:vcpus>1</nova:vcpus>
Jul 29 14:48:29 user nova-compute[70924]:       </nova:flavor>
Jul 29 14:48:29 user nova-compute[70924]:       <nova:owner>
Jul 29 14:48:29 user nova-compute[70924]:         <nova:user uuid="0fe49a3ddecb49d78f668df836df4ce8">tempest-ServersNegativeTestJSON-1209083119-project-member</nova:user>
Jul 29 14:48:29 user nova-compute[70924]:         <nova:project uuid="8d5793d2e5b9451f9ef38fa61cb877d5">tempest-ServersNegativeTestJSON-1209083119</nova:project>
Jul 29 14:48:29 user nova-compute[70924]:       </nova:owner>
Jul 29 14:48:29 user nova-compute[70924]:       <nova:root type="image" uuid="3aba2e73-6832-404b-8bd0-d0503ce82b8c"/>
Jul 29 14:48:29 user nova-compute[70924]:       <nova:ports>
Jul 29 14:48:29 user nova-compute[70924]:         <nova:port uuid="67386daa-d99b-4cd2-aec9-5df2b4d957f0">
Jul 29 14:48:29 user nova-compute[70924]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 29 14:48:29 user nova-compute[70924]:         </nova:port>
Jul 29 14:48:29 user nova-compute[70924]:       </nova:ports>
Jul 29 14:48:29 user nova-compute[70924]:     </nova:instance>
Jul 29 14:48:29 user nova-compute[70924]:   </metadata>
Jul 29 14:48:29 user nova-compute[70924]:   <sysinfo type="smbios">
Jul 29 14:48:29 user nova-compute[70924]:     <system>
Jul 29 14:48:29 user nova-compute[70924]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 14:48:29 user nova-compute[70924]:       <entry name="product">OpenStack Nova</entry>
Jul 29 14:48:29 user nova-compute[70924]:       <entry name="version">0.0.0</entry>
Jul 29 14:48:29 user nova-compute[70924]:       <entry name="serial">7171083a-00aa-4faf-9732-88cab8a0d83d</entry>
Jul 29 14:48:29 user nova-compute[70924]:       <entry name="uuid">7171083a-00aa-4faf-9732-88cab8a0d83d</entry>
Jul 29 14:48:29 user nova-compute[70924]:       <entry name="family">Virtual Machine</entry>
Jul 29 14:48:29 user nova-compute[70924]:     </system>
Jul 29 14:48:29 user nova-compute[70924]:   </sysinfo>
Jul 29 14:48:29 user nova-compute[70924]:   <os>
Jul 29 14:48:29 user nova-compute[70924]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 14:48:29 user nova-compute[70924]:     <boot dev="hd"/>
Jul 29 14:48:29 user nova-compute[70924]:     <smbios mode="sysinfo"/>
Jul 29 14:48:29 user nova-compute[70924]:   </os>
Jul 29 14:48:29 user nova-compute[70924]:   <features>
Jul 29 14:48:29 user nova-compute[70924]:     <acpi/>
Jul 29 14:48:29 user nova-compute[70924]:     <apic/>
Jul 29 14:48:29 user nova-compute[70924]:     <vmcoreinfo/>
Jul 29 14:48:29 user nova-compute[70924]:   </features>
Jul 29 14:48:29 user nova-compute[70924]:   <clock offset="utc">
Jul 29 14:48:29 user nova-compute[70924]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 14:48:29 user nova-compute[70924]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 14:48:29 user nova-compute[70924]:     <timer name="hpet" present="no"/>
Jul 29 14:48:29 user nova-compute[70924]:   </clock>
Jul 29 14:48:29 user nova-compute[70924]:   <cpu mode="custom" match="exact">
Jul 29 14:48:29 user nova-compute[70924]:     <model>Nehalem</model>
Jul 29 14:48:29 user nova-compute[70924]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 14:48:29 user nova-compute[70924]:   </cpu>
Jul 29 14:48:29 user nova-compute[70924]:   <devices>
Jul 29 14:48:29 user nova-compute[70924]:     <disk type="file" device="disk">
Jul 29 14:48:29 user nova-compute[70924]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 14:48:29 user nova-compute[70924]:       <source file="/opt/stack/data/nova/instances/7171083a-00aa-4faf-9732-88cab8a0d83d/disk"/>
Jul 29 14:48:29 user nova-compute[70924]:       <target dev="vda" bus="virtio"/>
Jul 29 14:48:29 user nova-compute[70924]:     </disk>
Jul 29 14:48:29 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 14:48:29 user nova-compute[70924]:       <mac address="fa:16:3e:04:89:76"/>
Jul 29 14:48:29 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:48:29 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 14:48:29 user nova-compute[70924]:       <target dev="tap67386daa-d9"/>
Jul 29 14:48:29 user nova-compute[70924]:     </interface>
Jul 29 14:48:29 user nova-compute[70924]:     <serial type="pty">
Jul 29 14:48:29 user nova-compute[70924]:       <log file="/opt/stack/data/nova/instances/7171083a-00aa-4faf-9732-88cab8a0d83d/console.log" append="off"/>
Jul 29 14:48:29 user nova-compute[70924]:     </serial>
Jul 29 14:48:29 user nova-compute[70924]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 14:48:29 user nova-compute[70924]:     <video>
Jul 29 14:48:29 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:48:29 user nova-compute[70924]:     </video>
Jul 29 14:48:29 user nova-compute[70924]:     <rng model="virtio">
Jul 29 14:48:29 user nova-compute[70924]:       <backend model="random">/dev/urandom</backend>
Jul 29 14:48:29 user nova-compute[70924]:     </rng>
Jul 29 14:48:29 user nova-compute[70924]:     <controller type="usb" index="0" model="none"/>
Jul 29 14:48:29 user nova-compute[70924]:     <memballoon model="virtio">
Jul 29 14:48:29 user nova-compute[70924]:       <stats period="10"/>
Jul 29 14:48:29 user nova-compute[70924]:     </memballoon>
Jul 29 14:48:29 user nova-compute[70924]:   </devices>
Jul 29 14:48:29 user nova-compute[70924]: </domain>
Jul 29 14:48:29 user nova-compute[70924]:  {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 14:48:29 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:48:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1159256951',display_name='tempest-ServersNegativeTestJSON-server-1159256951',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1159256951',id=21,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d5793d2e5b9451f9ef38fa61cb877d5',ramdisk_id='',reservation_id='r-7vcr36ib',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1209083119',owner_user_name='tempest-ServersNegativeTestJSON-1209083119-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:48:28Z,user_data=None,user_id='0fe49a3ddecb49d78f668df836df4ce8',uuid=7171083a-00aa-4faf-9732-88cab8a0d83d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67386daa-d99b-4cd2-aec9-5df2b4d957f0", "address": "fa:16:3e:04:89:76", "network": {"id": "cb1ab4d5-0cba-4628-bca8-015a7acce83b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-875103426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d5793d2e5b9451f9ef38fa61cb877d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67386daa-d9", "ovs_interfaceid": "67386daa-d99b-4cd2-aec9-5df2b4d957f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 14:48:29 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Converting VIF {"id": "67386daa-d99b-4cd2-aec9-5df2b4d957f0", "address": "fa:16:3e:04:89:76", "network": {"id": "cb1ab4d5-0cba-4628-bca8-015a7acce83b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-875103426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d5793d2e5b9451f9ef38fa61cb877d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67386daa-d9", "ovs_interfaceid": "67386daa-d99b-4cd2-aec9-5df2b4d957f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:48:29 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:89:76,bridge_name='br-int',has_traffic_filtering=True,id=67386daa-d99b-4cd2-aec9-5df2b4d957f0,network=Network(cb1ab4d5-0cba-4628-bca8-015a7acce83b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67386daa-d9') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:48:29 user nova-compute[70924]: DEBUG os_vif [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:89:76,bridge_name='br-int',has_traffic_filtering=True,id=67386daa-d99b-4cd2-aec9-5df2b4d957f0,network=Network(cb1ab4d5-0cba-4628-bca8-015a7acce83b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67386daa-d9') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 14:48:29 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:29 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:48:29 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 14:48:29 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:29 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap67386daa-d9, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:48:29 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap67386daa-d9, col_values=(('external_ids', {'iface-id': '67386daa-d99b-4cd2-aec9-5df2b4d957f0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:89:76', 'vm-uuid': '7171083a-00aa-4faf-9732-88cab8a0d83d'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:48:29 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:29 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:48:29 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:29 user nova-compute[70924]: INFO os_vif [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:89:76,bridge_name='br-int',has_traffic_filtering=True,id=67386daa-d99b-4cd2-aec9-5df2b4d957f0,network=Network(cb1ab4d5-0cba-4628-bca8-015a7acce83b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67386daa-d9')
Jul 29 14:48:29 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:48:29 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] No VIF found with MAC fa:16:3e:04:89:76, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:48:29 user nova-compute[70924]: DEBUG nova.network.neutron [req-3e94d057-0456-4cb1-99ff-fcbe41e12321 req-a4d88c18-e50f-4d9c-9cbb-db1054ad6c06 service nova] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] Updated VIF entry in instance network info cache for port 67386daa-d99b-4cd2-aec9-5df2b4d957f0. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:48:29 user nova-compute[70924]: DEBUG nova.network.neutron [req-3e94d057-0456-4cb1-99ff-fcbe41e12321 req-a4d88c18-e50f-4d9c-9cbb-db1054ad6c06 service nova] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] Updating instance_info_cache with network_info: [{"id": "67386daa-d99b-4cd2-aec9-5df2b4d957f0", "address": "fa:16:3e:04:89:76", "network": {"id": "cb1ab4d5-0cba-4628-bca8-015a7acce83b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-875103426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d5793d2e5b9451f9ef38fa61cb877d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67386daa-d9", "ovs_interfaceid": "67386daa-d99b-4cd2-aec9-5df2b4d957f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:48:29 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-3e94d057-0456-4cb1-99ff-fcbe41e12321 req-a4d88c18-e50f-4d9c-9cbb-db1054ad6c06 service nova] Releasing lock "refresh_cache-7171083a-00aa-4faf-9732-88cab8a0d83d" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:48:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:31 user nova-compute[70924]: DEBUG nova.compute.manager [req-2412f4ae-28e2-40b4-9ce6-b121f7f677e1 req-8fcde450-8ff5-4c86-b52d-8f209276f834 service nova] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] Received event network-vif-plugged-67386daa-d99b-4cd2-aec9-5df2b4d957f0 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:48:31 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-2412f4ae-28e2-40b4-9ce6-b121f7f677e1 req-8fcde450-8ff5-4c86-b52d-8f209276f834 service nova] Acquiring lock "7171083a-00aa-4faf-9732-88cab8a0d83d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:48:31 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-2412f4ae-28e2-40b4-9ce6-b121f7f677e1 req-8fcde450-8ff5-4c86-b52d-8f209276f834 service nova] Lock "7171083a-00aa-4faf-9732-88cab8a0d83d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:48:31 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-2412f4ae-28e2-40b4-9ce6-b121f7f677e1 req-8fcde450-8ff5-4c86-b52d-8f209276f834 service nova] Lock "7171083a-00aa-4faf-9732-88cab8a0d83d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:48:31 user nova-compute[70924]: DEBUG nova.compute.manager [req-2412f4ae-28e2-40b4-9ce6-b121f7f677e1 req-8fcde450-8ff5-4c86-b52d-8f209276f834 service nova] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] No waiting events found dispatching network-vif-plugged-67386daa-d99b-4cd2-aec9-5df2b4d957f0 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:48:31 user nova-compute[70924]: WARNING nova.compute.manager [req-2412f4ae-28e2-40b4-9ce6-b121f7f677e1 req-8fcde450-8ff5-4c86-b52d-8f209276f834 service nova] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] Received unexpected event network-vif-plugged-67386daa-d99b-4cd2-aec9-5df2b4d957f0 for instance with vm_state building and task_state spawning.
Jul 29 14:48:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:33 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642113.2554605, 7171083a-00aa-4faf-9732-88cab8a0d83d => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:48:33 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] VM Resumed (Lifecycle Event)
Jul 29 14:48:33 user nova-compute[70924]: DEBUG nova.compute.manager [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] Instance event wait completed in 0 seconds for  {{(pid=70924) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 14:48:33 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] Guest created on hypervisor {{(pid=70924) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 14:48:33 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] Instance spawned successfully.
Jul 29 14:48:33 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 14:48:33 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] Found default for hw_cdrom_bus of ide {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:48:33 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] Found default for hw_disk_bus of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:48:33 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] Found default for hw_input_bus of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:48:33 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] Found default for hw_pointer_model of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:48:33 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] Found default for hw_video_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:48:33 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] Found default for hw_vif_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:48:33 user nova-compute[70924]: DEBUG nova.compute.manager [req-52cf4c8f-ba51-4589-91dd-6ed0d583692a req-219191d0-5441-4db5-a07c-c09a0f9ce364 service nova] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] Received event network-vif-plugged-67386daa-d99b-4cd2-aec9-5df2b4d957f0 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:48:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-52cf4c8f-ba51-4589-91dd-6ed0d583692a req-219191d0-5441-4db5-a07c-c09a0f9ce364 service nova] Acquiring lock "7171083a-00aa-4faf-9732-88cab8a0d83d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:48:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-52cf4c8f-ba51-4589-91dd-6ed0d583692a req-219191d0-5441-4db5-a07c-c09a0f9ce364 service nova] Lock "7171083a-00aa-4faf-9732-88cab8a0d83d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:48:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-52cf4c8f-ba51-4589-91dd-6ed0d583692a req-219191d0-5441-4db5-a07c-c09a0f9ce364 service nova] Lock "7171083a-00aa-4faf-9732-88cab8a0d83d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:48:33 user nova-compute[70924]: DEBUG nova.compute.manager [req-52cf4c8f-ba51-4589-91dd-6ed0d583692a req-219191d0-5441-4db5-a07c-c09a0f9ce364 service nova] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] No waiting events found dispatching network-vif-plugged-67386daa-d99b-4cd2-aec9-5df2b4d957f0 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:48:33 user nova-compute[70924]: WARNING nova.compute.manager [req-52cf4c8f-ba51-4589-91dd-6ed0d583692a req-219191d0-5441-4db5-a07c-c09a0f9ce364 service nova] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] Received unexpected event network-vif-plugged-67386daa-d99b-4cd2-aec9-5df2b4d957f0 for instance with vm_state building and task_state spawning.
Jul 29 14:48:33 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:48:33 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:48:33 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:48:33 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642113.2568674, 7171083a-00aa-4faf-9732-88cab8a0d83d => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:48:33 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] VM Started (Lifecycle Event)
Jul 29 14:48:33 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:48:33 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:48:33 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:48:33 user nova-compute[70924]: INFO nova.compute.manager [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] Took 5.78 seconds to spawn the instance on the hypervisor.
Jul 29 14:48:33 user nova-compute[70924]: DEBUG nova.compute.manager [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:48:33 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:33 user nova-compute[70924]: INFO nova.compute.manager [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] Took 6.45 seconds to build instance.
Jul 29 14:48:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-71744286-8da2-485f-a547-6f91d38ab0fe tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Lock "7171083a-00aa-4faf-9732-88cab8a0d83d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.552s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:48:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:35 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:36 user nova-compute[70924]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690642101.6568372, f5929dcf-8594-4323-a6f5-a322aff7c881 => Stopped> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:48:36 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] VM Stopped (Lifecycle Event)
Jul 29 14:48:36 user nova-compute[70924]: DEBUG nova.compute.manager [None req-b76fb854-d0fc-40e2-9066-d25bc3e5c1af None None] [instance: f5929dcf-8594-4323-a6f5-a322aff7c881] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:48:38 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:39 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:42 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:45 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:47 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:48:47 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70924) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 14:48:47 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:48:47 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:48:47 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:48:47 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:48:47 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Auditing locally available compute resources for user (node: user) {{(pid=70924) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 14:48:47 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:48:47 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:48:47 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:48:47 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:48:47 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 14:48:47 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:48:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:48:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:48:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:48:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f7989ca-77e9-440f-bd2f-60e46e005557/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:48:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f7989ca-77e9-440f-bd2f-60e46e005557/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:48:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f7989ca-77e9-440f-bd2f-60e46e005557/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:48:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:48 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Acquiring lock "bdaf1714-27f9-47ee-808b-206ec78c6067" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:48:48 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "bdaf1714-27f9-47ee-808b-206ec78c6067" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:48:48 user nova-compute[70924]: DEBUG nova.compute.manager [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Starting instance... {{(pid=70924) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 14:48:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f7989ca-77e9-440f-bd2f-60e46e005557/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:48:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7171083a-00aa-4faf-9732-88cab8a0d83d/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:48:48 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:48:48 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:48:48 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70924) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 14:48:48 user nova-compute[70924]: INFO nova.compute.claims [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Claim successful on node user
Jul 29 14:48:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7171083a-00aa-4faf-9732-88cab8a0d83d/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:48:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7171083a-00aa-4faf-9732-88cab8a0d83d/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:48:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7171083a-00aa-4faf-9732-88cab8a0d83d/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:48:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cb12b3e-de44-4887-ab74-2a68164b5f7d/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:48:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cb12b3e-de44-4887-ab74-2a68164b5f7d/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:48:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cb12b3e-de44-4887-ab74-2a68164b5f7d/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:48:49 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:48:49 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:48:49 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.514s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:48:49 user nova-compute[70924]: DEBUG nova.compute.manager [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Start building networks asynchronously for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 14:48:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cb12b3e-de44-4887-ab74-2a68164b5f7d/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:48:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:48:49 user nova-compute[70924]: DEBUG nova.compute.manager [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Allocating IP information in the background. {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 14:48:49 user nova-compute[70924]: DEBUG nova.network.neutron [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] allocate_for_instance() {{(pid=70924) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 14:48:49 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 14:48:49 user nova-compute[70924]: DEBUG nova.compute.manager [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Start building block device mappings for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 14:48:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:48:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:48:49 user nova-compute[70924]: DEBUG nova.policy [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7c9562451ffa45b2aad975335d83fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5f9f30926f47afad3cb4c9e89d55c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70924) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 14:48:49 user nova-compute[70924]: DEBUG nova.compute.manager [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Start spawning the instance on the hypervisor. {{(pid=70924) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 14:48:49 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Creating instance directory {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 14:48:49 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Creating image(s)
Jul 29 14:48:49 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Acquiring lock "/opt/stack/data/nova/instances/bdaf1714-27f9-47ee-808b-206ec78c6067/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:48:49 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "/opt/stack/data/nova/instances/bdaf1714-27f9-47ee-808b-206ec78c6067/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:48:49 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "/opt/stack/data/nova/instances/bdaf1714-27f9-47ee-808b-206ec78c6067/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:48:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:48:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:48:49 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.517s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:48:49 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Acquiring lock "bd72453517468710f1de26b27fb0ea28688e9009" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:48:49 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:48:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:48:49 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:48:49 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:48:49 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Hypervisor/Node resource view: name=user free_ram=7671MB free_disk=25.528980255126953GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70924) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 14:48:49 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:48:49 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:48:50 user nova-compute[70924]: DEBUG nova.network.neutron [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Successfully created port: d95eba18-cd83-40e6-847a-c36b2e084f89 {{(pid=70924) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 14:48:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.140s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:48:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/bdaf1714-27f9-47ee-808b-206ec78c6067/disk 1073741824 {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:48:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/bdaf1714-27f9-47ee-808b-206ec78c6067/disk 1073741824" returned: 0 in 0.070s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:48:50 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.217s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:48:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:48:50 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance db656346-c4af-43da-9600-fd39f1b9e4dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:48:50 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 86ecc6cb-88a8-4572-8e41-d4c5859036a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:48:50 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 02c75b00-a1b4-4ef9-ae96-bc67d8038589 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:48:50 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance f5350fb5-9460-490b-a47e-74f88c8eb51c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:48:50 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 1f7989ca-77e9-440f-bd2f-60e46e005557 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:48:50 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 7cb12b3e-de44-4887-ab74-2a68164b5f7d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:48:50 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 7171083a-00aa-4faf-9732-88cab8a0d83d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:48:50 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance bdaf1714-27f9-47ee-808b-206ec78c6067 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:48:50 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 14:48:50 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 14:48:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.154s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:48:50 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bdaf1714-27f9-47ee-808b-206ec78c6067/disk. size=1073741824 {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 14:48:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdaf1714-27f9-47ee-808b-206ec78c6067/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:48:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdaf1714-27f9-47ee-808b-206ec78c6067/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:48:50 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Cannot resize image /opt/stack/data/nova/instances/bdaf1714-27f9-47ee-808b-206ec78c6067/disk to a smaller size. {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 14:48:50 user nova-compute[70924]: DEBUG nova.objects.instance [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lazy-loading 'migration_context' on Instance uuid bdaf1714-27f9-47ee-808b-206ec78c6067 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:48:50 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Created local disks {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 14:48:50 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Ensure instance console log exists: /opt/stack/data/nova/instances/bdaf1714-27f9-47ee-808b-206ec78c6067/console.log {{(pid=70924) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 14:48:50 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:48:50 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:48:50 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:48:50 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:48:50 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:48:50 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Compute_service record updated for user:user {{(pid=70924) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 14:48:50 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.588s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:48:50 user nova-compute[70924]: DEBUG nova.network.neutron [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Successfully updated port: d95eba18-cd83-40e6-847a-c36b2e084f89 {{(pid=70924) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 14:48:50 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Acquiring lock "refresh_cache-bdaf1714-27f9-47ee-808b-206ec78c6067" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:48:50 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Acquired lock "refresh_cache-bdaf1714-27f9-47ee-808b-206ec78c6067" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:48:50 user nova-compute[70924]: DEBUG nova.network.neutron [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 14:48:50 user nova-compute[70924]: DEBUG nova.compute.manager [req-fe4ce935-0d8d-4310-a329-9961b66ee08c req-d2c08b30-3164-47de-891c-2f53379d4481 service nova] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Received event network-changed-d95eba18-cd83-40e6-847a-c36b2e084f89 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:48:50 user nova-compute[70924]: DEBUG nova.compute.manager [req-fe4ce935-0d8d-4310-a329-9961b66ee08c req-d2c08b30-3164-47de-891c-2f53379d4481 service nova] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Refreshing instance network info cache due to event network-changed-d95eba18-cd83-40e6-847a-c36b2e084f89. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:48:50 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-fe4ce935-0d8d-4310-a329-9961b66ee08c req-d2c08b30-3164-47de-891c-2f53379d4481 service nova] Acquiring lock "refresh_cache-bdaf1714-27f9-47ee-808b-206ec78c6067" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:48:50 user nova-compute[70924]: DEBUG nova.network.neutron [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Instance cache missing network info. {{(pid=70924) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 14:48:51 user nova-compute[70924]: DEBUG nova.network.neutron [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Updating instance_info_cache with network_info: [{"id": "d95eba18-cd83-40e6-847a-c36b2e084f89", "address": "fa:16:3e:45:15:fc", "network": {"id": "ff833b6e-b3ce-44ac-88ec-775f193cdfe4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-546934977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f5f9f30926f47afad3cb4c9e89d55c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd95eba18-cd", "ovs_interfaceid": "d95eba18-cd83-40e6-847a-c36b2e084f89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:48:51 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Releasing lock "refresh_cache-bdaf1714-27f9-47ee-808b-206ec78c6067" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:48:51 user nova-compute[70924]: DEBUG nova.compute.manager [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Instance network_info: |[{"id": "d95eba18-cd83-40e6-847a-c36b2e084f89", "address": "fa:16:3e:45:15:fc", "network": {"id": "ff833b6e-b3ce-44ac-88ec-775f193cdfe4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-546934977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f5f9f30926f47afad3cb4c9e89d55c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd95eba18-cd", "ovs_interfaceid": "d95eba18-cd83-40e6-847a-c36b2e084f89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 14:48:51 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-fe4ce935-0d8d-4310-a329-9961b66ee08c req-d2c08b30-3164-47de-891c-2f53379d4481 service nova] Acquired lock "refresh_cache-bdaf1714-27f9-47ee-808b-206ec78c6067" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:48:51 user nova-compute[70924]: DEBUG nova.network.neutron [req-fe4ce935-0d8d-4310-a329-9961b66ee08c req-d2c08b30-3164-47de-891c-2f53379d4481 service nova] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Refreshing network info cache for port d95eba18-cd83-40e6-847a-c36b2e084f89 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:48:51 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Start _get_guest_xml network_info=[{"id": "d95eba18-cd83-40e6-847a-c36b2e084f89", "address": "fa:16:3e:45:15:fc", "network": {"id": "ff833b6e-b3ce-44ac-88ec-775f193cdfe4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-546934977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f5f9f30926f47afad3cb4c9e89d55c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd95eba18-cd", "ovs_interfaceid": "d95eba18-cd83-40e6-847a-c36b2e084f89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '3aba2e73-6832-404b-8bd0-d0503ce82b8c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 14:48:51 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:48:51 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:48:51 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 14:48:51 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] CPU controller missing on host. {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 14:48:51 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 14:48:51 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] CPU controller found on host. {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 14:48:51 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70924) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 14:48:51 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T14:36:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 14:48:51 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Flavor limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 14:48:51 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Image limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 14:48:51 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Flavor pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 14:48:51 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Image pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 14:48:51 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 14:48:51 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 14:48:51 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 14:48:51 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Got 1 possible topologies {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 14:48:51 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 14:48:51 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 14:48:51 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:48:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-54166973',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-54166973',id=22,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4138Bk00KQqmdfErUxFcQgiDYdWqeBsVhjPxaQRe+n75igQpnWmMVo4wZ/3rzplwKKaH6Hx7du1dBe18tcOE6kgd7gQe+rlVaexoX2OrP2lfJM85qo3Gho73g735rkUA==',key_name='tempest-keypair-1998502930',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f5f9f30926f47afad3cb4c9e89d55c5',ramdisk_id='',reservation_id='r-zgo1dppv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-130200384',owner_user_name='tempest-AttachVolumeShelveTestJSON-130200384-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:48:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c9562451ffa45b2aad975335d83fa8c',uuid=bdaf1714-27f9-47ee-808b-206ec78c6067,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d95eba18-cd83-40e6-847a-c36b2e084f89", "address": "fa:16:3e:45:15:fc", "network": {"id": "ff833b6e-b3ce-44ac-88ec-775f193cdfe4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-546934977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f5f9f30926f47afad3cb4c9e89d55c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd95eba18-cd", "ovs_interfaceid": "d95eba18-cd83-40e6-847a-c36b2e084f89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:48:51 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Converting VIF {"id": "d95eba18-cd83-40e6-847a-c36b2e084f89", "address": "fa:16:3e:45:15:fc", "network": {"id": "ff833b6e-b3ce-44ac-88ec-775f193cdfe4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-546934977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f5f9f30926f47afad3cb4c9e89d55c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd95eba18-cd", "ovs_interfaceid": "d95eba18-cd83-40e6-847a-c36b2e084f89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:48:51 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:15:fc,bridge_name='br-int',has_traffic_filtering=True,id=d95eba18-cd83-40e6-847a-c36b2e084f89,network=Network(ff833b6e-b3ce-44ac-88ec-775f193cdfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd95eba18-cd') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:48:51 user nova-compute[70924]: DEBUG nova.objects.instance [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lazy-loading 'pci_devices' on Instance uuid bdaf1714-27f9-47ee-808b-206ec78c6067 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:48:51 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] End _get_guest_xml xml=<domain type="kvm">
Jul 29 14:48:51 user nova-compute[70924]:   <uuid>bdaf1714-27f9-47ee-808b-206ec78c6067</uuid>
Jul 29 14:48:51 user nova-compute[70924]:   <name>instance-00000016</name>
Jul 29 14:48:51 user nova-compute[70924]:   <memory>524288</memory>
Jul 29 14:48:51 user nova-compute[70924]:   <vcpu>1</vcpu>
Jul 29 14:48:51 user nova-compute[70924]:   <metadata>
Jul 29 14:48:51 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 14:48:51 user nova-compute[70924]:       <nova:package version="0.0.0"/>
Jul 29 14:48:51 user nova-compute[70924]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-54166973</nova:name>
Jul 29 14:48:51 user nova-compute[70924]:       <nova:creationTime>2023-07-29 14:48:51</nova:creationTime>
Jul 29 14:48:51 user nova-compute[70924]:       <nova:flavor name="m1.tiny">
Jul 29 14:48:51 user nova-compute[70924]:         <nova:memory>512</nova:memory>
Jul 29 14:48:51 user nova-compute[70924]:         <nova:disk>1</nova:disk>
Jul 29 14:48:51 user nova-compute[70924]:         <nova:swap>0</nova:swap>
Jul 29 14:48:51 user nova-compute[70924]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 14:48:51 user nova-compute[70924]:         <nova:vcpus>1</nova:vcpus>
Jul 29 14:48:51 user nova-compute[70924]:       </nova:flavor>
Jul 29 14:48:51 user nova-compute[70924]:       <nova:owner>
Jul 29 14:48:51 user nova-compute[70924]:         <nova:user uuid="7c9562451ffa45b2aad975335d83fa8c">tempest-AttachVolumeShelveTestJSON-130200384-project-member</nova:user>
Jul 29 14:48:51 user nova-compute[70924]:         <nova:project uuid="6f5f9f30926f47afad3cb4c9e89d55c5">tempest-AttachVolumeShelveTestJSON-130200384</nova:project>
Jul 29 14:48:51 user nova-compute[70924]:       </nova:owner>
Jul 29 14:48:51 user nova-compute[70924]:       <nova:root type="image" uuid="3aba2e73-6832-404b-8bd0-d0503ce82b8c"/>
Jul 29 14:48:51 user nova-compute[70924]:       <nova:ports>
Jul 29 14:48:51 user nova-compute[70924]:         <nova:port uuid="d95eba18-cd83-40e6-847a-c36b2e084f89">
Jul 29 14:48:51 user nova-compute[70924]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 29 14:48:51 user nova-compute[70924]:         </nova:port>
Jul 29 14:48:51 user nova-compute[70924]:       </nova:ports>
Jul 29 14:48:51 user nova-compute[70924]:     </nova:instance>
Jul 29 14:48:51 user nova-compute[70924]:   </metadata>
Jul 29 14:48:51 user nova-compute[70924]:   <sysinfo type="smbios">
Jul 29 14:48:51 user nova-compute[70924]:     <system>
Jul 29 14:48:51 user nova-compute[70924]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 14:48:51 user nova-compute[70924]:       <entry name="product">OpenStack Nova</entry>
Jul 29 14:48:51 user nova-compute[70924]:       <entry name="version">0.0.0</entry>
Jul 29 14:48:51 user nova-compute[70924]:       <entry name="serial">bdaf1714-27f9-47ee-808b-206ec78c6067</entry>
Jul 29 14:48:51 user nova-compute[70924]:       <entry name="uuid">bdaf1714-27f9-47ee-808b-206ec78c6067</entry>
Jul 29 14:48:51 user nova-compute[70924]:       <entry name="family">Virtual Machine</entry>
Jul 29 14:48:51 user nova-compute[70924]:     </system>
Jul 29 14:48:51 user nova-compute[70924]:   </sysinfo>
Jul 29 14:48:51 user nova-compute[70924]:   <os>
Jul 29 14:48:51 user nova-compute[70924]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 14:48:51 user nova-compute[70924]:     <boot dev="hd"/>
Jul 29 14:48:51 user nova-compute[70924]:     <smbios mode="sysinfo"/>
Jul 29 14:48:51 user nova-compute[70924]:   </os>
Jul 29 14:48:51 user nova-compute[70924]:   <features>
Jul 29 14:48:51 user nova-compute[70924]:     <acpi/>
Jul 29 14:48:51 user nova-compute[70924]:     <apic/>
Jul 29 14:48:51 user nova-compute[70924]:     <vmcoreinfo/>
Jul 29 14:48:51 user nova-compute[70924]:   </features>
Jul 29 14:48:51 user nova-compute[70924]:   <clock offset="utc">
Jul 29 14:48:51 user nova-compute[70924]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 14:48:51 user nova-compute[70924]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 14:48:51 user nova-compute[70924]:     <timer name="hpet" present="no"/>
Jul 29 14:48:51 user nova-compute[70924]:   </clock>
Jul 29 14:48:51 user nova-compute[70924]:   <cpu mode="custom" match="exact">
Jul 29 14:48:51 user nova-compute[70924]:     <model>Nehalem</model>
Jul 29 14:48:51 user nova-compute[70924]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 14:48:51 user nova-compute[70924]:   </cpu>
Jul 29 14:48:51 user nova-compute[70924]:   <devices>
Jul 29 14:48:51 user nova-compute[70924]:     <disk type="file" device="disk">
Jul 29 14:48:51 user nova-compute[70924]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 14:48:51 user nova-compute[70924]:       <source file="/opt/stack/data/nova/instances/bdaf1714-27f9-47ee-808b-206ec78c6067/disk"/>
Jul 29 14:48:51 user nova-compute[70924]:       <target dev="vda" bus="virtio"/>
Jul 29 14:48:51 user nova-compute[70924]:     </disk>
Jul 29 14:48:51 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 14:48:51 user nova-compute[70924]:       <mac address="fa:16:3e:45:15:fc"/>
Jul 29 14:48:51 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:48:51 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 14:48:51 user nova-compute[70924]:       <target dev="tapd95eba18-cd"/>
Jul 29 14:48:51 user nova-compute[70924]:     </interface>
Jul 29 14:48:51 user nova-compute[70924]:     <serial type="pty">
Jul 29 14:48:51 user nova-compute[70924]:       <log file="/opt/stack/data/nova/instances/bdaf1714-27f9-47ee-808b-206ec78c6067/console.log" append="off"/>
Jul 29 14:48:51 user nova-compute[70924]:     </serial>
Jul 29 14:48:51 user nova-compute[70924]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 14:48:51 user nova-compute[70924]:     <video>
Jul 29 14:48:51 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:48:51 user nova-compute[70924]:     </video>
Jul 29 14:48:51 user nova-compute[70924]:     <rng model="virtio">
Jul 29 14:48:51 user nova-compute[70924]:       <backend model="random">/dev/urandom</backend>
Jul 29 14:48:51 user nova-compute[70924]:     </rng>
Jul 29 14:48:51 user nova-compute[70924]:     <controller type="usb" index="0" model="none"/>
Jul 29 14:48:51 user nova-compute[70924]:     <memballoon model="virtio">
Jul 29 14:48:51 user nova-compute[70924]:       <stats period="10"/>
Jul 29 14:48:51 user nova-compute[70924]:     </memballoon>
Jul 29 14:48:51 user nova-compute[70924]:   </devices>
Jul 29 14:48:51 user nova-compute[70924]: </domain>
Jul 29 14:48:51 user nova-compute[70924]:  {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 14:48:51 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:48:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-54166973',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-54166973',id=22,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4138Bk00KQqmdfErUxFcQgiDYdWqeBsVhjPxaQRe+n75igQpnWmMVo4wZ/3rzplwKKaH6Hx7du1dBe18tcOE6kgd7gQe+rlVaexoX2OrP2lfJM85qo3Gho73g735rkUA==',key_name='tempest-keypair-1998502930',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f5f9f30926f47afad3cb4c9e89d55c5',ramdisk_id='',reservation_id='r-zgo1dppv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-130200384',owner_user_name='tempest-AttachVolumeShelveTestJSON-130200384-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:48:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c9562451ffa45b2aad975335d83fa8c',uuid=bdaf1714-27f9-47ee-808b-206ec78c6067,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d95eba18-cd83-40e6-847a-c36b2e084f89", "address": "fa:16:3e:45:15:fc", "network": {"id": "ff833b6e-b3ce-44ac-88ec-775f193cdfe4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-546934977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f5f9f30926f47afad3cb4c9e89d55c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd95eba18-cd", "ovs_interfaceid": "d95eba18-cd83-40e6-847a-c36b2e084f89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 14:48:51 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Converting VIF {"id": "d95eba18-cd83-40e6-847a-c36b2e084f89", "address": "fa:16:3e:45:15:fc", "network": {"id": "ff833b6e-b3ce-44ac-88ec-775f193cdfe4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-546934977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f5f9f30926f47afad3cb4c9e89d55c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd95eba18-cd", "ovs_interfaceid": "d95eba18-cd83-40e6-847a-c36b2e084f89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:48:51 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:15:fc,bridge_name='br-int',has_traffic_filtering=True,id=d95eba18-cd83-40e6-847a-c36b2e084f89,network=Network(ff833b6e-b3ce-44ac-88ec-775f193cdfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd95eba18-cd') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:48:51 user nova-compute[70924]: DEBUG os_vif [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:15:fc,bridge_name='br-int',has_traffic_filtering=True,id=d95eba18-cd83-40e6-847a-c36b2e084f89,network=Network(ff833b6e-b3ce-44ac-88ec-775f193cdfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd95eba18-cd') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 14:48:51 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:51 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:48:51 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 14:48:51 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:51 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd95eba18-cd, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:48:51 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd95eba18-cd, col_values=(('external_ids', {'iface-id': 'd95eba18-cd83-40e6-847a-c36b2e084f89', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:15:fc', 'vm-uuid': 'bdaf1714-27f9-47ee-808b-206ec78c6067'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:48:51 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:51 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:48:51 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:51 user nova-compute[70924]: INFO os_vif [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:15:fc,bridge_name='br-int',has_traffic_filtering=True,id=d95eba18-cd83-40e6-847a-c36b2e084f89,network=Network(ff833b6e-b3ce-44ac-88ec-775f193cdfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd95eba18-cd')
Jul 29 14:48:51 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:48:51 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] No VIF found with MAC fa:16:3e:45:15:fc, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:48:51 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:48:51 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:48:51 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:48:51 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Starting heal instance info cache {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 14:48:51 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Rebuilding the list of instances to heal {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 29 14:48:51 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Skipping network cache update for instance because it is Building. {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Jul 29 14:48:51 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "refresh_cache-db656346-c4af-43da-9600-fd39f1b9e4dc" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:48:51 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquired lock "refresh_cache-db656346-c4af-43da-9600-fd39f1b9e4dc" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:48:51 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Forcefully refreshing network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 29 14:48:51 user nova-compute[70924]: DEBUG nova.objects.instance [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lazy-loading 'info_cache' on Instance uuid db656346-c4af-43da-9600-fd39f1b9e4dc {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:48:51 user nova-compute[70924]: DEBUG nova.network.neutron [req-fe4ce935-0d8d-4310-a329-9961b66ee08c req-d2c08b30-3164-47de-891c-2f53379d4481 service nova] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Updated VIF entry in instance network info cache for port d95eba18-cd83-40e6-847a-c36b2e084f89. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:48:51 user nova-compute[70924]: DEBUG nova.network.neutron [req-fe4ce935-0d8d-4310-a329-9961b66ee08c req-d2c08b30-3164-47de-891c-2f53379d4481 service nova] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Updating instance_info_cache with network_info: [{"id": "d95eba18-cd83-40e6-847a-c36b2e084f89", "address": "fa:16:3e:45:15:fc", "network": {"id": "ff833b6e-b3ce-44ac-88ec-775f193cdfe4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-546934977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f5f9f30926f47afad3cb4c9e89d55c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd95eba18-cd", "ovs_interfaceid": "d95eba18-cd83-40e6-847a-c36b2e084f89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:48:51 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-fe4ce935-0d8d-4310-a329-9961b66ee08c req-d2c08b30-3164-47de-891c-2f53379d4481 service nova] Releasing lock "refresh_cache-bdaf1714-27f9-47ee-808b-206ec78c6067" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:48:52 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Updating instance_info_cache with network_info: [{"id": "bd091ea0-8c42-4140-aad1-617f27d2a469", "address": "fa:16:3e:53:1d:70", "network": {"id": "d5876e18-e2af-45c2-aab5-2d0d552ebfe4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2035085552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9e5c78c1684c359cfab4e32b9c213f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd091ea0-8c", "ovs_interfaceid": "bd091ea0-8c42-4140-aad1-617f27d2a469", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:48:52 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Releasing lock "refresh_cache-db656346-c4af-43da-9600-fd39f1b9e4dc" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:48:52 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Updated the network info_cache for instance {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 29 14:48:52 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:48:52 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:48:52 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:48:52 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:48:52 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:48:52 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:52 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:52 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:52 user nova-compute[70924]: DEBUG nova.compute.manager [req-45a94695-cf0f-47a2-9014-71567bd4ab48 req-138506bf-6f48-40df-9bec-86423b220acd service nova] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Received event network-vif-plugged-d95eba18-cd83-40e6-847a-c36b2e084f89 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:48:52 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-45a94695-cf0f-47a2-9014-71567bd4ab48 req-138506bf-6f48-40df-9bec-86423b220acd service nova] Acquiring lock "bdaf1714-27f9-47ee-808b-206ec78c6067-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:48:52 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-45a94695-cf0f-47a2-9014-71567bd4ab48 req-138506bf-6f48-40df-9bec-86423b220acd service nova] Lock "bdaf1714-27f9-47ee-808b-206ec78c6067-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:48:52 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-45a94695-cf0f-47a2-9014-71567bd4ab48 req-138506bf-6f48-40df-9bec-86423b220acd service nova] Lock "bdaf1714-27f9-47ee-808b-206ec78c6067-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:48:52 user nova-compute[70924]: DEBUG nova.compute.manager [req-45a94695-cf0f-47a2-9014-71567bd4ab48 req-138506bf-6f48-40df-9bec-86423b220acd service nova] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] No waiting events found dispatching network-vif-plugged-d95eba18-cd83-40e6-847a-c36b2e084f89 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:48:52 user nova-compute[70924]: WARNING nova.compute.manager [req-45a94695-cf0f-47a2-9014-71567bd4ab48 req-138506bf-6f48-40df-9bec-86423b220acd service nova] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Received unexpected event network-vif-plugged-d95eba18-cd83-40e6-847a-c36b2e084f89 for instance with vm_state building and task_state spawning.
Jul 29 14:48:53 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:53 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:53 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:53 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:54 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642134.7877378, bdaf1714-27f9-47ee-808b-206ec78c6067 => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:48:54 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] VM Resumed (Lifecycle Event)
Jul 29 14:48:54 user nova-compute[70924]: DEBUG nova.compute.manager [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Instance event wait completed in 0 seconds for  {{(pid=70924) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 14:48:54 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Guest created on hypervisor {{(pid=70924) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 14:48:54 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Instance spawned successfully.
Jul 29 14:48:54 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 14:48:54 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:48:54 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:48:54 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Found default for hw_cdrom_bus of ide {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:48:54 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Found default for hw_disk_bus of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:48:54 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Found default for hw_input_bus of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:48:54 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Found default for hw_pointer_model of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:48:54 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Found default for hw_video_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:48:54 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Found default for hw_vif_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:48:54 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:48:54 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642134.7885404, bdaf1714-27f9-47ee-808b-206ec78c6067 => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:48:54 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] VM Started (Lifecycle Event)
Jul 29 14:48:54 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:48:54 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:48:54 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:48:54 user nova-compute[70924]: INFO nova.compute.manager [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Took 5.57 seconds to spawn the instance on the hypervisor.
Jul 29 14:48:54 user nova-compute[70924]: DEBUG nova.compute.manager [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:48:55 user nova-compute[70924]: INFO nova.compute.manager [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Took 6.49 seconds to build instance.
Jul 29 14:48:55 user nova-compute[70924]: DEBUG nova.compute.manager [req-27f35506-9a28-4250-b7ad-db5d4283e1d3 req-d43c4872-ce27-4989-a46f-2c65c3655945 service nova] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Received event network-vif-plugged-d95eba18-cd83-40e6-847a-c36b2e084f89 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:48:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-27f35506-9a28-4250-b7ad-db5d4283e1d3 req-d43c4872-ce27-4989-a46f-2c65c3655945 service nova] Acquiring lock "bdaf1714-27f9-47ee-808b-206ec78c6067-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:48:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-27f35506-9a28-4250-b7ad-db5d4283e1d3 req-d43c4872-ce27-4989-a46f-2c65c3655945 service nova] Lock "bdaf1714-27f9-47ee-808b-206ec78c6067-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:48:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-27f35506-9a28-4250-b7ad-db5d4283e1d3 req-d43c4872-ce27-4989-a46f-2c65c3655945 service nova] Lock "bdaf1714-27f9-47ee-808b-206ec78c6067-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:48:55 user nova-compute[70924]: DEBUG nova.compute.manager [req-27f35506-9a28-4250-b7ad-db5d4283e1d3 req-d43c4872-ce27-4989-a46f-2c65c3655945 service nova] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] No waiting events found dispatching network-vif-plugged-d95eba18-cd83-40e6-847a-c36b2e084f89 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:48:55 user nova-compute[70924]: WARNING nova.compute.manager [req-27f35506-9a28-4250-b7ad-db5d4283e1d3 req-d43c4872-ce27-4989-a46f-2c65c3655945 service nova] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Received unexpected event network-vif-plugged-d95eba18-cd83-40e6-847a-c36b2e084f89 for instance with vm_state active and task_state None.
Jul 29 14:48:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0f0f322e-c17b-48d5-91b0-eec21141e129 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "bdaf1714-27f9-47ee-808b-206ec78c6067" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.609s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:48:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Acquiring lock "a8d47810-5115-41fd-a4be-86aa2f716c79" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:48:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Lock "a8d47810-5115-41fd-a4be-86aa2f716c79" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:48:55 user nova-compute[70924]: DEBUG nova.compute.manager [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] Starting instance... {{(pid=70924) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 14:48:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:48:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:48:55 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70924) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 14:48:55 user nova-compute[70924]: INFO nova.compute.claims [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] Claim successful on node user
Jul 29 14:48:55 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:48:55 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:48:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.373s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:48:55 user nova-compute[70924]: DEBUG nova.compute.manager [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] Start building networks asynchronously for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 14:48:55 user nova-compute[70924]: DEBUG nova.compute.manager [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] Allocating IP information in the background. {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 14:48:55 user nova-compute[70924]: DEBUG nova.network.neutron [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] allocate_for_instance() {{(pid=70924) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 14:48:55 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 14:48:55 user nova-compute[70924]: DEBUG nova.compute.manager [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] Start building block device mappings for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 14:48:56 user nova-compute[70924]: DEBUG nova.policy [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3b1d926fc4c646dba0bf9e852302a13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47334cc65f984a95b4c6c06d3d8d1d40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70924) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 14:48:56 user nova-compute[70924]: DEBUG nova.compute.manager [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] Start spawning the instance on the hypervisor. {{(pid=70924) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 14:48:56 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] Creating instance directory {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 14:48:56 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] Creating image(s)
Jul 29 14:48:56 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Acquiring lock "/opt/stack/data/nova/instances/a8d47810-5115-41fd-a4be-86aa2f716c79/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:48:56 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Lock "/opt/stack/data/nova/instances/a8d47810-5115-41fd-a4be-86aa2f716c79/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:48:56 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Lock "/opt/stack/data/nova/instances/a8d47810-5115-41fd-a4be-86aa2f716c79/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:48:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:48:56 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.151s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:48:56 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Acquiring lock "bd72453517468710f1de26b27fb0ea28688e9009" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:48:56 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:48:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:48:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.152s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:48:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/a8d47810-5115-41fd-a4be-86aa2f716c79/disk 1073741824 {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:48:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/a8d47810-5115-41fd-a4be-86aa2f716c79/disk 1073741824" returned: 0 in 0.056s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:48:56 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.215s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:48:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:48:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.150s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:48:56 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a8d47810-5115-41fd-a4be-86aa2f716c79/disk. size=1073741824 {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 14:48:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d47810-5115-41fd-a4be-86aa2f716c79/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:48:56 user nova-compute[70924]: DEBUG nova.network.neutron [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] Successfully created port: ecae5278-1212-4eee-966e-a15a8c2b8a56 {{(pid=70924) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 14:48:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d47810-5115-41fd-a4be-86aa2f716c79/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:48:56 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Cannot resize image /opt/stack/data/nova/instances/a8d47810-5115-41fd-a4be-86aa2f716c79/disk to a smaller size. {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 14:48:56 user nova-compute[70924]: DEBUG nova.objects.instance [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Lazy-loading 'migration_context' on Instance uuid a8d47810-5115-41fd-a4be-86aa2f716c79 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:48:56 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] Created local disks {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 14:48:56 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] Ensure instance console log exists: /opt/stack/data/nova/instances/a8d47810-5115-41fd-a4be-86aa2f716c79/console.log {{(pid=70924) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 14:48:56 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:48:56 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:48:56 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:48:57 user nova-compute[70924]: DEBUG nova.network.neutron [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] Successfully updated port: ecae5278-1212-4eee-966e-a15a8c2b8a56 {{(pid=70924) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 14:48:57 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Acquiring lock "refresh_cache-a8d47810-5115-41fd-a4be-86aa2f716c79" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:48:57 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Acquired lock "refresh_cache-a8d47810-5115-41fd-a4be-86aa2f716c79" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:48:57 user nova-compute[70924]: DEBUG nova.network.neutron [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 14:48:57 user nova-compute[70924]: DEBUG nova.compute.manager [req-e1e3ed1a-0a30-490e-ac3b-3274f45c604c req-ad4834a1-cbf0-44b7-8491-eda08a25cc91 service nova] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] Received event network-changed-ecae5278-1212-4eee-966e-a15a8c2b8a56 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:48:57 user nova-compute[70924]: DEBUG nova.compute.manager [req-e1e3ed1a-0a30-490e-ac3b-3274f45c604c req-ad4834a1-cbf0-44b7-8491-eda08a25cc91 service nova] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] Refreshing instance network info cache due to event network-changed-ecae5278-1212-4eee-966e-a15a8c2b8a56. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:48:57 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-e1e3ed1a-0a30-490e-ac3b-3274f45c604c req-ad4834a1-cbf0-44b7-8491-eda08a25cc91 service nova] Acquiring lock "refresh_cache-a8d47810-5115-41fd-a4be-86aa2f716c79" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:48:57 user nova-compute[70924]: DEBUG nova.network.neutron [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] Instance cache missing network info. {{(pid=70924) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 14:48:57 user nova-compute[70924]: DEBUG nova.network.neutron [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] Updating instance_info_cache with network_info: [{"id": "ecae5278-1212-4eee-966e-a15a8c2b8a56", "address": "fa:16:3e:98:67:16", "network": {"id": "0bec09f1-f460-4e97-917e-84769ed49901", "bridge": "br-int", "label": "tempest-VolumesActionsTest-956399393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47334cc65f984a95b4c6c06d3d8d1d40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecae5278-12", "ovs_interfaceid": "ecae5278-1212-4eee-966e-a15a8c2b8a56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:48:57 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Releasing lock "refresh_cache-a8d47810-5115-41fd-a4be-86aa2f716c79" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:48:57 user nova-compute[70924]: DEBUG nova.compute.manager [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] Instance network_info: |[{"id": "ecae5278-1212-4eee-966e-a15a8c2b8a56", "address": "fa:16:3e:98:67:16", "network": {"id": "0bec09f1-f460-4e97-917e-84769ed49901", "bridge": "br-int", "label": "tempest-VolumesActionsTest-956399393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47334cc65f984a95b4c6c06d3d8d1d40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecae5278-12", "ovs_interfaceid": "ecae5278-1212-4eee-966e-a15a8c2b8a56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 14:48:57 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-e1e3ed1a-0a30-490e-ac3b-3274f45c604c req-ad4834a1-cbf0-44b7-8491-eda08a25cc91 service nova] Acquired lock "refresh_cache-a8d47810-5115-41fd-a4be-86aa2f716c79" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:48:57 user nova-compute[70924]: DEBUG nova.network.neutron [req-e1e3ed1a-0a30-490e-ac3b-3274f45c604c req-ad4834a1-cbf0-44b7-8491-eda08a25cc91 service nova] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] Refreshing network info cache for port ecae5278-1212-4eee-966e-a15a8c2b8a56 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:48:57 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] Start _get_guest_xml network_info=[{"id": "ecae5278-1212-4eee-966e-a15a8c2b8a56", "address": "fa:16:3e:98:67:16", "network": {"id": "0bec09f1-f460-4e97-917e-84769ed49901", "bridge": "br-int", "label": "tempest-VolumesActionsTest-956399393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47334cc65f984a95b4c6c06d3d8d1d40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecae5278-12", "ovs_interfaceid": "ecae5278-1212-4eee-966e-a15a8c2b8a56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '3aba2e73-6832-404b-8bd0-d0503ce82b8c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 14:48:57 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:48:57 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:48:57 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 14:48:57 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] CPU controller missing on host. {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 14:48:57 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 14:48:57 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] CPU controller found on host. {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 14:48:57 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70924) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 14:48:57 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T14:36:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 14:48:57 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Flavor limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 14:48:57 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Image limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 14:48:57 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Flavor pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 14:48:57 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Image pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 14:48:57 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 14:48:57 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 14:48:57 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 14:48:57 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Got 1 possible topologies {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 14:48:57 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 14:48:57 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 14:48:58 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:48:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-749721387',display_name='tempest-VolumesActionsTest-instance-749721387',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-749721387',id=23,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47334cc65f984a95b4c6c06d3d8d1d40',ramdisk_id='',reservation_id='r-cr3682vz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-325820960',owner_user_name='tempest-VolumesActionsTest-325820960-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:48:56Z,user_data=None,user_id='3b1d926fc4c646dba0bf9e852302a13b',uuid=a8d47810-5115-41fd-a4be-86aa2f716c79,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ecae5278-1212-4eee-966e-a15a8c2b8a56", "address": "fa:16:3e:98:67:16", "network": {"id": "0bec09f1-f460-4e97-917e-84769ed49901", "bridge": "br-int", "label": "tempest-VolumesActionsTest-956399393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47334cc65f984a95b4c6c06d3d8d1d40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecae5278-12", "ovs_interfaceid": "ecae5278-1212-4eee-966e-a15a8c2b8a56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:48:58 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Converting VIF {"id": "ecae5278-1212-4eee-966e-a15a8c2b8a56", "address": "fa:16:3e:98:67:16", "network": {"id": "0bec09f1-f460-4e97-917e-84769ed49901", "bridge": "br-int", "label": "tempest-VolumesActionsTest-956399393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47334cc65f984a95b4c6c06d3d8d1d40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecae5278-12", "ovs_interfaceid": "ecae5278-1212-4eee-966e-a15a8c2b8a56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:48:58 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:67:16,bridge_name='br-int',has_traffic_filtering=True,id=ecae5278-1212-4eee-966e-a15a8c2b8a56,network=Network(0bec09f1-f460-4e97-917e-84769ed49901),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecae5278-12') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:48:58 user nova-compute[70924]: DEBUG nova.objects.instance [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Lazy-loading 'pci_devices' on Instance uuid a8d47810-5115-41fd-a4be-86aa2f716c79 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:48:58 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] End _get_guest_xml xml=<domain type="kvm">
Jul 29 14:48:58 user nova-compute[70924]:   <uuid>a8d47810-5115-41fd-a4be-86aa2f716c79</uuid>
Jul 29 14:48:58 user nova-compute[70924]:   <name>instance-00000017</name>
Jul 29 14:48:58 user nova-compute[70924]:   <memory>524288</memory>
Jul 29 14:48:58 user nova-compute[70924]:   <vcpu>1</vcpu>
Jul 29 14:48:58 user nova-compute[70924]:   <metadata>
Jul 29 14:48:58 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 14:48:58 user nova-compute[70924]:       <nova:package version="0.0.0"/>
Jul 29 14:48:58 user nova-compute[70924]:       <nova:name>tempest-VolumesActionsTest-instance-749721387</nova:name>
Jul 29 14:48:58 user nova-compute[70924]:       <nova:creationTime>2023-07-29 14:48:57</nova:creationTime>
Jul 29 14:48:58 user nova-compute[70924]:       <nova:flavor name="m1.tiny">
Jul 29 14:48:58 user nova-compute[70924]:         <nova:memory>512</nova:memory>
Jul 29 14:48:58 user nova-compute[70924]:         <nova:disk>1</nova:disk>
Jul 29 14:48:58 user nova-compute[70924]:         <nova:swap>0</nova:swap>
Jul 29 14:48:58 user nova-compute[70924]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 14:48:58 user nova-compute[70924]:         <nova:vcpus>1</nova:vcpus>
Jul 29 14:48:58 user nova-compute[70924]:       </nova:flavor>
Jul 29 14:48:58 user nova-compute[70924]:       <nova:owner>
Jul 29 14:48:58 user nova-compute[70924]:         <nova:user uuid="3b1d926fc4c646dba0bf9e852302a13b">tempest-VolumesActionsTest-325820960-project-member</nova:user>
Jul 29 14:48:58 user nova-compute[70924]:         <nova:project uuid="47334cc65f984a95b4c6c06d3d8d1d40">tempest-VolumesActionsTest-325820960</nova:project>
Jul 29 14:48:58 user nova-compute[70924]:       </nova:owner>
Jul 29 14:48:58 user nova-compute[70924]:       <nova:root type="image" uuid="3aba2e73-6832-404b-8bd0-d0503ce82b8c"/>
Jul 29 14:48:58 user nova-compute[70924]:       <nova:ports>
Jul 29 14:48:58 user nova-compute[70924]:         <nova:port uuid="ecae5278-1212-4eee-966e-a15a8c2b8a56">
Jul 29 14:48:58 user nova-compute[70924]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 29 14:48:58 user nova-compute[70924]:         </nova:port>
Jul 29 14:48:58 user nova-compute[70924]:       </nova:ports>
Jul 29 14:48:58 user nova-compute[70924]:     </nova:instance>
Jul 29 14:48:58 user nova-compute[70924]:   </metadata>
Jul 29 14:48:58 user nova-compute[70924]:   <sysinfo type="smbios">
Jul 29 14:48:58 user nova-compute[70924]:     <system>
Jul 29 14:48:58 user nova-compute[70924]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 14:48:58 user nova-compute[70924]:       <entry name="product">OpenStack Nova</entry>
Jul 29 14:48:58 user nova-compute[70924]:       <entry name="version">0.0.0</entry>
Jul 29 14:48:58 user nova-compute[70924]:       <entry name="serial">a8d47810-5115-41fd-a4be-86aa2f716c79</entry>
Jul 29 14:48:58 user nova-compute[70924]:       <entry name="uuid">a8d47810-5115-41fd-a4be-86aa2f716c79</entry>
Jul 29 14:48:58 user nova-compute[70924]:       <entry name="family">Virtual Machine</entry>
Jul 29 14:48:58 user nova-compute[70924]:     </system>
Jul 29 14:48:58 user nova-compute[70924]:   </sysinfo>
Jul 29 14:48:58 user nova-compute[70924]:   <os>
Jul 29 14:48:58 user nova-compute[70924]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 14:48:58 user nova-compute[70924]:     <boot dev="hd"/>
Jul 29 14:48:58 user nova-compute[70924]:     <smbios mode="sysinfo"/>
Jul 29 14:48:58 user nova-compute[70924]:   </os>
Jul 29 14:48:58 user nova-compute[70924]:   <features>
Jul 29 14:48:58 user nova-compute[70924]:     <acpi/>
Jul 29 14:48:58 user nova-compute[70924]:     <apic/>
Jul 29 14:48:58 user nova-compute[70924]:     <vmcoreinfo/>
Jul 29 14:48:58 user nova-compute[70924]:   </features>
Jul 29 14:48:58 user nova-compute[70924]:   <clock offset="utc">
Jul 29 14:48:58 user nova-compute[70924]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 14:48:58 user nova-compute[70924]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 14:48:58 user nova-compute[70924]:     <timer name="hpet" present="no"/>
Jul 29 14:48:58 user nova-compute[70924]:   </clock>
Jul 29 14:48:58 user nova-compute[70924]:   <cpu mode="custom" match="exact">
Jul 29 14:48:58 user nova-compute[70924]:     <model>Nehalem</model>
Jul 29 14:48:58 user nova-compute[70924]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 14:48:58 user nova-compute[70924]:   </cpu>
Jul 29 14:48:58 user nova-compute[70924]:   <devices>
Jul 29 14:48:58 user nova-compute[70924]:     <disk type="file" device="disk">
Jul 29 14:48:58 user nova-compute[70924]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 14:48:58 user nova-compute[70924]:       <source file="/opt/stack/data/nova/instances/a8d47810-5115-41fd-a4be-86aa2f716c79/disk"/>
Jul 29 14:48:58 user nova-compute[70924]:       <target dev="vda" bus="virtio"/>
Jul 29 14:48:58 user nova-compute[70924]:     </disk>
Jul 29 14:48:58 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 14:48:58 user nova-compute[70924]:       <mac address="fa:16:3e:98:67:16"/>
Jul 29 14:48:58 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:48:58 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 14:48:58 user nova-compute[70924]:       <target dev="tapecae5278-12"/>
Jul 29 14:48:58 user nova-compute[70924]:     </interface>
Jul 29 14:48:58 user nova-compute[70924]:     <serial type="pty">
Jul 29 14:48:58 user nova-compute[70924]:       <log file="/opt/stack/data/nova/instances/a8d47810-5115-41fd-a4be-86aa2f716c79/console.log" append="off"/>
Jul 29 14:48:58 user nova-compute[70924]:     </serial>
Jul 29 14:48:58 user nova-compute[70924]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 14:48:58 user nova-compute[70924]:     <video>
Jul 29 14:48:58 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:48:58 user nova-compute[70924]:     </video>
Jul 29 14:48:58 user nova-compute[70924]:     <rng model="virtio">
Jul 29 14:48:58 user nova-compute[70924]:       <backend model="random">/dev/urandom</backend>
Jul 29 14:48:58 user nova-compute[70924]:     </rng>
Jul 29 14:48:58 user nova-compute[70924]:     <controller type="usb" index="0" model="none"/>
Jul 29 14:48:58 user nova-compute[70924]:     <memballoon model="virtio">
Jul 29 14:48:58 user nova-compute[70924]:       <stats period="10"/>
Jul 29 14:48:58 user nova-compute[70924]:     </memballoon>
Jul 29 14:48:58 user nova-compute[70924]:   </devices>
Jul 29 14:48:58 user nova-compute[70924]: </domain>
Jul 29 14:48:58 user nova-compute[70924]:  {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 14:48:58 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:48:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-749721387',display_name='tempest-VolumesActionsTest-instance-749721387',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-749721387',id=23,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47334cc65f984a95b4c6c06d3d8d1d40',ramdisk_id='',reservation_id='r-cr3682vz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-325820960',owner_user_name='tempest-VolumesActionsTest-325820960-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:48:56Z,user_data=None,user_id='3b1d926fc4c646dba0bf9e852302a13b',uuid=a8d47810-5115-41fd-a4be-86aa2f716c79,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ecae5278-1212-4eee-966e-a15a8c2b8a56", "address": "fa:16:3e:98:67:16", "network": {"id": "0bec09f1-f460-4e97-917e-84769ed49901", "bridge": "br-int", "label": "tempest-VolumesActionsTest-956399393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47334cc65f984a95b4c6c06d3d8d1d40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecae5278-12", "ovs_interfaceid": "ecae5278-1212-4eee-966e-a15a8c2b8a56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 14:48:58 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Converting VIF {"id": "ecae5278-1212-4eee-966e-a15a8c2b8a56", "address": "fa:16:3e:98:67:16", "network": {"id": "0bec09f1-f460-4e97-917e-84769ed49901", "bridge": "br-int", "label": "tempest-VolumesActionsTest-956399393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47334cc65f984a95b4c6c06d3d8d1d40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecae5278-12", "ovs_interfaceid": "ecae5278-1212-4eee-966e-a15a8c2b8a56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:48:58 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:67:16,bridge_name='br-int',has_traffic_filtering=True,id=ecae5278-1212-4eee-966e-a15a8c2b8a56,network=Network(0bec09f1-f460-4e97-917e-84769ed49901),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecae5278-12') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:48:58 user nova-compute[70924]: DEBUG os_vif [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:67:16,bridge_name='br-int',has_traffic_filtering=True,id=ecae5278-1212-4eee-966e-a15a8c2b8a56,network=Network(0bec09f1-f460-4e97-917e-84769ed49901),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecae5278-12') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 14:48:58 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:58 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:48:58 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 14:48:58 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:58 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapecae5278-12, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:48:58 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapecae5278-12, col_values=(('external_ids', {'iface-id': 'ecae5278-1212-4eee-966e-a15a8c2b8a56', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:67:16', 'vm-uuid': 'a8d47810-5115-41fd-a4be-86aa2f716c79'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:48:58 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:58 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:48:58 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:58 user nova-compute[70924]: INFO os_vif [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:67:16,bridge_name='br-int',has_traffic_filtering=True,id=ecae5278-1212-4eee-966e-a15a8c2b8a56,network=Network(0bec09f1-f460-4e97-917e-84769ed49901),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecae5278-12')
Jul 29 14:48:58 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:48:58 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] No VIF found with MAC fa:16:3e:98:67:16, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:48:58 user nova-compute[70924]: DEBUG nova.network.neutron [req-e1e3ed1a-0a30-490e-ac3b-3274f45c604c req-ad4834a1-cbf0-44b7-8491-eda08a25cc91 service nova] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] Updated VIF entry in instance network info cache for port ecae5278-1212-4eee-966e-a15a8c2b8a56. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:48:58 user nova-compute[70924]: DEBUG nova.network.neutron [req-e1e3ed1a-0a30-490e-ac3b-3274f45c604c req-ad4834a1-cbf0-44b7-8491-eda08a25cc91 service nova] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] Updating instance_info_cache with network_info: [{"id": "ecae5278-1212-4eee-966e-a15a8c2b8a56", "address": "fa:16:3e:98:67:16", "network": {"id": "0bec09f1-f460-4e97-917e-84769ed49901", "bridge": "br-int", "label": "tempest-VolumesActionsTest-956399393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47334cc65f984a95b4c6c06d3d8d1d40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecae5278-12", "ovs_interfaceid": "ecae5278-1212-4eee-966e-a15a8c2b8a56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:48:58 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-e1e3ed1a-0a30-490e-ac3b-3274f45c604c req-ad4834a1-cbf0-44b7-8491-eda08a25cc91 service nova] Releasing lock "refresh_cache-a8d47810-5115-41fd-a4be-86aa2f716c79" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:48:58 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:59 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:59 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:59 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:48:59 user nova-compute[70924]: DEBUG nova.compute.manager [req-6ac47bb3-7961-4e0f-ba8e-1c07d09b9c51 req-2d31a874-b6c8-4c40-889c-2d0bc355e4d8 service nova] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] Received event network-vif-plugged-ecae5278-1212-4eee-966e-a15a8c2b8a56 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:48:59 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-6ac47bb3-7961-4e0f-ba8e-1c07d09b9c51 req-2d31a874-b6c8-4c40-889c-2d0bc355e4d8 service nova] Acquiring lock "a8d47810-5115-41fd-a4be-86aa2f716c79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:48:59 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-6ac47bb3-7961-4e0f-ba8e-1c07d09b9c51 req-2d31a874-b6c8-4c40-889c-2d0bc355e4d8 service nova] Lock "a8d47810-5115-41fd-a4be-86aa2f716c79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:48:59 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-6ac47bb3-7961-4e0f-ba8e-1c07d09b9c51 req-2d31a874-b6c8-4c40-889c-2d0bc355e4d8 service nova] Lock "a8d47810-5115-41fd-a4be-86aa2f716c79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:48:59 user nova-compute[70924]: DEBUG nova.compute.manager [req-6ac47bb3-7961-4e0f-ba8e-1c07d09b9c51 req-2d31a874-b6c8-4c40-889c-2d0bc355e4d8 service nova] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] No waiting events found dispatching network-vif-plugged-ecae5278-1212-4eee-966e-a15a8c2b8a56 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:48:59 user nova-compute[70924]: WARNING nova.compute.manager [req-6ac47bb3-7961-4e0f-ba8e-1c07d09b9c51 req-2d31a874-b6c8-4c40-889c-2d0bc355e4d8 service nova] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] Received unexpected event network-vif-plugged-ecae5278-1212-4eee-966e-a15a8c2b8a56 for instance with vm_state building and task_state spawning.
Jul 29 14:49:00 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:49:00 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:49:00 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:49:00 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:49:01 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642141.7091851, a8d47810-5115-41fd-a4be-86aa2f716c79 => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:49:01 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] VM Resumed (Lifecycle Event)
Jul 29 14:49:01 user nova-compute[70924]: DEBUG nova.compute.manager [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] Instance event wait completed in 0 seconds for  {{(pid=70924) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 14:49:01 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] Guest created on hypervisor {{(pid=70924) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 14:49:01 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] Instance spawned successfully.
Jul 29 14:49:01 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 14:49:01 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:49:01 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:49:01 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] Found default for hw_cdrom_bus of ide {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:49:01 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] Found default for hw_disk_bus of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:49:01 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] Found default for hw_input_bus of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:49:01 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] Found default for hw_pointer_model of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:49:01 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] Found default for hw_video_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:49:01 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] Found default for hw_vif_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:49:01 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:49:01 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642141.7187274, a8d47810-5115-41fd-a4be-86aa2f716c79 => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:49:01 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] VM Started (Lifecycle Event)
Jul 29 14:49:01 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:49:01 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:49:01 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:49:01 user nova-compute[70924]: DEBUG nova.compute.manager [req-db2cb609-d493-43e0-b01c-36669d15915a req-e65097db-916f-4aae-a150-ae71d627f1bc service nova] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] Received event network-vif-plugged-ecae5278-1212-4eee-966e-a15a8c2b8a56 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:49:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-db2cb609-d493-43e0-b01c-36669d15915a req-e65097db-916f-4aae-a150-ae71d627f1bc service nova] Acquiring lock "a8d47810-5115-41fd-a4be-86aa2f716c79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:49:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-db2cb609-d493-43e0-b01c-36669d15915a req-e65097db-916f-4aae-a150-ae71d627f1bc service nova] Lock "a8d47810-5115-41fd-a4be-86aa2f716c79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:49:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-db2cb609-d493-43e0-b01c-36669d15915a req-e65097db-916f-4aae-a150-ae71d627f1bc service nova] Lock "a8d47810-5115-41fd-a4be-86aa2f716c79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:49:01 user nova-compute[70924]: DEBUG nova.compute.manager [req-db2cb609-d493-43e0-b01c-36669d15915a req-e65097db-916f-4aae-a150-ae71d627f1bc service nova] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] No waiting events found dispatching network-vif-plugged-ecae5278-1212-4eee-966e-a15a8c2b8a56 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:49:01 user nova-compute[70924]: WARNING nova.compute.manager [req-db2cb609-d493-43e0-b01c-36669d15915a req-e65097db-916f-4aae-a150-ae71d627f1bc service nova] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] Received unexpected event network-vif-plugged-ecae5278-1212-4eee-966e-a15a8c2b8a56 for instance with vm_state building and task_state spawning.
Jul 29 14:49:01 user nova-compute[70924]: INFO nova.compute.manager [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] Took 5.69 seconds to spawn the instance on the hypervisor.
Jul 29 14:49:01 user nova-compute[70924]: DEBUG nova.compute.manager [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:49:01 user nova-compute[70924]: INFO nova.compute.manager [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] Took 6.49 seconds to build instance.
Jul 29 14:49:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-fb6585f7-4285-41a7-8c12-0856eedeee6b tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Lock "a8d47810-5115-41fd-a4be-86aa2f716c79" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.606s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:49:03 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:49:03 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:49:03 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:49:07 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:49:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:49:11 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:49:13 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:49:13 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:49:14 user nova-compute[70924]: DEBUG nova.compute.manager [req-6091cc78-3eba-4ae1-bc69-325ab3465623 req-fe853379-a30e-4557-9927-03d85dae84e2 service nova] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Received event network-changed-4fdb3c78-791e-4638-8def-ec63abfa254d {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:49:14 user nova-compute[70924]: DEBUG nova.compute.manager [req-6091cc78-3eba-4ae1-bc69-325ab3465623 req-fe853379-a30e-4557-9927-03d85dae84e2 service nova] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Refreshing instance network info cache due to event network-changed-4fdb3c78-791e-4638-8def-ec63abfa254d. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:49:14 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-6091cc78-3eba-4ae1-bc69-325ab3465623 req-fe853379-a30e-4557-9927-03d85dae84e2 service nova] Acquiring lock "refresh_cache-1f7989ca-77e9-440f-bd2f-60e46e005557" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:49:14 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-6091cc78-3eba-4ae1-bc69-325ab3465623 req-fe853379-a30e-4557-9927-03d85dae84e2 service nova] Acquired lock "refresh_cache-1f7989ca-77e9-440f-bd2f-60e46e005557" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:49:14 user nova-compute[70924]: DEBUG nova.network.neutron [req-6091cc78-3eba-4ae1-bc69-325ab3465623 req-fe853379-a30e-4557-9927-03d85dae84e2 service nova] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Refreshing network info cache for port 4fdb3c78-791e-4638-8def-ec63abfa254d {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:49:15 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:49:15 user nova-compute[70924]: DEBUG nova.network.neutron [req-6091cc78-3eba-4ae1-bc69-325ab3465623 req-fe853379-a30e-4557-9927-03d85dae84e2 service nova] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Updated VIF entry in instance network info cache for port 4fdb3c78-791e-4638-8def-ec63abfa254d. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:49:15 user nova-compute[70924]: DEBUG nova.network.neutron [req-6091cc78-3eba-4ae1-bc69-325ab3465623 req-fe853379-a30e-4557-9927-03d85dae84e2 service nova] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Updating instance_info_cache with network_info: [{"id": "4fdb3c78-791e-4638-8def-ec63abfa254d", "address": "fa:16:3e:09:43:b7", "network": {"id": "14a35b1f-254b-4eae-8c5f-d18ab7e0cb3c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1329518083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4a2f0557d16467f8f1c7f8a2890e9e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fdb3c78-79", "ovs_interfaceid": "4fdb3c78-791e-4638-8def-ec63abfa254d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:49:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-6091cc78-3eba-4ae1-bc69-325ab3465623 req-fe853379-a30e-4557-9927-03d85dae84e2 service nova] Releasing lock "refresh_cache-1f7989ca-77e9-440f-bd2f-60e46e005557" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:49:18 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:49:18 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:49:19 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-647500ef-a121-4efa-bd5e-b506c21ae295 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Acquiring lock "1f7989ca-77e9-440f-bd2f-60e46e005557" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:49:19 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-647500ef-a121-4efa-bd5e-b506c21ae295 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lock "1f7989ca-77e9-440f-bd2f-60e46e005557" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:49:19 user nova-compute[70924]: DEBUG nova.objects.instance [None req-647500ef-a121-4efa-bd5e-b506c21ae295 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lazy-loading 'flavor' on Instance uuid 1f7989ca-77e9-440f-bd2f-60e46e005557 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:49:19 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-647500ef-a121-4efa-bd5e-b506c21ae295 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lock "1f7989ca-77e9-440f-bd2f-60e46e005557" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:49:19 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-647500ef-a121-4efa-bd5e-b506c21ae295 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Acquiring lock "1f7989ca-77e9-440f-bd2f-60e46e005557" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:49:19 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-647500ef-a121-4efa-bd5e-b506c21ae295 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lock "1f7989ca-77e9-440f-bd2f-60e46e005557" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:49:19 user nova-compute[70924]: INFO nova.compute.manager [None req-647500ef-a121-4efa-bd5e-b506c21ae295 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Attaching volume 380ac2a7-5deb-4ee1-ac58-5720bf5b917f to /dev/vdb
Jul 29 14:49:19 user nova-compute[70924]: DEBUG os_brick.utils [None req-647500ef-a121-4efa-bd5e-b506c21ae295 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:49:19 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:19 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:49:19 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4337335-554c-4150-a9dd-72e18834ab15]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f2127c4a30d9\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:49:19 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:19 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:49:19 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3485125-342c-4d9f-882f-ae1dfb7be5a7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:49:19 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:19 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:49:19 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[911bd966-61a2-4fd5-8967-5044a8309f60]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:49:19 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1ed3fa-d05f-471d-ba50-10c942cf410d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:49:19 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-647500ef-a121-4efa-bd5e-b506c21ae295 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Running cmd (subprocess): nvme version {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:19 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-647500ef-a121-4efa-bd5e-b506c21ae295 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] 'nvme version' failed. Not Retrying. {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:49:19 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.nvmeof [None req-647500ef-a121-4efa-bd5e-b506c21ae295 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] nvme not present on system {{(pid=70924) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 14:49:19 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:19 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:49:19 user nova-compute[70924]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 14:49:19 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3288d3-cb27-4e16-a339-e13fcd31165e]: (4, '') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:49:19 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-647500ef-a121-4efa-bd5e-b506c21ae295 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70924) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 14:49:19 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-647500ef-a121-4efa-bd5e-b506c21ae295 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 14:49:19 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-647500ef-a121-4efa-bd5e-b506c21ae295 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] LIGHTOS: no hostnqn found. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 14:49:19 user nova-compute[70924]: DEBUG os_brick.utils [None req-647500ef-a121-4efa-bd5e-b506c21ae295 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f2127c4a30d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:49:19 user nova-compute[70924]: DEBUG nova.virt.block_device [None req-647500ef-a121-4efa-bd5e-b506c21ae295 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Updating existing volume attachment record: 9be9aa01-2124-4da9-a7af-127c7a9042ba {{(pid=70924) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 14:49:21 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:49:23 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:49:23 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:49:23 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:49:25 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Acquiring lock "9ec07c62-951b-4e3a-bffa-e01dfb4665ec" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:49:25 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "9ec07c62-951b-4e3a-bffa-e01dfb4665ec" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:49:25 user nova-compute[70924]: DEBUG nova.compute.manager [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Starting instance... {{(pid=70924) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 14:49:25 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:49:25 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:49:25 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70924) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 14:49:25 user nova-compute[70924]: INFO nova.compute.claims [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Claim successful on node user
Jul 29 14:49:25 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:49:25 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:49:25 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.483s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:49:25 user nova-compute[70924]: DEBUG nova.compute.manager [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Start building networks asynchronously for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 14:49:25 user nova-compute[70924]: DEBUG nova.compute.manager [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Allocating IP information in the background. {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 14:49:25 user nova-compute[70924]: DEBUG nova.network.neutron [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] allocate_for_instance() {{(pid=70924) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 14:49:25 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 14:49:25 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Acquiring lock "091e384f-7851-4ac9-b566-990df0497fc5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:49:25 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "091e384f-7851-4ac9-b566-990df0497fc5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:49:25 user nova-compute[70924]: DEBUG nova.compute.manager [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Start building block device mappings for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 14:49:25 user nova-compute[70924]: DEBUG nova.compute.manager [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Starting instance... {{(pid=70924) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 14:49:25 user nova-compute[70924]: DEBUG nova.policy [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8ec7e735cfff48828e0c0c7618f50711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fcf4644e7a24bf68b407be2e3d9732c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70924) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 14:49:25 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:49:25 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:49:25 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70924) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 14:49:25 user nova-compute[70924]: INFO nova.compute.claims [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Claim successful on node user
Jul 29 14:49:25 user nova-compute[70924]: DEBUG nova.compute.manager [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Start spawning the instance on the hypervisor. {{(pid=70924) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 14:49:25 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Creating instance directory {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 14:49:25 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Creating image(s)
Jul 29 14:49:25 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Acquiring lock "/opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:49:25 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "/opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:49:25 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "/opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:49:25 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:26 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.164s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:49:26 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Acquiring lock "bd72453517468710f1de26b27fb0ea28688e9009" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:49:26 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:49:26 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:26 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.158s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:49:26 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk 1073741824 {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:26 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk 1073741824" returned: 0 in 0.060s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:49:26 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:49:26 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:26 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.172s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:49:26 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk. size=1073741824 {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 14:49:26 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:26 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:49:26 user nova-compute[70924]: DEBUG nova.network.neutron [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Successfully created port: cb01658e-4dd9-426e-9b45-340ea19db056 {{(pid=70924) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 14:49:26 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:49:26 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.728s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:49:26 user nova-compute[70924]: DEBUG nova.compute.manager [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Start building networks asynchronously for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 14:49:26 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:49:26 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Cannot resize image /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk to a smaller size. {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 14:49:26 user nova-compute[70924]: DEBUG nova.objects.instance [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lazy-loading 'migration_context' on Instance uuid 9ec07c62-951b-4e3a-bffa-e01dfb4665ec {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:49:26 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Created local disks {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 14:49:26 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Ensure instance console log exists: /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/console.log {{(pid=70924) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 14:49:26 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:49:26 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:49:26 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:49:26 user nova-compute[70924]: DEBUG nova.compute.manager [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Allocating IP information in the background. {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 14:49:26 user nova-compute[70924]: DEBUG nova.network.neutron [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] allocate_for_instance() {{(pid=70924) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 14:49:26 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 14:49:26 user nova-compute[70924]: DEBUG nova.compute.manager [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Start building block device mappings for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 14:49:26 user nova-compute[70924]: DEBUG nova.policy [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8ec7e735cfff48828e0c0c7618f50711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fcf4644e7a24bf68b407be2e3d9732c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70924) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 14:49:26 user nova-compute[70924]: DEBUG nova.compute.manager [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Start spawning the instance on the hypervisor. {{(pid=70924) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 14:49:26 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Creating instance directory {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 14:49:26 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Creating image(s)
Jul 29 14:49:26 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Acquiring lock "/opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:49:26 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "/opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:49:26 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "/opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:49:26 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.168s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:49:27 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Acquiring lock "bd72453517468710f1de26b27fb0ea28688e9009" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:49:27 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:49:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.172s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:49:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk 1073741824 {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk 1073741824" returned: 0 in 0.065s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:49:27 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:49:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.170s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:49:27 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Checking if we can resize image /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk. size=1073741824 {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 14:49:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:27 user nova-compute[70924]: DEBUG nova.network.neutron [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Successfully updated port: cb01658e-4dd9-426e-9b45-340ea19db056 {{(pid=70924) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 14:49:27 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Acquiring lock "refresh_cache-9ec07c62-951b-4e3a-bffa-e01dfb4665ec" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:49:27 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Acquired lock "refresh_cache-9ec07c62-951b-4e3a-bffa-e01dfb4665ec" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:49:27 user nova-compute[70924]: DEBUG nova.network.neutron [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 14:49:27 user nova-compute[70924]: DEBUG nova.compute.manager [req-e40172da-7204-4f54-91cc-58889199bbc9 req-f664786a-cb94-4bce-b7c1-1731f27b4f23 service nova] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Received event network-changed-cb01658e-4dd9-426e-9b45-340ea19db056 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:49:27 user nova-compute[70924]: DEBUG nova.compute.manager [req-e40172da-7204-4f54-91cc-58889199bbc9 req-f664786a-cb94-4bce-b7c1-1731f27b4f23 service nova] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Refreshing instance network info cache due to event network-changed-cb01658e-4dd9-426e-9b45-340ea19db056. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:49:27 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-e40172da-7204-4f54-91cc-58889199bbc9 req-f664786a-cb94-4bce-b7c1-1731f27b4f23 service nova] Acquiring lock "refresh_cache-9ec07c62-951b-4e3a-bffa-e01dfb4665ec" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:49:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:49:27 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Cannot resize image /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk to a smaller size. {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 14:49:27 user nova-compute[70924]: DEBUG nova.objects.instance [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lazy-loading 'migration_context' on Instance uuid 091e384f-7851-4ac9-b566-990df0497fc5 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:49:27 user nova-compute[70924]: DEBUG nova.network.neutron [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Instance cache missing network info. {{(pid=70924) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 14:49:27 user nova-compute[70924]: DEBUG nova.network.neutron [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Successfully created port: 1da26b57-ec30-415a-8a43-fe0e662667e1 {{(pid=70924) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 14:49:27 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Acquiring lock "c31a724f-3006-4e5d-a9b5-847fd6cd170a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:49:27 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "c31a724f-3006-4e5d-a9b5-847fd6cd170a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:49:27 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Created local disks {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 14:49:27 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Ensure instance console log exists: /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/console.log {{(pid=70924) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 14:49:27 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:49:27 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:49:27 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:49:27 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-647500ef-a121-4efa-bd5e-b506c21ae295 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Calling os-brick to attach iSCSI Volume {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 14:49:27 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-647500ef-a121-4efa-bd5e-b506c21ae295 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:380ac2a7-5deb-4ee1-ac58-5720bf5b917f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jtVpKCxr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:49:27 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-647500ef-a121-4efa-bd5e-b506c21ae295 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:49:27 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-647500ef-a121-4efa-bd5e-b506c21ae295 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:49:27 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-647500ef-a121-4efa-bd5e-b506c21ae295 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:49:27 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-647500ef-a121-4efa-bd5e-b506c21ae295 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:49:27 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-647500ef-a121-4efa-bd5e-b506c21ae295 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:380ac2a7-5deb-4ee1-ac58-5720bf5b917f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:49:27 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-647500ef-a121-4efa-bd5e-b506c21ae295 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:380ac2a7-5deb-4ee1-ac58-5720bf5b917f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:49:27 user nova-compute[70924]: INFO os_brick.initiator.connectors.iscsi [None req-647500ef-a121-4efa-bd5e-b506c21ae295 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 14:49:27 user nova-compute[70924]: DEBUG nova.compute.manager [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] Starting instance... {{(pid=70924) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 14:49:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:380ac2a7-5deb-4ee1-ac58-5720bf5b917f -p 172.16.0.220:3260 {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:380ac2a7-5deb-4ee1-ac58-5720bf5b917f -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:49:27 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8640eab-7fea-410a-b867-c36f0989175f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:49:27 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-647500ef-a121-4efa-bd5e-b506c21ae295 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 14:49:27 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:49:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:380ac2a7-5deb-4ee1-ac58-5720bf5b917f -p 172.16.0.220:3260 --interface default --op new {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:380ac2a7-5deb-4ee1-ac58-5720bf5b917f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:49:27 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb20a1e-9647-4c8d-a7c5-d8c4bc6fb9af]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:380ac2a7-5deb-4ee1-ac58-5720bf5b917f] added\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:49:27 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-647500ef-a121-4efa-bd5e-b506c21ae295 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:380ac2a7-5deb-4ee1-ac58-5720bf5b917f] added
Jul 29 14:49:27 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:49:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:380ac2a7-5deb-4ee1-ac58-5720bf5b917f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:380ac2a7-5deb-4ee1-ac58-5720bf5b917f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:49:27 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0131000b-fc2c-4d34-ac14-6384a29f5d20]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:49:27 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-647500ef-a121-4efa-bd5e-b506c21ae295 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:49:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:380ac2a7-5deb-4ee1-ac58-5720bf5b917f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:27 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:49:27 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:49:27 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70924) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 14:49:27 user nova-compute[70924]: INFO nova.compute.claims [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] Claim successful on node user
Jul 29 14:49:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:380ac2a7-5deb-4ee1-ac58-5720bf5b917f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:49:27 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf474fb-3637-4972-b722-a577e650ef2a]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:49:27 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-647500ef-a121-4efa-bd5e-b506c21ae295 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:49:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:380ac2a7-5deb-4ee1-ac58-5720bf5b917f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jtVpKCxr {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:380ac2a7-5deb-4ee1-ac58-5720bf5b917f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jtVpKCxr" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:49:27 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[757d7e7a-8feb-4339-8f7a-93e3fd8f1fb9]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:49:27 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-647500ef-a121-4efa-bd5e-b506c21ae295 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jtVpKCxr'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:49:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:380ac2a7-5deb-4ee1-ac58-5720bf5b917f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:380ac2a7-5deb-4ee1-ac58-5720bf5b917f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:49:27 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24d0065-c7df-453f-bb8f-5995ca5c0d68]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:49:27 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-647500ef-a121-4efa-bd5e-b506c21ae295 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:49:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:49:27 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e94d76c-5fbc-45e5-b53b-0a00f715342e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:49:27 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-647500ef-a121-4efa-bd5e-b506c21ae295 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:49:27 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:49:27 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-647500ef-a121-4efa-bd5e-b506c21ae295 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:49:27 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:49:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:380ac2a7-5deb-4ee1-ac58-5720bf5b917f -p 172.16.0.220:3260 --login {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:380ac2a7-5deb-4ee1-ac58-5720bf5b917f -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:49:27 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f76649-e23b-454f-bd2d-a33ec9f3a224]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:380ac2a7-5deb-4ee1-ac58-5720bf5b917f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:380ac2a7-5deb-4ee1-ac58-5720bf5b917f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:49:27 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-647500ef-a121-4efa-bd5e-b506c21ae295 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:380ac2a7-5deb-4ee1-ac58-5720bf5b917f, portal: 172.16.0.220,3260]
Jul 29 14:49:27 user nova-compute[70924]: Login to [iface: default, target: iqn.2010-10.org.openstack:380ac2a7-5deb-4ee1-ac58-5720bf5b917f, portal: 172.16.0.220,3260] successful.
Jul 29 14:49:27 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:49:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:380ac2a7-5deb-4ee1-ac58-5720bf5b917f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:380ac2a7-5deb-4ee1-ac58-5720bf5b917f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02ee739-328c-4b4e-af5d-785807dcdbd9]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-647500ef-a121-4efa-bd5e-b506c21ae295 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG nova.network.neutron [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Updating instance_info_cache with network_info: [{"id": "cb01658e-4dd9-426e-9b45-340ea19db056", "address": "fa:16:3e:75:a4:24", "network": {"id": "b2aee530-d195-47bb-b39d-c8bd15b81a08", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-421022738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcf4644e7a24bf68b407be2e3d9732c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb01658e-4d", "ovs_interfaceid": "cb01658e-4dd9-426e-9b45-340ea19db056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d5dbcd-571f-45c2-ab65-4fff18d0c0b8]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:380ac2a7-5deb-4ee1-ac58-5720bf5b917f (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-647500ef-a121-4efa-bd5e-b506c21ae295 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:49:28 user nova-compute[70924]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:380ac2a7-5deb-4ee1-ac58-5720bf5b917f (non-flash)
Jul 29 14:49:28 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-647500ef-a121-4efa-bd5e-b506c21ae295 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:49:28 user nova-compute[70924]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:380ac2a7-5deb-4ee1-ac58-5720bf5b917f (non-flash)
Jul 29 14:49:28 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-647500ef-a121-4efa-bd5e-b506c21ae295 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:380ac2a7-5deb-4ee1-ac58-5720bf5b917f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-647500ef-a121-4efa-bd5e-b506c21ae295 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Connected to 172.16.0.220:3260 {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-647500ef-a121-4efa-bd5e-b506c21ae295 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] HCTL ('34', '-', '-', 0) found on session 22 with lun 0 {{(pid=70924) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-647500ef-a121-4efa-bd5e-b506c21ae295 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70924) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Releasing lock "refresh_cache-9ec07c62-951b-4e3a-bffa-e01dfb4665ec" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG nova.compute.manager [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Instance network_info: |[{"id": "cb01658e-4dd9-426e-9b45-340ea19db056", "address": "fa:16:3e:75:a4:24", "network": {"id": "b2aee530-d195-47bb-b39d-c8bd15b81a08", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-421022738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcf4644e7a24bf68b407be2e3d9732c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb01658e-4d", "ovs_interfaceid": "cb01658e-4dd9-426e-9b45-340ea19db056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-e40172da-7204-4f54-91cc-58889199bbc9 req-f664786a-cb94-4bce-b7c1-1731f27b4f23 service nova] Acquired lock "refresh_cache-9ec07c62-951b-4e3a-bffa-e01dfb4665ec" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG nova.network.neutron [req-e40172da-7204-4f54-91cc-58889199bbc9 req-f664786a-cb94-4bce-b7c1-1731f27b4f23 service nova] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Refreshing network info cache for port cb01658e-4dd9-426e-9b45-340ea19db056 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Start _get_guest_xml network_info=[{"id": "cb01658e-4dd9-426e-9b45-340ea19db056", "address": "fa:16:3e:75:a4:24", "network": {"id": "b2aee530-d195-47bb-b39d-c8bd15b81a08", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-421022738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcf4644e7a24bf68b407be2e3d9732c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb01658e-4d", "ovs_interfaceid": "cb01658e-4dd9-426e-9b45-340ea19db056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '3aba2e73-6832-404b-8bd0-d0503ce82b8c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ce7a36-8f97-4eec-bd67-34065dad57ff]: (4, ('- - 0', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-647500ef-a121-4efa-bd5e-b506c21ae295 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Searching for a device in session 22 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-647500ef-a121-4efa-bd5e-b506c21ae295 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jtVpKCxr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 14:49:28 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:49:28 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:49:28 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] CPU controller missing on host. {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] CPU controller found on host. {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70924) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T14:36:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Flavor limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Image limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Flavor pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Image pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Got 1 possible topologies {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:49:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-399297785',display_name='tempest-ServerRescueNegativeTestJSON-server-399297785',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-399297785',id=24,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8fcf4644e7a24bf68b407be2e3d9732c',ramdisk_id='',reservation_id='r-nfbumwrt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1436708078',owner_user_name='tempest-ServerRescueNegativeTestJSON-1436708078-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:49:26Z,user_data=None,user_id='8ec7e735cfff48828e0c0c7618f50711',uuid=9ec07c62-951b-4e3a-bffa-e01dfb4665ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb01658e-4dd9-426e-9b45-340ea19db056", "address": "fa:16:3e:75:a4:24", "network": {"id": "b2aee530-d195-47bb-b39d-c8bd15b81a08", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-421022738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcf4644e7a24bf68b407be2e3d9732c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb01658e-4d", "ovs_interfaceid": "cb01658e-4dd9-426e-9b45-340ea19db056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Converting VIF {"id": "cb01658e-4dd9-426e-9b45-340ea19db056", "address": "fa:16:3e:75:a4:24", "network": {"id": "b2aee530-d195-47bb-b39d-c8bd15b81a08", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-421022738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcf4644e7a24bf68b407be2e3d9732c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb01658e-4d", "ovs_interfaceid": "cb01658e-4dd9-426e-9b45-340ea19db056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:a4:24,bridge_name='br-int',has_traffic_filtering=True,id=cb01658e-4dd9-426e-9b45-340ea19db056,network=Network(b2aee530-d195-47bb-b39d-c8bd15b81a08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb01658e-4d') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG nova.objects.instance [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lazy-loading 'pci_devices' on Instance uuid 9ec07c62-951b-4e3a-bffa-e01dfb4665ec {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] End _get_guest_xml xml=<domain type="kvm">
Jul 29 14:49:28 user nova-compute[70924]:   <uuid>9ec07c62-951b-4e3a-bffa-e01dfb4665ec</uuid>
Jul 29 14:49:28 user nova-compute[70924]:   <name>instance-00000018</name>
Jul 29 14:49:28 user nova-compute[70924]:   <memory>524288</memory>
Jul 29 14:49:28 user nova-compute[70924]:   <vcpu>1</vcpu>
Jul 29 14:49:28 user nova-compute[70924]:   <metadata>
Jul 29 14:49:28 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 14:49:28 user nova-compute[70924]:       <nova:package version="0.0.0"/>
Jul 29 14:49:28 user nova-compute[70924]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-399297785</nova:name>
Jul 29 14:49:28 user nova-compute[70924]:       <nova:creationTime>2023-07-29 14:49:28</nova:creationTime>
Jul 29 14:49:28 user nova-compute[70924]:       <nova:flavor name="m1.tiny">
Jul 29 14:49:28 user nova-compute[70924]:         <nova:memory>512</nova:memory>
Jul 29 14:49:28 user nova-compute[70924]:         <nova:disk>1</nova:disk>
Jul 29 14:49:28 user nova-compute[70924]:         <nova:swap>0</nova:swap>
Jul 29 14:49:28 user nova-compute[70924]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 14:49:28 user nova-compute[70924]:         <nova:vcpus>1</nova:vcpus>
Jul 29 14:49:28 user nova-compute[70924]:       </nova:flavor>
Jul 29 14:49:28 user nova-compute[70924]:       <nova:owner>
Jul 29 14:49:28 user nova-compute[70924]:         <nova:user uuid="8ec7e735cfff48828e0c0c7618f50711">tempest-ServerRescueNegativeTestJSON-1436708078-project-member</nova:user>
Jul 29 14:49:28 user nova-compute[70924]:         <nova:project uuid="8fcf4644e7a24bf68b407be2e3d9732c">tempest-ServerRescueNegativeTestJSON-1436708078</nova:project>
Jul 29 14:49:28 user nova-compute[70924]:       </nova:owner>
Jul 29 14:49:28 user nova-compute[70924]:       <nova:root type="image" uuid="3aba2e73-6832-404b-8bd0-d0503ce82b8c"/>
Jul 29 14:49:28 user nova-compute[70924]:       <nova:ports>
Jul 29 14:49:28 user nova-compute[70924]:         <nova:port uuid="cb01658e-4dd9-426e-9b45-340ea19db056">
Jul 29 14:49:28 user nova-compute[70924]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 29 14:49:28 user nova-compute[70924]:         </nova:port>
Jul 29 14:49:28 user nova-compute[70924]:       </nova:ports>
Jul 29 14:49:28 user nova-compute[70924]:     </nova:instance>
Jul 29 14:49:28 user nova-compute[70924]:   </metadata>
Jul 29 14:49:28 user nova-compute[70924]:   <sysinfo type="smbios">
Jul 29 14:49:28 user nova-compute[70924]:     <system>
Jul 29 14:49:28 user nova-compute[70924]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 14:49:28 user nova-compute[70924]:       <entry name="product">OpenStack Nova</entry>
Jul 29 14:49:28 user nova-compute[70924]:       <entry name="version">0.0.0</entry>
Jul 29 14:49:28 user nova-compute[70924]:       <entry name="serial">9ec07c62-951b-4e3a-bffa-e01dfb4665ec</entry>
Jul 29 14:49:28 user nova-compute[70924]:       <entry name="uuid">9ec07c62-951b-4e3a-bffa-e01dfb4665ec</entry>
Jul 29 14:49:28 user nova-compute[70924]:       <entry name="family">Virtual Machine</entry>
Jul 29 14:49:28 user nova-compute[70924]:     </system>
Jul 29 14:49:28 user nova-compute[70924]:   </sysinfo>
Jul 29 14:49:28 user nova-compute[70924]:   <os>
Jul 29 14:49:28 user nova-compute[70924]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 14:49:28 user nova-compute[70924]:     <boot dev="hd"/>
Jul 29 14:49:28 user nova-compute[70924]:     <smbios mode="sysinfo"/>
Jul 29 14:49:28 user nova-compute[70924]:   </os>
Jul 29 14:49:28 user nova-compute[70924]:   <features>
Jul 29 14:49:28 user nova-compute[70924]:     <acpi/>
Jul 29 14:49:28 user nova-compute[70924]:     <apic/>
Jul 29 14:49:28 user nova-compute[70924]:     <vmcoreinfo/>
Jul 29 14:49:28 user nova-compute[70924]:   </features>
Jul 29 14:49:28 user nova-compute[70924]:   <clock offset="utc">
Jul 29 14:49:28 user nova-compute[70924]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 14:49:28 user nova-compute[70924]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 14:49:28 user nova-compute[70924]:     <timer name="hpet" present="no"/>
Jul 29 14:49:28 user nova-compute[70924]:   </clock>
Jul 29 14:49:28 user nova-compute[70924]:   <cpu mode="custom" match="exact">
Jul 29 14:49:28 user nova-compute[70924]:     <model>Nehalem</model>
Jul 29 14:49:28 user nova-compute[70924]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 14:49:28 user nova-compute[70924]:   </cpu>
Jul 29 14:49:28 user nova-compute[70924]:   <devices>
Jul 29 14:49:28 user nova-compute[70924]:     <disk type="file" device="disk">
Jul 29 14:49:28 user nova-compute[70924]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 14:49:28 user nova-compute[70924]:       <source file="/opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk"/>
Jul 29 14:49:28 user nova-compute[70924]:       <target dev="vda" bus="virtio"/>
Jul 29 14:49:28 user nova-compute[70924]:     </disk>
Jul 29 14:49:28 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 14:49:28 user nova-compute[70924]:       <mac address="fa:16:3e:75:a4:24"/>
Jul 29 14:49:28 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:49:28 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 14:49:28 user nova-compute[70924]:       <target dev="tapcb01658e-4d"/>
Jul 29 14:49:28 user nova-compute[70924]:     </interface>
Jul 29 14:49:28 user nova-compute[70924]:     <serial type="pty">
Jul 29 14:49:28 user nova-compute[70924]:       <log file="/opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/console.log" append="off"/>
Jul 29 14:49:28 user nova-compute[70924]:     </serial>
Jul 29 14:49:28 user nova-compute[70924]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 14:49:28 user nova-compute[70924]:     <video>
Jul 29 14:49:28 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:49:28 user nova-compute[70924]:     </video>
Jul 29 14:49:28 user nova-compute[70924]:     <rng model="virtio">
Jul 29 14:49:28 user nova-compute[70924]:       <backend model="random">/dev/urandom</backend>
Jul 29 14:49:28 user nova-compute[70924]:     </rng>
Jul 29 14:49:28 user nova-compute[70924]:     <controller type="usb" index="0" model="none"/>
Jul 29 14:49:28 user nova-compute[70924]:     <memballoon model="virtio">
Jul 29 14:49:28 user nova-compute[70924]:       <stats period="10"/>
Jul 29 14:49:28 user nova-compute[70924]:     </memballoon>
Jul 29 14:49:28 user nova-compute[70924]:   </devices>
Jul 29 14:49:28 user nova-compute[70924]: </domain>
Jul 29 14:49:28 user nova-compute[70924]:  {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:49:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-399297785',display_name='tempest-ServerRescueNegativeTestJSON-server-399297785',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-399297785',id=24,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8fcf4644e7a24bf68b407be2e3d9732c',ramdisk_id='',reservation_id='r-nfbumwrt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1436708078',owner_user_name='tempest-ServerRescueNegativeTestJSON-1436708078-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:49:26Z,user_data=None,user_id='8ec7e735cfff48828e0c0c7618f50711',uuid=9ec07c62-951b-4e3a-bffa-e01dfb4665ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb01658e-4dd9-426e-9b45-340ea19db056", "address": "fa:16:3e:75:a4:24", "network": {"id": "b2aee530-d195-47bb-b39d-c8bd15b81a08", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-421022738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcf4644e7a24bf68b407be2e3d9732c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb01658e-4d", "ovs_interfaceid": "cb01658e-4dd9-426e-9b45-340ea19db056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Converting VIF {"id": "cb01658e-4dd9-426e-9b45-340ea19db056", "address": "fa:16:3e:75:a4:24", "network": {"id": "b2aee530-d195-47bb-b39d-c8bd15b81a08", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-421022738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcf4644e7a24bf68b407be2e3d9732c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb01658e-4d", "ovs_interfaceid": "cb01658e-4dd9-426e-9b45-340ea19db056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:a4:24,bridge_name='br-int',has_traffic_filtering=True,id=cb01658e-4dd9-426e-9b45-340ea19db056,network=Network(b2aee530-d195-47bb-b39d-c8bd15b81a08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb01658e-4d') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG os_vif [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:a4:24,bridge_name='br-int',has_traffic_filtering=True,id=cb01658e-4dd9-426e-9b45-340ea19db056,network=Network(b2aee530-d195-47bb-b39d-c8bd15b81a08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb01658e-4d') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcb01658e-4d, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcb01658e-4d, col_values=(('external_ids', {'iface-id': 'cb01658e-4dd9-426e-9b45-340ea19db056', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:a4:24', 'vm-uuid': '9ec07c62-951b-4e3a-bffa-e01dfb4665ec'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:49:28 user nova-compute[70924]: INFO os_vif [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:a4:24,bridge_name='br-int',has_traffic_filtering=True,id=cb01658e-4dd9-426e-9b45-340ea19db056,network=Network(b2aee530-d195-47bb-b39d-c8bd15b81a08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb01658e-4d')
Jul 29 14:49:28 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] No VIF found with MAC fa:16:3e:75:a4:24, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.647s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG nova.compute.manager [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] Start building networks asynchronously for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG nova.compute.manager [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] Allocating IP information in the background. {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG nova.network.neutron [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] allocate_for_instance() {{(pid=70924) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 14:49:28 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 14:49:28 user nova-compute[70924]: DEBUG nova.compute.manager [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] Start building block device mappings for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG nova.network.neutron [req-e40172da-7204-4f54-91cc-58889199bbc9 req-f664786a-cb94-4bce-b7c1-1731f27b4f23 service nova] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Updated VIF entry in instance network info cache for port cb01658e-4dd9-426e-9b45-340ea19db056. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG nova.network.neutron [req-e40172da-7204-4f54-91cc-58889199bbc9 req-f664786a-cb94-4bce-b7c1-1731f27b4f23 service nova] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Updating instance_info_cache with network_info: [{"id": "cb01658e-4dd9-426e-9b45-340ea19db056", "address": "fa:16:3e:75:a4:24", "network": {"id": "b2aee530-d195-47bb-b39d-c8bd15b81a08", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-421022738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcf4644e7a24bf68b407be2e3d9732c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb01658e-4d", "ovs_interfaceid": "cb01658e-4dd9-426e-9b45-340ea19db056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-e40172da-7204-4f54-91cc-58889199bbc9 req-f664786a-cb94-4bce-b7c1-1731f27b4f23 service nova] Releasing lock "refresh_cache-9ec07c62-951b-4e3a-bffa-e01dfb4665ec" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG nova.compute.manager [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] Start spawning the instance on the hypervisor. {{(pid=70924) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] Creating instance directory {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 14:49:28 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] Creating image(s)
Jul 29 14:49:28 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Acquiring lock "/opt/stack/data/nova/instances/c31a724f-3006-4e5d-a9b5-847fd6cd170a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "/opt/stack/data/nova/instances/c31a724f-3006-4e5d-a9b5-847fd6cd170a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "/opt/stack/data/nova/instances/c31a724f-3006-4e5d-a9b5-847fd6cd170a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG nova.network.neutron [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Successfully updated port: 1da26b57-ec30-415a-8a43-fe0e662667e1 {{(pid=70924) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG nova.policy [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '43582a8a85c54b5e9d16d11b12bf50d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9e5c78c1684c359cfab4e32b9c213f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70924) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Acquiring lock "refresh_cache-091e384f-7851-4ac9-b566-990df0497fc5" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Acquired lock "refresh_cache-091e384f-7851-4ac9-b566-990df0497fc5" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG nova.network.neutron [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG nova.compute.manager [req-2772dd39-d3ad-46fe-a6a5-838280ba2efa req-cdab9918-bc86-42d9-9a68-f9e006e48c41 service nova] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Received event network-changed-1da26b57-ec30-415a-8a43-fe0e662667e1 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG nova.compute.manager [req-2772dd39-d3ad-46fe-a6a5-838280ba2efa req-cdab9918-bc86-42d9-9a68-f9e006e48c41 service nova] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Refreshing instance network info cache due to event network-changed-1da26b57-ec30-415a-8a43-fe0e662667e1. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-2772dd39-d3ad-46fe-a6a5-838280ba2efa req-cdab9918-bc86-42d9-9a68-f9e006e48c41 service nova] Acquiring lock "refresh_cache-091e384f-7851-4ac9-b566-990df0497fc5" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.148s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Acquiring lock "bd72453517468710f1de26b27fb0ea28688e9009" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:28 user nova-compute[70924]: DEBUG nova.network.neutron [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Instance cache missing network info. {{(pid=70924) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 14:49:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.155s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:49:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/c31a724f-3006-4e5d-a9b5-847fd6cd170a/disk 1073741824 {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-647500ef-a121-4efa-bd5e-b506c21ae295 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.396s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:49:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-647500ef-a121-4efa-bd5e-b506c21ae295 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] <== connect_volume: return (1400ms) {'type': 'block', 'scsi_wwn': '23866323966306339', 'path': '/dev/sdc'} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:49:29 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-647500ef-a121-4efa-bd5e-b506c21ae295 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866323966306339', 'path': '/dev/sdc'} {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 14:49:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/c31a724f-3006-4e5d-a9b5-847fd6cd170a/disk 1073741824" returned: 0 in 0.064s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:49:29 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:49:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:29 user nova-compute[70924]: DEBUG nova.objects.instance [None req-647500ef-a121-4efa-bd5e-b506c21ae295 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lazy-loading 'flavor' on Instance uuid 1f7989ca-77e9-440f-bd2f-60e46e005557 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:49:29 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-647500ef-a121-4efa-bd5e-b506c21ae295 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] attach device xml: <disk type="block" device="disk">
Jul 29 14:49:29 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:49:29 user nova-compute[70924]:   <source dev="/dev/sdc"/>
Jul 29 14:49:29 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 14:49:29 user nova-compute[70924]:   <serial>380ac2a7-5deb-4ee1-ac58-5720bf5b917f</serial>
Jul 29 14:49:29 user nova-compute[70924]: </disk>
Jul 29 14:49:29 user nova-compute[70924]:  {{(pid=70924) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 29 14:49:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.144s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:49:29 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c31a724f-3006-4e5d-a9b5-847fd6cd170a/disk. size=1073741824 {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 14:49:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c31a724f-3006-4e5d-a9b5-847fd6cd170a/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c31a724f-3006-4e5d-a9b5-847fd6cd170a/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:49:29 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Cannot resize image /opt/stack/data/nova/instances/c31a724f-3006-4e5d-a9b5-847fd6cd170a/disk to a smaller size. {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 14:49:29 user nova-compute[70924]: DEBUG nova.objects.instance [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lazy-loading 'migration_context' on Instance uuid c31a724f-3006-4e5d-a9b5-847fd6cd170a {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:49:29 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] Created local disks {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 14:49:29 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] Ensure instance console log exists: /opt/stack/data/nova/instances/c31a724f-3006-4e5d-a9b5-847fd6cd170a/console.log {{(pid=70924) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 14:49:29 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:49:29 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:49:29 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:49:29 user nova-compute[70924]: DEBUG nova.network.neutron [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Updating instance_info_cache with network_info: [{"id": "1da26b57-ec30-415a-8a43-fe0e662667e1", "address": "fa:16:3e:7c:7f:15", "network": {"id": "b2aee530-d195-47bb-b39d-c8bd15b81a08", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-421022738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcf4644e7a24bf68b407be2e3d9732c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1da26b57-ec", "ovs_interfaceid": "1da26b57-ec30-415a-8a43-fe0e662667e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:49:29 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Releasing lock "refresh_cache-091e384f-7851-4ac9-b566-990df0497fc5" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:49:29 user nova-compute[70924]: DEBUG nova.compute.manager [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Instance network_info: |[{"id": "1da26b57-ec30-415a-8a43-fe0e662667e1", "address": "fa:16:3e:7c:7f:15", "network": {"id": "b2aee530-d195-47bb-b39d-c8bd15b81a08", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-421022738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcf4644e7a24bf68b407be2e3d9732c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1da26b57-ec", "ovs_interfaceid": "1da26b57-ec30-415a-8a43-fe0e662667e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 14:49:29 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-2772dd39-d3ad-46fe-a6a5-838280ba2efa req-cdab9918-bc86-42d9-9a68-f9e006e48c41 service nova] Acquired lock "refresh_cache-091e384f-7851-4ac9-b566-990df0497fc5" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:49:29 user nova-compute[70924]: DEBUG nova.network.neutron [req-2772dd39-d3ad-46fe-a6a5-838280ba2efa req-cdab9918-bc86-42d9-9a68-f9e006e48c41 service nova] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Refreshing network info cache for port 1da26b57-ec30-415a-8a43-fe0e662667e1 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:49:29 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Start _get_guest_xml network_info=[{"id": "1da26b57-ec30-415a-8a43-fe0e662667e1", "address": "fa:16:3e:7c:7f:15", "network": {"id": "b2aee530-d195-47bb-b39d-c8bd15b81a08", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-421022738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcf4644e7a24bf68b407be2e3d9732c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1da26b57-ec", "ovs_interfaceid": "1da26b57-ec30-415a-8a43-fe0e662667e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '3aba2e73-6832-404b-8bd0-d0503ce82b8c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 14:49:29 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:49:29 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:49:29 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 14:49:29 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] CPU controller missing on host. {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 14:49:29 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 14:49:29 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] CPU controller found on host. {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 14:49:29 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70924) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 14:49:29 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T14:36:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 14:49:29 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Flavor limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 14:49:29 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Image limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 14:49:29 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Flavor pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 14:49:29 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Image pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 14:49:29 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 14:49:29 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 14:49:29 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 14:49:29 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Got 1 possible topologies {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 14:49:29 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 14:49:29 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 14:49:29 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:49:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-985418414',display_name='tempest-ServerRescueNegativeTestJSON-server-985418414',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-985418414',id=25,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8fcf4644e7a24bf68b407be2e3d9732c',ramdisk_id='',reservation_id='r-77bcp480',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1436708078',owner_user_name='tempest-ServerRescueNegativeTestJSON-1436708078-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:49:27Z,user_data=None,user_id='8ec7e735cfff48828e0c0c7618f50711',uuid=091e384f-7851-4ac9-b566-990df0497fc5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1da26b57-ec30-415a-8a43-fe0e662667e1", "address": "fa:16:3e:7c:7f:15", "network": {"id": "b2aee530-d195-47bb-b39d-c8bd15b81a08", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-421022738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcf4644e7a24bf68b407be2e3d9732c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1da26b57-ec", "ovs_interfaceid": "1da26b57-ec30-415a-8a43-fe0e662667e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:49:29 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Converting VIF {"id": "1da26b57-ec30-415a-8a43-fe0e662667e1", "address": "fa:16:3e:7c:7f:15", "network": {"id": "b2aee530-d195-47bb-b39d-c8bd15b81a08", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-421022738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcf4644e7a24bf68b407be2e3d9732c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1da26b57-ec", "ovs_interfaceid": "1da26b57-ec30-415a-8a43-fe0e662667e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:49:29 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:7f:15,bridge_name='br-int',has_traffic_filtering=True,id=1da26b57-ec30-415a-8a43-fe0e662667e1,network=Network(b2aee530-d195-47bb-b39d-c8bd15b81a08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1da26b57-ec') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:49:29 user nova-compute[70924]: DEBUG nova.objects.instance [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lazy-loading 'pci_devices' on Instance uuid 091e384f-7851-4ac9-b566-990df0497fc5 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:49:29 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] End _get_guest_xml xml=<domain type="kvm">
Jul 29 14:49:29 user nova-compute[70924]:   <uuid>091e384f-7851-4ac9-b566-990df0497fc5</uuid>
Jul 29 14:49:29 user nova-compute[70924]:   <name>instance-00000019</name>
Jul 29 14:49:29 user nova-compute[70924]:   <memory>524288</memory>
Jul 29 14:49:29 user nova-compute[70924]:   <vcpu>1</vcpu>
Jul 29 14:49:29 user nova-compute[70924]:   <metadata>
Jul 29 14:49:29 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 14:49:29 user nova-compute[70924]:       <nova:package version="0.0.0"/>
Jul 29 14:49:29 user nova-compute[70924]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-985418414</nova:name>
Jul 29 14:49:29 user nova-compute[70924]:       <nova:creationTime>2023-07-29 14:49:29</nova:creationTime>
Jul 29 14:49:29 user nova-compute[70924]:       <nova:flavor name="m1.tiny">
Jul 29 14:49:29 user nova-compute[70924]:         <nova:memory>512</nova:memory>
Jul 29 14:49:29 user nova-compute[70924]:         <nova:disk>1</nova:disk>
Jul 29 14:49:29 user nova-compute[70924]:         <nova:swap>0</nova:swap>
Jul 29 14:49:29 user nova-compute[70924]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 14:49:29 user nova-compute[70924]:         <nova:vcpus>1</nova:vcpus>
Jul 29 14:49:29 user nova-compute[70924]:       </nova:flavor>
Jul 29 14:49:29 user nova-compute[70924]:       <nova:owner>
Jul 29 14:49:29 user nova-compute[70924]:         <nova:user uuid="8ec7e735cfff48828e0c0c7618f50711">tempest-ServerRescueNegativeTestJSON-1436708078-project-member</nova:user>
Jul 29 14:49:29 user nova-compute[70924]:         <nova:project uuid="8fcf4644e7a24bf68b407be2e3d9732c">tempest-ServerRescueNegativeTestJSON-1436708078</nova:project>
Jul 29 14:49:29 user nova-compute[70924]:       </nova:owner>
Jul 29 14:49:29 user nova-compute[70924]:       <nova:root type="image" uuid="3aba2e73-6832-404b-8bd0-d0503ce82b8c"/>
Jul 29 14:49:29 user nova-compute[70924]:       <nova:ports>
Jul 29 14:49:29 user nova-compute[70924]:         <nova:port uuid="1da26b57-ec30-415a-8a43-fe0e662667e1">
Jul 29 14:49:29 user nova-compute[70924]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 29 14:49:29 user nova-compute[70924]:         </nova:port>
Jul 29 14:49:29 user nova-compute[70924]:       </nova:ports>
Jul 29 14:49:29 user nova-compute[70924]:     </nova:instance>
Jul 29 14:49:29 user nova-compute[70924]:   </metadata>
Jul 29 14:49:29 user nova-compute[70924]:   <sysinfo type="smbios">
Jul 29 14:49:29 user nova-compute[70924]:     <system>
Jul 29 14:49:29 user nova-compute[70924]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 14:49:29 user nova-compute[70924]:       <entry name="product">OpenStack Nova</entry>
Jul 29 14:49:29 user nova-compute[70924]:       <entry name="version">0.0.0</entry>
Jul 29 14:49:29 user nova-compute[70924]:       <entry name="serial">091e384f-7851-4ac9-b566-990df0497fc5</entry>
Jul 29 14:49:29 user nova-compute[70924]:       <entry name="uuid">091e384f-7851-4ac9-b566-990df0497fc5</entry>
Jul 29 14:49:29 user nova-compute[70924]:       <entry name="family">Virtual Machine</entry>
Jul 29 14:49:29 user nova-compute[70924]:     </system>
Jul 29 14:49:29 user nova-compute[70924]:   </sysinfo>
Jul 29 14:49:29 user nova-compute[70924]:   <os>
Jul 29 14:49:29 user nova-compute[70924]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 14:49:29 user nova-compute[70924]:     <boot dev="hd"/>
Jul 29 14:49:29 user nova-compute[70924]:     <smbios mode="sysinfo"/>
Jul 29 14:49:29 user nova-compute[70924]:   </os>
Jul 29 14:49:29 user nova-compute[70924]:   <features>
Jul 29 14:49:29 user nova-compute[70924]:     <acpi/>
Jul 29 14:49:29 user nova-compute[70924]:     <apic/>
Jul 29 14:49:29 user nova-compute[70924]:     <vmcoreinfo/>
Jul 29 14:49:29 user nova-compute[70924]:   </features>
Jul 29 14:49:29 user nova-compute[70924]:   <clock offset="utc">
Jul 29 14:49:29 user nova-compute[70924]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 14:49:29 user nova-compute[70924]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 14:49:29 user nova-compute[70924]:     <timer name="hpet" present="no"/>
Jul 29 14:49:29 user nova-compute[70924]:   </clock>
Jul 29 14:49:29 user nova-compute[70924]:   <cpu mode="custom" match="exact">
Jul 29 14:49:29 user nova-compute[70924]:     <model>Nehalem</model>
Jul 29 14:49:29 user nova-compute[70924]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 14:49:29 user nova-compute[70924]:   </cpu>
Jul 29 14:49:29 user nova-compute[70924]:   <devices>
Jul 29 14:49:29 user nova-compute[70924]:     <disk type="file" device="disk">
Jul 29 14:49:29 user nova-compute[70924]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 14:49:29 user nova-compute[70924]:       <source file="/opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk"/>
Jul 29 14:49:29 user nova-compute[70924]:       <target dev="vda" bus="virtio"/>
Jul 29 14:49:29 user nova-compute[70924]:     </disk>
Jul 29 14:49:29 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 14:49:29 user nova-compute[70924]:       <mac address="fa:16:3e:7c:7f:15"/>
Jul 29 14:49:29 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:49:29 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 14:49:29 user nova-compute[70924]:       <target dev="tap1da26b57-ec"/>
Jul 29 14:49:29 user nova-compute[70924]:     </interface>
Jul 29 14:49:29 user nova-compute[70924]:     <serial type="pty">
Jul 29 14:49:29 user nova-compute[70924]:       <log file="/opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/console.log" append="off"/>
Jul 29 14:49:29 user nova-compute[70924]:     </serial>
Jul 29 14:49:29 user nova-compute[70924]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 14:49:29 user nova-compute[70924]:     <video>
Jul 29 14:49:29 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:49:29 user nova-compute[70924]:     </video>
Jul 29 14:49:29 user nova-compute[70924]:     <rng model="virtio">
Jul 29 14:49:29 user nova-compute[70924]:       <backend model="random">/dev/urandom</backend>
Jul 29 14:49:29 user nova-compute[70924]:     </rng>
Jul 29 14:49:29 user nova-compute[70924]:     <controller type="usb" index="0" model="none"/>
Jul 29 14:49:29 user nova-compute[70924]:     <memballoon model="virtio">
Jul 29 14:49:29 user nova-compute[70924]:       <stats period="10"/>
Jul 29 14:49:29 user nova-compute[70924]:     </memballoon>
Jul 29 14:49:29 user nova-compute[70924]:   </devices>
Jul 29 14:49:29 user nova-compute[70924]: </domain>
Jul 29 14:49:29 user nova-compute[70924]:  {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 14:49:29 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:49:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-985418414',display_name='tempest-ServerRescueNegativeTestJSON-server-985418414',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-985418414',id=25,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8fcf4644e7a24bf68b407be2e3d9732c',ramdisk_id='',reservation_id='r-77bcp480',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1436708078',owner_user_name='tempest-ServerRescueNegativeTestJSON-1436708078-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:49:27Z,user_data=None,user_id='8ec7e735cfff48828e0c0c7618f50711',uuid=091e384f-7851-4ac9-b566-990df0497fc5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1da26b57-ec30-415a-8a43-fe0e662667e1", "address": "fa:16:3e:7c:7f:15", "network": {"id": "b2aee530-d195-47bb-b39d-c8bd15b81a08", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-421022738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcf4644e7a24bf68b407be2e3d9732c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1da26b57-ec", "ovs_interfaceid": "1da26b57-ec30-415a-8a43-fe0e662667e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 14:49:29 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Converting VIF {"id": "1da26b57-ec30-415a-8a43-fe0e662667e1", "address": "fa:16:3e:7c:7f:15", "network": {"id": "b2aee530-d195-47bb-b39d-c8bd15b81a08", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-421022738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcf4644e7a24bf68b407be2e3d9732c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1da26b57-ec", "ovs_interfaceid": "1da26b57-ec30-415a-8a43-fe0e662667e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:49:29 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:7f:15,bridge_name='br-int',has_traffic_filtering=True,id=1da26b57-ec30-415a-8a43-fe0e662667e1,network=Network(b2aee530-d195-47bb-b39d-c8bd15b81a08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1da26b57-ec') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:49:29 user nova-compute[70924]: DEBUG os_vif [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:7f:15,bridge_name='br-int',has_traffic_filtering=True,id=1da26b57-ec30-415a-8a43-fe0e662667e1,network=Network(b2aee530-d195-47bb-b39d-c8bd15b81a08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1da26b57-ec') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 14:49:29 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:49:29 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:49:29 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 14:49:29 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:49:29 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1da26b57-ec, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:49:29 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1da26b57-ec, col_values=(('external_ids', {'iface-id': '1da26b57-ec30-415a-8a43-fe0e662667e1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:7f:15', 'vm-uuid': '091e384f-7851-4ac9-b566-990df0497fc5'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:49:29 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:49:29 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:49:29 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:49:29 user nova-compute[70924]: INFO os_vif [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:7f:15,bridge_name='br-int',has_traffic_filtering=True,id=1da26b57-ec30-415a-8a43-fe0e662667e1,network=Network(b2aee530-d195-47bb-b39d-c8bd15b81a08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1da26b57-ec')
Jul 29 14:49:29 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-647500ef-a121-4efa-bd5e-b506c21ae295 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:49:29 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-647500ef-a121-4efa-bd5e-b506c21ae295 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:49:29 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-647500ef-a121-4efa-bd5e-b506c21ae295 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] No VIF found with MAC fa:16:3e:09:43:b7, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:49:29 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:49:29 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] No VIF found with MAC fa:16:3e:7c:7f:15, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:49:29 user nova-compute[70924]: DEBUG nova.network.neutron [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] Successfully created port: 31895092-6af7-4934-895e-f8455642368c {{(pid=70924) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 14:49:29 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-647500ef-a121-4efa-bd5e-b506c21ae295 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lock "1f7989ca-77e9-440f-bd2f-60e46e005557" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.158s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:49:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:49:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:49:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:49:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:49:30 user nova-compute[70924]: DEBUG nova.compute.manager [req-9153c23e-1df7-4e71-b978-f34a1e38abae req-fb9fc619-f8f2-4d1c-a1f8-bb5868f8d96f service nova] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Received event network-vif-plugged-cb01658e-4dd9-426e-9b45-340ea19db056 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:49:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-9153c23e-1df7-4e71-b978-f34a1e38abae req-fb9fc619-f8f2-4d1c-a1f8-bb5868f8d96f service nova] Acquiring lock "9ec07c62-951b-4e3a-bffa-e01dfb4665ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:49:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-9153c23e-1df7-4e71-b978-f34a1e38abae req-fb9fc619-f8f2-4d1c-a1f8-bb5868f8d96f service nova] Lock "9ec07c62-951b-4e3a-bffa-e01dfb4665ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:49:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-9153c23e-1df7-4e71-b978-f34a1e38abae req-fb9fc619-f8f2-4d1c-a1f8-bb5868f8d96f service nova] Lock "9ec07c62-951b-4e3a-bffa-e01dfb4665ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:49:30 user nova-compute[70924]: DEBUG nova.compute.manager [req-9153c23e-1df7-4e71-b978-f34a1e38abae req-fb9fc619-f8f2-4d1c-a1f8-bb5868f8d96f service nova] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] No waiting events found dispatching network-vif-plugged-cb01658e-4dd9-426e-9b45-340ea19db056 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:49:30 user nova-compute[70924]: WARNING nova.compute.manager [req-9153c23e-1df7-4e71-b978-f34a1e38abae req-fb9fc619-f8f2-4d1c-a1f8-bb5868f8d96f service nova] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Received unexpected event network-vif-plugged-cb01658e-4dd9-426e-9b45-340ea19db056 for instance with vm_state building and task_state spawning.
Jul 29 14:49:30 user nova-compute[70924]: DEBUG nova.network.neutron [req-2772dd39-d3ad-46fe-a6a5-838280ba2efa req-cdab9918-bc86-42d9-9a68-f9e006e48c41 service nova] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Updated VIF entry in instance network info cache for port 1da26b57-ec30-415a-8a43-fe0e662667e1. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:49:30 user nova-compute[70924]: DEBUG nova.network.neutron [req-2772dd39-d3ad-46fe-a6a5-838280ba2efa req-cdab9918-bc86-42d9-9a68-f9e006e48c41 service nova] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Updating instance_info_cache with network_info: [{"id": "1da26b57-ec30-415a-8a43-fe0e662667e1", "address": "fa:16:3e:7c:7f:15", "network": {"id": "b2aee530-d195-47bb-b39d-c8bd15b81a08", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-421022738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcf4644e7a24bf68b407be2e3d9732c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1da26b57-ec", "ovs_interfaceid": "1da26b57-ec30-415a-8a43-fe0e662667e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:49:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-2772dd39-d3ad-46fe-a6a5-838280ba2efa req-cdab9918-bc86-42d9-9a68-f9e006e48c41 service nova] Releasing lock "refresh_cache-091e384f-7851-4ac9-b566-990df0497fc5" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:49:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:49:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:49:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:49:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:49:30 user nova-compute[70924]: DEBUG nova.network.neutron [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] Successfully updated port: 31895092-6af7-4934-895e-f8455642368c {{(pid=70924) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 14:49:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Acquiring lock "refresh_cache-c31a724f-3006-4e5d-a9b5-847fd6cd170a" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:49:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Acquired lock "refresh_cache-c31a724f-3006-4e5d-a9b5-847fd6cd170a" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:49:30 user nova-compute[70924]: DEBUG nova.network.neutron [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 14:49:30 user nova-compute[70924]: DEBUG nova.compute.manager [req-c4a785ec-f0ed-489d-b7d7-9743a5b0bd69 req-cc22b74f-3396-471c-ae2a-863e117a84f3 service nova] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] Received event network-changed-31895092-6af7-4934-895e-f8455642368c {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:49:30 user nova-compute[70924]: DEBUG nova.compute.manager [req-c4a785ec-f0ed-489d-b7d7-9743a5b0bd69 req-cc22b74f-3396-471c-ae2a-863e117a84f3 service nova] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] Refreshing instance network info cache due to event network-changed-31895092-6af7-4934-895e-f8455642368c. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:49:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c4a785ec-f0ed-489d-b7d7-9743a5b0bd69 req-cc22b74f-3396-471c-ae2a-863e117a84f3 service nova] Acquiring lock "refresh_cache-c31a724f-3006-4e5d-a9b5-847fd6cd170a" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:49:31 user nova-compute[70924]: DEBUG nova.network.neutron [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] Instance cache missing network info. {{(pid=70924) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 14:49:31 user nova-compute[70924]: DEBUG nova.network.neutron [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] Updating instance_info_cache with network_info: [{"id": "31895092-6af7-4934-895e-f8455642368c", "address": "fa:16:3e:09:8e:63", "network": {"id": "d5876e18-e2af-45c2-aab5-2d0d552ebfe4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2035085552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9e5c78c1684c359cfab4e32b9c213f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31895092-6a", "ovs_interfaceid": "31895092-6af7-4934-895e-f8455642368c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:49:31 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Releasing lock "refresh_cache-c31a724f-3006-4e5d-a9b5-847fd6cd170a" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:49:31 user nova-compute[70924]: DEBUG nova.compute.manager [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] Instance network_info: |[{"id": "31895092-6af7-4934-895e-f8455642368c", "address": "fa:16:3e:09:8e:63", "network": {"id": "d5876e18-e2af-45c2-aab5-2d0d552ebfe4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2035085552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9e5c78c1684c359cfab4e32b9c213f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31895092-6a", "ovs_interfaceid": "31895092-6af7-4934-895e-f8455642368c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 14:49:31 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c4a785ec-f0ed-489d-b7d7-9743a5b0bd69 req-cc22b74f-3396-471c-ae2a-863e117a84f3 service nova] Acquired lock "refresh_cache-c31a724f-3006-4e5d-a9b5-847fd6cd170a" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:49:31 user nova-compute[70924]: DEBUG nova.network.neutron [req-c4a785ec-f0ed-489d-b7d7-9743a5b0bd69 req-cc22b74f-3396-471c-ae2a-863e117a84f3 service nova] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] Refreshing network info cache for port 31895092-6af7-4934-895e-f8455642368c {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:49:31 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] Start _get_guest_xml network_info=[{"id": "31895092-6af7-4934-895e-f8455642368c", "address": "fa:16:3e:09:8e:63", "network": {"id": "d5876e18-e2af-45c2-aab5-2d0d552ebfe4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2035085552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9e5c78c1684c359cfab4e32b9c213f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31895092-6a", "ovs_interfaceid": "31895092-6af7-4934-895e-f8455642368c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '3aba2e73-6832-404b-8bd0-d0503ce82b8c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 14:49:31 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:49:31 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:49:31 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 14:49:31 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] CPU controller missing on host. {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 14:49:31 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 14:49:31 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] CPU controller found on host. {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 14:49:31 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70924) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 14:49:31 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T14:36:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 14:49:31 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Flavor limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 14:49:31 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Image limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 14:49:31 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Flavor pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 14:49:31 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Image pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 14:49:31 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 14:49:31 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 14:49:31 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 14:49:31 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Got 1 possible topologies {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 14:49:31 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 14:49:31 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 14:49:31 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:49:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1437543645',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1437543645',id=26,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a9e5c78c1684c359cfab4e32b9c213f',ramdisk_id='',reservation_id='r-jbuysvy6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2089253815',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:49:29Z,user_data=None,user_id='43582a8a85c54b5e9d16d11b12bf50d4',uuid=c31a724f-3006-4e5d-a9b5-847fd6cd170a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31895092-6af7-4934-895e-f8455642368c", "address": "fa:16:3e:09:8e:63", "network": {"id": "d5876e18-e2af-45c2-aab5-2d0d552ebfe4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2035085552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9e5c78c1684c359cfab4e32b9c213f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31895092-6a", "ovs_interfaceid": "31895092-6af7-4934-895e-f8455642368c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:49:31 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Converting VIF {"id": "31895092-6af7-4934-895e-f8455642368c", "address": "fa:16:3e:09:8e:63", "network": {"id": "d5876e18-e2af-45c2-aab5-2d0d552ebfe4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2035085552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9e5c78c1684c359cfab4e32b9c213f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31895092-6a", "ovs_interfaceid": "31895092-6af7-4934-895e-f8455642368c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:49:31 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:8e:63,bridge_name='br-int',has_traffic_filtering=True,id=31895092-6af7-4934-895e-f8455642368c,network=Network(d5876e18-e2af-45c2-aab5-2d0d552ebfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31895092-6a') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:49:31 user nova-compute[70924]: DEBUG nova.objects.instance [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lazy-loading 'pci_devices' on Instance uuid c31a724f-3006-4e5d-a9b5-847fd6cd170a {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:49:31 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] End _get_guest_xml xml=<domain type="kvm">
Jul 29 14:49:31 user nova-compute[70924]:   <uuid>c31a724f-3006-4e5d-a9b5-847fd6cd170a</uuid>
Jul 29 14:49:31 user nova-compute[70924]:   <name>instance-0000001a</name>
Jul 29 14:49:31 user nova-compute[70924]:   <memory>524288</memory>
Jul 29 14:49:31 user nova-compute[70924]:   <vcpu>1</vcpu>
Jul 29 14:49:31 user nova-compute[70924]:   <metadata>
Jul 29 14:49:31 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 14:49:31 user nova-compute[70924]:       <nova:package version="0.0.0"/>
Jul 29 14:49:31 user nova-compute[70924]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1437543645</nova:name>
Jul 29 14:49:31 user nova-compute[70924]:       <nova:creationTime>2023-07-29 14:49:31</nova:creationTime>
Jul 29 14:49:31 user nova-compute[70924]:       <nova:flavor name="m1.tiny">
Jul 29 14:49:31 user nova-compute[70924]:         <nova:memory>512</nova:memory>
Jul 29 14:49:31 user nova-compute[70924]:         <nova:disk>1</nova:disk>
Jul 29 14:49:31 user nova-compute[70924]:         <nova:swap>0</nova:swap>
Jul 29 14:49:31 user nova-compute[70924]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 14:49:31 user nova-compute[70924]:         <nova:vcpus>1</nova:vcpus>
Jul 29 14:49:31 user nova-compute[70924]:       </nova:flavor>
Jul 29 14:49:31 user nova-compute[70924]:       <nova:owner>
Jul 29 14:49:31 user nova-compute[70924]:         <nova:user uuid="43582a8a85c54b5e9d16d11b12bf50d4">tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member</nova:user>
Jul 29 14:49:31 user nova-compute[70924]:         <nova:project uuid="5a9e5c78c1684c359cfab4e32b9c213f">tempest-ServerBootFromVolumeStableRescueTest-2089253815</nova:project>
Jul 29 14:49:31 user nova-compute[70924]:       </nova:owner>
Jul 29 14:49:31 user nova-compute[70924]:       <nova:root type="image" uuid="3aba2e73-6832-404b-8bd0-d0503ce82b8c"/>
Jul 29 14:49:31 user nova-compute[70924]:       <nova:ports>
Jul 29 14:49:31 user nova-compute[70924]:         <nova:port uuid="31895092-6af7-4934-895e-f8455642368c">
Jul 29 14:49:31 user nova-compute[70924]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 29 14:49:31 user nova-compute[70924]:         </nova:port>
Jul 29 14:49:31 user nova-compute[70924]:       </nova:ports>
Jul 29 14:49:31 user nova-compute[70924]:     </nova:instance>
Jul 29 14:49:31 user nova-compute[70924]:   </metadata>
Jul 29 14:49:31 user nova-compute[70924]:   <sysinfo type="smbios">
Jul 29 14:49:31 user nova-compute[70924]:     <system>
Jul 29 14:49:31 user nova-compute[70924]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 14:49:31 user nova-compute[70924]:       <entry name="product">OpenStack Nova</entry>
Jul 29 14:49:31 user nova-compute[70924]:       <entry name="version">0.0.0</entry>
Jul 29 14:49:31 user nova-compute[70924]:       <entry name="serial">c31a724f-3006-4e5d-a9b5-847fd6cd170a</entry>
Jul 29 14:49:31 user nova-compute[70924]:       <entry name="uuid">c31a724f-3006-4e5d-a9b5-847fd6cd170a</entry>
Jul 29 14:49:31 user nova-compute[70924]:       <entry name="family">Virtual Machine</entry>
Jul 29 14:49:31 user nova-compute[70924]:     </system>
Jul 29 14:49:31 user nova-compute[70924]:   </sysinfo>
Jul 29 14:49:31 user nova-compute[70924]:   <os>
Jul 29 14:49:31 user nova-compute[70924]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 14:49:31 user nova-compute[70924]:     <boot dev="hd"/>
Jul 29 14:49:31 user nova-compute[70924]:     <smbios mode="sysinfo"/>
Jul 29 14:49:31 user nova-compute[70924]:   </os>
Jul 29 14:49:31 user nova-compute[70924]:   <features>
Jul 29 14:49:31 user nova-compute[70924]:     <acpi/>
Jul 29 14:49:31 user nova-compute[70924]:     <apic/>
Jul 29 14:49:31 user nova-compute[70924]:     <vmcoreinfo/>
Jul 29 14:49:31 user nova-compute[70924]:   </features>
Jul 29 14:49:31 user nova-compute[70924]:   <clock offset="utc">
Jul 29 14:49:31 user nova-compute[70924]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 14:49:31 user nova-compute[70924]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 14:49:31 user nova-compute[70924]:     <timer name="hpet" present="no"/>
Jul 29 14:49:31 user nova-compute[70924]:   </clock>
Jul 29 14:49:31 user nova-compute[70924]:   <cpu mode="custom" match="exact">
Jul 29 14:49:31 user nova-compute[70924]:     <model>Nehalem</model>
Jul 29 14:49:31 user nova-compute[70924]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 14:49:31 user nova-compute[70924]:   </cpu>
Jul 29 14:49:31 user nova-compute[70924]:   <devices>
Jul 29 14:49:31 user nova-compute[70924]:     <disk type="file" device="disk">
Jul 29 14:49:31 user nova-compute[70924]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 14:49:31 user nova-compute[70924]:       <source file="/opt/stack/data/nova/instances/c31a724f-3006-4e5d-a9b5-847fd6cd170a/disk"/>
Jul 29 14:49:31 user nova-compute[70924]:       <target dev="vda" bus="virtio"/>
Jul 29 14:49:31 user nova-compute[70924]:     </disk>
Jul 29 14:49:31 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 14:49:31 user nova-compute[70924]:       <mac address="fa:16:3e:09:8e:63"/>
Jul 29 14:49:31 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:49:31 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 14:49:31 user nova-compute[70924]:       <target dev="tap31895092-6a"/>
Jul 29 14:49:31 user nova-compute[70924]:     </interface>
Jul 29 14:49:31 user nova-compute[70924]:     <serial type="pty">
Jul 29 14:49:31 user nova-compute[70924]:       <log file="/opt/stack/data/nova/instances/c31a724f-3006-4e5d-a9b5-847fd6cd170a/console.log" append="off"/>
Jul 29 14:49:31 user nova-compute[70924]:     </serial>
Jul 29 14:49:31 user nova-compute[70924]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 14:49:31 user nova-compute[70924]:     <video>
Jul 29 14:49:31 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:49:31 user nova-compute[70924]:     </video>
Jul 29 14:49:31 user nova-compute[70924]:     <rng model="virtio">
Jul 29 14:49:31 user nova-compute[70924]:       <backend model="random">/dev/urandom</backend>
Jul 29 14:49:31 user nova-compute[70924]:     </rng>
Jul 29 14:49:31 user nova-compute[70924]:     <controller type="usb" index="0" model="none"/>
Jul 29 14:49:31 user nova-compute[70924]:     <memballoon model="virtio">
Jul 29 14:49:31 user nova-compute[70924]:       <stats period="10"/>
Jul 29 14:49:31 user nova-compute[70924]:     </memballoon>
Jul 29 14:49:31 user nova-compute[70924]:   </devices>
Jul 29 14:49:31 user nova-compute[70924]: </domain>
Jul 29 14:49:31 user nova-compute[70924]:  {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 14:49:31 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:49:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1437543645',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1437543645',id=26,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a9e5c78c1684c359cfab4e32b9c213f',ramdisk_id='',reservation_id='r-jbuysvy6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2089253815',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:49:29Z,user_data=None,user_id='43582a8a85c54b5e9d16d11b12bf50d4',uuid=c31a724f-3006-4e5d-a9b5-847fd6cd170a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31895092-6af7-4934-895e-f8455642368c", "address": "fa:16:3e:09:8e:63", "network": {"id": "d5876e18-e2af-45c2-aab5-2d0d552ebfe4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2035085552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9e5c78c1684c359cfab4e32b9c213f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31895092-6a", "ovs_interfaceid": "31895092-6af7-4934-895e-f8455642368c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 14:49:31 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Converting VIF {"id": "31895092-6af7-4934-895e-f8455642368c", "address": "fa:16:3e:09:8e:63", "network": {"id": "d5876e18-e2af-45c2-aab5-2d0d552ebfe4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2035085552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9e5c78c1684c359cfab4e32b9c213f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31895092-6a", "ovs_interfaceid": "31895092-6af7-4934-895e-f8455642368c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:49:31 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:8e:63,bridge_name='br-int',has_traffic_filtering=True,id=31895092-6af7-4934-895e-f8455642368c,network=Network(d5876e18-e2af-45c2-aab5-2d0d552ebfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31895092-6a') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:49:31 user nova-compute[70924]: DEBUG os_vif [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:8e:63,bridge_name='br-int',has_traffic_filtering=True,id=31895092-6af7-4934-895e-f8455642368c,network=Network(d5876e18-e2af-45c2-aab5-2d0d552ebfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31895092-6a') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 14:49:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:49:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:49:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 14:49:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:49:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap31895092-6a, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:49:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap31895092-6a, col_values=(('external_ids', {'iface-id': '31895092-6af7-4934-895e-f8455642368c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:8e:63', 'vm-uuid': 'c31a724f-3006-4e5d-a9b5-847fd6cd170a'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:49:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:49:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:49:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:49:31 user nova-compute[70924]: INFO os_vif [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:8e:63,bridge_name='br-int',has_traffic_filtering=True,id=31895092-6af7-4934-895e-f8455642368c,network=Network(d5876e18-e2af-45c2-aab5-2d0d552ebfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31895092-6a')
Jul 29 14:49:31 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:49:31 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] No VIF found with MAC fa:16:3e:09:8e:63, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:49:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:49:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:49:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:49:31 user nova-compute[70924]: DEBUG nova.network.neutron [req-c4a785ec-f0ed-489d-b7d7-9743a5b0bd69 req-cc22b74f-3396-471c-ae2a-863e117a84f3 service nova] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] Updated VIF entry in instance network info cache for port 31895092-6af7-4934-895e-f8455642368c. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:49:31 user nova-compute[70924]: DEBUG nova.network.neutron [req-c4a785ec-f0ed-489d-b7d7-9743a5b0bd69 req-cc22b74f-3396-471c-ae2a-863e117a84f3 service nova] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] Updating instance_info_cache with network_info: [{"id": "31895092-6af7-4934-895e-f8455642368c", "address": "fa:16:3e:09:8e:63", "network": {"id": "d5876e18-e2af-45c2-aab5-2d0d552ebfe4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2035085552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9e5c78c1684c359cfab4e32b9c213f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31895092-6a", "ovs_interfaceid": "31895092-6af7-4934-895e-f8455642368c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:49:31 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c4a785ec-f0ed-489d-b7d7-9743a5b0bd69 req-cc22b74f-3396-471c-ae2a-863e117a84f3 service nova] Releasing lock "refresh_cache-c31a724f-3006-4e5d-a9b5-847fd6cd170a" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:49:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:49:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:49:32 user nova-compute[70924]: DEBUG nova.compute.manager [req-48dbfb1a-da8b-4f2a-b5f2-cd4d9f6b80ac req-fccc80ab-d66c-4156-9ab3-e25d789b67d4 service nova] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Received event network-vif-plugged-cb01658e-4dd9-426e-9b45-340ea19db056 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:49:32 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-48dbfb1a-da8b-4f2a-b5f2-cd4d9f6b80ac req-fccc80ab-d66c-4156-9ab3-e25d789b67d4 service nova] Acquiring lock "9ec07c62-951b-4e3a-bffa-e01dfb4665ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:49:32 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-48dbfb1a-da8b-4f2a-b5f2-cd4d9f6b80ac req-fccc80ab-d66c-4156-9ab3-e25d789b67d4 service nova] Lock "9ec07c62-951b-4e3a-bffa-e01dfb4665ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:49:32 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-48dbfb1a-da8b-4f2a-b5f2-cd4d9f6b80ac req-fccc80ab-d66c-4156-9ab3-e25d789b67d4 service nova] Lock "9ec07c62-951b-4e3a-bffa-e01dfb4665ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:49:32 user nova-compute[70924]: DEBUG nova.compute.manager [req-48dbfb1a-da8b-4f2a-b5f2-cd4d9f6b80ac req-fccc80ab-d66c-4156-9ab3-e25d789b67d4 service nova] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] No waiting events found dispatching network-vif-plugged-cb01658e-4dd9-426e-9b45-340ea19db056 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:49:32 user nova-compute[70924]: WARNING nova.compute.manager [req-48dbfb1a-da8b-4f2a-b5f2-cd4d9f6b80ac req-fccc80ab-d66c-4156-9ab3-e25d789b67d4 service nova] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Received unexpected event network-vif-plugged-cb01658e-4dd9-426e-9b45-340ea19db056 for instance with vm_state building and task_state spawning.
Jul 29 14:49:32 user nova-compute[70924]: DEBUG nova.compute.manager [req-48dbfb1a-da8b-4f2a-b5f2-cd4d9f6b80ac req-fccc80ab-d66c-4156-9ab3-e25d789b67d4 service nova] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Received event network-vif-plugged-1da26b57-ec30-415a-8a43-fe0e662667e1 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:49:32 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-48dbfb1a-da8b-4f2a-b5f2-cd4d9f6b80ac req-fccc80ab-d66c-4156-9ab3-e25d789b67d4 service nova] Acquiring lock "091e384f-7851-4ac9-b566-990df0497fc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:49:32 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-48dbfb1a-da8b-4f2a-b5f2-cd4d9f6b80ac req-fccc80ab-d66c-4156-9ab3-e25d789b67d4 service nova] Lock "091e384f-7851-4ac9-b566-990df0497fc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:49:32 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-48dbfb1a-da8b-4f2a-b5f2-cd4d9f6b80ac req-fccc80ab-d66c-4156-9ab3-e25d789b67d4 service nova] Lock "091e384f-7851-4ac9-b566-990df0497fc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:49:32 user nova-compute[70924]: DEBUG nova.compute.manager [req-48dbfb1a-da8b-4f2a-b5f2-cd4d9f6b80ac req-fccc80ab-d66c-4156-9ab3-e25d789b67d4 service nova] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] No waiting events found dispatching network-vif-plugged-1da26b57-ec30-415a-8a43-fe0e662667e1 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:49:32 user nova-compute[70924]: WARNING nova.compute.manager [req-48dbfb1a-da8b-4f2a-b5f2-cd4d9f6b80ac req-fccc80ab-d66c-4156-9ab3-e25d789b67d4 service nova] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Received unexpected event network-vif-plugged-1da26b57-ec30-415a-8a43-fe0e662667e1 for instance with vm_state building and task_state spawning.
Jul 29 14:49:32 user nova-compute[70924]: DEBUG nova.compute.manager [req-48dbfb1a-da8b-4f2a-b5f2-cd4d9f6b80ac req-fccc80ab-d66c-4156-9ab3-e25d789b67d4 service nova] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Received event network-vif-plugged-1da26b57-ec30-415a-8a43-fe0e662667e1 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:49:32 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-48dbfb1a-da8b-4f2a-b5f2-cd4d9f6b80ac req-fccc80ab-d66c-4156-9ab3-e25d789b67d4 service nova] Acquiring lock "091e384f-7851-4ac9-b566-990df0497fc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:49:32 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-48dbfb1a-da8b-4f2a-b5f2-cd4d9f6b80ac req-fccc80ab-d66c-4156-9ab3-e25d789b67d4 service nova] Lock "091e384f-7851-4ac9-b566-990df0497fc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:49:32 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-48dbfb1a-da8b-4f2a-b5f2-cd4d9f6b80ac req-fccc80ab-d66c-4156-9ab3-e25d789b67d4 service nova] Lock "091e384f-7851-4ac9-b566-990df0497fc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:49:32 user nova-compute[70924]: DEBUG nova.compute.manager [req-48dbfb1a-da8b-4f2a-b5f2-cd4d9f6b80ac req-fccc80ab-d66c-4156-9ab3-e25d789b67d4 service nova] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] No waiting events found dispatching network-vif-plugged-1da26b57-ec30-415a-8a43-fe0e662667e1 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:49:32 user nova-compute[70924]: WARNING nova.compute.manager [req-48dbfb1a-da8b-4f2a-b5f2-cd4d9f6b80ac req-fccc80ab-d66c-4156-9ab3-e25d789b67d4 service nova] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Received unexpected event network-vif-plugged-1da26b57-ec30-415a-8a43-fe0e662667e1 for instance with vm_state building and task_state spawning.
Jul 29 14:49:32 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:49:33 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:49:33 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:49:33 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:49:33 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:49:33 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:49:34 user nova-compute[70924]: DEBUG nova.compute.manager [req-2f72b4e8-558c-4eb7-acaa-589da58742f6 req-2bf912da-5d46-4f16-880a-a75150cdcfc4 service nova] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] Received event network-vif-plugged-31895092-6af7-4934-895e-f8455642368c {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:49:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-2f72b4e8-558c-4eb7-acaa-589da58742f6 req-2bf912da-5d46-4f16-880a-a75150cdcfc4 service nova] Acquiring lock "c31a724f-3006-4e5d-a9b5-847fd6cd170a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:49:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-2f72b4e8-558c-4eb7-acaa-589da58742f6 req-2bf912da-5d46-4f16-880a-a75150cdcfc4 service nova] Lock "c31a724f-3006-4e5d-a9b5-847fd6cd170a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:49:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-2f72b4e8-558c-4eb7-acaa-589da58742f6 req-2bf912da-5d46-4f16-880a-a75150cdcfc4 service nova] Lock "c31a724f-3006-4e5d-a9b5-847fd6cd170a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:49:34 user nova-compute[70924]: DEBUG nova.compute.manager [req-2f72b4e8-558c-4eb7-acaa-589da58742f6 req-2bf912da-5d46-4f16-880a-a75150cdcfc4 service nova] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] No waiting events found dispatching network-vif-plugged-31895092-6af7-4934-895e-f8455642368c {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:49:34 user nova-compute[70924]: WARNING nova.compute.manager [req-2f72b4e8-558c-4eb7-acaa-589da58742f6 req-2bf912da-5d46-4f16-880a-a75150cdcfc4 service nova] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] Received unexpected event network-vif-plugged-31895092-6af7-4934-895e-f8455642368c for instance with vm_state building and task_state spawning.
Jul 29 14:49:34 user nova-compute[70924]: DEBUG nova.compute.manager [req-2f72b4e8-558c-4eb7-acaa-589da58742f6 req-2bf912da-5d46-4f16-880a-a75150cdcfc4 service nova] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] Received event network-vif-plugged-31895092-6af7-4934-895e-f8455642368c {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:49:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-2f72b4e8-558c-4eb7-acaa-589da58742f6 req-2bf912da-5d46-4f16-880a-a75150cdcfc4 service nova] Acquiring lock "c31a724f-3006-4e5d-a9b5-847fd6cd170a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:49:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-2f72b4e8-558c-4eb7-acaa-589da58742f6 req-2bf912da-5d46-4f16-880a-a75150cdcfc4 service nova] Lock "c31a724f-3006-4e5d-a9b5-847fd6cd170a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:49:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-2f72b4e8-558c-4eb7-acaa-589da58742f6 req-2bf912da-5d46-4f16-880a-a75150cdcfc4 service nova] Lock "c31a724f-3006-4e5d-a9b5-847fd6cd170a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:49:34 user nova-compute[70924]: DEBUG nova.compute.manager [req-2f72b4e8-558c-4eb7-acaa-589da58742f6 req-2bf912da-5d46-4f16-880a-a75150cdcfc4 service nova] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] No waiting events found dispatching network-vif-plugged-31895092-6af7-4934-895e-f8455642368c {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:49:34 user nova-compute[70924]: WARNING nova.compute.manager [req-2f72b4e8-558c-4eb7-acaa-589da58742f6 req-2bf912da-5d46-4f16-880a-a75150cdcfc4 service nova] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] Received unexpected event network-vif-plugged-31895092-6af7-4934-895e-f8455642368c for instance with vm_state building and task_state spawning.
Jul 29 14:49:34 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642174.6526463, 9ec07c62-951b-4e3a-bffa-e01dfb4665ec => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:49:34 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] VM Resumed (Lifecycle Event)
Jul 29 14:49:34 user nova-compute[70924]: DEBUG nova.compute.manager [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Instance event wait completed in 0 seconds for  {{(pid=70924) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 14:49:34 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Guest created on hypervisor {{(pid=70924) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 14:49:34 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:49:34 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Instance spawned successfully.
Jul 29 14:49:34 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 14:49:34 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:49:34 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Found default for hw_cdrom_bus of ide {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:49:34 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Found default for hw_disk_bus of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:49:34 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Found default for hw_input_bus of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:49:34 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Found default for hw_pointer_model of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:49:34 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Found default for hw_video_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:49:34 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Found default for hw_vif_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:49:34 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:49:34 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642174.6614187, 9ec07c62-951b-4e3a-bffa-e01dfb4665ec => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:49:34 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] VM Started (Lifecycle Event)
Jul 29 14:49:34 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:49:34 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:49:34 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:49:34 user nova-compute[70924]: INFO nova.compute.manager [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Took 8.94 seconds to spawn the instance on the hypervisor.
Jul 29 14:49:34 user nova-compute[70924]: DEBUG nova.compute.manager [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:49:34 user nova-compute[70924]: INFO nova.compute.manager [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Took 9.81 seconds to build instance.
Jul 29 14:49:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a7ae6ff8-f53f-43c0-bd18-85f247affa38 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "9ec07c62-951b-4e3a-bffa-e01dfb4665ec" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.911s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:49:35 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642175.0195982, 091e384f-7851-4ac9-b566-990df0497fc5 => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:49:35 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] VM Resumed (Lifecycle Event)
Jul 29 14:49:35 user nova-compute[70924]: DEBUG nova.compute.manager [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Instance event wait completed in 0 seconds for  {{(pid=70924) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 14:49:35 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Guest created on hypervisor {{(pid=70924) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 14:49:35 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Instance spawned successfully.
Jul 29 14:49:35 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 14:49:35 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:49:35 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:49:35 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Found default for hw_cdrom_bus of ide {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:49:35 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Found default for hw_disk_bus of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:49:35 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Found default for hw_input_bus of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:49:35 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Found default for hw_pointer_model of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:49:35 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Found default for hw_video_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:49:35 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Found default for hw_vif_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:49:35 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:49:35 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642175.0204685, 091e384f-7851-4ac9-b566-990df0497fc5 => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:49:35 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] VM Started (Lifecycle Event)
Jul 29 14:49:35 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:49:35 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:49:35 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:49:35 user nova-compute[70924]: INFO nova.compute.manager [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Took 8.28 seconds to spawn the instance on the hypervisor.
Jul 29 14:49:35 user nova-compute[70924]: DEBUG nova.compute.manager [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:49:35 user nova-compute[70924]: INFO nova.compute.manager [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Took 9.46 seconds to build instance.
Jul 29 14:49:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1e165e48-48b4-48cf-bef6-1fc88e7a5bcd tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "091e384f-7851-4ac9-b566-990df0497fc5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.574s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:49:35 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:49:35 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642175.455058, c31a724f-3006-4e5d-a9b5-847fd6cd170a => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:49:35 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] VM Resumed (Lifecycle Event)
Jul 29 14:49:35 user nova-compute[70924]: DEBUG nova.compute.manager [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] Instance event wait completed in 0 seconds for  {{(pid=70924) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 14:49:35 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] Guest created on hypervisor {{(pid=70924) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 14:49:35 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] Instance spawned successfully.
Jul 29 14:49:35 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 14:49:35 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:49:35 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:49:35 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] Found default for hw_cdrom_bus of ide {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:49:35 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] Found default for hw_disk_bus of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:49:35 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] Found default for hw_input_bus of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:49:35 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] Found default for hw_pointer_model of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:49:35 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] Found default for hw_video_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:49:35 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] Found default for hw_vif_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:49:35 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:49:35 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642175.4582672, c31a724f-3006-4e5d-a9b5-847fd6cd170a => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:49:35 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] VM Started (Lifecycle Event)
Jul 29 14:49:35 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:49:35 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:49:35 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:49:35 user nova-compute[70924]: INFO nova.compute.manager [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] Took 6.86 seconds to spawn the instance on the hypervisor.
Jul 29 14:49:35 user nova-compute[70924]: DEBUG nova.compute.manager [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:49:35 user nova-compute[70924]: INFO nova.compute.manager [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] Took 7.93 seconds to build instance.
Jul 29 14:49:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-585c60f0-363e-4bf9-b962-e3a3c156225f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "c31a724f-3006-4e5d-a9b5-847fd6cd170a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.052s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:49:36 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:49:38 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:49:40 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:49:41 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:49:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:49:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:49:46 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:49:47 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:49:47 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:49:47 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:49:47 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:49:47 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Auditing locally available compute resources for user (node: user) {{(pid=70924) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 14:49:47 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:47 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:49:47 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:49:48 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 14:49:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c31a724f-3006-4e5d-a9b5-847fd6cd170a/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:48 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-dab74330-6abf-4478-8bcf-51fbd4c8cb25 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Acquiring lock "1f7989ca-77e9-440f-bd2f-60e46e005557" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:49:48 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-dab74330-6abf-4478-8bcf-51fbd4c8cb25 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lock "1f7989ca-77e9-440f-bd2f-60e46e005557" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:49:48 user nova-compute[70924]: INFO nova.compute.manager [None req-dab74330-6abf-4478-8bcf-51fbd4c8cb25 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Detaching volume 380ac2a7-5deb-4ee1-ac58-5720bf5b917f
Jul 29 14:49:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c31a724f-3006-4e5d-a9b5-847fd6cd170a/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:49:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c31a724f-3006-4e5d-a9b5-847fd6cd170a/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:48 user nova-compute[70924]: INFO nova.virt.block_device [None req-dab74330-6abf-4478-8bcf-51fbd4c8cb25 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Attempting to driver detach volume 380ac2a7-5deb-4ee1-ac58-5720bf5b917f from mountpoint /dev/vdb
Jul 29 14:49:48 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-dab74330-6abf-4478-8bcf-51fbd4c8cb25 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Attempting to detach device vdb from instance 1f7989ca-77e9-440f-bd2f-60e46e005557 from the persistent domain config. {{(pid=70924) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 29 14:49:48 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-dab74330-6abf-4478-8bcf-51fbd4c8cb25 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 14:49:48 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:49:48 user nova-compute[70924]:   <source dev="/dev/sdc"/>
Jul 29 14:49:48 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 14:49:48 user nova-compute[70924]:   <serial>380ac2a7-5deb-4ee1-ac58-5720bf5b917f</serial>
Jul 29 14:49:48 user nova-compute[70924]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 14:49:48 user nova-compute[70924]: </disk>
Jul 29 14:49:48 user nova-compute[70924]:  {{(pid=70924) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 14:49:48 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-dab74330-6abf-4478-8bcf-51fbd4c8cb25 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Successfully detached device vdb from instance 1f7989ca-77e9-440f-bd2f-60e46e005557 from the persistent domain config.
Jul 29 14:49:48 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-dab74330-6abf-4478-8bcf-51fbd4c8cb25 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1f7989ca-77e9-440f-bd2f-60e46e005557 from the live domain config. {{(pid=70924) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 29 14:49:48 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-dab74330-6abf-4478-8bcf-51fbd4c8cb25 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 14:49:48 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:49:48 user nova-compute[70924]:   <source dev="/dev/sdc"/>
Jul 29 14:49:48 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 14:49:48 user nova-compute[70924]:   <serial>380ac2a7-5deb-4ee1-ac58-5720bf5b917f</serial>
Jul 29 14:49:48 user nova-compute[70924]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 14:49:48 user nova-compute[70924]: </disk>
Jul 29 14:49:48 user nova-compute[70924]:  {{(pid=70924) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 14:49:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c31a724f-3006-4e5d-a9b5-847fd6cd170a/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:49:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:49:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:49:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:49:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d47810-5115-41fd-a4be-86aa2f716c79/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d47810-5115-41fd-a4be-86aa2f716c79/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:49:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d47810-5115-41fd-a4be-86aa2f716c79/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:49 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Received event <DeviceRemovedEvent: 1690642189.0174456, 1f7989ca-77e9-440f-bd2f-60e46e005557 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70924) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 29 14:49:49 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-dab74330-6abf-4478-8bcf-51fbd4c8cb25 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1f7989ca-77e9-440f-bd2f-60e46e005557 {{(pid=70924) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 29 14:49:49 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-dab74330-6abf-4478-8bcf-51fbd4c8cb25 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Successfully detached device vdb from instance 1f7989ca-77e9-440f-bd2f-60e46e005557 from the live domain config.
Jul 29 14:49:49 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dab74330-6abf-4478-8bcf-51fbd4c8cb25 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] calling os-brick to detach iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 14:49:49 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-dab74330-6abf-4478-8bcf-51fbd4c8cb25 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, {'target_iqns': ['iqn.2010-10.org.openstack:380ac2a7-5deb-4ee1-ac58-5720bf5b917f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jtVpKCxr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:49:49 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-dab74330-6abf-4478-8bcf-51fbd4c8cb25 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:49:49 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-dab74330-6abf-4478-8bcf-51fbd4c8cb25 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:49:49 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-dab74330-6abf-4478-8bcf-51fbd4c8cb25 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:49:49 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-dab74330-6abf-4478-8bcf-51fbd4c8cb25 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:380ac2a7-5deb-4ee1-ac58-5720bf5b917f', 0)] {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 14:49:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:49:49 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96af325-8daf-4437-a83d-9273add3554d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:380ac2a7-5deb-4ee1-ac58-5720bf5b917f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:49:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:49:49 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb733bcc-b291-4ca9-af2e-d6ed7dfd7a82]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:380ac2a7-5deb-4ee1-ac58-5720bf5b917f (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:49:49 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-dab74330-6abf-4478-8bcf-51fbd4c8cb25 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:49:49 user nova-compute[70924]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:380ac2a7-5deb-4ee1-ac58-5720bf5b917f (non-flash)
Jul 29 14:49:49 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:49:49 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-dab74330-6abf-4478-8bcf-51fbd4c8cb25 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:49:49 user nova-compute[70924]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:380ac2a7-5deb-4ee1-ac58-5720bf5b917f (non-flash)
Jul 29 14:49:49 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:49:49 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-dab74330-6abf-4478-8bcf-51fbd4c8cb25 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feedc57d510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:380ac2a7-5deb-4ee1-ac58-5720bf5b917f'): ({'sdc'}, set())}) {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 14:49:49 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-dab74330-6abf-4478-8bcf-51fbd4c8cb25 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Removing single pathed devices sdc {{(pid=70924) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 14:49:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d47810-5115-41fd-a4be-86aa2f716c79/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:49:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f7989ca-77e9-440f-bd2f-60e46e005557/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:49:49 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9517c1a3-8b3d-4d9a-b150-b3c3c6a9d421]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:49:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:49:49 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[03211d20-3280-4330-a530-b1f538b32b64]: (4, ('ok\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:49:49 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-dab74330-6abf-4478-8bcf-51fbd4c8cb25 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Flushing IO for device /dev/sdc {{(pid=70924) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 14:49:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:49:49 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2eba2d-c958-479c-b815-19d55a41fef7]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:49:49 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-dab74330-6abf-4478-8bcf-51fbd4c8cb25 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70924) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 14:49:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.057s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:49:49 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50931ca-bd4e-4b78-b810-a3532115911b]: (4, ('1', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:49:49 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-dab74330-6abf-4478-8bcf-51fbd4c8cb25 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 14:49:49 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-dab74330-6abf-4478-8bcf-51fbd4c8cb25 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] SCSI volumes sdc have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 14:49:49 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-dab74330-6abf-4478-8bcf-51fbd4c8cb25 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:380ac2a7-5deb-4ee1-ac58-5720bf5b917f')] {{(pid=70924) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 14:49:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:380ac2a7-5deb-4ee1-ac58-5720bf5b917f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f7989ca-77e9-440f-bd2f-60e46e005557/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:49:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f7989ca-77e9-440f-bd2f-60e46e005557/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:380ac2a7-5deb-4ee1-ac58-5720bf5b917f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:49:49 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[186d2da9-3dcb-4dd0-8f09-238e39b5e13a]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:49:49 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-dab74330-6abf-4478-8bcf-51fbd4c8cb25 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:49:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:380ac2a7-5deb-4ee1-ac58-5720bf5b917f -p 172.16.0.220:3260 --logout {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:380ac2a7-5deb-4ee1-ac58-5720bf5b917f -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:49:49 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67c79c9-56e0-4afd-81ae-c73761d9f083]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:380ac2a7-5deb-4ee1-ac58-5720bf5b917f, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:380ac2a7-5deb-4ee1-ac58-5720bf5b917f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:49:49 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-dab74330-6abf-4478-8bcf-51fbd4c8cb25 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:380ac2a7-5deb-4ee1-ac58-5720bf5b917f, portal: 172.16.0.220,3260]
Jul 29 14:49:49 user nova-compute[70924]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:380ac2a7-5deb-4ee1-ac58-5720bf5b917f, portal: 172.16.0.220,3260] successful.
Jul 29 14:49:49 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:49:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:380ac2a7-5deb-4ee1-ac58-5720bf5b917f -p 172.16.0.220:3260 --op delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:380ac2a7-5deb-4ee1-ac58-5720bf5b917f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:49:49 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[66311a34-1be0-4e3d-8cb4-f265e88a2f46]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:49:49 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-dab74330-6abf-4478-8bcf-51fbd4c8cb25 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:49:49 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-dab74330-6abf-4478-8bcf-51fbd4c8cb25 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.389s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:49:49 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-dab74330-6abf-4478-8bcf-51fbd4c8cb25 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] <== disconnect_volume: return (391ms) None {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:49:49 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dab74330-6abf-4478-8bcf-51fbd4c8cb25 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Disconnected iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 14:49:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f7989ca-77e9-440f-bd2f-60e46e005557/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:49:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7171083a-00aa-4faf-9732-88cab8a0d83d/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7171083a-00aa-4faf-9732-88cab8a0d83d/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:49:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7171083a-00aa-4faf-9732-88cab8a0d83d/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7171083a-00aa-4faf-9732-88cab8a0d83d/disk --force-share --output=json" returned: 0 in 0.326s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:49:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdaf1714-27f9-47ee-808b-206ec78c6067/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdaf1714-27f9-47ee-808b-206ec78c6067/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:49:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdaf1714-27f9-47ee-808b-206ec78c6067/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdaf1714-27f9-47ee-808b-206ec78c6067/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:49:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cb12b3e-de44-4887-ab74-2a68164b5f7d/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cb12b3e-de44-4887-ab74-2a68164b5f7d/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:49:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cb12b3e-de44-4887-ab74-2a68164b5f7d/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cb12b3e-de44-4887-ab74-2a68164b5f7d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:49:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:49:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:49:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:49:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:51 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:49:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:49:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:49:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:51 user nova-compute[70924]: DEBUG nova.objects.instance [None req-dab74330-6abf-4478-8bcf-51fbd4c8cb25 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lazy-loading 'flavor' on Instance uuid 1f7989ca-77e9-440f-bd2f-60e46e005557 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:49:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:49:51 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-dab74330-6abf-4478-8bcf-51fbd4c8cb25 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lock "1f7989ca-77e9-440f-bd2f-60e46e005557" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.535s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:49:52 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:49:52 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:49:52 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Hypervisor/Node resource view: name=user free_ram=7094MB free_disk=25.45388412475586GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70924) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 14:49:52 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:49:52 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:49:52 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance db656346-c4af-43da-9600-fd39f1b9e4dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:49:52 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 86ecc6cb-88a8-4572-8e41-d4c5859036a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:49:52 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 02c75b00-a1b4-4ef9-ae96-bc67d8038589 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:49:52 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance f5350fb5-9460-490b-a47e-74f88c8eb51c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:49:52 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 1f7989ca-77e9-440f-bd2f-60e46e005557 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:49:52 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 7cb12b3e-de44-4887-ab74-2a68164b5f7d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:49:52 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 7171083a-00aa-4faf-9732-88cab8a0d83d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:49:52 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance bdaf1714-27f9-47ee-808b-206ec78c6067 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:49:52 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance a8d47810-5115-41fd-a4be-86aa2f716c79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:49:52 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 9ec07c62-951b-4e3a-bffa-e01dfb4665ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:49:52 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 091e384f-7851-4ac9-b566-990df0497fc5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:49:52 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance c31a724f-3006-4e5d-a9b5-847fd6cd170a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:49:52 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 14:49:52 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 14:49:52 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:49:52 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:49:52 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Compute_service record updated for user:user {{(pid=70924) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 14:49:52 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.682s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:49:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Acquiring lock "fd91d5fc-857d-4d63-ad83-8028c1d3309f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:49:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Lock "fd91d5fc-857d-4d63-ad83-8028c1d3309f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:49:53 user nova-compute[70924]: DEBUG nova.compute.manager [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Starting instance... {{(pid=70924) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 14:49:53 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:49:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:49:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:49:53 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70924) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 14:49:53 user nova-compute[70924]: INFO nova.compute.claims [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Claim successful on node user
Jul 29 14:49:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Acquiring lock "fd57baf8-6306-4553-a058-e915fb543405" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:49:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "fd57baf8-6306-4553-a058-e915fb543405" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:49:53 user nova-compute[70924]: DEBUG nova.compute.manager [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] Starting instance... {{(pid=70924) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 14:49:54 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:49:54 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:49:54 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:49:54 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.529s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:49:54 user nova-compute[70924]: DEBUG nova.compute.manager [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Start building networks asynchronously for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 14:49:54 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.025s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:49:54 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70924) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 14:49:54 user nova-compute[70924]: INFO nova.compute.claims [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] Claim successful on node user
Jul 29 14:49:54 user nova-compute[70924]: DEBUG nova.compute.manager [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Allocating IP information in the background. {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 14:49:54 user nova-compute[70924]: DEBUG nova.network.neutron [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] allocate_for_instance() {{(pid=70924) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 14:49:54 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 14:49:54 user nova-compute[70924]: DEBUG nova.compute.manager [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Start building block device mappings for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 14:49:54 user nova-compute[70924]: INFO nova.virt.block_device [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Booting with volume 229cbfa1-ea7a-4400-b9c6-9df461306495 at /dev/vda
Jul 29 14:49:54 user nova-compute[70924]: DEBUG nova.policy [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '53f2f7de42a74fb997661c7d579f508d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85e92f662b024b8a86d5fd646f169169', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70924) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 14:49:54 user nova-compute[70924]: DEBUG os_brick.utils [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:49:54 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:54 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:49:54 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2156130b-4f2f-4d54-ae93-ca553e6d6314]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f2127c4a30d9\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:49:54 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:54 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:49:54 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc060977-2bec-4f3b-a445-c7eaeed6b4d6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:49:54 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:54 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:49:54 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2518a48-00fe-4581-8593-4aac9edbca42]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:49:54 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a256195-ea4a-41ef-9842-4acb291a759a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:49:54 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Running cmd (subprocess): nvme version {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:54 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] 'nvme version' failed. Not Retrying. {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:49:54 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] nvme not present on system {{(pid=70924) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 14:49:54 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:54 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:49:54 user nova-compute[70924]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 14:49:54 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a34e80-164b-42df-bed1-9a1b476e4ed6]: (4, '') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:49:54 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70924) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 14:49:54 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 14:49:54 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] LIGHTOS: no hostnqn found. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 14:49:54 user nova-compute[70924]: DEBUG os_brick.utils [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f2127c4a30d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:49:54 user nova-compute[70924]: DEBUG nova.virt.block_device [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Updating existing volume attachment record: 3bc423ba-0b1e-41d8-928d-94ce09c93e33 {{(pid=70924) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 14:49:54 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:49:54 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:49:54 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.553s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:49:54 user nova-compute[70924]: DEBUG nova.compute.manager [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] Start building networks asynchronously for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 14:49:54 user nova-compute[70924]: DEBUG nova.compute.manager [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] Allocating IP information in the background. {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 14:49:54 user nova-compute[70924]: DEBUG nova.network.neutron [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] allocate_for_instance() {{(pid=70924) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 14:49:54 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 14:49:54 user nova-compute[70924]: DEBUG nova.compute.manager [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] Start building block device mappings for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 14:49:54 user nova-compute[70924]: INFO nova.virt.block_device [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] Booting with volume 60c129c4-a916-49f7-86b6-ff1a2339a464 at /dev/vda
Jul 29 14:49:54 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:49:54 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:49:54 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Starting heal instance info cache {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 14:49:54 user nova-compute[70924]: DEBUG os_brick.utils [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:49:54 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:49:55 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c66df9-f638-4f7e-9afc-203f379ea201]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f2127c4a30d9\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:49:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:49:55 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[3621deb9-7eaa-435b-aa27-b3dd356c6316]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:49:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "refresh_cache-86ecc6cb-88a8-4572-8e41-d4c5859036a6" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:49:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquired lock "refresh_cache-86ecc6cb-88a8-4572-8e41-d4c5859036a6" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:49:55 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Forcefully refreshing network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 29 14:49:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:49:55 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea0fa4b-59f7-4a6c-9f29-7a7ec78ca20e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:49:55 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e759e98c-3cc9-4235-9d21-17aed7fb82ad]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:49:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Running cmd (subprocess): nvme version {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] 'nvme version' failed. Not Retrying. {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:49:55 user nova-compute[70924]: DEBUG nova.network.neutron [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Successfully created port: a9e045fe-1480-4254-ad3d-ce7a12c1b293 {{(pid=70924) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 14:49:55 user nova-compute[70924]: DEBUG nova.policy [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '55b9032bef2d4d3586dc5d18cdc1ee55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33d01ba458f466b99b6bc5bba88d8c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70924) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 14:49:55 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] nvme not present on system {{(pid=70924) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 14:49:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:49:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:49:55 user nova-compute[70924]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 14:49:55 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5717304-ef50-4e76-8a6c-5e0228da150f]: (4, '') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:49:55 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70924) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 14:49:55 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 14:49:55 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] LIGHTOS: no hostnqn found. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 14:49:55 user nova-compute[70924]: DEBUG os_brick.utils [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f2127c4a30d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:49:55 user nova-compute[70924]: DEBUG nova.virt.block_device [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] Updating existing volume attachment record: 066cbbf9-640c-4573-9442-ccf028b1913a {{(pid=70924) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 14:49:55 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Updating instance_info_cache with network_info: [{"id": "4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3", "address": "fa:16:3e:d6:b6:d3", "network": {"id": "55c18d07-a341-4678-9d1c-2dff057a9b1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1092921088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b33d01ba458f466b99b6bc5bba88d8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cd05bcc-ca", "ovs_interfaceid": "4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:49:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Releasing lock "refresh_cache-86ecc6cb-88a8-4572-8e41-d4c5859036a6" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:49:55 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Updated the network info_cache for instance {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 29 14:49:55 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:49:55 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:49:55 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:49:55 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:49:55 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:49:55 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:49:55 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70924) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 14:49:56 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:49:56 user nova-compute[70924]: DEBUG nova.network.neutron [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] Successfully created port: c8f2eadb-705f-4b8b-9f67-c5280cf1f025 {{(pid=70924) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 14:49:56 user nova-compute[70924]: DEBUG nova.network.neutron [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Successfully updated port: a9e045fe-1480-4254-ad3d-ce7a12c1b293 {{(pid=70924) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 14:49:56 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Acquiring lock "refresh_cache-fd91d5fc-857d-4d63-ad83-8028c1d3309f" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:49:56 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Acquired lock "refresh_cache-fd91d5fc-857d-4d63-ad83-8028c1d3309f" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:49:56 user nova-compute[70924]: DEBUG nova.network.neutron [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 14:49:56 user nova-compute[70924]: DEBUG nova.compute.manager [req-de16d29b-1ab9-4142-9dae-c153b41d4e21 req-d6495b97-18a1-49af-9edd-fb7941bc9e43 service nova] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Received event network-changed-a9e045fe-1480-4254-ad3d-ce7a12c1b293 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:49:56 user nova-compute[70924]: DEBUG nova.compute.manager [req-de16d29b-1ab9-4142-9dae-c153b41d4e21 req-d6495b97-18a1-49af-9edd-fb7941bc9e43 service nova] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Refreshing instance network info cache due to event network-changed-a9e045fe-1480-4254-ad3d-ce7a12c1b293. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:49:56 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-de16d29b-1ab9-4142-9dae-c153b41d4e21 req-d6495b97-18a1-49af-9edd-fb7941bc9e43 service nova] Acquiring lock "refresh_cache-fd91d5fc-857d-4d63-ad83-8028c1d3309f" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:49:57 user nova-compute[70924]: DEBUG nova.network.neutron [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Instance cache missing network info. {{(pid=70924) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 14:49:57 user nova-compute[70924]: DEBUG nova.network.neutron [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Updating instance_info_cache with network_info: [{"id": "a9e045fe-1480-4254-ad3d-ce7a12c1b293", "address": "fa:16:3e:a4:a5:1c", "network": {"id": "fe4e60fb-1489-4a58-989a-1d81e33eddbc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1273087888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85e92f662b024b8a86d5fd646f169169", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9e045fe-14", "ovs_interfaceid": "a9e045fe-1480-4254-ad3d-ce7a12c1b293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:49:57 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Releasing lock "refresh_cache-fd91d5fc-857d-4d63-ad83-8028c1d3309f" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:49:57 user nova-compute[70924]: DEBUG nova.compute.manager [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Instance network_info: |[{"id": "a9e045fe-1480-4254-ad3d-ce7a12c1b293", "address": "fa:16:3e:a4:a5:1c", "network": {"id": "fe4e60fb-1489-4a58-989a-1d81e33eddbc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1273087888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85e92f662b024b8a86d5fd646f169169", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9e045fe-14", "ovs_interfaceid": "a9e045fe-1480-4254-ad3d-ce7a12c1b293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 14:49:57 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-de16d29b-1ab9-4142-9dae-c153b41d4e21 req-d6495b97-18a1-49af-9edd-fb7941bc9e43 service nova] Acquired lock "refresh_cache-fd91d5fc-857d-4d63-ad83-8028c1d3309f" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:49:57 user nova-compute[70924]: DEBUG nova.network.neutron [req-de16d29b-1ab9-4142-9dae-c153b41d4e21 req-d6495b97-18a1-49af-9edd-fb7941bc9e43 service nova] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Refreshing network info cache for port a9e045fe-1480-4254-ad3d-ce7a12c1b293 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:49:58 user nova-compute[70924]: DEBUG nova.network.neutron [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] Successfully updated port: c8f2eadb-705f-4b8b-9f67-c5280cf1f025 {{(pid=70924) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 14:49:58 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Acquiring lock "refresh_cache-fd57baf8-6306-4553-a058-e915fb543405" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:49:58 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Acquired lock "refresh_cache-fd57baf8-6306-4553-a058-e915fb543405" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:49:58 user nova-compute[70924]: DEBUG nova.network.neutron [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 14:49:58 user nova-compute[70924]: DEBUG nova.network.neutron [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] Instance cache missing network info. {{(pid=70924) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 14:49:58 user nova-compute[70924]: DEBUG nova.network.neutron [req-de16d29b-1ab9-4142-9dae-c153b41d4e21 req-d6495b97-18a1-49af-9edd-fb7941bc9e43 service nova] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Updated VIF entry in instance network info cache for port a9e045fe-1480-4254-ad3d-ce7a12c1b293. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:49:58 user nova-compute[70924]: DEBUG nova.network.neutron [req-de16d29b-1ab9-4142-9dae-c153b41d4e21 req-d6495b97-18a1-49af-9edd-fb7941bc9e43 service nova] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Updating instance_info_cache with network_info: [{"id": "a9e045fe-1480-4254-ad3d-ce7a12c1b293", "address": "fa:16:3e:a4:a5:1c", "network": {"id": "fe4e60fb-1489-4a58-989a-1d81e33eddbc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1273087888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85e92f662b024b8a86d5fd646f169169", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9e045fe-14", "ovs_interfaceid": "a9e045fe-1480-4254-ad3d-ce7a12c1b293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:49:58 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-de16d29b-1ab9-4142-9dae-c153b41d4e21 req-d6495b97-18a1-49af-9edd-fb7941bc9e43 service nova] Releasing lock "refresh_cache-fd91d5fc-857d-4d63-ad83-8028c1d3309f" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:49:58 user nova-compute[70924]: DEBUG nova.network.neutron [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] Updating instance_info_cache with network_info: [{"id": "c8f2eadb-705f-4b8b-9f67-c5280cf1f025", "address": "fa:16:3e:15:d2:44", "network": {"id": "55c18d07-a341-4678-9d1c-2dff057a9b1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1092921088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b33d01ba458f466b99b6bc5bba88d8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8f2eadb-70", "ovs_interfaceid": "c8f2eadb-705f-4b8b-9f67-c5280cf1f025", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:49:58 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:49:58 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Releasing lock "refresh_cache-fd57baf8-6306-4553-a058-e915fb543405" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:49:58 user nova-compute[70924]: DEBUG nova.compute.manager [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] Instance network_info: |[{"id": "c8f2eadb-705f-4b8b-9f67-c5280cf1f025", "address": "fa:16:3e:15:d2:44", "network": {"id": "55c18d07-a341-4678-9d1c-2dff057a9b1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1092921088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b33d01ba458f466b99b6bc5bba88d8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8f2eadb-70", "ovs_interfaceid": "c8f2eadb-705f-4b8b-9f67-c5280cf1f025", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 14:49:58 user nova-compute[70924]: DEBUG nova.compute.manager [req-1b0dc240-7e75-49f0-af9a-338f8daff247 req-bf83f7ed-5b60-411b-a299-fa0dfec7ba64 service nova] [instance: fd57baf8-6306-4553-a058-e915fb543405] Received event network-changed-c8f2eadb-705f-4b8b-9f67-c5280cf1f025 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:49:58 user nova-compute[70924]: DEBUG nova.compute.manager [req-1b0dc240-7e75-49f0-af9a-338f8daff247 req-bf83f7ed-5b60-411b-a299-fa0dfec7ba64 service nova] [instance: fd57baf8-6306-4553-a058-e915fb543405] Refreshing instance network info cache due to event network-changed-c8f2eadb-705f-4b8b-9f67-c5280cf1f025. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:49:58 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-1b0dc240-7e75-49f0-af9a-338f8daff247 req-bf83f7ed-5b60-411b-a299-fa0dfec7ba64 service nova] Acquiring lock "refresh_cache-fd57baf8-6306-4553-a058-e915fb543405" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:49:58 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-1b0dc240-7e75-49f0-af9a-338f8daff247 req-bf83f7ed-5b60-411b-a299-fa0dfec7ba64 service nova] Acquired lock "refresh_cache-fd57baf8-6306-4553-a058-e915fb543405" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:49:58 user nova-compute[70924]: DEBUG nova.network.neutron [req-1b0dc240-7e75-49f0-af9a-338f8daff247 req-bf83f7ed-5b60-411b-a299-fa0dfec7ba64 service nova] [instance: fd57baf8-6306-4553-a058-e915fb543405] Refreshing network info cache for port c8f2eadb-705f-4b8b-9f67-c5280cf1f025 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:49:59 user nova-compute[70924]: DEBUG nova.network.neutron [req-1b0dc240-7e75-49f0-af9a-338f8daff247 req-bf83f7ed-5b60-411b-a299-fa0dfec7ba64 service nova] [instance: fd57baf8-6306-4553-a058-e915fb543405] Updated VIF entry in instance network info cache for port c8f2eadb-705f-4b8b-9f67-c5280cf1f025. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:49:59 user nova-compute[70924]: DEBUG nova.network.neutron [req-1b0dc240-7e75-49f0-af9a-338f8daff247 req-bf83f7ed-5b60-411b-a299-fa0dfec7ba64 service nova] [instance: fd57baf8-6306-4553-a058-e915fb543405] Updating instance_info_cache with network_info: [{"id": "c8f2eadb-705f-4b8b-9f67-c5280cf1f025", "address": "fa:16:3e:15:d2:44", "network": {"id": "55c18d07-a341-4678-9d1c-2dff057a9b1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1092921088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b33d01ba458f466b99b6bc5bba88d8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8f2eadb-70", "ovs_interfaceid": "c8f2eadb-705f-4b8b-9f67-c5280cf1f025", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:49:59 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-1b0dc240-7e75-49f0-af9a-338f8daff247 req-bf83f7ed-5b60-411b-a299-fa0dfec7ba64 service nova] Releasing lock "refresh_cache-fd57baf8-6306-4553-a058-e915fb543405" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:50:01 user nova-compute[70924]: DEBUG nova.compute.manager [req-b9f2ba93-9d4b-4aac-8d53-5838c41466da req-5c80ebdb-10f3-4f18-8e85-ada30180fb06 service nova] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Received event network-changed-e41d642f-f559-4294-b5ff-5ec478fb3438 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:50:01 user nova-compute[70924]: DEBUG nova.compute.manager [req-b9f2ba93-9d4b-4aac-8d53-5838c41466da req-5c80ebdb-10f3-4f18-8e85-ada30180fb06 service nova] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Refreshing instance network info cache due to event network-changed-e41d642f-f559-4294-b5ff-5ec478fb3438. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:50:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b9f2ba93-9d4b-4aac-8d53-5838c41466da req-5c80ebdb-10f3-4f18-8e85-ada30180fb06 service nova] Acquiring lock "refresh_cache-7cb12b3e-de44-4887-ab74-2a68164b5f7d" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:50:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b9f2ba93-9d4b-4aac-8d53-5838c41466da req-5c80ebdb-10f3-4f18-8e85-ada30180fb06 service nova] Acquired lock "refresh_cache-7cb12b3e-de44-4887-ab74-2a68164b5f7d" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:50:01 user nova-compute[70924]: DEBUG nova.network.neutron [req-b9f2ba93-9d4b-4aac-8d53-5838c41466da req-5c80ebdb-10f3-4f18-8e85-ada30180fb06 service nova] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Refreshing network info cache for port e41d642f-f559-4294-b5ff-5ec478fb3438 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:50:01 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:01 user nova-compute[70924]: DEBUG nova.network.neutron [req-b9f2ba93-9d4b-4aac-8d53-5838c41466da req-5c80ebdb-10f3-4f18-8e85-ada30180fb06 service nova] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Updated VIF entry in instance network info cache for port e41d642f-f559-4294-b5ff-5ec478fb3438. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:50:01 user nova-compute[70924]: DEBUG nova.network.neutron [req-b9f2ba93-9d4b-4aac-8d53-5838c41466da req-5c80ebdb-10f3-4f18-8e85-ada30180fb06 service nova] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Updating instance_info_cache with network_info: [{"id": "e41d642f-f559-4294-b5ff-5ec478fb3438", "address": "fa:16:3e:f7:ee:73", "network": {"id": "46d2cfde-13db-4cf3-af0e-4d6742f37044", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1642265305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0388bcf487e492082e85b183f38765c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape41d642f-f5", "ovs_interfaceid": "e41d642f-f559-4294-b5ff-5ec478fb3438", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:50:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b9f2ba93-9d4b-4aac-8d53-5838c41466da req-5c80ebdb-10f3-4f18-8e85-ada30180fb06 service nova] Releasing lock "refresh_cache-7cb12b3e-de44-4887-ab74-2a68164b5f7d" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG nova.compute.manager [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Start spawning the instance on the hypervisor. {{(pid=70924) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Creating instance directory {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 14:50:02 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Creating image(s)
Jul 29 14:50:02 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Did not create local disks {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Ensure instance console log exists: /opt/stack/data/nova/instances/fd91d5fc-857d-4d63-ad83-8028c1d3309f/console.log {{(pid=70924) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Start _get_guest_xml network_info=[{"id": "a9e045fe-1480-4254-ad3d-ce7a12c1b293", "address": "fa:16:3e:a4:a5:1c", "network": {"id": "fe4e60fb-1489-4a58-989a-1d81e33eddbc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1273087888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85e92f662b024b8a86d5fd646f169169", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9e045fe-14", "ovs_interfaceid": "a9e045fe-1480-4254-ad3d-ce7a12c1b293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tvIfOzwR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fd91d5fc-857d-4d63-ad83-8028c1d3309f', 'attached_at': '', 'detached_at': '', 'volume_id': '229cbfa1-ea7a-4400-b9c6-9df461306495', 'serial': '229cbfa1-ea7a-4400-b9c6-9df461306495'}, 'attachment_id': '3bc423ba-0b1e-41d8-928d-94ce09c93e33', 'volume_type': None} {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 14:50:02 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:50:02 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:50:02 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] CPU controller missing on host. {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] CPU controller found on host. {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70924) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T14:36:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Flavor limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Image limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Flavor pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Image pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Got 1 possible topologies {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Calling os-brick to attach iSCSI Volume {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tvIfOzwR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:50:02 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:50:02 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:50:02 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:50:02 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:50:02 user nova-compute[70924]: INFO os_brick.initiator.connectors.iscsi [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 14:50:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 -p 172.16.0.220:3260 {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d5b3dc-ef94-48e7-8739-3a409007d967]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 14:50:02 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 -p 172.16.0.220:3260 --interface default --op new {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9240c98-0807-4053-b025-1203cda6ff7c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495] added\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495] added
Jul 29 14:50:02 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca4ddb4f-48c6-4931-81b0-8dde1d3f88aa]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba79345-3b8e-490a-947b-4802ae4244a0]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tvIfOzwR {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tvIfOzwR" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc37b27-1ba1-412c-b738-4702abbb0cf6]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tvIfOzwR'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe68a1b-aa5f-442f-8bd8-5316cad18433]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ddb250-1d94-43a7-b379-f2c6fe04b725]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:50:02 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:50:02 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 -p 172.16.0.220:3260 --login {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded7dfdc-135d-4bba-a3aa-169f25a89286]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495, portal: 172.16.0.220,3260]
Jul 29 14:50:02 user nova-compute[70924]: Login to [iface: default, target: iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495, portal: 172.16.0.220,3260] successful.
Jul 29 14:50:02 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c3bb78-5889-4887-955e-9165a50b2675]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[768f13d7-44b5-4639-85a8-43aa26331bde]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:50:02 user nova-compute[70924]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)
Jul 29 14:50:02 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:50:02 user nova-compute[70924]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)
Jul 29 14:50:02 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Connected to 172.16.0.220:3260 {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] HCTL ('34', '-', '-', 0) found on session 23 with lun 0 {{(pid=70924) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70924) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[426dbe38-96b4-4543-88cc-75764102a4a5]: (4, ('- - 0', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tvIfOzwR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG nova.compute.manager [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] Start spawning the instance on the hypervisor. {{(pid=70924) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] Creating instance directory {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 14:50:02 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] Creating image(s)
Jul 29 14:50:02 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] Did not create local disks {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] Ensure instance console log exists: /opt/stack/data/nova/instances/fd57baf8-6306-4553-a058-e915fb543405/console.log {{(pid=70924) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] Start _get_guest_xml network_info=[{"id": "c8f2eadb-705f-4b8b-9f67-c5280cf1f025", "address": "fa:16:3e:15:d2:44", "network": {"id": "55c18d07-a341-4678-9d1c-2dff057a9b1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1092921088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b33d01ba458f466b99b6bc5bba88d8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8f2eadb-70", "ovs_interfaceid": "c8f2eadb-705f-4b8b-9f67-c5280cf1f025", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zKwhpaCm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fd57baf8-6306-4553-a058-e915fb543405', 'attached_at': '', 'detached_at': '', 'volume_id': '60c129c4-a916-49f7-86b6-ff1a2339a464', 'serial': '60c129c4-a916-49f7-86b6-ff1a2339a464'}, 'attachment_id': '066cbbf9-640c-4573-9442-ccf028b1913a', 'volume_type': None} {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 14:50:02 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:50:02 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:50:02 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] CPU controller missing on host. {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] CPU controller found on host. {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70924) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T14:36:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Flavor limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Image limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Flavor pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Image pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 14:50:02 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 14:50:03 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 14:50:03 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 14:50:03 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Got 1 possible topologies {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 14:50:03 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 14:50:03 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 14:50:03 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] Calling os-brick to attach iSCSI Volume {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 14:50:03 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zKwhpaCm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:50:03 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:50:03 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:50:03 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:03 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:50:03 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '26335353064353663', 'path': '/dev/sdc'} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:50:03 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26335353064353663', 'path': '/dev/sdc'} {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 14:50:03 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.639s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:50:03 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:50:03 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:50:03 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:50:03 user nova-compute[70924]: INFO os_brick.initiator.connectors.iscsi [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 14:50:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 -p 172.16.0.220:3260 {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:03 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:49:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-101620479',display_name='tempest-TestShelveInstance-server-101620479',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-101620479',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJl9SeKBDEFUdZXIRYxtj3V1LFrnLzpBI1BTadh9TNsH8fkqnHg5Fw+RxTHhcTZ72iicnrnvmeL33OTqSqXpIduQnNb3GyKNIEhQtAMHUQIlw02/VIbczFOLlqv70OZPgQ==',key_name='tempest-TestShelveInstance-614764253',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85e92f662b024b8a86d5fd646f169169',ramdisk_id='',reservation_id='r-npw3a429',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1828854384',owner_user_name='tempest-TestShelveInstance-1828854384-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:49:54Z,user_data=None,user_id='53f2f7de42a74fb997661c7d579f508d',uuid=fd91d5fc-857d-4d63-ad83-8028c1d3309f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9e045fe-1480-4254-ad3d-ce7a12c1b293", "address": "fa:16:3e:a4:a5:1c", "network": {"id": "fe4e60fb-1489-4a58-989a-1d81e33eddbc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1273087888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85e92f662b024b8a86d5fd646f169169", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9e045fe-14", "ovs_interfaceid": "a9e045fe-1480-4254-ad3d-ce7a12c1b293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:50:03 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Converting VIF {"id": "a9e045fe-1480-4254-ad3d-ce7a12c1b293", "address": "fa:16:3e:a4:a5:1c", "network": {"id": "fe4e60fb-1489-4a58-989a-1d81e33eddbc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1273087888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85e92f662b024b8a86d5fd646f169169", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9e045fe-14", "ovs_interfaceid": "a9e045fe-1480-4254-ad3d-ce7a12c1b293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:50:03 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:a5:1c,bridge_name='br-int',has_traffic_filtering=True,id=a9e045fe-1480-4254-ad3d-ce7a12c1b293,network=Network(fe4e60fb-1489-4a58-989a-1d81e33eddbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9e045fe-14') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:50:03 user nova-compute[70924]: DEBUG nova.objects.instance [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Lazy-loading 'pci_devices' on Instance uuid fd91d5fc-857d-4d63-ad83-8028c1d3309f {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:50:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:03 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[827ade2d-ed27-43a4-8678-41a780ebfdee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:03 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 14:50:03 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:50:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 -p 172.16.0.220:3260 --interface default --op new {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:03 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] End _get_guest_xml xml=<domain type="kvm">
Jul 29 14:50:03 user nova-compute[70924]:   <uuid>fd91d5fc-857d-4d63-ad83-8028c1d3309f</uuid>
Jul 29 14:50:03 user nova-compute[70924]:   <name>instance-0000001b</name>
Jul 29 14:50:03 user nova-compute[70924]:   <memory>524288</memory>
Jul 29 14:50:03 user nova-compute[70924]:   <vcpu>1</vcpu>
Jul 29 14:50:03 user nova-compute[70924]:   <metadata>
Jul 29 14:50:03 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 14:50:03 user nova-compute[70924]:       <nova:package version="0.0.0"/>
Jul 29 14:50:03 user nova-compute[70924]:       <nova:name>tempest-TestShelveInstance-server-101620479</nova:name>
Jul 29 14:50:03 user nova-compute[70924]:       <nova:creationTime>2023-07-29 14:50:02</nova:creationTime>
Jul 29 14:50:03 user nova-compute[70924]:       <nova:flavor name="m1.tiny">
Jul 29 14:50:03 user nova-compute[70924]:         <nova:memory>512</nova:memory>
Jul 29 14:50:03 user nova-compute[70924]:         <nova:disk>1</nova:disk>
Jul 29 14:50:03 user nova-compute[70924]:         <nova:swap>0</nova:swap>
Jul 29 14:50:03 user nova-compute[70924]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 14:50:03 user nova-compute[70924]:         <nova:vcpus>1</nova:vcpus>
Jul 29 14:50:03 user nova-compute[70924]:       </nova:flavor>
Jul 29 14:50:03 user nova-compute[70924]:       <nova:owner>
Jul 29 14:50:03 user nova-compute[70924]:         <nova:user uuid="53f2f7de42a74fb997661c7d579f508d">tempest-TestShelveInstance-1828854384-project-member</nova:user>
Jul 29 14:50:03 user nova-compute[70924]:         <nova:project uuid="85e92f662b024b8a86d5fd646f169169">tempest-TestShelveInstance-1828854384</nova:project>
Jul 29 14:50:03 user nova-compute[70924]:       </nova:owner>
Jul 29 14:50:03 user nova-compute[70924]:       <nova:ports>
Jul 29 14:50:03 user nova-compute[70924]:         <nova:port uuid="a9e045fe-1480-4254-ad3d-ce7a12c1b293">
Jul 29 14:50:03 user nova-compute[70924]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 29 14:50:03 user nova-compute[70924]:         </nova:port>
Jul 29 14:50:03 user nova-compute[70924]:       </nova:ports>
Jul 29 14:50:03 user nova-compute[70924]:     </nova:instance>
Jul 29 14:50:03 user nova-compute[70924]:   </metadata>
Jul 29 14:50:03 user nova-compute[70924]:   <sysinfo type="smbios">
Jul 29 14:50:03 user nova-compute[70924]:     <system>
Jul 29 14:50:03 user nova-compute[70924]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 14:50:03 user nova-compute[70924]:       <entry name="product">OpenStack Nova</entry>
Jul 29 14:50:03 user nova-compute[70924]:       <entry name="version">0.0.0</entry>
Jul 29 14:50:03 user nova-compute[70924]:       <entry name="serial">fd91d5fc-857d-4d63-ad83-8028c1d3309f</entry>
Jul 29 14:50:03 user nova-compute[70924]:       <entry name="uuid">fd91d5fc-857d-4d63-ad83-8028c1d3309f</entry>
Jul 29 14:50:03 user nova-compute[70924]:       <entry name="family">Virtual Machine</entry>
Jul 29 14:50:03 user nova-compute[70924]:     </system>
Jul 29 14:50:03 user nova-compute[70924]:   </sysinfo>
Jul 29 14:50:03 user nova-compute[70924]:   <os>
Jul 29 14:50:03 user nova-compute[70924]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 14:50:03 user nova-compute[70924]:     <boot dev="hd"/>
Jul 29 14:50:03 user nova-compute[70924]:     <smbios mode="sysinfo"/>
Jul 29 14:50:03 user nova-compute[70924]:   </os>
Jul 29 14:50:03 user nova-compute[70924]:   <features>
Jul 29 14:50:03 user nova-compute[70924]:     <acpi/>
Jul 29 14:50:03 user nova-compute[70924]:     <apic/>
Jul 29 14:50:03 user nova-compute[70924]:     <vmcoreinfo/>
Jul 29 14:50:03 user nova-compute[70924]:   </features>
Jul 29 14:50:03 user nova-compute[70924]:   <clock offset="utc">
Jul 29 14:50:03 user nova-compute[70924]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 14:50:03 user nova-compute[70924]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 14:50:03 user nova-compute[70924]:     <timer name="hpet" present="no"/>
Jul 29 14:50:03 user nova-compute[70924]:   </clock>
Jul 29 14:50:03 user nova-compute[70924]:   <cpu mode="custom" match="exact">
Jul 29 14:50:03 user nova-compute[70924]:     <model>Nehalem</model>
Jul 29 14:50:03 user nova-compute[70924]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 14:50:03 user nova-compute[70924]:   </cpu>
Jul 29 14:50:03 user nova-compute[70924]:   <devices>
Jul 29 14:50:03 user nova-compute[70924]:     <disk type="block" device="disk">
Jul 29 14:50:03 user nova-compute[70924]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:50:03 user nova-compute[70924]:       <source dev="/dev/sdc"/>
Jul 29 14:50:03 user nova-compute[70924]:       <target dev="vda" bus="virtio"/>
Jul 29 14:50:03 user nova-compute[70924]:       <serial>229cbfa1-ea7a-4400-b9c6-9df461306495</serial>
Jul 29 14:50:03 user nova-compute[70924]:     </disk>
Jul 29 14:50:03 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 14:50:03 user nova-compute[70924]:       <mac address="fa:16:3e:a4:a5:1c"/>
Jul 29 14:50:03 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:50:03 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 14:50:03 user nova-compute[70924]:       <target dev="tapa9e045fe-14"/>
Jul 29 14:50:03 user nova-compute[70924]:     </interface>
Jul 29 14:50:03 user nova-compute[70924]:     <serial type="pty">
Jul 29 14:50:03 user nova-compute[70924]:       <log file="/opt/stack/data/nova/instances/fd91d5fc-857d-4d63-ad83-8028c1d3309f/console.log" append="off"/>
Jul 29 14:50:03 user nova-compute[70924]:     </serial>
Jul 29 14:50:03 user nova-compute[70924]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 14:50:03 user nova-compute[70924]:     <video>
Jul 29 14:50:03 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:50:03 user nova-compute[70924]:     </video>
Jul 29 14:50:03 user nova-compute[70924]:     <rng model="virtio">
Jul 29 14:50:03 user nova-compute[70924]:       <backend model="random">/dev/urandom</backend>
Jul 29 14:50:03 user nova-compute[70924]:     </rng>
Jul 29 14:50:03 user nova-compute[70924]:     <controller type="usb" index="0" model="none"/>
Jul 29 14:50:03 user nova-compute[70924]:     <memballoon model="virtio">
Jul 29 14:50:03 user nova-compute[70924]:       <stats period="10"/>
Jul 29 14:50:03 user nova-compute[70924]:     </memballoon>
Jul 29 14:50:03 user nova-compute[70924]:   </devices>
Jul 29 14:50:03 user nova-compute[70924]: </domain>
Jul 29 14:50:03 user nova-compute[70924]:  {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 14:50:03 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:49:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-101620479',display_name='tempest-TestShelveInstance-server-101620479',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-101620479',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJl9SeKBDEFUdZXIRYxtj3V1LFrnLzpBI1BTadh9TNsH8fkqnHg5Fw+RxTHhcTZ72iicnrnvmeL33OTqSqXpIduQnNb3GyKNIEhQtAMHUQIlw02/VIbczFOLlqv70OZPgQ==',key_name='tempest-TestShelveInstance-614764253',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85e92f662b024b8a86d5fd646f169169',ramdisk_id='',reservation_id='r-npw3a429',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1828854384',owner_user_name='tempest-TestShelveInstance-1828854384-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:49:54Z,user_data=None,user_id='53f2f7de42a74fb997661c7d579f508d',uuid=fd91d5fc-857d-4d63-ad83-8028c1d3309f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9e045fe-1480-4254-ad3d-ce7a12c1b293", "address": "fa:16:3e:a4:a5:1c", "network": {"id": "fe4e60fb-1489-4a58-989a-1d81e33eddbc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1273087888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85e92f662b024b8a86d5fd646f169169", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9e045fe-14", "ovs_interfaceid": "a9e045fe-1480-4254-ad3d-ce7a12c1b293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 14:50:03 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Converting VIF {"id": "a9e045fe-1480-4254-ad3d-ce7a12c1b293", "address": "fa:16:3e:a4:a5:1c", "network": {"id": "fe4e60fb-1489-4a58-989a-1d81e33eddbc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1273087888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85e92f662b024b8a86d5fd646f169169", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9e045fe-14", "ovs_interfaceid": "a9e045fe-1480-4254-ad3d-ce7a12c1b293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:50:03 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:a5:1c,bridge_name='br-int',has_traffic_filtering=True,id=a9e045fe-1480-4254-ad3d-ce7a12c1b293,network=Network(fe4e60fb-1489-4a58-989a-1d81e33eddbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9e045fe-14') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:50:03 user nova-compute[70924]: DEBUG os_vif [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:a5:1c,bridge_name='br-int',has_traffic_filtering=True,id=a9e045fe-1480-4254-ad3d-ce7a12c1b293,network=Network(fe4e60fb-1489-4a58-989a-1d81e33eddbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9e045fe-14') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 14:50:03 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:03 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:50:03 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 14:50:03 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:03 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa9e045fe-14, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:50:03 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa9e045fe-14, col_values=(('external_ids', {'iface-id': 'a9e045fe-1480-4254-ad3d-ce7a12c1b293', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:a5:1c', 'vm-uuid': 'fd91d5fc-857d-4d63-ad83-8028c1d3309f'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:50:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:03 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f5a56f-2ecd-4532-8107-fc901b01c076]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464] added\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:03 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464] added
Jul 29 14:50:03 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:50:03 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:03 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:50:03 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:03 user nova-compute[70924]: INFO os_vif [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:a5:1c,bridge_name='br-int',has_traffic_filtering=True,id=a9e045fe-1480-4254-ad3d-ce7a12c1b293,network=Network(fe4e60fb-1489-4a58-989a-1d81e33eddbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9e045fe-14')
Jul 29 14:50:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:03 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b96f73c-4747-4c5a-8d0a-a2ca6fd07f57]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:03 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:50:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:03 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a3f983-a6fa-4c42-a579-720f3666f7e7]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:03 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:50:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zKwhpaCm {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:03 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:50:03 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] No VIF found with MAC fa:16:3e:a4:a5:1c, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:50:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zKwhpaCm" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:03 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[4172e99e-e2bb-4de8-ad54-fc7c50eab181]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:03 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zKwhpaCm'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:50:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:03 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[7786785b-5df0-4ae0-ba35-c125525b6fa0]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:03 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:50:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:03 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[271716d5-e47f-4cfd-80ed-345610e60e3a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:03 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:50:03 user nova-compute[70924]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)
Jul 29 14:50:03 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:50:03 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:50:03 user nova-compute[70924]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)
Jul 29 14:50:03 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:50:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 -p 172.16.0.220:3260 --login {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 -p 172.16.0.220:3260 --login" returned: 0 in 0.230s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:04 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[72aa2f9a-5a5b-4394-ba96-a4b263714b83]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:04 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464, portal: 172.16.0.220,3260]
Jul 29 14:50:04 user nova-compute[70924]: Login to [iface: default, target: iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464, portal: 172.16.0.220,3260] successful.
Jul 29 14:50:04 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:50:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:04 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e54fb0-48e6-4ea9-a54a-11da145f805c]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:04 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:50:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:04 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7c9706-9619-46d1-8d9e-3daf31723315]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:04 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:50:04 user nova-compute[70924]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)
Jul 29 14:50:04 user nova-compute[70924]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:50:04 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:50:04 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:50:04 user nova-compute[70924]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)
Jul 29 14:50:04 user nova-compute[70924]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:50:04 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:50:04 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.520s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:50:04 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Connected to 172.16.0.220:3260 {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 14:50:04 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] HCTL ('35', '-', '-', 0) found on session 24 with lun 0 {{(pid=70924) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 14:50:04 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70924) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 14:50:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:04 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[4035ddf2-d18f-4235-b0ba-f4f9cc45e7d8]: (4, ('- - 0', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:04 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Searching for a device in session 24 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 14:50:04 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zKwhpaCm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 14:50:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.558s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:50:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] <== connect_volume: return (2198ms) {'type': 'block', 'scsi_wwn': '26637313937346466', 'path': '/dev/sdd'} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:50:05 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637313937346466', 'path': '/dev/sdd'} {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 14:50:05 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:49:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1631866093',display_name='tempest-ServerActionsTestOtherA-server-1631866093',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1631866093',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfg71Q+cjedfRarcbIler9POuKvX/jsQII2ANgknh6qTEvuHJAE8T34RCDfGUcAvd9SbwZCzhWP8ikNDBjVZKRBIySMsLhBLIX0hKsMOAV+S3aIT6/Yawicov1EmjAkDw==',key_name='tempest-keypair-1866871140',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b33d01ba458f466b99b6bc5bba88d8c0',ramdisk_id='',reservation_id='r-gzlw9uxq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-166265056',owner_user_name='tempest-ServerActionsTestOtherA-166265056-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:49:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55b9032bef2d4d3586dc5d18cdc1ee55',uuid=fd57baf8-6306-4553-a058-e915fb543405,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8f2eadb-705f-4b8b-9f67-c5280cf1f025", "address": "fa:16:3e:15:d2:44", "network": {"id": "55c18d07-a341-4678-9d1c-2dff057a9b1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1092921088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b33d01ba458f466b99b6bc5bba88d8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8f2eadb-70", "ovs_interfaceid": "c8f2eadb-705f-4b8b-9f67-c5280cf1f025", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:50:05 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Converting VIF {"id": "c8f2eadb-705f-4b8b-9f67-c5280cf1f025", "address": "fa:16:3e:15:d2:44", "network": {"id": "55c18d07-a341-4678-9d1c-2dff057a9b1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1092921088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b33d01ba458f466b99b6bc5bba88d8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8f2eadb-70", "ovs_interfaceid": "c8f2eadb-705f-4b8b-9f67-c5280cf1f025", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:50:05 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:d2:44,bridge_name='br-int',has_traffic_filtering=True,id=c8f2eadb-705f-4b8b-9f67-c5280cf1f025,network=Network(55c18d07-a341-4678-9d1c-2dff057a9b1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8f2eadb-70') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:50:05 user nova-compute[70924]: DEBUG nova.objects.instance [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lazy-loading 'pci_devices' on Instance uuid fd57baf8-6306-4553-a058-e915fb543405 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:50:05 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] End _get_guest_xml xml=<domain type="kvm">
Jul 29 14:50:05 user nova-compute[70924]:   <uuid>fd57baf8-6306-4553-a058-e915fb543405</uuid>
Jul 29 14:50:05 user nova-compute[70924]:   <name>instance-0000001c</name>
Jul 29 14:50:05 user nova-compute[70924]:   <memory>524288</memory>
Jul 29 14:50:05 user nova-compute[70924]:   <vcpu>1</vcpu>
Jul 29 14:50:05 user nova-compute[70924]:   <metadata>
Jul 29 14:50:05 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 14:50:05 user nova-compute[70924]:       <nova:package version="0.0.0"/>
Jul 29 14:50:05 user nova-compute[70924]:       <nova:name>tempest-ServerActionsTestOtherA-server-1631866093</nova:name>
Jul 29 14:50:05 user nova-compute[70924]:       <nova:creationTime>2023-07-29 14:50:02</nova:creationTime>
Jul 29 14:50:05 user nova-compute[70924]:       <nova:flavor name="m1.tiny">
Jul 29 14:50:05 user nova-compute[70924]:         <nova:memory>512</nova:memory>
Jul 29 14:50:05 user nova-compute[70924]:         <nova:disk>1</nova:disk>
Jul 29 14:50:05 user nova-compute[70924]:         <nova:swap>0</nova:swap>
Jul 29 14:50:05 user nova-compute[70924]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 14:50:05 user nova-compute[70924]:         <nova:vcpus>1</nova:vcpus>
Jul 29 14:50:05 user nova-compute[70924]:       </nova:flavor>
Jul 29 14:50:05 user nova-compute[70924]:       <nova:owner>
Jul 29 14:50:05 user nova-compute[70924]:         <nova:user uuid="55b9032bef2d4d3586dc5d18cdc1ee55">tempest-ServerActionsTestOtherA-166265056-project-member</nova:user>
Jul 29 14:50:05 user nova-compute[70924]:         <nova:project uuid="b33d01ba458f466b99b6bc5bba88d8c0">tempest-ServerActionsTestOtherA-166265056</nova:project>
Jul 29 14:50:05 user nova-compute[70924]:       </nova:owner>
Jul 29 14:50:05 user nova-compute[70924]:       <nova:ports>
Jul 29 14:50:05 user nova-compute[70924]:         <nova:port uuid="c8f2eadb-705f-4b8b-9f67-c5280cf1f025">
Jul 29 14:50:05 user nova-compute[70924]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 29 14:50:05 user nova-compute[70924]:         </nova:port>
Jul 29 14:50:05 user nova-compute[70924]:       </nova:ports>
Jul 29 14:50:05 user nova-compute[70924]:     </nova:instance>
Jul 29 14:50:05 user nova-compute[70924]:   </metadata>
Jul 29 14:50:05 user nova-compute[70924]:   <sysinfo type="smbios">
Jul 29 14:50:05 user nova-compute[70924]:     <system>
Jul 29 14:50:05 user nova-compute[70924]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 14:50:05 user nova-compute[70924]:       <entry name="product">OpenStack Nova</entry>
Jul 29 14:50:05 user nova-compute[70924]:       <entry name="version">0.0.0</entry>
Jul 29 14:50:05 user nova-compute[70924]:       <entry name="serial">fd57baf8-6306-4553-a058-e915fb543405</entry>
Jul 29 14:50:05 user nova-compute[70924]:       <entry name="uuid">fd57baf8-6306-4553-a058-e915fb543405</entry>
Jul 29 14:50:05 user nova-compute[70924]:       <entry name="family">Virtual Machine</entry>
Jul 29 14:50:05 user nova-compute[70924]:     </system>
Jul 29 14:50:05 user nova-compute[70924]:   </sysinfo>
Jul 29 14:50:05 user nova-compute[70924]:   <os>
Jul 29 14:50:05 user nova-compute[70924]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 14:50:05 user nova-compute[70924]:     <boot dev="hd"/>
Jul 29 14:50:05 user nova-compute[70924]:     <smbios mode="sysinfo"/>
Jul 29 14:50:05 user nova-compute[70924]:   </os>
Jul 29 14:50:05 user nova-compute[70924]:   <features>
Jul 29 14:50:05 user nova-compute[70924]:     <acpi/>
Jul 29 14:50:05 user nova-compute[70924]:     <apic/>
Jul 29 14:50:05 user nova-compute[70924]:     <vmcoreinfo/>
Jul 29 14:50:05 user nova-compute[70924]:   </features>
Jul 29 14:50:05 user nova-compute[70924]:   <clock offset="utc">
Jul 29 14:50:05 user nova-compute[70924]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 14:50:05 user nova-compute[70924]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 14:50:05 user nova-compute[70924]:     <timer name="hpet" present="no"/>
Jul 29 14:50:05 user nova-compute[70924]:   </clock>
Jul 29 14:50:05 user nova-compute[70924]:   <cpu mode="custom" match="exact">
Jul 29 14:50:05 user nova-compute[70924]:     <model>Nehalem</model>
Jul 29 14:50:05 user nova-compute[70924]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 14:50:05 user nova-compute[70924]:   </cpu>
Jul 29 14:50:05 user nova-compute[70924]:   <devices>
Jul 29 14:50:05 user nova-compute[70924]:     <disk type="block" device="disk">
Jul 29 14:50:05 user nova-compute[70924]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:50:05 user nova-compute[70924]:       <source dev="/dev/sdd"/>
Jul 29 14:50:05 user nova-compute[70924]:       <target dev="vda" bus="virtio"/>
Jul 29 14:50:05 user nova-compute[70924]:       <serial>60c129c4-a916-49f7-86b6-ff1a2339a464</serial>
Jul 29 14:50:05 user nova-compute[70924]:     </disk>
Jul 29 14:50:05 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 14:50:05 user nova-compute[70924]:       <mac address="fa:16:3e:15:d2:44"/>
Jul 29 14:50:05 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:50:05 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 14:50:05 user nova-compute[70924]:       <target dev="tapc8f2eadb-70"/>
Jul 29 14:50:05 user nova-compute[70924]:     </interface>
Jul 29 14:50:05 user nova-compute[70924]:     <serial type="pty">
Jul 29 14:50:05 user nova-compute[70924]:       <log file="/opt/stack/data/nova/instances/fd57baf8-6306-4553-a058-e915fb543405/console.log" append="off"/>
Jul 29 14:50:05 user nova-compute[70924]:     </serial>
Jul 29 14:50:05 user nova-compute[70924]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 14:50:05 user nova-compute[70924]:     <video>
Jul 29 14:50:05 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:50:05 user nova-compute[70924]:     </video>
Jul 29 14:50:05 user nova-compute[70924]:     <rng model="virtio">
Jul 29 14:50:05 user nova-compute[70924]:       <backend model="random">/dev/urandom</backend>
Jul 29 14:50:05 user nova-compute[70924]:     </rng>
Jul 29 14:50:05 user nova-compute[70924]:     <controller type="usb" index="0" model="none"/>
Jul 29 14:50:05 user nova-compute[70924]:     <memballoon model="virtio">
Jul 29 14:50:05 user nova-compute[70924]:       <stats period="10"/>
Jul 29 14:50:05 user nova-compute[70924]:     </memballoon>
Jul 29 14:50:05 user nova-compute[70924]:   </devices>
Jul 29 14:50:05 user nova-compute[70924]: </domain>
Jul 29 14:50:05 user nova-compute[70924]:  {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 14:50:05 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:49:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1631866093',display_name='tempest-ServerActionsTestOtherA-server-1631866093',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1631866093',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfg71Q+cjedfRarcbIler9POuKvX/jsQII2ANgknh6qTEvuHJAE8T34RCDfGUcAvd9SbwZCzhWP8ikNDBjVZKRBIySMsLhBLIX0hKsMOAV+S3aIT6/Yawicov1EmjAkDw==',key_name='tempest-keypair-1866871140',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b33d01ba458f466b99b6bc5bba88d8c0',ramdisk_id='',reservation_id='r-gzlw9uxq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-166265056',owner_user_name='tempest-ServerActionsTestOtherA-166265056-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:49:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55b9032bef2d4d3586dc5d18cdc1ee55',uuid=fd57baf8-6306-4553-a058-e915fb543405,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8f2eadb-705f-4b8b-9f67-c5280cf1f025", "address": "fa:16:3e:15:d2:44", "network": {"id": "55c18d07-a341-4678-9d1c-2dff057a9b1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1092921088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b33d01ba458f466b99b6bc5bba88d8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8f2eadb-70", "ovs_interfaceid": "c8f2eadb-705f-4b8b-9f67-c5280cf1f025", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 14:50:05 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Converting VIF {"id": "c8f2eadb-705f-4b8b-9f67-c5280cf1f025", "address": "fa:16:3e:15:d2:44", "network": {"id": "55c18d07-a341-4678-9d1c-2dff057a9b1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1092921088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b33d01ba458f466b99b6bc5bba88d8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8f2eadb-70", "ovs_interfaceid": "c8f2eadb-705f-4b8b-9f67-c5280cf1f025", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:50:05 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:d2:44,bridge_name='br-int',has_traffic_filtering=True,id=c8f2eadb-705f-4b8b-9f67-c5280cf1f025,network=Network(55c18d07-a341-4678-9d1c-2dff057a9b1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8f2eadb-70') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:50:05 user nova-compute[70924]: DEBUG os_vif [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:d2:44,bridge_name='br-int',has_traffic_filtering=True,id=c8f2eadb-705f-4b8b-9f67-c5280cf1f025,network=Network(55c18d07-a341-4678-9d1c-2dff057a9b1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8f2eadb-70') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 14:50:05 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:05 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:50:05 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 14:50:05 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:05 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc8f2eadb-70, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:50:05 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc8f2eadb-70, col_values=(('external_ids', {'iface-id': 'c8f2eadb-705f-4b8b-9f67-c5280cf1f025', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:d2:44', 'vm-uuid': 'fd57baf8-6306-4553-a058-e915fb543405'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:50:05 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:05 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:50:05 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:05 user nova-compute[70924]: INFO os_vif [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:d2:44,bridge_name='br-int',has_traffic_filtering=True,id=c8f2eadb-705f-4b8b-9f67-c5280cf1f025,network=Network(55c18d07-a341-4678-9d1c-2dff057a9b1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8f2eadb-70')
Jul 29 14:50:05 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:05 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:50:05 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] No VIF found with MAC fa:16:3e:15:d2:44, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:50:05 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:05 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:05 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-580c3bac-66cc-44c4-882b-92d44c68dd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Acquiring lock "7cb12b3e-de44-4887-ab74-2a68164b5f7d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:50:05 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-580c3bac-66cc-44c4-882b-92d44c68dd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "7cb12b3e-de44-4887-ab74-2a68164b5f7d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:50:05 user nova-compute[70924]: DEBUG nova.objects.instance [None req-580c3bac-66cc-44c4-882b-92d44c68dd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lazy-loading 'flavor' on Instance uuid 7cb12b3e-de44-4887-ab74-2a68164b5f7d {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:50:05 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-580c3bac-66cc-44c4-882b-92d44c68dd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "7cb12b3e-de44-4887-ab74-2a68164b5f7d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:50:05 user nova-compute[70924]: DEBUG nova.compute.manager [req-5a0a4c70-fee2-4100-8661-6a2c764cc86a req-2d4293db-51df-4b86-8f03-e4e66b8defce service nova] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Received event network-vif-plugged-a9e045fe-1480-4254-ad3d-ce7a12c1b293 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:50:05 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-5a0a4c70-fee2-4100-8661-6a2c764cc86a req-2d4293db-51df-4b86-8f03-e4e66b8defce service nova] Acquiring lock "fd91d5fc-857d-4d63-ad83-8028c1d3309f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:50:05 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-5a0a4c70-fee2-4100-8661-6a2c764cc86a req-2d4293db-51df-4b86-8f03-e4e66b8defce service nova] Lock "fd91d5fc-857d-4d63-ad83-8028c1d3309f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:50:05 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-5a0a4c70-fee2-4100-8661-6a2c764cc86a req-2d4293db-51df-4b86-8f03-e4e66b8defce service nova] Lock "fd91d5fc-857d-4d63-ad83-8028c1d3309f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:50:05 user nova-compute[70924]: DEBUG nova.compute.manager [req-5a0a4c70-fee2-4100-8661-6a2c764cc86a req-2d4293db-51df-4b86-8f03-e4e66b8defce service nova] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] No waiting events found dispatching network-vif-plugged-a9e045fe-1480-4254-ad3d-ce7a12c1b293 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:50:05 user nova-compute[70924]: WARNING nova.compute.manager [req-5a0a4c70-fee2-4100-8661-6a2c764cc86a req-2d4293db-51df-4b86-8f03-e4e66b8defce service nova] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Received unexpected event network-vif-plugged-a9e045fe-1480-4254-ad3d-ce7a12c1b293 for instance with vm_state building and task_state spawning.
Jul 29 14:50:05 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-580c3bac-66cc-44c4-882b-92d44c68dd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Acquiring lock "7cb12b3e-de44-4887-ab74-2a68164b5f7d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:50:05 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-580c3bac-66cc-44c4-882b-92d44c68dd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "7cb12b3e-de44-4887-ab74-2a68164b5f7d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:50:05 user nova-compute[70924]: INFO nova.compute.manager [None req-580c3bac-66cc-44c4-882b-92d44c68dd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Attaching volume d8cda795-fcae-41e3-80f3-2066316032fe to /dev/vdb
Jul 29 14:50:05 user nova-compute[70924]: DEBUG os_brick.utils [None req-580c3bac-66cc-44c4-882b-92d44c68dd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:50:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:05 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea604c1-4170-4dad-9d8c-190a7f3e0c37]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f2127c4a30d9\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:05 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b87b7a6-9f5a-4f1d-9710-6a4a9e9eee07]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:05 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e48e478-4795-4b0b-9324-71b26dfcf1a5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:05 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85fd0ae-b668-4152-895c-12c402cb6d76]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-580c3bac-66cc-44c4-882b-92d44c68dd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Running cmd (subprocess): nvme version {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-580c3bac-66cc-44c4-882b-92d44c68dd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] 'nvme version' failed. Not Retrying. {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:50:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.nvmeof [None req-580c3bac-66cc-44c4-882b-92d44c68dd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] nvme not present on system {{(pid=70924) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 14:50:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:50:05 user nova-compute[70924]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 14:50:05 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[060f695f-c47a-4d9e-8072-ed15635e0685]: (4, '') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-580c3bac-66cc-44c4-882b-92d44c68dd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70924) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 14:50:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-580c3bac-66cc-44c4-882b-92d44c68dd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 14:50:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-580c3bac-66cc-44c4-882b-92d44c68dd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] LIGHTOS: no hostnqn found. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 14:50:05 user nova-compute[70924]: DEBUG os_brick.utils [None req-580c3bac-66cc-44c4-882b-92d44c68dd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f2127c4a30d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:50:05 user nova-compute[70924]: DEBUG nova.virt.block_device [None req-580c3bac-66cc-44c4-882b-92d44c68dd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Updating existing volume attachment record: 3310f0f1-bcde-4689-9d46-4f641d9e7e3e {{(pid=70924) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 14:50:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:07 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:07 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:07 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:07 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:07 user nova-compute[70924]: DEBUG nova.compute.manager [req-12a53de9-d4f9-4319-b4fc-ba82cf110de6 req-aae6c430-7038-48cd-9e7e-b8d115f1fa49 service nova] [instance: fd57baf8-6306-4553-a058-e915fb543405] Received event network-vif-plugged-c8f2eadb-705f-4b8b-9f67-c5280cf1f025 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:50:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-12a53de9-d4f9-4319-b4fc-ba82cf110de6 req-aae6c430-7038-48cd-9e7e-b8d115f1fa49 service nova] Acquiring lock "fd57baf8-6306-4553-a058-e915fb543405-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:50:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-12a53de9-d4f9-4319-b4fc-ba82cf110de6 req-aae6c430-7038-48cd-9e7e-b8d115f1fa49 service nova] Lock "fd57baf8-6306-4553-a058-e915fb543405-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:50:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-12a53de9-d4f9-4319-b4fc-ba82cf110de6 req-aae6c430-7038-48cd-9e7e-b8d115f1fa49 service nova] Lock "fd57baf8-6306-4553-a058-e915fb543405-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:50:07 user nova-compute[70924]: DEBUG nova.compute.manager [req-12a53de9-d4f9-4319-b4fc-ba82cf110de6 req-aae6c430-7038-48cd-9e7e-b8d115f1fa49 service nova] [instance: fd57baf8-6306-4553-a058-e915fb543405] No waiting events found dispatching network-vif-plugged-c8f2eadb-705f-4b8b-9f67-c5280cf1f025 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:50:07 user nova-compute[70924]: WARNING nova.compute.manager [req-12a53de9-d4f9-4319-b4fc-ba82cf110de6 req-aae6c430-7038-48cd-9e7e-b8d115f1fa49 service nova] [instance: fd57baf8-6306-4553-a058-e915fb543405] Received unexpected event network-vif-plugged-c8f2eadb-705f-4b8b-9f67-c5280cf1f025 for instance with vm_state building and task_state spawning.
Jul 29 14:50:07 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:07 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:07 user nova-compute[70924]: DEBUG nova.compute.manager [req-8a0642df-970e-44d9-a777-aca47a7436e1 req-a7a6b1f9-25bb-4020-91df-43f69e252888 service nova] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Received event network-vif-plugged-a9e045fe-1480-4254-ad3d-ce7a12c1b293 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:50:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-8a0642df-970e-44d9-a777-aca47a7436e1 req-a7a6b1f9-25bb-4020-91df-43f69e252888 service nova] Acquiring lock "fd91d5fc-857d-4d63-ad83-8028c1d3309f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:50:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-8a0642df-970e-44d9-a777-aca47a7436e1 req-a7a6b1f9-25bb-4020-91df-43f69e252888 service nova] Lock "fd91d5fc-857d-4d63-ad83-8028c1d3309f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:50:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-8a0642df-970e-44d9-a777-aca47a7436e1 req-a7a6b1f9-25bb-4020-91df-43f69e252888 service nova] Lock "fd91d5fc-857d-4d63-ad83-8028c1d3309f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:50:07 user nova-compute[70924]: DEBUG nova.compute.manager [req-8a0642df-970e-44d9-a777-aca47a7436e1 req-a7a6b1f9-25bb-4020-91df-43f69e252888 service nova] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] No waiting events found dispatching network-vif-plugged-a9e045fe-1480-4254-ad3d-ce7a12c1b293 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:50:07 user nova-compute[70924]: WARNING nova.compute.manager [req-8a0642df-970e-44d9-a777-aca47a7436e1 req-a7a6b1f9-25bb-4020-91df-43f69e252888 service nova] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Received unexpected event network-vif-plugged-a9e045fe-1480-4254-ad3d-ce7a12c1b293 for instance with vm_state building and task_state spawning.
Jul 29 14:50:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:08 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642208.6537266, fd91d5fc-857d-4d63-ad83-8028c1d3309f => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:50:08 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] VM Resumed (Lifecycle Event)
Jul 29 14:50:08 user nova-compute[70924]: DEBUG nova.compute.manager [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Instance event wait completed in 0 seconds for  {{(pid=70924) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 14:50:08 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Guest created on hypervisor {{(pid=70924) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 14:50:08 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Instance spawned successfully.
Jul 29 14:50:08 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 14:50:08 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:50:08 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:50:08 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Found default for hw_cdrom_bus of ide {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:50:08 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Found default for hw_disk_bus of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:50:08 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Found default for hw_input_bus of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:50:08 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Found default for hw_pointer_model of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:50:08 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Found default for hw_video_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:50:08 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Found default for hw_vif_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:50:08 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:50:08 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642208.65533, fd91d5fc-857d-4d63-ad83-8028c1d3309f => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:50:08 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] VM Started (Lifecycle Event)
Jul 29 14:50:08 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:50:08 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:50:08 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:50:08 user nova-compute[70924]: INFO nova.compute.manager [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Took 6.49 seconds to spawn the instance on the hypervisor.
Jul 29 14:50:08 user nova-compute[70924]: DEBUG nova.compute.manager [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:50:08 user nova-compute[70924]: INFO nova.compute.manager [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Took 15.33 seconds to build instance.
Jul 29 14:50:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2ff73c85-7c94-4efb-ad29-bab5b77596d4 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Lock "fd91d5fc-857d-4d63-ad83-8028c1d3309f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.423s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:50:09 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642209.1922526, fd57baf8-6306-4553-a058-e915fb543405 => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:50:09 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: fd57baf8-6306-4553-a058-e915fb543405] VM Resumed (Lifecycle Event)
Jul 29 14:50:09 user nova-compute[70924]: DEBUG nova.compute.manager [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] Instance event wait completed in 0 seconds for  {{(pid=70924) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 14:50:09 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] Guest created on hypervisor {{(pid=70924) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 14:50:09 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: fd57baf8-6306-4553-a058-e915fb543405] Instance spawned successfully.
Jul 29 14:50:09 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 14:50:09 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: fd57baf8-6306-4553-a058-e915fb543405] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:50:09 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: fd57baf8-6306-4553-a058-e915fb543405] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:50:09 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: fd57baf8-6306-4553-a058-e915fb543405] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:50:09 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642209.1950803, fd57baf8-6306-4553-a058-e915fb543405 => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:50:09 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: fd57baf8-6306-4553-a058-e915fb543405] VM Started (Lifecycle Event)
Jul 29 14:50:09 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] Found default for hw_cdrom_bus of ide {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:50:09 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] Found default for hw_disk_bus of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:50:09 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] Found default for hw_input_bus of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:50:09 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] Found default for hw_pointer_model of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:50:09 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] Found default for hw_video_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:50:09 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] Found default for hw_vif_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:50:09 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: fd57baf8-6306-4553-a058-e915fb543405] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:50:09 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: fd57baf8-6306-4553-a058-e915fb543405] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:50:09 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: fd57baf8-6306-4553-a058-e915fb543405] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:50:09 user nova-compute[70924]: DEBUG nova.compute.manager [req-1e4bcbf5-a610-4ea4-aaef-2fdc938cca53 req-5ec42990-4ee7-4e5c-8e6a-0ad025c5e79e service nova] [instance: fd57baf8-6306-4553-a058-e915fb543405] Received event network-vif-plugged-c8f2eadb-705f-4b8b-9f67-c5280cf1f025 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:50:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-1e4bcbf5-a610-4ea4-aaef-2fdc938cca53 req-5ec42990-4ee7-4e5c-8e6a-0ad025c5e79e service nova] Acquiring lock "fd57baf8-6306-4553-a058-e915fb543405-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:50:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-1e4bcbf5-a610-4ea4-aaef-2fdc938cca53 req-5ec42990-4ee7-4e5c-8e6a-0ad025c5e79e service nova] Lock "fd57baf8-6306-4553-a058-e915fb543405-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:50:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-1e4bcbf5-a610-4ea4-aaef-2fdc938cca53 req-5ec42990-4ee7-4e5c-8e6a-0ad025c5e79e service nova] Lock "fd57baf8-6306-4553-a058-e915fb543405-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:50:09 user nova-compute[70924]: DEBUG nova.compute.manager [req-1e4bcbf5-a610-4ea4-aaef-2fdc938cca53 req-5ec42990-4ee7-4e5c-8e6a-0ad025c5e79e service nova] [instance: fd57baf8-6306-4553-a058-e915fb543405] No waiting events found dispatching network-vif-plugged-c8f2eadb-705f-4b8b-9f67-c5280cf1f025 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:50:09 user nova-compute[70924]: WARNING nova.compute.manager [req-1e4bcbf5-a610-4ea4-aaef-2fdc938cca53 req-5ec42990-4ee7-4e5c-8e6a-0ad025c5e79e service nova] [instance: fd57baf8-6306-4553-a058-e915fb543405] Received unexpected event network-vif-plugged-c8f2eadb-705f-4b8b-9f67-c5280cf1f025 for instance with vm_state building and task_state spawning.
Jul 29 14:50:09 user nova-compute[70924]: INFO nova.compute.manager [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] Took 6.36 seconds to spawn the instance on the hypervisor.
Jul 29 14:50:09 user nova-compute[70924]: DEBUG nova.compute.manager [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:50:09 user nova-compute[70924]: INFO nova.compute.manager [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] Took 15.46 seconds to build instance.
Jul 29 14:50:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-bda94242-b094-4ab7-af58-d58aa26fa05b tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "fd57baf8-6306-4553-a058-e915fb543405" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.568s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:50:10 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:13 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:13 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-580c3bac-66cc-44c4-882b-92d44c68dd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Calling os-brick to attach iSCSI Volume {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 14:50:13 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-580c3bac-66cc-44c4-882b-92d44c68dd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jVrAgyeu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:50:13 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-580c3bac-66cc-44c4-882b-92d44c68dd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:50:13 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-580c3bac-66cc-44c4-882b-92d44c68dd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:50:13 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-580c3bac-66cc-44c4-882b-92d44c68dd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:50:13 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-580c3bac-66cc-44c4-882b-92d44c68dd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:50:13 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-580c3bac-66cc-44c4-882b-92d44c68dd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:50:13 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-580c3bac-66cc-44c4-882b-92d44c68dd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:50:13 user nova-compute[70924]: INFO os_brick.initiator.connectors.iscsi [None req-580c3bac-66cc-44c4-882b-92d44c68dd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 14:50:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe -p 172.16.0.220:3260 {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:13 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88983ed-b847-460f-9452-59fdf0ae502d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:13 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-580c3bac-66cc-44c4-882b-92d44c68dd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 14:50:13 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:50:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe -p 172.16.0.220:3260 --interface default --op new {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:13 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5fd6fa5-ec6f-462b-b35f-d0eca697059a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe] added\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:13 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-580c3bac-66cc-44c4-882b-92d44c68dd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe] added
Jul 29 14:50:13 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:50:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:13 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[86722ceb-0bae-4340-9e64-39963bb2ef2c]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:13 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-580c3bac-66cc-44c4-882b-92d44c68dd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:50:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:13 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[8843997c-2d1e-4c5e-90d1-35f50041ec38]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:13 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-580c3bac-66cc-44c4-882b-92d44c68dd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:50:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jVrAgyeu {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:14 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jVrAgyeu" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:14 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26e5488-ba42-461a-a1d1-d9f583665dcb]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:14 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-580c3bac-66cc-44c4-882b-92d44c68dd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jVrAgyeu'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:50:14 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:14 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:14 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1313c9-2d35-4c87-9203-2d4388c101a8]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:14 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-580c3bac-66cc-44c4-882b-92d44c68dd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:50:14 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:14 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:14 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc58aa94-9c5a-49fd-bc92-ccaa15593827]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:14 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-580c3bac-66cc-44c4-882b-92d44c68dd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:50:14 user nova-compute[70924]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)
Jul 29 14:50:14 user nova-compute[70924]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:50:14 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:50:14 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-580c3bac-66cc-44c4-882b-92d44c68dd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:50:14 user nova-compute[70924]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)
Jul 29 14:50:14 user nova-compute[70924]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:50:14 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:50:14 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe -p 172.16.0.220:3260 --login {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:14 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:14 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[423a0d2c-0850-4906-9b49-c87ccefbe829]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:14 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-580c3bac-66cc-44c4-882b-92d44c68dd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe, portal: 172.16.0.220,3260]
Jul 29 14:50:14 user nova-compute[70924]: Login to [iface: default, target: iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe, portal: 172.16.0.220,3260] successful.
Jul 29 14:50:14 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:50:14 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:14 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:14 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e910bb8-861e-409c-91e8-810fcb8047c9]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:14 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-580c3bac-66cc-44c4-882b-92d44c68dd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:50:14 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:14 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:14 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[29186b4a-99f5-468f-8b86-ee3b22ce9897]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:14 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-580c3bac-66cc-44c4-882b-92d44c68dd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:50:14 user nova-compute[70924]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)
Jul 29 14:50:14 user nova-compute[70924]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:50:14 user nova-compute[70924]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)
Jul 29 14:50:14 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:50:14 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-580c3bac-66cc-44c4-882b-92d44c68dd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:50:14 user nova-compute[70924]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)
Jul 29 14:50:14 user nova-compute[70924]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:50:14 user nova-compute[70924]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)
Jul 29 14:50:14 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:50:14 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-580c3bac-66cc-44c4-882b-92d44c68dd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:50:14 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-580c3bac-66cc-44c4-882b-92d44c68dd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Connected to 172.16.0.220:3260 {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 14:50:14 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-580c3bac-66cc-44c4-882b-92d44c68dd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] HCTL ('36', '-', '-', 0) found on session 25 with lun 0 {{(pid=70924) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 14:50:14 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-580c3bac-66cc-44c4-882b-92d44c68dd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70924) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 14:50:14 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:14 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:14 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[114888e5-2b48-4261-b2a7-42f8f40605b3]: (4, ('- - 0', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:14 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-580c3bac-66cc-44c4-882b-92d44c68dd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Searching for a device in session 25 and hctl ['36', '*', '*', 0] yield: None {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 14:50:15 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-580c3bac-66cc-44c4-882b-92d44c68dd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Searching for a device in session 25 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 14:50:15 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-580c3bac-66cc-44c4-882b-92d44c68dd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jVrAgyeu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 14:50:15 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-580c3bac-66cc-44c4-882b-92d44c68dd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:50:15 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-580c3bac-66cc-44c4-882b-92d44c68dd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '23765353663643934', 'path': '/dev/sde'} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:50:15 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-580c3bac-66cc-44c4-882b-92d44c68dd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765353663643934', 'path': '/dev/sde'} {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 14:50:15 user nova-compute[70924]: DEBUG nova.objects.instance [None req-580c3bac-66cc-44c4-882b-92d44c68dd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lazy-loading 'flavor' on Instance uuid 7cb12b3e-de44-4887-ab74-2a68164b5f7d {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:50:15 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-580c3bac-66cc-44c4-882b-92d44c68dd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] attach device xml: <disk type="block" device="disk">
Jul 29 14:50:15 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:50:15 user nova-compute[70924]:   <source dev="/dev/sde"/>
Jul 29 14:50:15 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 14:50:15 user nova-compute[70924]:   <serial>d8cda795-fcae-41e3-80f3-2066316032fe</serial>
Jul 29 14:50:15 user nova-compute[70924]: </disk>
Jul 29 14:50:15 user nova-compute[70924]:  {{(pid=70924) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 29 14:50:15 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:15 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-580c3bac-66cc-44c4-882b-92d44c68dd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:50:15 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-580c3bac-66cc-44c4-882b-92d44c68dd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:50:15 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-580c3bac-66cc-44c4-882b-92d44c68dd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] No VIF found with MAC fa:16:3e:f7:ee:73, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:50:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-580c3bac-66cc-44c4-882b-92d44c68dd25 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "7cb12b3e-de44-4887-ab74-2a68164b5f7d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.105s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:50:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-c6d7cf6b-9055-48e3-b233-c5758b1d13c0 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Acquiring lock "7cb12b3e-de44-4887-ab74-2a68164b5f7d" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:50:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-c6d7cf6b-9055-48e3-b233-c5758b1d13c0 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "7cb12b3e-de44-4887-ab74-2a68164b5f7d" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:50:16 user nova-compute[70924]: DEBUG nova.compute.manager [None req-c6d7cf6b-9055-48e3-b233-c5758b1d13c0 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:50:16 user nova-compute[70924]: DEBUG nova.compute.manager [None req-c6d7cf6b-9055-48e3-b233-c5758b1d13c0 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=70924) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Jul 29 14:50:16 user nova-compute[70924]: DEBUG nova.objects.instance [None req-c6d7cf6b-9055-48e3-b233-c5758b1d13c0 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lazy-loading 'flavor' on Instance uuid 7cb12b3e-de44-4887-ab74-2a68164b5f7d {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:50:16 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:16 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:16 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:16 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:16 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:17 user nova-compute[70924]: DEBUG nova.compute.manager [req-fba0c1ff-7f0e-4aad-8c03-662853cf00b8 req-31c598ce-5d5c-478c-85c0-6da04414f5b5 service nova] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Received event network-vif-unplugged-e41d642f-f559-4294-b5ff-5ec478fb3438 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:50:17 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-fba0c1ff-7f0e-4aad-8c03-662853cf00b8 req-31c598ce-5d5c-478c-85c0-6da04414f5b5 service nova] Acquiring lock "7cb12b3e-de44-4887-ab74-2a68164b5f7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:50:17 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-fba0c1ff-7f0e-4aad-8c03-662853cf00b8 req-31c598ce-5d5c-478c-85c0-6da04414f5b5 service nova] Lock "7cb12b3e-de44-4887-ab74-2a68164b5f7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:50:17 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-fba0c1ff-7f0e-4aad-8c03-662853cf00b8 req-31c598ce-5d5c-478c-85c0-6da04414f5b5 service nova] Lock "7cb12b3e-de44-4887-ab74-2a68164b5f7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:50:17 user nova-compute[70924]: DEBUG nova.compute.manager [req-fba0c1ff-7f0e-4aad-8c03-662853cf00b8 req-31c598ce-5d5c-478c-85c0-6da04414f5b5 service nova] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] No waiting events found dispatching network-vif-unplugged-e41d642f-f559-4294-b5ff-5ec478fb3438 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:50:17 user nova-compute[70924]: WARNING nova.compute.manager [req-fba0c1ff-7f0e-4aad-8c03-662853cf00b8 req-31c598ce-5d5c-478c-85c0-6da04414f5b5 service nova] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Received unexpected event network-vif-unplugged-e41d642f-f559-4294-b5ff-5ec478fb3438 for instance with vm_state active and task_state powering-off.
Jul 29 14:50:17 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:17 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Instance destroyed successfully.
Jul 29 14:50:17 user nova-compute[70924]: DEBUG nova.compute.manager [None req-c6d7cf6b-9055-48e3-b233-c5758b1d13c0 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:50:17 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-c6d7cf6b-9055-48e3-b233-c5758b1d13c0 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "7cb12b3e-de44-4887-ab74-2a68164b5f7d" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.932s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:50:18 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Acquiring lock "d0776c81-190d-41da-99c5-7419ed69b92c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:50:18 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Lock "d0776c81-190d-41da-99c5-7419ed69b92c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:50:18 user nova-compute[70924]: DEBUG nova.compute.manager [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: d0776c81-190d-41da-99c5-7419ed69b92c] Starting instance... {{(pid=70924) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 14:50:18 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:50:18 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:50:18 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70924) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 14:50:18 user nova-compute[70924]: INFO nova.compute.claims [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: d0776c81-190d-41da-99c5-7419ed69b92c] Claim successful on node user
Jul 29 14:50:18 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:18 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:50:18 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:50:18 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.525s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:50:18 user nova-compute[70924]: DEBUG nova.compute.manager [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: d0776c81-190d-41da-99c5-7419ed69b92c] Start building networks asynchronously for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 14:50:18 user nova-compute[70924]: DEBUG nova.compute.manager [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: d0776c81-190d-41da-99c5-7419ed69b92c] Allocating IP information in the background. {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 14:50:18 user nova-compute[70924]: DEBUG nova.network.neutron [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: d0776c81-190d-41da-99c5-7419ed69b92c] allocate_for_instance() {{(pid=70924) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 14:50:19 user nova-compute[70924]: DEBUG nova.policy [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0fe49a3ddecb49d78f668df836df4ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5793d2e5b9451f9ef38fa61cb877d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70924) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 14:50:19 user nova-compute[70924]: DEBUG nova.compute.manager [req-aaf1f67c-08c0-4ee7-8839-0bdc895bbf13 req-f4b9a768-8bf0-4437-ae3e-c6db49724297 service nova] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Received event network-vif-plugged-e41d642f-f559-4294-b5ff-5ec478fb3438 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:50:19 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-aaf1f67c-08c0-4ee7-8839-0bdc895bbf13 req-f4b9a768-8bf0-4437-ae3e-c6db49724297 service nova] Acquiring lock "7cb12b3e-de44-4887-ab74-2a68164b5f7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:50:19 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-aaf1f67c-08c0-4ee7-8839-0bdc895bbf13 req-f4b9a768-8bf0-4437-ae3e-c6db49724297 service nova] Lock "7cb12b3e-de44-4887-ab74-2a68164b5f7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:50:19 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-aaf1f67c-08c0-4ee7-8839-0bdc895bbf13 req-f4b9a768-8bf0-4437-ae3e-c6db49724297 service nova] Lock "7cb12b3e-de44-4887-ab74-2a68164b5f7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:50:19 user nova-compute[70924]: DEBUG nova.compute.manager [req-aaf1f67c-08c0-4ee7-8839-0bdc895bbf13 req-f4b9a768-8bf0-4437-ae3e-c6db49724297 service nova] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] No waiting events found dispatching network-vif-plugged-e41d642f-f559-4294-b5ff-5ec478fb3438 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:50:19 user nova-compute[70924]: WARNING nova.compute.manager [req-aaf1f67c-08c0-4ee7-8839-0bdc895bbf13 req-f4b9a768-8bf0-4437-ae3e-c6db49724297 service nova] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Received unexpected event network-vif-plugged-e41d642f-f559-4294-b5ff-5ec478fb3438 for instance with vm_state stopped and task_state None.
Jul 29 14:50:19 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: d0776c81-190d-41da-99c5-7419ed69b92c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 14:50:19 user nova-compute[70924]: DEBUG nova.compute.manager [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: d0776c81-190d-41da-99c5-7419ed69b92c] Start building block device mappings for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 14:50:19 user nova-compute[70924]: DEBUG nova.compute.manager [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: d0776c81-190d-41da-99c5-7419ed69b92c] Start spawning the instance on the hypervisor. {{(pid=70924) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 14:50:19 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: d0776c81-190d-41da-99c5-7419ed69b92c] Creating instance directory {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 14:50:19 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: d0776c81-190d-41da-99c5-7419ed69b92c] Creating image(s)
Jul 29 14:50:19 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Acquiring lock "/opt/stack/data/nova/instances/d0776c81-190d-41da-99c5-7419ed69b92c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:50:19 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Lock "/opt/stack/data/nova/instances/d0776c81-190d-41da-99c5-7419ed69b92c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:50:19 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Lock "/opt/stack/data/nova/instances/d0776c81-190d-41da-99c5-7419ed69b92c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:50:19 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:19 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.177s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:19 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Acquiring lock "bd72453517468710f1de26b27fb0ea28688e9009" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:50:19 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:50:19 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:19 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-53e2aecb-7452-4cdc-8dc3-83201e299f44 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Acquiring lock "f5350fb5-9460-490b-a47e-74f88c8eb51c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:50:19 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-53e2aecb-7452-4cdc-8dc3-83201e299f44 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Lock "f5350fb5-9460-490b-a47e-74f88c8eb51c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:50:19 user nova-compute[70924]: DEBUG nova.objects.instance [None req-53e2aecb-7452-4cdc-8dc3-83201e299f44 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Lazy-loading 'flavor' on Instance uuid f5350fb5-9460-490b-a47e-74f88c8eb51c {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:50:19 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-53e2aecb-7452-4cdc-8dc3-83201e299f44 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Lock "f5350fb5-9460-490b-a47e-74f88c8eb51c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:50:19 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.158s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:19 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/d0776c81-190d-41da-99c5-7419ed69b92c/disk 1073741824 {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:19 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/d0776c81-190d-41da-99c5-7419ed69b92c/disk 1073741824" returned: 0 in 0.059s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:19 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:50:19 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:19 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-53e2aecb-7452-4cdc-8dc3-83201e299f44 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Acquiring lock "f5350fb5-9460-490b-a47e-74f88c8eb51c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:50:19 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-53e2aecb-7452-4cdc-8dc3-83201e299f44 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Lock "f5350fb5-9460-490b-a47e-74f88c8eb51c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:50:19 user nova-compute[70924]: INFO nova.compute.manager [None req-53e2aecb-7452-4cdc-8dc3-83201e299f44 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Attaching volume 40240a39-c2db-4b14-bc97-0fb20849bdef to /dev/vdb
Jul 29 14:50:19 user nova-compute[70924]: DEBUG nova.network.neutron [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: d0776c81-190d-41da-99c5-7419ed69b92c] Successfully created port: 77586dcd-0ed2-4e9c-a29f-324b2726a962 {{(pid=70924) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 14:50:19 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.159s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:19 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d0776c81-190d-41da-99c5-7419ed69b92c/disk. size=1073741824 {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 14:50:19 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0776c81-190d-41da-99c5-7419ed69b92c/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:19 user nova-compute[70924]: DEBUG os_brick.utils [None req-53e2aecb-7452-4cdc-8dc3-83201e299f44 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:50:19 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:19 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:19 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f40d34-9b15-4c33-9895-0cc42667118e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f2127c4a30d9\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:19 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:19 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:19 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[abdf239d-8e42-4427-825f-f3a1a12a8f46]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:19 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:19 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:19 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cbbc84c-2a94-46bc-9c0e-5d1a0327567c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:19 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[7578e469-9a7f-4df7-9f86-6bec3fe0734a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:19 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-53e2aecb-7452-4cdc-8dc3-83201e299f44 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Running cmd (subprocess): nvme version {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:19 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-53e2aecb-7452-4cdc-8dc3-83201e299f44 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] 'nvme version' failed. Not Retrying. {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:50:20 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.nvmeof [None req-53e2aecb-7452-4cdc-8dc3-83201e299f44 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] nvme not present on system {{(pid=70924) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 14:50:20 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0776c81-190d-41da-99c5-7419ed69b92c/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:20 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Cannot resize image /opt/stack/data/nova/instances/d0776c81-190d-41da-99c5-7419ed69b92c/disk to a smaller size. {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 14:50:20 user nova-compute[70924]: DEBUG nova.objects.instance [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Lazy-loading 'migration_context' on Instance uuid d0776c81-190d-41da-99c5-7419ed69b92c {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:50:20 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:20 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: d0776c81-190d-41da-99c5-7419ed69b92c] Created local disks {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 14:50:20 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: d0776c81-190d-41da-99c5-7419ed69b92c] Ensure instance console log exists: /opt/stack/data/nova/instances/d0776c81-190d-41da-99c5-7419ed69b92c/console.log {{(pid=70924) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 14:50:20 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:50:20 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:50:20 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:50:20 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:50:20 user nova-compute[70924]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 14:50:20 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c4e94a-d56d-44d0-84d4-c42003f17c77]: (4, '') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:20 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-53e2aecb-7452-4cdc-8dc3-83201e299f44 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70924) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 14:50:20 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-53e2aecb-7452-4cdc-8dc3-83201e299f44 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 14:50:20 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-53e2aecb-7452-4cdc-8dc3-83201e299f44 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] LIGHTOS: no hostnqn found. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 14:50:20 user nova-compute[70924]: DEBUG os_brick.utils [None req-53e2aecb-7452-4cdc-8dc3-83201e299f44 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f2127c4a30d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:50:20 user nova-compute[70924]: DEBUG nova.virt.block_device [None req-53e2aecb-7452-4cdc-8dc3-83201e299f44 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Updating existing volume attachment record: 875753c7-cd54-4638-992b-4f39950e733e {{(pid=70924) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 14:50:20 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:20 user nova-compute[70924]: DEBUG nova.network.neutron [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: d0776c81-190d-41da-99c5-7419ed69b92c] Successfully updated port: 77586dcd-0ed2-4e9c-a29f-324b2726a962 {{(pid=70924) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 14:50:20 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Acquiring lock "refresh_cache-d0776c81-190d-41da-99c5-7419ed69b92c" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:50:20 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Acquired lock "refresh_cache-d0776c81-190d-41da-99c5-7419ed69b92c" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:50:20 user nova-compute[70924]: DEBUG nova.network.neutron [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: d0776c81-190d-41da-99c5-7419ed69b92c] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 14:50:20 user nova-compute[70924]: DEBUG nova.compute.manager [req-42a3bdba-026f-4dad-a938-7b13dbc049a5 req-9ba93cdd-669e-42b6-89e6-b7dde562c8c0 service nova] [instance: d0776c81-190d-41da-99c5-7419ed69b92c] Received event network-changed-77586dcd-0ed2-4e9c-a29f-324b2726a962 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:50:20 user nova-compute[70924]: DEBUG nova.compute.manager [req-42a3bdba-026f-4dad-a938-7b13dbc049a5 req-9ba93cdd-669e-42b6-89e6-b7dde562c8c0 service nova] [instance: d0776c81-190d-41da-99c5-7419ed69b92c] Refreshing instance network info cache due to event network-changed-77586dcd-0ed2-4e9c-a29f-324b2726a962. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:50:20 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-42a3bdba-026f-4dad-a938-7b13dbc049a5 req-9ba93cdd-669e-42b6-89e6-b7dde562c8c0 service nova] Acquiring lock "refresh_cache-d0776c81-190d-41da-99c5-7419ed69b92c" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:50:20 user nova-compute[70924]: DEBUG nova.network.neutron [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: d0776c81-190d-41da-99c5-7419ed69b92c] Instance cache missing network info. {{(pid=70924) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 14:50:21 user nova-compute[70924]: DEBUG nova.network.neutron [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: d0776c81-190d-41da-99c5-7419ed69b92c] Updating instance_info_cache with network_info: [{"id": "77586dcd-0ed2-4e9c-a29f-324b2726a962", "address": "fa:16:3e:8e:67:39", "network": {"id": "cb1ab4d5-0cba-4628-bca8-015a7acce83b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-875103426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d5793d2e5b9451f9ef38fa61cb877d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77586dcd-0e", "ovs_interfaceid": "77586dcd-0ed2-4e9c-a29f-324b2726a962", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:50:21 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Releasing lock "refresh_cache-d0776c81-190d-41da-99c5-7419ed69b92c" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:50:21 user nova-compute[70924]: DEBUG nova.compute.manager [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: d0776c81-190d-41da-99c5-7419ed69b92c] Instance network_info: |[{"id": "77586dcd-0ed2-4e9c-a29f-324b2726a962", "address": "fa:16:3e:8e:67:39", "network": {"id": "cb1ab4d5-0cba-4628-bca8-015a7acce83b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-875103426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d5793d2e5b9451f9ef38fa61cb877d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77586dcd-0e", "ovs_interfaceid": "77586dcd-0ed2-4e9c-a29f-324b2726a962", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 14:50:21 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-42a3bdba-026f-4dad-a938-7b13dbc049a5 req-9ba93cdd-669e-42b6-89e6-b7dde562c8c0 service nova] Acquired lock "refresh_cache-d0776c81-190d-41da-99c5-7419ed69b92c" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:50:21 user nova-compute[70924]: DEBUG nova.network.neutron [req-42a3bdba-026f-4dad-a938-7b13dbc049a5 req-9ba93cdd-669e-42b6-89e6-b7dde562c8c0 service nova] [instance: d0776c81-190d-41da-99c5-7419ed69b92c] Refreshing network info cache for port 77586dcd-0ed2-4e9c-a29f-324b2726a962 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:50:21 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: d0776c81-190d-41da-99c5-7419ed69b92c] Start _get_guest_xml network_info=[{"id": "77586dcd-0ed2-4e9c-a29f-324b2726a962", "address": "fa:16:3e:8e:67:39", "network": {"id": "cb1ab4d5-0cba-4628-bca8-015a7acce83b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-875103426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d5793d2e5b9451f9ef38fa61cb877d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77586dcd-0e", "ovs_interfaceid": "77586dcd-0ed2-4e9c-a29f-324b2726a962", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '3aba2e73-6832-404b-8bd0-d0503ce82b8c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 14:50:21 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:50:21 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:50:21 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 14:50:21 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] CPU controller missing on host. {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 14:50:21 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 14:50:21 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] CPU controller found on host. {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 14:50:21 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70924) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 14:50:21 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T14:36:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 14:50:21 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Flavor limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 14:50:21 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Image limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 14:50:21 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Flavor pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 14:50:21 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Image pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 14:50:21 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 14:50:21 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 14:50:21 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 14:50:21 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Got 1 possible topologies {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 14:50:21 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 14:50:21 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 14:50:21 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:50:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2134470961',display_name='tempest-ServersNegativeTestJSON-server-2134470961',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2134470961',id=29,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d5793d2e5b9451f9ef38fa61cb877d5',ramdisk_id='',reservation_id='r-9ij64diu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1209083119',owner_user_name='tempest-ServersNegativeTestJSON-1209083119-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:50:19Z,user_data=None,user_id='0fe49a3ddecb49d78f668df836df4ce8',uuid=d0776c81-190d-41da-99c5-7419ed69b92c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77586dcd-0ed2-4e9c-a29f-324b2726a962", "address": "fa:16:3e:8e:67:39", "network": {"id": "cb1ab4d5-0cba-4628-bca8-015a7acce83b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-875103426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d5793d2e5b9451f9ef38fa61cb877d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77586dcd-0e", "ovs_interfaceid": "77586dcd-0ed2-4e9c-a29f-324b2726a962", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:50:21 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Converting VIF {"id": "77586dcd-0ed2-4e9c-a29f-324b2726a962", "address": "fa:16:3e:8e:67:39", "network": {"id": "cb1ab4d5-0cba-4628-bca8-015a7acce83b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-875103426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d5793d2e5b9451f9ef38fa61cb877d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77586dcd-0e", "ovs_interfaceid": "77586dcd-0ed2-4e9c-a29f-324b2726a962", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:50:21 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:67:39,bridge_name='br-int',has_traffic_filtering=True,id=77586dcd-0ed2-4e9c-a29f-324b2726a962,network=Network(cb1ab4d5-0cba-4628-bca8-015a7acce83b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77586dcd-0e') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:50:21 user nova-compute[70924]: DEBUG nova.objects.instance [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Lazy-loading 'pci_devices' on Instance uuid d0776c81-190d-41da-99c5-7419ed69b92c {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:50:21 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: d0776c81-190d-41da-99c5-7419ed69b92c] End _get_guest_xml xml=<domain type="kvm">
Jul 29 14:50:21 user nova-compute[70924]:   <uuid>d0776c81-190d-41da-99c5-7419ed69b92c</uuid>
Jul 29 14:50:21 user nova-compute[70924]:   <name>instance-0000001d</name>
Jul 29 14:50:21 user nova-compute[70924]:   <memory>524288</memory>
Jul 29 14:50:21 user nova-compute[70924]:   <vcpu>1</vcpu>
Jul 29 14:50:21 user nova-compute[70924]:   <metadata>
Jul 29 14:50:21 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 14:50:21 user nova-compute[70924]:       <nova:package version="0.0.0"/>
Jul 29 14:50:21 user nova-compute[70924]:       <nova:name>tempest-ServersNegativeTestJSON-server-2134470961</nova:name>
Jul 29 14:50:21 user nova-compute[70924]:       <nova:creationTime>2023-07-29 14:50:21</nova:creationTime>
Jul 29 14:50:21 user nova-compute[70924]:       <nova:flavor name="m1.tiny">
Jul 29 14:50:21 user nova-compute[70924]:         <nova:memory>512</nova:memory>
Jul 29 14:50:21 user nova-compute[70924]:         <nova:disk>1</nova:disk>
Jul 29 14:50:21 user nova-compute[70924]:         <nova:swap>0</nova:swap>
Jul 29 14:50:21 user nova-compute[70924]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 14:50:21 user nova-compute[70924]:         <nova:vcpus>1</nova:vcpus>
Jul 29 14:50:21 user nova-compute[70924]:       </nova:flavor>
Jul 29 14:50:21 user nova-compute[70924]:       <nova:owner>
Jul 29 14:50:21 user nova-compute[70924]:         <nova:user uuid="0fe49a3ddecb49d78f668df836df4ce8">tempest-ServersNegativeTestJSON-1209083119-project-member</nova:user>
Jul 29 14:50:21 user nova-compute[70924]:         <nova:project uuid="8d5793d2e5b9451f9ef38fa61cb877d5">tempest-ServersNegativeTestJSON-1209083119</nova:project>
Jul 29 14:50:21 user nova-compute[70924]:       </nova:owner>
Jul 29 14:50:21 user nova-compute[70924]:       <nova:root type="image" uuid="3aba2e73-6832-404b-8bd0-d0503ce82b8c"/>
Jul 29 14:50:21 user nova-compute[70924]:       <nova:ports>
Jul 29 14:50:21 user nova-compute[70924]:         <nova:port uuid="77586dcd-0ed2-4e9c-a29f-324b2726a962">
Jul 29 14:50:21 user nova-compute[70924]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 29 14:50:21 user nova-compute[70924]:         </nova:port>
Jul 29 14:50:21 user nova-compute[70924]:       </nova:ports>
Jul 29 14:50:21 user nova-compute[70924]:     </nova:instance>
Jul 29 14:50:21 user nova-compute[70924]:   </metadata>
Jul 29 14:50:21 user nova-compute[70924]:   <sysinfo type="smbios">
Jul 29 14:50:21 user nova-compute[70924]:     <system>
Jul 29 14:50:21 user nova-compute[70924]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 14:50:21 user nova-compute[70924]:       <entry name="product">OpenStack Nova</entry>
Jul 29 14:50:21 user nova-compute[70924]:       <entry name="version">0.0.0</entry>
Jul 29 14:50:21 user nova-compute[70924]:       <entry name="serial">d0776c81-190d-41da-99c5-7419ed69b92c</entry>
Jul 29 14:50:21 user nova-compute[70924]:       <entry name="uuid">d0776c81-190d-41da-99c5-7419ed69b92c</entry>
Jul 29 14:50:21 user nova-compute[70924]:       <entry name="family">Virtual Machine</entry>
Jul 29 14:50:21 user nova-compute[70924]:     </system>
Jul 29 14:50:21 user nova-compute[70924]:   </sysinfo>
Jul 29 14:50:21 user nova-compute[70924]:   <os>
Jul 29 14:50:21 user nova-compute[70924]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 14:50:21 user nova-compute[70924]:     <boot dev="hd"/>
Jul 29 14:50:21 user nova-compute[70924]:     <smbios mode="sysinfo"/>
Jul 29 14:50:21 user nova-compute[70924]:   </os>
Jul 29 14:50:21 user nova-compute[70924]:   <features>
Jul 29 14:50:21 user nova-compute[70924]:     <acpi/>
Jul 29 14:50:21 user nova-compute[70924]:     <apic/>
Jul 29 14:50:21 user nova-compute[70924]:     <vmcoreinfo/>
Jul 29 14:50:21 user nova-compute[70924]:   </features>
Jul 29 14:50:21 user nova-compute[70924]:   <clock offset="utc">
Jul 29 14:50:21 user nova-compute[70924]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 14:50:21 user nova-compute[70924]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 14:50:21 user nova-compute[70924]:     <timer name="hpet" present="no"/>
Jul 29 14:50:21 user nova-compute[70924]:   </clock>
Jul 29 14:50:21 user nova-compute[70924]:   <cpu mode="custom" match="exact">
Jul 29 14:50:21 user nova-compute[70924]:     <model>Nehalem</model>
Jul 29 14:50:21 user nova-compute[70924]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 14:50:21 user nova-compute[70924]:   </cpu>
Jul 29 14:50:21 user nova-compute[70924]:   <devices>
Jul 29 14:50:21 user nova-compute[70924]:     <disk type="file" device="disk">
Jul 29 14:50:21 user nova-compute[70924]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 14:50:21 user nova-compute[70924]:       <source file="/opt/stack/data/nova/instances/d0776c81-190d-41da-99c5-7419ed69b92c/disk"/>
Jul 29 14:50:21 user nova-compute[70924]:       <target dev="vda" bus="virtio"/>
Jul 29 14:50:21 user nova-compute[70924]:     </disk>
Jul 29 14:50:21 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 14:50:21 user nova-compute[70924]:       <mac address="fa:16:3e:8e:67:39"/>
Jul 29 14:50:21 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:50:21 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 14:50:21 user nova-compute[70924]:       <target dev="tap77586dcd-0e"/>
Jul 29 14:50:21 user nova-compute[70924]:     </interface>
Jul 29 14:50:21 user nova-compute[70924]:     <serial type="pty">
Jul 29 14:50:21 user nova-compute[70924]:       <log file="/opt/stack/data/nova/instances/d0776c81-190d-41da-99c5-7419ed69b92c/console.log" append="off"/>
Jul 29 14:50:21 user nova-compute[70924]:     </serial>
Jul 29 14:50:21 user nova-compute[70924]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 14:50:21 user nova-compute[70924]:     <video>
Jul 29 14:50:21 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:50:21 user nova-compute[70924]:     </video>
Jul 29 14:50:21 user nova-compute[70924]:     <rng model="virtio">
Jul 29 14:50:21 user nova-compute[70924]:       <backend model="random">/dev/urandom</backend>
Jul 29 14:50:21 user nova-compute[70924]:     </rng>
Jul 29 14:50:21 user nova-compute[70924]:     <controller type="usb" index="0" model="none"/>
Jul 29 14:50:21 user nova-compute[70924]:     <memballoon model="virtio">
Jul 29 14:50:21 user nova-compute[70924]:       <stats period="10"/>
Jul 29 14:50:21 user nova-compute[70924]:     </memballoon>
Jul 29 14:50:21 user nova-compute[70924]:   </devices>
Jul 29 14:50:21 user nova-compute[70924]: </domain>
Jul 29 14:50:21 user nova-compute[70924]:  {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 14:50:21 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:50:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2134470961',display_name='tempest-ServersNegativeTestJSON-server-2134470961',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2134470961',id=29,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d5793d2e5b9451f9ef38fa61cb877d5',ramdisk_id='',reservation_id='r-9ij64diu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1209083119',owner_user_name='tempest-ServersNegativeTestJSON-1209083119-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:50:19Z,user_data=None,user_id='0fe49a3ddecb49d78f668df836df4ce8',uuid=d0776c81-190d-41da-99c5-7419ed69b92c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77586dcd-0ed2-4e9c-a29f-324b2726a962", "address": "fa:16:3e:8e:67:39", "network": {"id": "cb1ab4d5-0cba-4628-bca8-015a7acce83b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-875103426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d5793d2e5b9451f9ef38fa61cb877d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77586dcd-0e", "ovs_interfaceid": "77586dcd-0ed2-4e9c-a29f-324b2726a962", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 14:50:21 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Converting VIF {"id": "77586dcd-0ed2-4e9c-a29f-324b2726a962", "address": "fa:16:3e:8e:67:39", "network": {"id": "cb1ab4d5-0cba-4628-bca8-015a7acce83b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-875103426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d5793d2e5b9451f9ef38fa61cb877d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77586dcd-0e", "ovs_interfaceid": "77586dcd-0ed2-4e9c-a29f-324b2726a962", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:50:21 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:67:39,bridge_name='br-int',has_traffic_filtering=True,id=77586dcd-0ed2-4e9c-a29f-324b2726a962,network=Network(cb1ab4d5-0cba-4628-bca8-015a7acce83b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77586dcd-0e') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:50:21 user nova-compute[70924]: DEBUG os_vif [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:67:39,bridge_name='br-int',has_traffic_filtering=True,id=77586dcd-0ed2-4e9c-a29f-324b2726a962,network=Network(cb1ab4d5-0cba-4628-bca8-015a7acce83b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77586dcd-0e') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 14:50:21 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:21 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:50:21 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 14:50:21 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:21 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap77586dcd-0e, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:50:21 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap77586dcd-0e, col_values=(('external_ids', {'iface-id': '77586dcd-0ed2-4e9c-a29f-324b2726a962', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:67:39', 'vm-uuid': 'd0776c81-190d-41da-99c5-7419ed69b92c'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:50:21 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:21 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:50:21 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:21 user nova-compute[70924]: INFO os_vif [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:67:39,bridge_name='br-int',has_traffic_filtering=True,id=77586dcd-0ed2-4e9c-a29f-324b2726a962,network=Network(cb1ab4d5-0cba-4628-bca8-015a7acce83b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77586dcd-0e')
Jul 29 14:50:21 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:50:21 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] No VIF found with MAC fa:16:3e:8e:67:39, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:50:21 user nova-compute[70924]: DEBUG nova.network.neutron [req-42a3bdba-026f-4dad-a938-7b13dbc049a5 req-9ba93cdd-669e-42b6-89e6-b7dde562c8c0 service nova] [instance: d0776c81-190d-41da-99c5-7419ed69b92c] Updated VIF entry in instance network info cache for port 77586dcd-0ed2-4e9c-a29f-324b2726a962. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:50:21 user nova-compute[70924]: DEBUG nova.network.neutron [req-42a3bdba-026f-4dad-a938-7b13dbc049a5 req-9ba93cdd-669e-42b6-89e6-b7dde562c8c0 service nova] [instance: d0776c81-190d-41da-99c5-7419ed69b92c] Updating instance_info_cache with network_info: [{"id": "77586dcd-0ed2-4e9c-a29f-324b2726a962", "address": "fa:16:3e:8e:67:39", "network": {"id": "cb1ab4d5-0cba-4628-bca8-015a7acce83b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-875103426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d5793d2e5b9451f9ef38fa61cb877d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77586dcd-0e", "ovs_interfaceid": "77586dcd-0ed2-4e9c-a29f-324b2726a962", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:50:21 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-42a3bdba-026f-4dad-a938-7b13dbc049a5 req-9ba93cdd-669e-42b6-89e6-b7dde562c8c0 service nova] Releasing lock "refresh_cache-d0776c81-190d-41da-99c5-7419ed69b92c" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:50:22 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:22 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:22 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:23 user nova-compute[70924]: DEBUG nova.compute.manager [req-b3a0fb9f-ba28-468d-b679-ca48542b271f req-b7e0631a-1b1a-4149-a55f-0a4f7a7738c0 service nova] [instance: d0776c81-190d-41da-99c5-7419ed69b92c] Received event network-vif-plugged-77586dcd-0ed2-4e9c-a29f-324b2726a962 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:50:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b3a0fb9f-ba28-468d-b679-ca48542b271f req-b7e0631a-1b1a-4149-a55f-0a4f7a7738c0 service nova] Acquiring lock "d0776c81-190d-41da-99c5-7419ed69b92c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:50:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b3a0fb9f-ba28-468d-b679-ca48542b271f req-b7e0631a-1b1a-4149-a55f-0a4f7a7738c0 service nova] Lock "d0776c81-190d-41da-99c5-7419ed69b92c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:50:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b3a0fb9f-ba28-468d-b679-ca48542b271f req-b7e0631a-1b1a-4149-a55f-0a4f7a7738c0 service nova] Lock "d0776c81-190d-41da-99c5-7419ed69b92c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:50:23 user nova-compute[70924]: DEBUG nova.compute.manager [req-b3a0fb9f-ba28-468d-b679-ca48542b271f req-b7e0631a-1b1a-4149-a55f-0a4f7a7738c0 service nova] [instance: d0776c81-190d-41da-99c5-7419ed69b92c] No waiting events found dispatching network-vif-plugged-77586dcd-0ed2-4e9c-a29f-324b2726a962 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:50:23 user nova-compute[70924]: WARNING nova.compute.manager [req-b3a0fb9f-ba28-468d-b679-ca48542b271f req-b7e0631a-1b1a-4149-a55f-0a4f7a7738c0 service nova] [instance: d0776c81-190d-41da-99c5-7419ed69b92c] Received unexpected event network-vif-plugged-77586dcd-0ed2-4e9c-a29f-324b2726a962 for instance with vm_state building and task_state spawning.
Jul 29 14:50:23 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:23 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:25 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642225.1886234, d0776c81-190d-41da-99c5-7419ed69b92c => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:50:25 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: d0776c81-190d-41da-99c5-7419ed69b92c] VM Resumed (Lifecycle Event)
Jul 29 14:50:25 user nova-compute[70924]: DEBUG nova.compute.manager [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: d0776c81-190d-41da-99c5-7419ed69b92c] Instance event wait completed in 0 seconds for  {{(pid=70924) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 14:50:25 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: d0776c81-190d-41da-99c5-7419ed69b92c] Guest created on hypervisor {{(pid=70924) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 14:50:25 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: d0776c81-190d-41da-99c5-7419ed69b92c] Instance spawned successfully.
Jul 29 14:50:25 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: d0776c81-190d-41da-99c5-7419ed69b92c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 14:50:25 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: d0776c81-190d-41da-99c5-7419ed69b92c] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:50:25 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: d0776c81-190d-41da-99c5-7419ed69b92c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:50:25 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: d0776c81-190d-41da-99c5-7419ed69b92c] Found default for hw_cdrom_bus of ide {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:50:25 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: d0776c81-190d-41da-99c5-7419ed69b92c] Found default for hw_disk_bus of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:50:25 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: d0776c81-190d-41da-99c5-7419ed69b92c] Found default for hw_input_bus of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:50:25 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: d0776c81-190d-41da-99c5-7419ed69b92c] Found default for hw_pointer_model of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:50:25 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: d0776c81-190d-41da-99c5-7419ed69b92c] Found default for hw_video_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:50:25 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: d0776c81-190d-41da-99c5-7419ed69b92c] Found default for hw_vif_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:50:25 user nova-compute[70924]: DEBUG nova.compute.manager [req-4e869f95-6701-4484-a6cb-6858b02817f5 req-3c08236b-cb6b-43d5-b7e7-f7379880c409 service nova] [instance: d0776c81-190d-41da-99c5-7419ed69b92c] Received event network-vif-plugged-77586dcd-0ed2-4e9c-a29f-324b2726a962 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:50:25 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-4e869f95-6701-4484-a6cb-6858b02817f5 req-3c08236b-cb6b-43d5-b7e7-f7379880c409 service nova] Acquiring lock "d0776c81-190d-41da-99c5-7419ed69b92c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:50:25 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-4e869f95-6701-4484-a6cb-6858b02817f5 req-3c08236b-cb6b-43d5-b7e7-f7379880c409 service nova] Lock "d0776c81-190d-41da-99c5-7419ed69b92c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:50:25 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-4e869f95-6701-4484-a6cb-6858b02817f5 req-3c08236b-cb6b-43d5-b7e7-f7379880c409 service nova] Lock "d0776c81-190d-41da-99c5-7419ed69b92c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:50:25 user nova-compute[70924]: DEBUG nova.compute.manager [req-4e869f95-6701-4484-a6cb-6858b02817f5 req-3c08236b-cb6b-43d5-b7e7-f7379880c409 service nova] [instance: d0776c81-190d-41da-99c5-7419ed69b92c] No waiting events found dispatching network-vif-plugged-77586dcd-0ed2-4e9c-a29f-324b2726a962 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:50:25 user nova-compute[70924]: WARNING nova.compute.manager [req-4e869f95-6701-4484-a6cb-6858b02817f5 req-3c08236b-cb6b-43d5-b7e7-f7379880c409 service nova] [instance: d0776c81-190d-41da-99c5-7419ed69b92c] Received unexpected event network-vif-plugged-77586dcd-0ed2-4e9c-a29f-324b2726a962 for instance with vm_state building and task_state spawning.
Jul 29 14:50:25 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: d0776c81-190d-41da-99c5-7419ed69b92c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:50:25 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642225.1926153, d0776c81-190d-41da-99c5-7419ed69b92c => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:50:25 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: d0776c81-190d-41da-99c5-7419ed69b92c] VM Started (Lifecycle Event)
Jul 29 14:50:25 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: d0776c81-190d-41da-99c5-7419ed69b92c] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:50:25 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: d0776c81-190d-41da-99c5-7419ed69b92c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:50:25 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: d0776c81-190d-41da-99c5-7419ed69b92c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:50:25 user nova-compute[70924]: INFO nova.compute.manager [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: d0776c81-190d-41da-99c5-7419ed69b92c] Took 6.02 seconds to spawn the instance on the hypervisor.
Jul 29 14:50:25 user nova-compute[70924]: DEBUG nova.compute.manager [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: d0776c81-190d-41da-99c5-7419ed69b92c] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:50:25 user nova-compute[70924]: INFO nova.compute.manager [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: d0776c81-190d-41da-99c5-7419ed69b92c] Took 7.03 seconds to build instance.
Jul 29 14:50:25 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0be09266-8026-4c50-a15e-94c1a29c16e0 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Lock "d0776c81-190d-41da-99c5-7419ed69b92c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.126s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:50:26 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:29 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53e2aecb-7452-4cdc-8dc3-83201e299f44 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Calling os-brick to attach iSCSI Volume {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 14:50:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e2aecb-7452-4cdc-8dc3-83201e299f44 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xWibJIcX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:50:29 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-53e2aecb-7452-4cdc-8dc3-83201e299f44 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:50:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-53e2aecb-7452-4cdc-8dc3-83201e299f44 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:50:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-53e2aecb-7452-4cdc-8dc3-83201e299f44 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:50:29 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-53e2aecb-7452-4cdc-8dc3-83201e299f44 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:50:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-53e2aecb-7452-4cdc-8dc3-83201e299f44 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:50:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-53e2aecb-7452-4cdc-8dc3-83201e299f44 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:50:29 user nova-compute[70924]: INFO os_brick.initiator.connectors.iscsi [None req-53e2aecb-7452-4cdc-8dc3-83201e299f44 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 14:50:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef -p 172.16.0.220:3260 {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:29 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[de94915f-c71e-4870-8b97-d84d4e30093f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e2aecb-7452-4cdc-8dc3-83201e299f44 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 14:50:29 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:50:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef -p 172.16.0.220:3260 --interface default --op new {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:29 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[38fffc64-285b-4493-92c1-c45406c2c55c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef] added\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e2aecb-7452-4cdc-8dc3-83201e299f44 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef] added
Jul 29 14:50:29 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:50:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:29 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea5c7f8-7284-445d-92a8-68f2277934a3]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e2aecb-7452-4cdc-8dc3-83201e299f44 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:50:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:29 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[748d0762-45bc-4c3b-b15f-8670ff773a09]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e2aecb-7452-4cdc-8dc3-83201e299f44 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:50:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xWibJIcX {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xWibJIcX" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:29 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c39844-37b9-43bd-90b2-cbde2e61a38a]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e2aecb-7452-4cdc-8dc3-83201e299f44 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xWibJIcX'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:50:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:29 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b41665-904a-4db4-be91-6d463ef2116b]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e2aecb-7452-4cdc-8dc3-83201e299f44 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:50:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:29 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b58d8b-1700-4884-986c-67177cc4512f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e2aecb-7452-4cdc-8dc3-83201e299f44 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:50:29 user nova-compute[70924]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)
Jul 29 14:50:29 user nova-compute[70924]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:50:29 user nova-compute[70924]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)
Jul 29 14:50:29 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:50:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e2aecb-7452-4cdc-8dc3-83201e299f44 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:50:29 user nova-compute[70924]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)
Jul 29 14:50:29 user nova-compute[70924]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:50:29 user nova-compute[70924]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)
Jul 29 14:50:29 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:50:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef -p 172.16.0.220:3260 --login {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:29 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf3c9d8-223f-4387-b140-ac177187f732]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e2aecb-7452-4cdc-8dc3-83201e299f44 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef, portal: 172.16.0.220,3260]
Jul 29 14:50:29 user nova-compute[70924]: Login to [iface: default, target: iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef, portal: 172.16.0.220,3260] successful.
Jul 29 14:50:29 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:50:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:29 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1cdc01-60c7-467c-b5f5-fa525603516e]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e2aecb-7452-4cdc-8dc3-83201e299f44 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:50:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:29 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e019d069-e26f-4f95-93eb-8c59b3d555a6]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e2aecb-7452-4cdc-8dc3-83201e299f44 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:50:29 user nova-compute[70924]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)
Jul 29 14:50:29 user nova-compute[70924]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:50:29 user nova-compute[70924]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)
Jul 29 14:50:29 user nova-compute[70924]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)
Jul 29 14:50:29 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:50:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e2aecb-7452-4cdc-8dc3-83201e299f44 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:50:29 user nova-compute[70924]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)
Jul 29 14:50:29 user nova-compute[70924]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:50:29 user nova-compute[70924]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)
Jul 29 14:50:29 user nova-compute[70924]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)
Jul 29 14:50:29 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:50:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-53e2aecb-7452-4cdc-8dc3-83201e299f44 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:50:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e2aecb-7452-4cdc-8dc3-83201e299f44 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Connected to 172.16.0.220:3260 {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 14:50:29 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-53e2aecb-7452-4cdc-8dc3-83201e299f44 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] HCTL ('37', '-', '-', 0) found on session 26 with lun 0 {{(pid=70924) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 14:50:29 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-53e2aecb-7452-4cdc-8dc3-83201e299f44 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=70924) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 14:50:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:29 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[849a5f22-b797-4945-85b8-3f6936311a6e]: (4, ('- - 0', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:29 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-53e2aecb-7452-4cdc-8dc3-83201e299f44 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Searching for a device in session 26 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 14:50:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e2aecb-7452-4cdc-8dc3-83201e299f44 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xWibJIcX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 14:50:30 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-53e2aecb-7452-4cdc-8dc3-83201e299f44 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:50:30 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e2aecb-7452-4cdc-8dc3-83201e299f44 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '23863623333313730', 'path': '/dev/sdf'} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:50:30 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53e2aecb-7452-4cdc-8dc3-83201e299f44 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23863623333313730', 'path': '/dev/sdf'} {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 14:50:30 user nova-compute[70924]: DEBUG nova.objects.instance [None req-53e2aecb-7452-4cdc-8dc3-83201e299f44 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Lazy-loading 'flavor' on Instance uuid f5350fb5-9460-490b-a47e-74f88c8eb51c {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:50:30 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-53e2aecb-7452-4cdc-8dc3-83201e299f44 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] attach device xml: <disk type="block" device="disk">
Jul 29 14:50:30 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:50:30 user nova-compute[70924]:   <source dev="/dev/sdf"/>
Jul 29 14:50:30 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 14:50:30 user nova-compute[70924]:   <serial>40240a39-c2db-4b14-bc97-0fb20849bdef</serial>
Jul 29 14:50:30 user nova-compute[70924]: </disk>
Jul 29 14:50:30 user nova-compute[70924]:  {{(pid=70924) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 29 14:50:30 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-53e2aecb-7452-4cdc-8dc3-83201e299f44 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:50:30 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-53e2aecb-7452-4cdc-8dc3-83201e299f44 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:50:30 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-53e2aecb-7452-4cdc-8dc3-83201e299f44 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] No VIF found with MAC fa:16:3e:90:f1:53, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:50:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-53e2aecb-7452-4cdc-8dc3-83201e299f44 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Lock "f5350fb5-9460-490b-a47e-74f88c8eb51c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.141s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:50:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:32 user nova-compute[70924]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690642217.5289185, 7cb12b3e-de44-4887-ab74-2a68164b5f7d => Stopped> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:50:32 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] VM Stopped (Lifecycle Event)
Jul 29 14:50:32 user nova-compute[70924]: DEBUG nova.compute.manager [None req-4efca1e3-780a-464f-aa88-7aec82e452da None None] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:50:32 user nova-compute[70924]: DEBUG nova.compute.manager [None req-4efca1e3-780a-464f-aa88-7aec82e452da None None] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:50:33 user nova-compute[70924]: DEBUG nova.compute.manager [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Stashing vm_state: active {{(pid=70924) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Jul 29 14:50:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:50:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:50:33 user nova-compute[70924]: DEBUG nova.objects.instance [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Lazy-loading 'pci_requests' on Instance uuid f5350fb5-9460-490b-a47e-74f88c8eb51c {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:50:33 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70924) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 14:50:33 user nova-compute[70924]: INFO nova.compute.claims [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Claim successful on node user
Jul 29 14:50:33 user nova-compute[70924]: DEBUG nova.objects.instance [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Lazy-loading 'resources' on Instance uuid f5350fb5-9460-490b-a47e-74f88c8eb51c {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:50:33 user nova-compute[70924]: DEBUG nova.objects.instance [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Lazy-loading 'pci_devices' on Instance uuid f5350fb5-9460-490b-a47e-74f88c8eb51c {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:50:33 user nova-compute[70924]: INFO nova.compute.resource_tracker [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Updating resource usage from migration 34c17454-041c-408f-80d8-2702f06cc0d4
Jul 29 14:50:33 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:33 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:50:33 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:50:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.616s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:50:33 user nova-compute[70924]: INFO nova.compute.manager [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Migrating
Jul 29 14:50:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:50:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Acquired lock "compute-rpcapi-router" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:50:33 user nova-compute[70924]: INFO nova.compute.rpcapi [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Jul 29 14:50:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Releasing lock "compute-rpcapi-router" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:50:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Acquiring lock "refresh_cache-f5350fb5-9460-490b-a47e-74f88c8eb51c" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:50:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Acquired lock "refresh_cache-f5350fb5-9460-490b-a47e-74f88c8eb51c" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:50:33 user nova-compute[70924]: DEBUG nova.network.neutron [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 14:50:34 user nova-compute[70924]: DEBUG nova.network.neutron [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Updating instance_info_cache with network_info: [{"id": "c4a5a7c9-34d6-4040-87a3-78c4fd26b170", "address": "fa:16:3e:90:f1:53", "network": {"id": "d87dd51f-8870-4dfa-b608-7c4b662219ca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1964327887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd007df2b3e04ab784369809178e4240", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a5a7c9-34", "ovs_interfaceid": "c4a5a7c9-34d6-4040-87a3-78c4fd26b170", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:50:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Releasing lock "refresh_cache-f5350fb5-9460-490b-a47e-74f88c8eb51c" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:50:34 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Starting migrate_disk_and_power_off {{(pid=70924) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Jul 29 14:50:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:34 user nova-compute[70924]: DEBUG nova.compute.manager [req-dd57bdf4-ed40-4735-a63f-9d63a5af82f5 req-2b6aefc5-4bac-4636-8450-d6aaf07a83d0 service nova] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Received event network-vif-unplugged-c4a5a7c9-34d6-4040-87a3-78c4fd26b170 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:50:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-dd57bdf4-ed40-4735-a63f-9d63a5af82f5 req-2b6aefc5-4bac-4636-8450-d6aaf07a83d0 service nova] Acquiring lock "f5350fb5-9460-490b-a47e-74f88c8eb51c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:50:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-dd57bdf4-ed40-4735-a63f-9d63a5af82f5 req-2b6aefc5-4bac-4636-8450-d6aaf07a83d0 service nova] Lock "f5350fb5-9460-490b-a47e-74f88c8eb51c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:50:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-dd57bdf4-ed40-4735-a63f-9d63a5af82f5 req-2b6aefc5-4bac-4636-8450-d6aaf07a83d0 service nova] Lock "f5350fb5-9460-490b-a47e-74f88c8eb51c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:50:34 user nova-compute[70924]: DEBUG nova.compute.manager [req-dd57bdf4-ed40-4735-a63f-9d63a5af82f5 req-2b6aefc5-4bac-4636-8450-d6aaf07a83d0 service nova] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] No waiting events found dispatching network-vif-unplugged-c4a5a7c9-34d6-4040-87a3-78c4fd26b170 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:50:34 user nova-compute[70924]: WARNING nova.compute.manager [req-dd57bdf4-ed40-4735-a63f-9d63a5af82f5 req-2b6aefc5-4bac-4636-8450-d6aaf07a83d0 service nova] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Received unexpected event network-vif-unplugged-c4a5a7c9-34d6-4040-87a3-78c4fd26b170 for instance with vm_state active and task_state resize_migrating.
Jul 29 14:50:35 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Instance destroyed successfully.
Jul 29 14:50:35 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:46:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1255761132',display_name='tempest-ServerActionsTestOtherB-server-1255761132',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1255761132',id=18,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIBMm7U7DNUnZfHvCCwqmdK01H/F7FPPtGEiHdQU/UfZbvDiHS9WyDAl4KpLKXM2BWrjymDoAA5PpeT/LkSZzEFYL6ZRKv5TsemED0bunybXK/h2EPtICo6kFvAJz1A93g==',key_name='tempest-keypair-566023039',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:46:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fd007df2b3e04ab784369809178e4240',ramdisk_id='',reservation_id='r-z4t1omey',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-298005467',owner_user_name='tempest-ServerActionsTestOtherB-298005467-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:50:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6e2628064a66492e9f85e99332ac3ceb',uuid=f5350fb5-9460-490b-a47e-74f88c8eb51c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c4a5a7c9-34d6-4040-87a3-78c4fd26b170", "address": "fa:16:3e:90:f1:53", "network": {"id": "d87dd51f-8870-4dfa-b608-7c4b662219ca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1964327887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1964327887-network", "vif_mac": "fa:16:3e:90:f1:53"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd007df2b3e04ab784369809178e4240", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a5a7c9-34", "ovs_interfaceid": "c4a5a7c9-34d6-4040-87a3-78c4fd26b170", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 14:50:35 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Converting VIF {"id": "c4a5a7c9-34d6-4040-87a3-78c4fd26b170", "address": "fa:16:3e:90:f1:53", "network": {"id": "d87dd51f-8870-4dfa-b608-7c4b662219ca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1964327887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1964327887-network", "vif_mac": "fa:16:3e:90:f1:53"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd007df2b3e04ab784369809178e4240", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a5a7c9-34", "ovs_interfaceid": "c4a5a7c9-34d6-4040-87a3-78c4fd26b170", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:50:35 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:90:f1:53,bridge_name='br-int',has_traffic_filtering=True,id=c4a5a7c9-34d6-4040-87a3-78c4fd26b170,network=Network(d87dd51f-8870-4dfa-b608-7c4b662219ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4a5a7c9-34') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:50:35 user nova-compute[70924]: DEBUG os_vif [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:f1:53,bridge_name='br-int',has_traffic_filtering=True,id=c4a5a7c9-34d6-4040-87a3-78c4fd26b170,network=Network(d87dd51f-8870-4dfa-b608-7c4b662219ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4a5a7c9-34') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 14:50:35 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:35 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc4a5a7c9-34, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:50:35 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:50:35 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:35 user nova-compute[70924]: INFO os_vif [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:f1:53,bridge_name='br-int',has_traffic_filtering=True,id=c4a5a7c9-34d6-4040-87a3-78c4fd26b170,network=Network(d87dd51f-8870-4dfa-b608-7c4b662219ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4a5a7c9-34')
Jul 29 14:50:35 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] calling os-brick to detach iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 14:50:35 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, {'target_iqns': ['iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xWibJIcX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:50:35 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:50:35 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:50:35 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:50:35 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef', 0)] {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 14:50:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:35 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc9b162-2581-4f85-9e60-30fecf8af979]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:35 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33cf40d-fb0a-46c4-80b9-4b7b8d4e29bd]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:35 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:50:35 user nova-compute[70924]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)
Jul 29 14:50:35 user nova-compute[70924]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:50:35 user nova-compute[70924]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)
Jul 29 14:50:35 user nova-compute[70924]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)
Jul 29 14:50:35 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:50:35 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:50:35 user nova-compute[70924]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)
Jul 29 14:50:35 user nova-compute[70924]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:50:35 user nova-compute[70924]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)
Jul 29 14:50:35 user nova-compute[70924]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)
Jul 29 14:50:35 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:50:35 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feedc69fac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef'): ({'sdf'}, set())}) {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 14:50:35 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Removing single pathed devices sdf {{(pid=70924) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 14:50:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:35 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8df7050-9a9f-4edb-a129-3a53d488734a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:35 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6982a799-c1c7-4fea-9772-43dccdeb40c8]: (4, ('ok\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:35 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Flushing IO for device /dev/sdf {{(pid=70924) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 14:50:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:35 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d6b7b9-8af7-45cc-8017-503a33bfc06b]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:35 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=70924) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 14:50:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.063s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:35 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d8f415-9911-4ea1-9f42-c8ce35dbfe21]: (4, ('1', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:35 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 14:50:35 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] SCSI volumes sdf have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 14:50:35 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef')] {{(pid=70924) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 14:50:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:35 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce18cf1-56ca-4167-b54e-640c6654155c]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:35 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:50:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef -p 172.16.0.220:3260 --logout {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:35 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc175a68-e339-457e-8de3-69b2b5d4de29]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:35 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef, portal: 172.16.0.220,3260]
Jul 29 14:50:35 user nova-compute[70924]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef, portal: 172.16.0.220,3260] successful.
Jul 29 14:50:35 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:50:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef -p 172.16.0.220:3260 --op delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:35 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9dfae8-5317-44e2-ab23-62a9ded55bee]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:35 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:50:35 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:50:35 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] <== disconnect_volume: return (296ms) None {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:50:35 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Disconnected iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 14:50:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:35 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 14:50:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c_resize/disk /opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c/disk {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:36 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] CMD "cp -r /opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c_resize/disk /opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c/disk" returned: 0 in 0.352s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:36 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c_resize/disk.info /opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c/disk.info {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:36 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] CMD "cp -r /opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c_resize/disk.info /opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c/disk.info" returned: 0 in 0.032s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:36 user nova-compute[70924]: DEBUG nova.compute.manager [req-6822a745-8a8e-4b6b-b2ca-3530d562301f req-ba677f6f-1909-4e4b-861b-625588b6bc40 service nova] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Received event network-vif-plugged-c4a5a7c9-34d6-4040-87a3-78c4fd26b170 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:50:36 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-6822a745-8a8e-4b6b-b2ca-3530d562301f req-ba677f6f-1909-4e4b-861b-625588b6bc40 service nova] Acquiring lock "f5350fb5-9460-490b-a47e-74f88c8eb51c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:50:36 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-6822a745-8a8e-4b6b-b2ca-3530d562301f req-ba677f6f-1909-4e4b-861b-625588b6bc40 service nova] Lock "f5350fb5-9460-490b-a47e-74f88c8eb51c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:50:36 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-6822a745-8a8e-4b6b-b2ca-3530d562301f req-ba677f6f-1909-4e4b-861b-625588b6bc40 service nova] Lock "f5350fb5-9460-490b-a47e-74f88c8eb51c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:50:36 user nova-compute[70924]: DEBUG nova.compute.manager [req-6822a745-8a8e-4b6b-b2ca-3530d562301f req-ba677f6f-1909-4e4b-861b-625588b6bc40 service nova] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] No waiting events found dispatching network-vif-plugged-c4a5a7c9-34d6-4040-87a3-78c4fd26b170 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:50:36 user nova-compute[70924]: WARNING nova.compute.manager [req-6822a745-8a8e-4b6b-b2ca-3530d562301f req-ba677f6f-1909-4e4b-861b-625588b6bc40 service nova] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Received unexpected event network-vif-plugged-c4a5a7c9-34d6-4040-87a3-78c4fd26b170 for instance with vm_state active and task_state resize_migrating.
Jul 29 14:50:37 user nova-compute[70924]: DEBUG nova.network.neutron [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Port c4a5a7c9-34d6-4040-87a3-78c4fd26b170 binding to destination host user is already ACTIVE {{(pid=70924) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Jul 29 14:50:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Acquiring lock "f5350fb5-9460-490b-a47e-74f88c8eb51c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:50:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Lock "f5350fb5-9460-490b-a47e-74f88c8eb51c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:50:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Lock "f5350fb5-9460-490b-a47e-74f88c8eb51c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:50:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Acquiring lock "refresh_cache-f5350fb5-9460-490b-a47e-74f88c8eb51c" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:50:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Acquired lock "refresh_cache-f5350fb5-9460-490b-a47e-74f88c8eb51c" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:50:37 user nova-compute[70924]: DEBUG nova.network.neutron [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 14:50:37 user nova-compute[70924]: DEBUG nova.network.neutron [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Updating instance_info_cache with network_info: [{"id": "c4a5a7c9-34d6-4040-87a3-78c4fd26b170", "address": "fa:16:3e:90:f1:53", "network": {"id": "d87dd51f-8870-4dfa-b608-7c4b662219ca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1964327887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd007df2b3e04ab784369809178e4240", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a5a7c9-34", "ovs_interfaceid": "c4a5a7c9-34d6-4040-87a3-78c4fd26b170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:50:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Releasing lock "refresh_cache-f5350fb5-9460-490b-a47e-74f88c8eb51c" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:50:38 user nova-compute[70924]: DEBUG os_brick.utils [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:50:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:38 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dab54cf-bf56-416e-86c7-4a3b079dc08f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f2127c4a30d9\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:38 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[be38a16d-9991-42c8-96af-a67baa221e81]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:38 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2834b1d-58fd-4407-90e9-95e9ca47e110]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:38 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7cc185-41c5-4ae0-a457-0299969af31f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Running cmd (subprocess): nvme version {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] 'nvme version' failed. Not Retrying. {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:50:38 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] nvme not present on system {{(pid=70924) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 14:50:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:50:38 user nova-compute[70924]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 14:50:38 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b9163c9-1f31-4073-b61a-45b0111aed8f]: (4, '') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:38 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70924) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 14:50:38 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 14:50:38 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] LIGHTOS: no hostnqn found. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 14:50:38 user nova-compute[70924]: DEBUG os_brick.utils [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f2127c4a30d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:50:38 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:40 user nova-compute[70924]: DEBUG nova.compute.manager [req-46676a03-eb15-49c9-b16a-13518b6aa632 req-e3060146-ee8a-44ea-91c3-cb70f99d6104 service nova] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Received event network-changed-d95eba18-cd83-40e6-847a-c36b2e084f89 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:50:40 user nova-compute[70924]: DEBUG nova.compute.manager [req-46676a03-eb15-49c9-b16a-13518b6aa632 req-e3060146-ee8a-44ea-91c3-cb70f99d6104 service nova] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Refreshing instance network info cache due to event network-changed-d95eba18-cd83-40e6-847a-c36b2e084f89. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:50:40 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-46676a03-eb15-49c9-b16a-13518b6aa632 req-e3060146-ee8a-44ea-91c3-cb70f99d6104 service nova] Acquiring lock "refresh_cache-bdaf1714-27f9-47ee-808b-206ec78c6067" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:50:40 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-46676a03-eb15-49c9-b16a-13518b6aa632 req-e3060146-ee8a-44ea-91c3-cb70f99d6104 service nova] Acquired lock "refresh_cache-bdaf1714-27f9-47ee-808b-206ec78c6067" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:50:40 user nova-compute[70924]: DEBUG nova.network.neutron [req-46676a03-eb15-49c9-b16a-13518b6aa632 req-e3060146-ee8a-44ea-91c3-cb70f99d6104 service nova] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Refreshing network info cache for port d95eba18-cd83-40e6-847a-c36b2e084f89 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:50:40 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:40 user nova-compute[70924]: DEBUG nova.network.neutron [req-46676a03-eb15-49c9-b16a-13518b6aa632 req-e3060146-ee8a-44ea-91c3-cb70f99d6104 service nova] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Updated VIF entry in instance network info cache for port d95eba18-cd83-40e6-847a-c36b2e084f89. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:50:40 user nova-compute[70924]: DEBUG nova.network.neutron [req-46676a03-eb15-49c9-b16a-13518b6aa632 req-e3060146-ee8a-44ea-91c3-cb70f99d6104 service nova] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Updating instance_info_cache with network_info: [{"id": "d95eba18-cd83-40e6-847a-c36b2e084f89", "address": "fa:16:3e:45:15:fc", "network": {"id": "ff833b6e-b3ce-44ac-88ec-775f193cdfe4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-546934977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f5f9f30926f47afad3cb4c9e89d55c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd95eba18-cd", "ovs_interfaceid": "d95eba18-cd83-40e6-847a-c36b2e084f89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:50:40 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-46676a03-eb15-49c9-b16a-13518b6aa632 req-e3060146-ee8a-44ea-91c3-cb70f99d6104 service nova] Releasing lock "refresh_cache-bdaf1714-27f9-47ee-808b-206ec78c6067" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:50:42 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-f2114975-d99f-48c7-9f8c-2242b07ab366 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Acquiring lock "1f7989ca-77e9-440f-bd2f-60e46e005557" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:50:42 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-f2114975-d99f-48c7-9f8c-2242b07ab366 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lock "1f7989ca-77e9-440f-bd2f-60e46e005557" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:50:42 user nova-compute[70924]: DEBUG nova.objects.instance [None req-f2114975-d99f-48c7-9f8c-2242b07ab366 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lazy-loading 'flavor' on Instance uuid 1f7989ca-77e9-440f-bd2f-60e46e005557 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:50:42 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-f2114975-d99f-48c7-9f8c-2242b07ab366 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lock "1f7989ca-77e9-440f-bd2f-60e46e005557" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:50:42 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-f2114975-d99f-48c7-9f8c-2242b07ab366 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Acquiring lock "1f7989ca-77e9-440f-bd2f-60e46e005557" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:50:42 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-f2114975-d99f-48c7-9f8c-2242b07ab366 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lock "1f7989ca-77e9-440f-bd2f-60e46e005557" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:50:42 user nova-compute[70924]: INFO nova.compute.manager [None req-f2114975-d99f-48c7-9f8c-2242b07ab366 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Attaching volume 48b7d610-c3f3-46a6-a129-366e9ba5e18e to /dev/vdb
Jul 29 14:50:42 user nova-compute[70924]: DEBUG os_brick.utils [None req-f2114975-d99f-48c7-9f8c-2242b07ab366 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:50:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:42 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[874cbc91-dfaa-4064-8617-579108e512dd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f2127c4a30d9\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:42 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff89678-479e-40bd-bc73-90a81c8ea42f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:42 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8cbcece-309e-449f-9f53-512b73ab3811]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:42 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c0f6bf-0b85-4b5e-8238-72fe6acf54a7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-f2114975-d99f-48c7-9f8c-2242b07ab366 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Running cmd (subprocess): nvme version {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-f2114975-d99f-48c7-9f8c-2242b07ab366 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] 'nvme version' failed. Not Retrying. {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:50:42 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f2114975-d99f-48c7-9f8c-2242b07ab366 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] nvme not present on system {{(pid=70924) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 14:50:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:50:42 user nova-compute[70924]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 14:50:42 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af69bcb-b2d0-4c2a-9953-f1ef2f034629]: (4, '') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:42 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-f2114975-d99f-48c7-9f8c-2242b07ab366 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70924) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 14:50:42 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-f2114975-d99f-48c7-9f8c-2242b07ab366 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 14:50:42 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-f2114975-d99f-48c7-9f8c-2242b07ab366 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] LIGHTOS: no hostnqn found. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 14:50:42 user nova-compute[70924]: DEBUG os_brick.utils [None req-f2114975-d99f-48c7-9f8c-2242b07ab366 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f2127c4a30d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:50:42 user nova-compute[70924]: DEBUG nova.virt.block_device [None req-f2114975-d99f-48c7-9f8c-2242b07ab366 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Updating existing volume attachment record: 68e0568e-7e54-463a-aa73-51234f13d9c0 {{(pid=70924) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 14:50:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:45 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:45 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-03c21ac7-40e1-4f1a-a061-39374f9e598e tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Acquiring lock "bdaf1714-27f9-47ee-808b-206ec78c6067" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:50:45 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-03c21ac7-40e1-4f1a-a061-39374f9e598e tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "bdaf1714-27f9-47ee-808b-206ec78c6067" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:50:45 user nova-compute[70924]: INFO nova.compute.manager [None req-03c21ac7-40e1-4f1a-a061-39374f9e598e tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Shelving
Jul 29 14:50:45 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:45 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:45 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:45 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:45 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:45 user nova-compute[70924]: DEBUG nova.compute.manager [req-cd5cb562-5d40-4801-887c-5ff8930c345f req-f3271c4a-242c-4dc3-8939-59dda9b5c2c1 service nova] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Received event network-vif-unplugged-d95eba18-cd83-40e6-847a-c36b2e084f89 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:50:45 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-cd5cb562-5d40-4801-887c-5ff8930c345f req-f3271c4a-242c-4dc3-8939-59dda9b5c2c1 service nova] Acquiring lock "bdaf1714-27f9-47ee-808b-206ec78c6067-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:50:45 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-cd5cb562-5d40-4801-887c-5ff8930c345f req-f3271c4a-242c-4dc3-8939-59dda9b5c2c1 service nova] Lock "bdaf1714-27f9-47ee-808b-206ec78c6067-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:50:45 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-cd5cb562-5d40-4801-887c-5ff8930c345f req-f3271c4a-242c-4dc3-8939-59dda9b5c2c1 service nova] Lock "bdaf1714-27f9-47ee-808b-206ec78c6067-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:50:45 user nova-compute[70924]: DEBUG nova.compute.manager [req-cd5cb562-5d40-4801-887c-5ff8930c345f req-f3271c4a-242c-4dc3-8939-59dda9b5c2c1 service nova] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] No waiting events found dispatching network-vif-unplugged-d95eba18-cd83-40e6-847a-c36b2e084f89 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:50:45 user nova-compute[70924]: WARNING nova.compute.manager [req-cd5cb562-5d40-4801-887c-5ff8930c345f req-f3271c4a-242c-4dc3-8939-59dda9b5c2c1 service nova] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Received unexpected event network-vif-unplugged-d95eba18-cd83-40e6-847a-c36b2e084f89 for instance with vm_state active and task_state shelving.
Jul 29 14:50:45 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Starting finish_migration {{(pid=70924) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Jul 29 14:50:45 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Instance directory exists: not creating {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 29 14:50:45 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Creating image(s)
Jul 29 14:50:46 user nova-compute[70924]: DEBUG nova.objects.instance [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Lazy-loading 'trusted_certs' on Instance uuid f5350fb5-9460-490b-a47e-74f88c8eb51c {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2e5eb191-37df-4449-a136-0604b633d81d tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Acquiring lock "a8d47810-5115-41fd-a4be-86aa2f716c79" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2e5eb191-37df-4449-a136-0604b633d81d tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Lock "a8d47810-5115-41fd-a4be-86aa2f716c79" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2e5eb191-37df-4449-a136-0604b633d81d tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Acquiring lock "a8d47810-5115-41fd-a4be-86aa2f716c79-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2e5eb191-37df-4449-a136-0604b633d81d tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Lock "a8d47810-5115-41fd-a4be-86aa2f716c79-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2e5eb191-37df-4449-a136-0604b633d81d tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Lock "a8d47810-5115-41fd-a4be-86aa2f716c79-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:50:46 user nova-compute[70924]: INFO nova.compute.manager [None req-2e5eb191-37df-4449-a136-0604b633d81d tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] Terminating instance
Jul 29 14:50:46 user nova-compute[70924]: DEBUG nova.compute.manager [None req-2e5eb191-37df-4449-a136-0604b633d81d tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] Start destroying the instance on the hypervisor. {{(pid=70924) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.159s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c/disk. size=21474836480 {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:46 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Instance destroyed successfully.
Jul 29 14:50:46 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c/disk 21474836480 {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c/disk 21474836480" returned: 0 in 0.115s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:46 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-03c21ac7-40e1-4f1a-a061-39374f9e598e tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Beginning cold snapshot process
Jul 29 14:50:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Did not create local disks {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Ensure instance console log exists: /opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c/console.log {{(pid=70924) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Start _get_guest_xml network_info=[{"id": "c4a5a7c9-34d6-4040-87a3-78c4fd26b170", "address": "fa:16:3e:90:f1:53", "network": {"id": "d87dd51f-8870-4dfa-b608-7c4b662219ca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1964327887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1964327887-network", "vif_mac": "fa:16:3e:90:f1:53"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd007df2b3e04ab784369809178e4240", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a5a7c9-34", "ovs_interfaceid": "c4a5a7c9-34d6-4040-87a3-78c4fd26b170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '3aba2e73-6832-404b-8bd0-d0503ce82b8c'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'boot_index': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xWibJIcX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'f5350fb5-9460-490b-a47e-74f88c8eb51c', 'attached_at': '2023-07-29T14:50:46.000000', 'detached_at': '', 'volume_id': '40240a39-c2db-4b14-bc97-0fb20849bdef', 'serial': '40240a39-c2db-4b14-bc97-0fb20849bdef'}, 'attachment_id': 'e237fb7d-b702-409f-aa3b-ed9762a6d62c', 'volume_type': None} {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 14:50:46 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:50:46 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:50:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] CPU controller missing on host. {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] CPU controller found on host. {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70924) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T14:36:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Flavor limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Image limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Flavor pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Image pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Got 1 possible topologies {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG nova.objects.instance [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Lazy-loading 'vcpu_model' on Instance uuid f5350fb5-9460-490b-a47e-74f88c8eb51c {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Calling os-brick to attach iSCSI Volume {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xWibJIcX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:50:46 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:50:46 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:50:46 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:50:46 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:50:46 user nova-compute[70924]: INFO os_brick.initiator.connectors.iscsi [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 14:50:46 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef -p 172.16.0.220:3260 {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG nova.compute.manager [req-866d6a2d-ace2-47a4-b456-87c80cc0dad3 req-ceb4434e-7358-4092-adc7-8c38054ed32d service nova] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] Received event network-vif-unplugged-ecae5278-1212-4eee-966e-a15a8c2b8a56 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-866d6a2d-ace2-47a4-b456-87c80cc0dad3 req-ceb4434e-7358-4092-adc7-8c38054ed32d service nova] Acquiring lock "a8d47810-5115-41fd-a4be-86aa2f716c79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-866d6a2d-ace2-47a4-b456-87c80cc0dad3 req-ceb4434e-7358-4092-adc7-8c38054ed32d service nova] Lock "a8d47810-5115-41fd-a4be-86aa2f716c79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-866d6a2d-ace2-47a4-b456-87c80cc0dad3 req-ceb4434e-7358-4092-adc7-8c38054ed32d service nova] Lock "a8d47810-5115-41fd-a4be-86aa2f716c79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG nova.compute.manager [req-866d6a2d-ace2-47a4-b456-87c80cc0dad3 req-ceb4434e-7358-4092-adc7-8c38054ed32d service nova] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] No waiting events found dispatching network-vif-unplugged-ecae5278-1212-4eee-966e-a15a8c2b8a56 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG nova.compute.manager [req-866d6a2d-ace2-47a4-b456-87c80cc0dad3 req-ceb4434e-7358-4092-adc7-8c38054ed32d service nova] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] Received event network-vif-unplugged-ecae5278-1212-4eee-966e-a15a8c2b8a56 for instance with task_state deleting. {{(pid=70924) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[22dd782e-151a-4462-981d-762d4f0986b7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 14:50:46 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef -p 172.16.0.220:3260 --interface default --op new {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd86120-c8bc-480c-a9cf-089df6f522da]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef] added\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef] added
Jul 29 14:50:46 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG nova.privsep.utils [None req-03c21ac7-40e1-4f1a-a061-39374f9e598e tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70924) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-03c21ac7-40e1-4f1a-a061-39374f9e598e tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/bdaf1714-27f9-47ee-808b-206ec78c6067/disk /opt/stack/data/nova/instances/snapshots/tmpr97d8vsz/cbf1b1b8af31421cbb00b9742cae27d9 {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1486090b-14a5-43b0-b318-5a8ada05de43]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[12448be9-9eed-4023-a696-b4f985e89f70]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xWibJIcX {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xWibJIcX" returned: 0 in 0.042s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6508c88-e9e9-42fb-8160-b5147b8afa73]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xWibJIcX'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.058s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[465f1198-c70b-491b-bd90-56a8c98495f7]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:50:46 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:47 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.051s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:47 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f66f56e-5849-4d79-8b92-841d07fd2c14]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:47 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:50:47 user nova-compute[70924]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)
Jul 29 14:50:47 user nova-compute[70924]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:50:47 user nova-compute[70924]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)
Jul 29 14:50:47 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:50:47 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:50:47 user nova-compute[70924]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)
Jul 29 14:50:47 user nova-compute[70924]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:50:47 user nova-compute[70924]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)
Jul 29 14:50:47 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:50:47 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef -p 172.16.0.220:3260 --login {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:47 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] Instance destroyed successfully.
Jul 29 14:50:47 user nova-compute[70924]: DEBUG nova.objects.instance [None req-2e5eb191-37df-4449-a136-0604b633d81d tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Lazy-loading 'resources' on Instance uuid a8d47810-5115-41fd-a4be-86aa2f716c79 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:50:47 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-2e5eb191-37df-4449-a136-0604b633d81d tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:48:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-749721387',display_name='tempest-VolumesActionsTest-instance-749721387',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-749721387',id=23,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:49:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47334cc65f984a95b4c6c06d3d8d1d40',ramdisk_id='',reservation_id='r-cr3682vz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-325820960',owner_user_name='tempest-VolumesActionsTest-325820960-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:49:02Z,user_data=None,user_id='3b1d926fc4c646dba0bf9e852302a13b',uuid=a8d47810-5115-41fd-a4be-86aa2f716c79,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ecae5278-1212-4eee-966e-a15a8c2b8a56", "address": "fa:16:3e:98:67:16", "network": {"id": "0bec09f1-f460-4e97-917e-84769ed49901", "bridge": "br-int", "label": "tempest-VolumesActionsTest-956399393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47334cc65f984a95b4c6c06d3d8d1d40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecae5278-12", "ovs_interfaceid": "ecae5278-1212-4eee-966e-a15a8c2b8a56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 14:50:47 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-2e5eb191-37df-4449-a136-0604b633d81d tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Converting VIF {"id": "ecae5278-1212-4eee-966e-a15a8c2b8a56", "address": "fa:16:3e:98:67:16", "network": {"id": "0bec09f1-f460-4e97-917e-84769ed49901", "bridge": "br-int", "label": "tempest-VolumesActionsTest-956399393-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47334cc65f984a95b4c6c06d3d8d1d40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecae5278-12", "ovs_interfaceid": "ecae5278-1212-4eee-966e-a15a8c2b8a56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:50:47 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-2e5eb191-37df-4449-a136-0604b633d81d tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:67:16,bridge_name='br-int',has_traffic_filtering=True,id=ecae5278-1212-4eee-966e-a15a8c2b8a56,network=Network(0bec09f1-f460-4e97-917e-84769ed49901),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecae5278-12') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:50:47 user nova-compute[70924]: DEBUG os_vif [None req-2e5eb191-37df-4449-a136-0604b633d81d tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:67:16,bridge_name='br-int',has_traffic_filtering=True,id=ecae5278-1212-4eee-966e-a15a8c2b8a56,network=Network(0bec09f1-f460-4e97-917e-84769ed49901),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecae5278-12') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 14:50:47 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:47 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapecae5278-12, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:50:47 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:47 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:50:47 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef -p 172.16.0.220:3260 --login" returned: 0 in 0.095s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:47 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ec352a-fb16-4372-9ca4-d8d3b620205d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:47 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef, portal: 172.16.0.220,3260]
Jul 29 14:50:47 user nova-compute[70924]: Login to [iface: default, target: iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef, portal: 172.16.0.220,3260] successful.
Jul 29 14:50:47 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:50:47 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:47 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:47 user nova-compute[70924]: INFO os_vif [None req-2e5eb191-37df-4449-a136-0604b633d81d tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:67:16,bridge_name='br-int',has_traffic_filtering=True,id=ecae5278-1212-4eee-966e-a15a8c2b8a56,network=Network(0bec09f1-f460-4e97-917e-84769ed49901),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecae5278-12')
Jul 29 14:50:47 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-2e5eb191-37df-4449-a136-0604b633d81d tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] Deleting instance files /opt/stack/data/nova/instances/a8d47810-5115-41fd-a4be-86aa2f716c79_del
Jul 29 14:50:47 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-2e5eb191-37df-4449-a136-0604b633d81d tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] Deletion of /opt/stack/data/nova/instances/a8d47810-5115-41fd-a4be-86aa2f716c79_del complete
Jul 29 14:50:47 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.041s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:47 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66e6f0d-a3e7-4dfb-b324-f3232365ae50]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:47 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:50:47 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:47 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:47 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[574daa4d-e6b9-4c25-b2b4-4b9c008f8200]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:47 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:50:47 user nova-compute[70924]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)
Jul 29 14:50:47 user nova-compute[70924]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:50:47 user nova-compute[70924]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)
Jul 29 14:50:47 user nova-compute[70924]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)
Jul 29 14:50:47 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:50:47 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:50:47 user nova-compute[70924]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)
Jul 29 14:50:47 user nova-compute[70924]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:50:47 user nova-compute[70924]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)
Jul 29 14:50:47 user nova-compute[70924]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)
Jul 29 14:50:47 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:50:47 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.553s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:50:47 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Connected to 172.16.0.220:3260 {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 14:50:47 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] HCTL ('37', '-', '-', 0) found on session 27 with lun 0 {{(pid=70924) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 14:50:47 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=70924) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 14:50:47 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:47 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.035s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:47 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[4feef4e8-78ae-4309-86b7-59a01514bad5]: (4, ('- - 0', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:47 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Searching for a device in session 27 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 14:50:47 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xWibJIcX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 14:50:47 user nova-compute[70924]: INFO nova.compute.manager [None req-2e5eb191-37df-4449-a136-0604b633d81d tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] Took 1.20 seconds to destroy the instance on the hypervisor.
Jul 29 14:50:47 user nova-compute[70924]: DEBUG oslo.service.loopingcall [None req-2e5eb191-37df-4449-a136-0604b633d81d tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70924) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 14:50:47 user nova-compute[70924]: DEBUG nova.compute.manager [-] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] Deallocating network for instance {{(pid=70924) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 14:50:47 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] deallocate_for_instance() {{(pid=70924) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 14:50:47 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:50:47 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:50:47 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:50:47 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:50:47 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Auditing locally available compute resources for user (node: user) {{(pid=70924) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 14:50:47 user nova-compute[70924]: DEBUG nova.compute.manager [req-baddc10f-6466-4ce8-9e89-d59a8bc4a7d3 req-18ccc8d5-5588-4ead-a77e-5328245f95f3 service nova] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Received event network-vif-plugged-d95eba18-cd83-40e6-847a-c36b2e084f89 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:50:47 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-baddc10f-6466-4ce8-9e89-d59a8bc4a7d3 req-18ccc8d5-5588-4ead-a77e-5328245f95f3 service nova] Acquiring lock "bdaf1714-27f9-47ee-808b-206ec78c6067-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:50:47 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-baddc10f-6466-4ce8-9e89-d59a8bc4a7d3 req-18ccc8d5-5588-4ead-a77e-5328245f95f3 service nova] Lock "bdaf1714-27f9-47ee-808b-206ec78c6067-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:50:47 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-baddc10f-6466-4ce8-9e89-d59a8bc4a7d3 req-18ccc8d5-5588-4ead-a77e-5328245f95f3 service nova] Lock "bdaf1714-27f9-47ee-808b-206ec78c6067-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:50:47 user nova-compute[70924]: DEBUG nova.compute.manager [req-baddc10f-6466-4ce8-9e89-d59a8bc4a7d3 req-18ccc8d5-5588-4ead-a77e-5328245f95f3 service nova] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] No waiting events found dispatching network-vif-plugged-d95eba18-cd83-40e6-847a-c36b2e084f89 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:50:47 user nova-compute[70924]: WARNING nova.compute.manager [req-baddc10f-6466-4ce8-9e89-d59a8bc4a7d3 req-18ccc8d5-5588-4ead-a77e-5328245f95f3 service nova] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Received unexpected event network-vif-plugged-d95eba18-cd83-40e6-847a-c36b2e084f89 for instance with vm_state active and task_state shelving_image_pending_upload.
Jul 29 14:50:47 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:47 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-03c21ac7-40e1-4f1a-a061-39374f9e598e tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/bdaf1714-27f9-47ee-808b-206ec78c6067/disk /opt/stack/data/nova/instances/snapshots/tmpr97d8vsz/cbf1b1b8af31421cbb00b9742cae27d9" returned: 0 in 1.037s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:47 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-03c21ac7-40e1-4f1a-a061-39374f9e598e tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Snapshot extracted, beginning image upload
Jul 29 14:50:47 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:47 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0776c81-190d-41da-99c5-7419ed69b92c/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0776c81-190d-41da-99c5-7419ed69b92c/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0776c81-190d-41da-99c5-7419ed69b92c/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:48 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.611s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:50:48 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] <== connect_volume: return (1614ms) {'type': 'block', 'scsi_wwn': '23863623333313730', 'path': '/dev/sdf'} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:50:48 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23863623333313730', 'path': '/dev/sdf'} {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 14:50:48 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:46:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1255761132',display_name='tempest-ServerActionsTestOtherB-server-1255761132',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1255761132',id=18,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIBMm7U7DNUnZfHvCCwqmdK01H/F7FPPtGEiHdQU/UfZbvDiHS9WyDAl4KpLKXM2BWrjymDoAA5PpeT/LkSZzEFYL6ZRKv5TsemED0bunybXK/h2EPtICo6kFvAJz1A93g==',key_name='tempest-keypair-566023039',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:46:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fd007df2b3e04ab784369809178e4240',ramdisk_id='',reservation_id='r-z4t1omey',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-298005467',owner_user_name='tempest-ServerActionsTestOtherB-298005467-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:50:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6e2628064a66492e9f85e99332ac3ceb',uuid=f5350fb5-9460-490b-a47e-74f88c8eb51c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c4a5a7c9-34d6-4040-87a3-78c4fd26b170", "address": "fa:16:3e:90:f1:53", "network": {"id": "d87dd51f-8870-4dfa-b608-7c4b662219ca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1964327887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1964327887-network", "vif_mac": "fa:16:3e:90:f1:53"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd007df2b3e04ab784369809178e4240", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a5a7c9-34", "ovs_interfaceid": "c4a5a7c9-34d6-4040-87a3-78c4fd26b170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:50:48 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Converting VIF {"id": "c4a5a7c9-34d6-4040-87a3-78c4fd26b170", "address": "fa:16:3e:90:f1:53", "network": {"id": "d87dd51f-8870-4dfa-b608-7c4b662219ca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1964327887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1964327887-network", "vif_mac": "fa:16:3e:90:f1:53"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd007df2b3e04ab784369809178e4240", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a5a7c9-34", "ovs_interfaceid": "c4a5a7c9-34d6-4040-87a3-78c4fd26b170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:50:48 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:f1:53,bridge_name='br-int',has_traffic_filtering=True,id=c4a5a7c9-34d6-4040-87a3-78c4fd26b170,network=Network(d87dd51f-8870-4dfa-b608-7c4b662219ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4a5a7c9-34') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:50:48 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] End _get_guest_xml xml=<domain type="kvm">
Jul 29 14:50:48 user nova-compute[70924]:   <uuid>f5350fb5-9460-490b-a47e-74f88c8eb51c</uuid>
Jul 29 14:50:48 user nova-compute[70924]:   <name>instance-00000012</name>
Jul 29 14:50:48 user nova-compute[70924]:   <memory>2097152</memory>
Jul 29 14:50:48 user nova-compute[70924]:   <vcpu>1</vcpu>
Jul 29 14:50:48 user nova-compute[70924]:   <metadata>
Jul 29 14:50:48 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 14:50:48 user nova-compute[70924]:       <nova:package version="0.0.0"/>
Jul 29 14:50:48 user nova-compute[70924]:       <nova:name>tempest-ServerActionsTestOtherB-server-1255761132</nova:name>
Jul 29 14:50:48 user nova-compute[70924]:       <nova:creationTime>2023-07-29 14:50:46</nova:creationTime>
Jul 29 14:50:48 user nova-compute[70924]:       <nova:flavor name="m1.small">
Jul 29 14:50:48 user nova-compute[70924]:         <nova:memory>2048</nova:memory>
Jul 29 14:50:48 user nova-compute[70924]:         <nova:disk>20</nova:disk>
Jul 29 14:50:48 user nova-compute[70924]:         <nova:swap>0</nova:swap>
Jul 29 14:50:48 user nova-compute[70924]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 14:50:48 user nova-compute[70924]:         <nova:vcpus>1</nova:vcpus>
Jul 29 14:50:48 user nova-compute[70924]:       </nova:flavor>
Jul 29 14:50:48 user nova-compute[70924]:       <nova:owner>
Jul 29 14:50:48 user nova-compute[70924]:         <nova:user uuid="6e2628064a66492e9f85e99332ac3ceb">tempest-ServerActionsTestOtherB-298005467-project-member</nova:user>
Jul 29 14:50:48 user nova-compute[70924]:         <nova:project uuid="fd007df2b3e04ab784369809178e4240">tempest-ServerActionsTestOtherB-298005467</nova:project>
Jul 29 14:50:48 user nova-compute[70924]:       </nova:owner>
Jul 29 14:50:48 user nova-compute[70924]:       <nova:root type="image" uuid="3aba2e73-6832-404b-8bd0-d0503ce82b8c"/>
Jul 29 14:50:48 user nova-compute[70924]:       <nova:ports>
Jul 29 14:50:48 user nova-compute[70924]:         <nova:port uuid="c4a5a7c9-34d6-4040-87a3-78c4fd26b170">
Jul 29 14:50:48 user nova-compute[70924]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 29 14:50:48 user nova-compute[70924]:         </nova:port>
Jul 29 14:50:48 user nova-compute[70924]:       </nova:ports>
Jul 29 14:50:48 user nova-compute[70924]:     </nova:instance>
Jul 29 14:50:48 user nova-compute[70924]:   </metadata>
Jul 29 14:50:48 user nova-compute[70924]:   <sysinfo type="smbios">
Jul 29 14:50:48 user nova-compute[70924]:     <system>
Jul 29 14:50:48 user nova-compute[70924]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 14:50:48 user nova-compute[70924]:       <entry name="product">OpenStack Nova</entry>
Jul 29 14:50:48 user nova-compute[70924]:       <entry name="version">0.0.0</entry>
Jul 29 14:50:48 user nova-compute[70924]:       <entry name="serial">f5350fb5-9460-490b-a47e-74f88c8eb51c</entry>
Jul 29 14:50:48 user nova-compute[70924]:       <entry name="uuid">f5350fb5-9460-490b-a47e-74f88c8eb51c</entry>
Jul 29 14:50:48 user nova-compute[70924]:       <entry name="family">Virtual Machine</entry>
Jul 29 14:50:48 user nova-compute[70924]:     </system>
Jul 29 14:50:48 user nova-compute[70924]:   </sysinfo>
Jul 29 14:50:48 user nova-compute[70924]:   <os>
Jul 29 14:50:48 user nova-compute[70924]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 14:50:48 user nova-compute[70924]:     <boot dev="hd"/>
Jul 29 14:50:48 user nova-compute[70924]:     <smbios mode="sysinfo"/>
Jul 29 14:50:48 user nova-compute[70924]:   </os>
Jul 29 14:50:48 user nova-compute[70924]:   <features>
Jul 29 14:50:48 user nova-compute[70924]:     <acpi/>
Jul 29 14:50:48 user nova-compute[70924]:     <apic/>
Jul 29 14:50:48 user nova-compute[70924]:     <vmcoreinfo/>
Jul 29 14:50:48 user nova-compute[70924]:   </features>
Jul 29 14:50:48 user nova-compute[70924]:   <clock offset="utc">
Jul 29 14:50:48 user nova-compute[70924]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 14:50:48 user nova-compute[70924]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 14:50:48 user nova-compute[70924]:     <timer name="hpet" present="no"/>
Jul 29 14:50:48 user nova-compute[70924]:   </clock>
Jul 29 14:50:48 user nova-compute[70924]:   <cpu mode="custom" match="exact">
Jul 29 14:50:48 user nova-compute[70924]:     <model>Nehalem</model>
Jul 29 14:50:48 user nova-compute[70924]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 14:50:48 user nova-compute[70924]:   </cpu>
Jul 29 14:50:48 user nova-compute[70924]:   <devices>
Jul 29 14:50:48 user nova-compute[70924]:     <disk type="file" device="disk">
Jul 29 14:50:48 user nova-compute[70924]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 14:50:48 user nova-compute[70924]:       <source file="/opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c/disk"/>
Jul 29 14:50:48 user nova-compute[70924]:       <target dev="vda" bus="virtio"/>
Jul 29 14:50:48 user nova-compute[70924]:     </disk>
Jul 29 14:50:48 user nova-compute[70924]:     <disk type="block" device="disk">
Jul 29 14:50:48 user nova-compute[70924]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:50:48 user nova-compute[70924]:       <source dev="/dev/sdf"/>
Jul 29 14:50:48 user nova-compute[70924]:       <target dev="vdb" bus="virtio"/>
Jul 29 14:50:48 user nova-compute[70924]:       <serial>40240a39-c2db-4b14-bc97-0fb20849bdef</serial>
Jul 29 14:50:48 user nova-compute[70924]:     </disk>
Jul 29 14:50:48 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 14:50:48 user nova-compute[70924]:       <mac address="fa:16:3e:90:f1:53"/>
Jul 29 14:50:48 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:50:48 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 14:50:48 user nova-compute[70924]:       <target dev="tapc4a5a7c9-34"/>
Jul 29 14:50:48 user nova-compute[70924]:     </interface>
Jul 29 14:50:48 user nova-compute[70924]:     <serial type="pty">
Jul 29 14:50:48 user nova-compute[70924]:       <log file="/opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c/console.log" append="off"/>
Jul 29 14:50:48 user nova-compute[70924]:     </serial>
Jul 29 14:50:48 user nova-compute[70924]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 14:50:48 user nova-compute[70924]:     <video>
Jul 29 14:50:48 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:50:48 user nova-compute[70924]:     </video>
Jul 29 14:50:48 user nova-compute[70924]:     <rng model="virtio">
Jul 29 14:50:48 user nova-compute[70924]:       <backend model="random">/dev/urandom</backend>
Jul 29 14:50:48 user nova-compute[70924]:     </rng>
Jul 29 14:50:48 user nova-compute[70924]:     <controller type="usb" index="0" model="none"/>
Jul 29 14:50:48 user nova-compute[70924]:     <memballoon model="virtio">
Jul 29 14:50:48 user nova-compute[70924]:       <stats period="10"/>
Jul 29 14:50:48 user nova-compute[70924]:     </memballoon>
Jul 29 14:50:48 user nova-compute[70924]:   </devices>
Jul 29 14:50:48 user nova-compute[70924]: </domain>
Jul 29 14:50:48 user nova-compute[70924]:  {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 14:50:48 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:46:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1255761132',display_name='tempest-ServerActionsTestOtherB-server-1255761132',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1255761132',id=18,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIBMm7U7DNUnZfHvCCwqmdK01H/F7FPPtGEiHdQU/UfZbvDiHS9WyDAl4KpLKXM2BWrjymDoAA5PpeT/LkSZzEFYL6ZRKv5TsemED0bunybXK/h2EPtICo6kFvAJz1A93g==',key_name='tempest-keypair-566023039',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:46:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fd007df2b3e04ab784369809178e4240',ramdisk_id='',reservation_id='r-z4t1omey',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-298005467',owner_user_name='tempest-ServerActionsTestOtherB-298005467-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:50:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6e2628064a66492e9f85e99332ac3ceb',uuid=f5350fb5-9460-490b-a47e-74f88c8eb51c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c4a5a7c9-34d6-4040-87a3-78c4fd26b170", "address": "fa:16:3e:90:f1:53", "network": {"id": "d87dd51f-8870-4dfa-b608-7c4b662219ca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1964327887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1964327887-network", "vif_mac": "fa:16:3e:90:f1:53"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd007df2b3e04ab784369809178e4240", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a5a7c9-34", "ovs_interfaceid": "c4a5a7c9-34d6-4040-87a3-78c4fd26b170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 14:50:48 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Converting VIF {"id": "c4a5a7c9-34d6-4040-87a3-78c4fd26b170", "address": "fa:16:3e:90:f1:53", "network": {"id": "d87dd51f-8870-4dfa-b608-7c4b662219ca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1964327887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1964327887-network", "vif_mac": "fa:16:3e:90:f1:53"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd007df2b3e04ab784369809178e4240", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a5a7c9-34", "ovs_interfaceid": "c4a5a7c9-34d6-4040-87a3-78c4fd26b170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:50:48 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:f1:53,bridge_name='br-int',has_traffic_filtering=True,id=c4a5a7c9-34d6-4040-87a3-78c4fd26b170,network=Network(d87dd51f-8870-4dfa-b608-7c4b662219ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4a5a7c9-34') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:50:48 user nova-compute[70924]: DEBUG os_vif [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:f1:53,bridge_name='br-int',has_traffic_filtering=True,id=c4a5a7c9-34d6-4040-87a3-78c4fd26b170,network=Network(d87dd51f-8870-4dfa-b608-7c4b662219ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4a5a7c9-34') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 14:50:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:50:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 14:50:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc4a5a7c9-34, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:50:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc4a5a7c9-34, col_values=(('external_ids', {'iface-id': 'c4a5a7c9-34d6-4040-87a3-78c4fd26b170', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:f1:53', 'vm-uuid': 'f5350fb5-9460-490b-a47e-74f88c8eb51c'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:50:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:50:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:48 user nova-compute[70924]: INFO os_vif [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:f1:53,bridge_name='br-int',has_traffic_filtering=True,id=c4a5a7c9-34d6-4040-87a3-78c4fd26b170,network=Network(d87dd51f-8870-4dfa-b608-7c4b662219ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4a5a7c9-34')
Jul 29 14:50:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0776c81-190d-41da-99c5-7419ed69b92c/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:48 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 14:50:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c31a724f-3006-4e5d-a9b5-847fd6cd170a/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:48 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:50:48 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:50:48 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] No VIF found with MAC fa:16:3e:90:f1:53, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:50:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c31a724f-3006-4e5d-a9b5-847fd6cd170a/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c31a724f-3006-4e5d-a9b5-847fd6cd170a/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:48 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:50:48 user nova-compute[70924]: DEBUG nova.compute.manager [req-822e0b0e-4742-4d69-b6d8-7692f20fa6b9 req-90f459ba-246f-4113-91b9-57ed95d937c7 service nova] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] Received event network-vif-deleted-ecae5278-1212-4eee-966e-a15a8c2b8a56 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:50:48 user nova-compute[70924]: INFO nova.compute.manager [req-822e0b0e-4742-4d69-b6d8-7692f20fa6b9 req-90f459ba-246f-4113-91b9-57ed95d937c7 service nova] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] Neutron deleted interface ecae5278-1212-4eee-966e-a15a8c2b8a56; detaching it from the instance and deleting it from the info cache
Jul 29 14:50:48 user nova-compute[70924]: DEBUG nova.network.neutron [req-822e0b0e-4742-4d69-b6d8-7692f20fa6b9 req-90f459ba-246f-4113-91b9-57ed95d937c7 service nova] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:50:48 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] Took 1.30 seconds to deallocate network for instance.
Jul 29 14:50:48 user nova-compute[70924]: DEBUG nova.compute.manager [req-822e0b0e-4742-4d69-b6d8-7692f20fa6b9 req-90f459ba-246f-4113-91b9-57ed95d937c7 service nova] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] Detach interface failed, port_id=ecae5278-1212-4eee-966e-a15a8c2b8a56, reason: Instance a8d47810-5115-41fd-a4be-86aa2f716c79 could not be found. {{(pid=70924) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 29 14:50:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c31a724f-3006-4e5d-a9b5-847fd6cd170a/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:48 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 14:50:48 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 14:50:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:48 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2e5eb191-37df-4449-a136-0604b633d81d tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:50:48 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2e5eb191-37df-4449-a136-0604b633d81d tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:50:48 user nova-compute[70924]: DEBUG nova.compute.manager [req-e67b6e45-9b64-420b-81d6-ec019eeab2d6 req-e48998f6-0d9d-4dcb-a14c-c9145fdba16a service nova] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] Received event network-vif-plugged-ecae5278-1212-4eee-966e-a15a8c2b8a56 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:50:48 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-e67b6e45-9b64-420b-81d6-ec019eeab2d6 req-e48998f6-0d9d-4dcb-a14c-c9145fdba16a service nova] Acquiring lock "a8d47810-5115-41fd-a4be-86aa2f716c79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:50:48 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-e67b6e45-9b64-420b-81d6-ec019eeab2d6 req-e48998f6-0d9d-4dcb-a14c-c9145fdba16a service nova] Lock "a8d47810-5115-41fd-a4be-86aa2f716c79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:50:48 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-e67b6e45-9b64-420b-81d6-ec019eeab2d6 req-e48998f6-0d9d-4dcb-a14c-c9145fdba16a service nova] Lock "a8d47810-5115-41fd-a4be-86aa2f716c79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:50:48 user nova-compute[70924]: DEBUG nova.compute.manager [req-e67b6e45-9b64-420b-81d6-ec019eeab2d6 req-e48998f6-0d9d-4dcb-a14c-c9145fdba16a service nova] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] No waiting events found dispatching network-vif-plugged-ecae5278-1212-4eee-966e-a15a8c2b8a56 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:50:48 user nova-compute[70924]: WARNING nova.compute.manager [req-e67b6e45-9b64-420b-81d6-ec019eeab2d6 req-e48998f6-0d9d-4dcb-a14c-c9145fdba16a service nova] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] Received unexpected event network-vif-plugged-ecae5278-1212-4eee-966e-a15a8c2b8a56 for instance with vm_state active and task_state deleting.
Jul 29 14:50:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f7989ca-77e9-440f-bd2f-60e46e005557/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f7989ca-77e9-440f-bd2f-60e46e005557/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f7989ca-77e9-440f-bd2f-60e46e005557/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f7989ca-77e9-440f-bd2f-60e46e005557/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7171083a-00aa-4faf-9732-88cab8a0d83d/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:49 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-2e5eb191-37df-4449-a136-0604b633d81d tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:50:49 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-2e5eb191-37df-4449-a136-0604b633d81d tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:50:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7171083a-00aa-4faf-9732-88cab8a0d83d/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7171083a-00aa-4faf-9732-88cab8a0d83d/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:49 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2e5eb191-37df-4449-a136-0604b633d81d tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.776s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:50:49 user nova-compute[70924]: INFO nova.scheduler.client.report [None req-2e5eb191-37df-4449-a136-0604b633d81d tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Deleted allocations for instance a8d47810-5115-41fd-a4be-86aa2f716c79
Jul 29 14:50:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7171083a-00aa-4faf-9732-88cab8a0d83d/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdaf1714-27f9-47ee-808b-206ec78c6067/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:49 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2e5eb191-37df-4449-a136-0604b633d81d tempest-VolumesActionsTest-325820960 tempest-VolumesActionsTest-325820960-project-member] Lock "a8d47810-5115-41fd-a4be-86aa2f716c79" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.629s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:50:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdaf1714-27f9-47ee-808b-206ec78c6067/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdaf1714-27f9-47ee-808b-206ec78c6067/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:49 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:49 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:49 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:49 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdaf1714-27f9-47ee-808b-206ec78c6067/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cb12b3e-de44-4887-ab74-2a68164b5f7d/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:50 user nova-compute[70924]: DEBUG nova.compute.manager [req-866051db-442a-4a58-936b-074632d8767c req-e7028273-3816-402c-ad7e-055ab6ea41a6 service nova] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Received event network-vif-plugged-c4a5a7c9-34d6-4040-87a3-78c4fd26b170 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:50:50 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-866051db-442a-4a58-936b-074632d8767c req-e7028273-3816-402c-ad7e-055ab6ea41a6 service nova] Acquiring lock "f5350fb5-9460-490b-a47e-74f88c8eb51c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:50:50 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-866051db-442a-4a58-936b-074632d8767c req-e7028273-3816-402c-ad7e-055ab6ea41a6 service nova] Lock "f5350fb5-9460-490b-a47e-74f88c8eb51c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:50:50 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-866051db-442a-4a58-936b-074632d8767c req-e7028273-3816-402c-ad7e-055ab6ea41a6 service nova] Lock "f5350fb5-9460-490b-a47e-74f88c8eb51c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:50:50 user nova-compute[70924]: DEBUG nova.compute.manager [req-866051db-442a-4a58-936b-074632d8767c req-e7028273-3816-402c-ad7e-055ab6ea41a6 service nova] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] No waiting events found dispatching network-vif-plugged-c4a5a7c9-34d6-4040-87a3-78c4fd26b170 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:50:50 user nova-compute[70924]: WARNING nova.compute.manager [req-866051db-442a-4a58-936b-074632d8767c req-e7028273-3816-402c-ad7e-055ab6ea41a6 service nova] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Received unexpected event network-vif-plugged-c4a5a7c9-34d6-4040-87a3-78c4fd26b170 for instance with vm_state active and task_state resize_finish.
Jul 29 14:50:50 user nova-compute[70924]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690642235.262235, f5350fb5-9460-490b-a47e-74f88c8eb51c => Stopped> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:50:50 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] VM Stopped (Lifecycle Event)
Jul 29 14:50:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cb12b3e-de44-4887-ab74-2a68164b5f7d/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cb12b3e-de44-4887-ab74-2a68164b5f7d/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:50 user nova-compute[70924]: DEBUG nova.compute.manager [None req-3d6c5b19-ba19-4edd-ba69-ead1d59f8666 None None] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:50:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cb12b3e-de44-4887-ab74-2a68164b5f7d/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:50 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 14:50:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:50 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-03c21ac7-40e1-4f1a-a061-39374f9e598e tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Snapshot image upload complete
Jul 29 14:50:50 user nova-compute[70924]: DEBUG nova.compute.manager [None req-03c21ac7-40e1-4f1a-a061-39374f9e598e tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:50:50 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:50 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:50 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:50 user nova-compute[70924]: INFO nova.compute.manager [None req-03c21ac7-40e1-4f1a-a061-39374f9e598e tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Shelve offloading
Jul 29 14:50:50 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Instance destroyed successfully.
Jul 29 14:50:50 user nova-compute[70924]: DEBUG nova.compute.manager [None req-03c21ac7-40e1-4f1a-a061-39374f9e598e tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:50:50 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-03c21ac7-40e1-4f1a-a061-39374f9e598e tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Acquiring lock "refresh_cache-bdaf1714-27f9-47ee-808b-206ec78c6067" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:50:50 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-03c21ac7-40e1-4f1a-a061-39374f9e598e tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Acquired lock "refresh_cache-bdaf1714-27f9-47ee-808b-206ec78c6067" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:50:50 user nova-compute[70924]: DEBUG nova.network.neutron [None req-03c21ac7-40e1-4f1a-a061-39374f9e598e tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 14:50:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:50 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 14:50:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:51 user nova-compute[70924]: DEBUG nova.network.neutron [None req-03c21ac7-40e1-4f1a-a061-39374f9e598e tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Updating instance_info_cache with network_info: [{"id": "d95eba18-cd83-40e6-847a-c36b2e084f89", "address": "fa:16:3e:45:15:fc", "network": {"id": "ff833b6e-b3ce-44ac-88ec-775f193cdfe4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-546934977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f5f9f30926f47afad3cb4c9e89d55c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd95eba18-cd", "ovs_interfaceid": "d95eba18-cd83-40e6-847a-c36b2e084f89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:50:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:51 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-03c21ac7-40e1-4f1a-a061-39374f9e598e tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Releasing lock "refresh_cache-bdaf1714-27f9-47ee-808b-206ec78c6067" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:50:51 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2114975-d99f-48c7-9f8c-2242b07ab366 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Calling os-brick to attach iSCSI Volume {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 14:50:51 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2114975-d99f-48c7-9f8c-2242b07ab366 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:48b7d610-c3f3-46a6-a129-366e9ba5e18e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bAhftZYD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:50:51 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-f2114975-d99f-48c7-9f8c-2242b07ab366 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:50:51 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-f2114975-d99f-48c7-9f8c-2242b07ab366 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:50:51 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-f2114975-d99f-48c7-9f8c-2242b07ab366 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:50:51 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-f2114975-d99f-48c7-9f8c-2242b07ab366 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:50:51 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-f2114975-d99f-48c7-9f8c-2242b07ab366 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48b7d610-c3f3-46a6-a129-366e9ba5e18e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:50:51 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-f2114975-d99f-48c7-9f8c-2242b07ab366 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48b7d610-c3f3-46a6-a129-366e9ba5e18e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:50:51 user nova-compute[70924]: INFO os_brick.initiator.connectors.iscsi [None req-f2114975-d99f-48c7-9f8c-2242b07ab366 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 14:50:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b7d610-c3f3-46a6-a129-366e9ba5e18e -p 172.16.0.220:3260 {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b7d610-c3f3-46a6-a129-366e9ba5e18e -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:51 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7bfb1c6-4a43-4f2b-a3bd-564df81b44ae]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:51 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2114975-d99f-48c7-9f8c-2242b07ab366 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 14:50:51 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:50:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b7d610-c3f3-46a6-a129-366e9ba5e18e -p 172.16.0.220:3260 --interface default --op new {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b7d610-c3f3-46a6-a129-366e9ba5e18e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:51 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da555a9-5b34-4a50-a6de-504f72a22b3e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48b7d610-c3f3-46a6-a129-366e9ba5e18e] added\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:51 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2114975-d99f-48c7-9f8c-2242b07ab366 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48b7d610-c3f3-46a6-a129-366e9ba5e18e] added
Jul 29 14:50:51 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:50:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b7d610-c3f3-46a6-a129-366e9ba5e18e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b7d610-c3f3-46a6-a129-366e9ba5e18e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:51 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b579fcf6-c22c-4870-87e7-602f5c347d82]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:51 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2114975-d99f-48c7-9f8c-2242b07ab366 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:50:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b7d610-c3f3-46a6-a129-366e9ba5e18e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b7d610-c3f3-46a6-a129-366e9ba5e18e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:51 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c54af3-5b0f-4d4b-aaaf-09e76c008941]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:51 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2114975-d99f-48c7-9f8c-2242b07ab366 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:50:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b7d610-c3f3-46a6-a129-366e9ba5e18e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bAhftZYD {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b7d610-c3f3-46a6-a129-366e9ba5e18e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bAhftZYD" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:51 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e91ace9e-334e-499c-945a-7d7def9d7284]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:51 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2114975-d99f-48c7-9f8c-2242b07ab366 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bAhftZYD'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:50:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b7d610-c3f3-46a6-a129-366e9ba5e18e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:51 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:50:51 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:50:51 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Hypervisor/Node resource view: name=user free_ram=6968MB free_disk=25.296653747558594GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70924) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 14:50:51 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:50:51 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:50:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b7d610-c3f3-46a6-a129-366e9ba5e18e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:51 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7404427-8852-46e1-bc32-8337d65d06c6]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:51 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2114975-d99f-48c7-9f8c-2242b07ab366 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:50:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:51 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8a6d94-4a1b-43a7-afd7-a4db630b04c5]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:51 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2114975-d99f-48c7-9f8c-2242b07ab366 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:50:51 user nova-compute[70924]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)
Jul 29 14:50:51 user nova-compute[70924]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:50:51 user nova-compute[70924]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)
Jul 29 14:50:51 user nova-compute[70924]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)
Jul 29 14:50:51 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:50:51 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2114975-d99f-48c7-9f8c-2242b07ab366 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:50:51 user nova-compute[70924]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)
Jul 29 14:50:51 user nova-compute[70924]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:50:51 user nova-compute[70924]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)
Jul 29 14:50:51 user nova-compute[70924]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)
Jul 29 14:50:51 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:50:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b7d610-c3f3-46a6-a129-366e9ba5e18e -p 172.16.0.220:3260 --login {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:52 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b7d610-c3f3-46a6-a129-366e9ba5e18e -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:52 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[170e8692-2e9c-459c-a42a-adbfb2189f57]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:48b7d610-c3f3-46a6-a129-366e9ba5e18e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:48b7d610-c3f3-46a6-a129-366e9ba5e18e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:52 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2114975-d99f-48c7-9f8c-2242b07ab366 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:48b7d610-c3f3-46a6-a129-366e9ba5e18e, portal: 172.16.0.220,3260]
Jul 29 14:50:52 user nova-compute[70924]: Login to [iface: default, target: iqn.2010-10.org.openstack:48b7d610-c3f3-46a6-a129-366e9ba5e18e, portal: 172.16.0.220,3260] successful.
Jul 29 14:50:52 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:50:52 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Applying migration context for instance f5350fb5-9460-490b-a47e-74f88c8eb51c as it has an incoming, in-progress migration 34c17454-041c-408f-80d8-2702f06cc0d4. Migration status is post-migrating {{(pid=70924) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Jul 29 14:50:52 user nova-compute[70924]: INFO nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Updating resource usage from migration 34c17454-041c-408f-80d8-2702f06cc0d4
Jul 29 14:50:52 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b7d610-c3f3-46a6-a129-366e9ba5e18e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:52 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b7d610-c3f3-46a6-a129-366e9ba5e18e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:52 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[39898916-a3dd-42e2-9113-b753faa1fc75]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:52 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2114975-d99f-48c7-9f8c-2242b07ab366 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:50:52 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:52 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance db656346-c4af-43da-9600-fd39f1b9e4dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:50:52 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 86ecc6cb-88a8-4572-8e41-d4c5859036a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:50:52 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 02c75b00-a1b4-4ef9-ae96-bc67d8038589 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:50:52 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 1f7989ca-77e9-440f-bd2f-60e46e005557 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:50:52 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 7cb12b3e-de44-4887-ab74-2a68164b5f7d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:50:52 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 7171083a-00aa-4faf-9732-88cab8a0d83d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:50:52 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance bdaf1714-27f9-47ee-808b-206ec78c6067 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:50:52 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 9ec07c62-951b-4e3a-bffa-e01dfb4665ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:50:52 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 091e384f-7851-4ac9-b566-990df0497fc5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:50:52 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance c31a724f-3006-4e5d-a9b5-847fd6cd170a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:50:52 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance fd91d5fc-857d-4d63-ad83-8028c1d3309f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:50:52 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance fd57baf8-6306-4553-a058-e915fb543405 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:50:52 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance d0776c81-190d-41da-99c5-7419ed69b92c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:50:52 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Migration 34c17454-041c-408f-80d8-2702f06cc0d4 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Jul 29 14:50:52 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance f5350fb5-9460-490b-a47e-74f88c8eb51c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:50:52 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 14:50:52 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Final resource view: name=user phys_ram=16011MB used_ram=9728MB phys_disk=40GB used_disk=31GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 14:50:52 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:52 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac93462-1cd6-40ab-9de6-ca82b330dc15]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b7d610-c3f3-46a6-a129-366e9ba5e18e (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:52 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2114975-d99f-48c7-9f8c-2242b07ab366 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:50:52 user nova-compute[70924]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)
Jul 29 14:50:52 user nova-compute[70924]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:50:52 user nova-compute[70924]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)
Jul 29 14:50:52 user nova-compute[70924]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)
Jul 29 14:50:52 user nova-compute[70924]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b7d610-c3f3-46a6-a129-366e9ba5e18e (non-flash)
Jul 29 14:50:52 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:50:52 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2114975-d99f-48c7-9f8c-2242b07ab366 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:50:52 user nova-compute[70924]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)
Jul 29 14:50:52 user nova-compute[70924]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:50:52 user nova-compute[70924]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)
Jul 29 14:50:52 user nova-compute[70924]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)
Jul 29 14:50:52 user nova-compute[70924]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b7d610-c3f3-46a6-a129-366e9ba5e18e (non-flash)
Jul 29 14:50:52 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:50:52 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-f2114975-d99f-48c7-9f8c-2242b07ab366 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48b7d610-c3f3-46a6-a129-366e9ba5e18e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.749s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:50:52 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2114975-d99f-48c7-9f8c-2242b07ab366 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Connected to 172.16.0.220:3260 {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 14:50:52 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-f2114975-d99f-48c7-9f8c-2242b07ab366 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] HCTL ('38', '-', '-', 0) found on session 28 with lun 0 {{(pid=70924) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 14:50:52 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-f2114975-d99f-48c7-9f8c-2242b07ab366 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=70924) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 14:50:52 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:52 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642252.1270173, f5350fb5-9460-490b-a47e-74f88c8eb51c => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:50:52 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] VM Resumed (Lifecycle Event)
Jul 29 14:50:52 user nova-compute[70924]: DEBUG nova.compute.manager [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Instance event wait completed in 0 seconds for  {{(pid=70924) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 14:50:52 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:52 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b8df3d-44be-43e4-adb5-d18c255a495f]: (4, ('- - 0', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:52 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-f2114975-d99f-48c7-9f8c-2242b07ab366 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Searching for a device in session 28 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 14:50:52 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2114975-d99f-48c7-9f8c-2242b07ab366 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bAhftZYD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 14:50:52 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Instance running successfully.
Jul 29 14:50:52 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Failed to set time: agent not configured {{(pid=70924) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Jul 29 14:50:52 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-1cdb0a9e-675d-4b71-b631-bd5c901ed319 tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] finish_migration finished successfully. {{(pid=70924) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Jul 29 14:50:52 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:50:52 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:50:52 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 29 14:50:52 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642252.1355014, f5350fb5-9460-490b-a47e-74f88c8eb51c => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:50:52 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] VM Started (Lifecycle Event)
Jul 29 14:50:52 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:50:52 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:50:52 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 29 14:50:52 user nova-compute[70924]: DEBUG nova.compute.manager [req-3626759a-a9cc-4e43-be66-f51e8e40b655 req-579440be-55a7-4942-a4e1-c6ae0b753c21 service nova] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Received event network-vif-plugged-c4a5a7c9-34d6-4040-87a3-78c4fd26b170 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:50:52 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-3626759a-a9cc-4e43-be66-f51e8e40b655 req-579440be-55a7-4942-a4e1-c6ae0b753c21 service nova] Acquiring lock "f5350fb5-9460-490b-a47e-74f88c8eb51c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:50:52 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-3626759a-a9cc-4e43-be66-f51e8e40b655 req-579440be-55a7-4942-a4e1-c6ae0b753c21 service nova] Lock "f5350fb5-9460-490b-a47e-74f88c8eb51c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:50:52 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-3626759a-a9cc-4e43-be66-f51e8e40b655 req-579440be-55a7-4942-a4e1-c6ae0b753c21 service nova] Lock "f5350fb5-9460-490b-a47e-74f88c8eb51c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:50:52 user nova-compute[70924]: DEBUG nova.compute.manager [req-3626759a-a9cc-4e43-be66-f51e8e40b655 req-579440be-55a7-4942-a4e1-c6ae0b753c21 service nova] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] No waiting events found dispatching network-vif-plugged-c4a5a7c9-34d6-4040-87a3-78c4fd26b170 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:50:52 user nova-compute[70924]: WARNING nova.compute.manager [req-3626759a-a9cc-4e43-be66-f51e8e40b655 req-579440be-55a7-4942-a4e1-c6ae0b753c21 service nova] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Received unexpected event network-vif-plugged-c4a5a7c9-34d6-4040-87a3-78c4fd26b170 for instance with vm_state active and task_state resize_finish.
Jul 29 14:50:52 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Instance destroyed successfully.
Jul 29 14:50:52 user nova-compute[70924]: DEBUG nova.objects.instance [None req-03c21ac7-40e1-4f1a-a061-39374f9e598e tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lazy-loading 'resources' on Instance uuid bdaf1714-27f9-47ee-808b-206ec78c6067 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:50:52 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-03c21ac7-40e1-4f1a-a061-39374f9e598e tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:48:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-54166973',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-54166973',id=22,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4138Bk00KQqmdfErUxFcQgiDYdWqeBsVhjPxaQRe+n75igQpnWmMVo4wZ/3rzplwKKaH6Hx7du1dBe18tcOE6kgd7gQe+rlVaexoX2OrP2lfJM85qo3Gho73g735rkUA==',key_name='tempest-keypair-1998502930',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:48:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='6f5f9f30926f47afad3cb4c9e89d55c5',ramdisk_id='',reservation_id='r-zgo1dppv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-130200384',owner_user_name='tempest-AttachVolumeShelveTestJSON-130200384-project-member',shelved_at='2023-07-29T14:50:50.604172',shelved_host='user',shelved_image_id='24784092-a866-4b07-b0dc-41421ee6964a'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:50:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c9562451ffa45b2aad975335d83fa8c',uuid=bdaf1714-27f9-47ee-808b-206ec78c6067,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "d95eba18-cd83-40e6-847a-c36b2e084f89", "address": "fa:16:3e:45:15:fc", "network": {"id": "ff833b6e-b3ce-44ac-88ec-775f193cdfe4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-546934977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f5f9f30926f47afad3cb4c9e89d55c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd95eba18-cd", "ovs_interfaceid": "d95eba18-cd83-40e6-847a-c36b2e084f89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 14:50:52 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-03c21ac7-40e1-4f1a-a061-39374f9e598e tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Converting VIF {"id": "d95eba18-cd83-40e6-847a-c36b2e084f89", "address": "fa:16:3e:45:15:fc", "network": {"id": "ff833b6e-b3ce-44ac-88ec-775f193cdfe4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-546934977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f5f9f30926f47afad3cb4c9e89d55c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd95eba18-cd", "ovs_interfaceid": "d95eba18-cd83-40e6-847a-c36b2e084f89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:50:52 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-03c21ac7-40e1-4f1a-a061-39374f9e598e tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:15:fc,bridge_name='br-int',has_traffic_filtering=True,id=d95eba18-cd83-40e6-847a-c36b2e084f89,network=Network(ff833b6e-b3ce-44ac-88ec-775f193cdfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd95eba18-cd') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:50:52 user nova-compute[70924]: DEBUG os_vif [None req-03c21ac7-40e1-4f1a-a061-39374f9e598e tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:15:fc,bridge_name='br-int',has_traffic_filtering=True,id=d95eba18-cd83-40e6-847a-c36b2e084f89,network=Network(ff833b6e-b3ce-44ac-88ec-775f193cdfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd95eba18-cd') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 14:50:52 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:52 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd95eba18-cd, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:50:52 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:52 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:50:52 user nova-compute[70924]: DEBUG nova.compute.manager [req-8155a42b-f156-47c9-80f6-da64ca410434 req-c1cf1762-0f35-4aa1-abff-cc2270b62cd8 service nova] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Received event network-changed-d95eba18-cd83-40e6-847a-c36b2e084f89 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:50:52 user nova-compute[70924]: DEBUG nova.compute.manager [req-8155a42b-f156-47c9-80f6-da64ca410434 req-c1cf1762-0f35-4aa1-abff-cc2270b62cd8 service nova] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Refreshing instance network info cache due to event network-changed-d95eba18-cd83-40e6-847a-c36b2e084f89. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:50:52 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-8155a42b-f156-47c9-80f6-da64ca410434 req-c1cf1762-0f35-4aa1-abff-cc2270b62cd8 service nova] Acquiring lock "refresh_cache-bdaf1714-27f9-47ee-808b-206ec78c6067" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:50:52 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-8155a42b-f156-47c9-80f6-da64ca410434 req-c1cf1762-0f35-4aa1-abff-cc2270b62cd8 service nova] Acquired lock "refresh_cache-bdaf1714-27f9-47ee-808b-206ec78c6067" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:50:52 user nova-compute[70924]: DEBUG nova.network.neutron [req-8155a42b-f156-47c9-80f6-da64ca410434 req-c1cf1762-0f35-4aa1-abff-cc2270b62cd8 service nova] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Refreshing network info cache for port d95eba18-cd83-40e6-847a-c36b2e084f89 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:50:52 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:52 user nova-compute[70924]: INFO os_vif [None req-03c21ac7-40e1-4f1a-a061-39374f9e598e tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:15:fc,bridge_name='br-int',has_traffic_filtering=True,id=d95eba18-cd83-40e6-847a-c36b2e084f89,network=Network(ff833b6e-b3ce-44ac-88ec-775f193cdfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd95eba18-cd')
Jul 29 14:50:52 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-03c21ac7-40e1-4f1a-a061-39374f9e598e tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Deleting instance files /opt/stack/data/nova/instances/bdaf1714-27f9-47ee-808b-206ec78c6067_del
Jul 29 14:50:52 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-03c21ac7-40e1-4f1a-a061-39374f9e598e tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Deletion of /opt/stack/data/nova/instances/bdaf1714-27f9-47ee-808b-206ec78c6067_del complete
Jul 29 14:50:52 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:50:52 user nova-compute[70924]: INFO nova.scheduler.client.report [None req-03c21ac7-40e1-4f1a-a061-39374f9e598e tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Deleted allocations for instance bdaf1714-27f9-47ee-808b-206ec78c6067
Jul 29 14:50:52 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:50:52 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Compute_service record updated for user:user {{(pid=70924) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 14:50:52 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.720s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:50:52 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-03c21ac7-40e1-4f1a-a061-39374f9e598e tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:50:52 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-03c21ac7-40e1-4f1a-a061-39374f9e598e tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:50:52 user nova-compute[70924]: DEBUG nova.objects.instance [None req-03c21ac7-40e1-4f1a-a061-39374f9e598e tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lazy-loading 'numa_topology' on Instance uuid bdaf1714-27f9-47ee-808b-206ec78c6067 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:50:52 user nova-compute[70924]: DEBUG nova.network.neutron [req-8155a42b-f156-47c9-80f6-da64ca410434 req-c1cf1762-0f35-4aa1-abff-cc2270b62cd8 service nova] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Updated VIF entry in instance network info cache for port d95eba18-cd83-40e6-847a-c36b2e084f89. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:50:52 user nova-compute[70924]: DEBUG nova.network.neutron [req-8155a42b-f156-47c9-80f6-da64ca410434 req-c1cf1762-0f35-4aa1-abff-cc2270b62cd8 service nova] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Updating instance_info_cache with network_info: [{"id": "d95eba18-cd83-40e6-847a-c36b2e084f89", "address": "fa:16:3e:45:15:fc", "network": {"id": "ff833b6e-b3ce-44ac-88ec-775f193cdfe4", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-546934977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f5f9f30926f47afad3cb4c9e89d55c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapd95eba18-cd", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:50:52 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-8155a42b-f156-47c9-80f6-da64ca410434 req-c1cf1762-0f35-4aa1-abff-cc2270b62cd8 service nova] Releasing lock "refresh_cache-bdaf1714-27f9-47ee-808b-206ec78c6067" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:50:53 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-03c21ac7-40e1-4f1a-a061-39374f9e598e tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:50:53 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-03c21ac7-40e1-4f1a-a061-39374f9e598e tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:50:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-03c21ac7-40e1-4f1a-a061-39374f9e598e tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.438s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:50:53 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-f2114975-d99f-48c7-9f8c-2242b07ab366 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.797s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:50:53 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2114975-d99f-48c7-9f8c-2242b07ab366 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] <== connect_volume: return (1800ms) {'type': 'block', 'scsi_wwn': '23763653863666539', 'path': '/dev/sdg'} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:50:53 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2114975-d99f-48c7-9f8c-2242b07ab366 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23763653863666539', 'path': '/dev/sdg'} {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 14:50:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-03c21ac7-40e1-4f1a-a061-39374f9e598e tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "bdaf1714-27f9-47ee-808b-206ec78c6067" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.804s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:50:53 user nova-compute[70924]: DEBUG nova.objects.instance [None req-f2114975-d99f-48c7-9f8c-2242b07ab366 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lazy-loading 'flavor' on Instance uuid 1f7989ca-77e9-440f-bd2f-60e46e005557 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:50:53 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-f2114975-d99f-48c7-9f8c-2242b07ab366 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] attach device xml: <disk type="block" device="disk">
Jul 29 14:50:53 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:50:53 user nova-compute[70924]:   <source dev="/dev/sdg"/>
Jul 29 14:50:53 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 14:50:53 user nova-compute[70924]:   <serial>48b7d610-c3f3-46a6-a129-366e9ba5e18e</serial>
Jul 29 14:50:53 user nova-compute[70924]: </disk>
Jul 29 14:50:53 user nova-compute[70924]:  {{(pid=70924) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 29 14:50:53 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:53 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-f2114975-d99f-48c7-9f8c-2242b07ab366 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:50:53 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-f2114975-d99f-48c7-9f8c-2242b07ab366 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:50:53 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-f2114975-d99f-48c7-9f8c-2242b07ab366 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] No VIF found with MAC fa:16:3e:09:43:b7, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:50:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-f2114975-d99f-48c7-9f8c-2242b07ab366 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lock "1f7989ca-77e9-440f-bd2f-60e46e005557" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.061s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:50:55 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:50:55 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:50:55 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:50:55 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Starting heal instance info cache {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 14:50:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "refresh_cache-02c75b00-a1b4-4ef9-ae96-bc67d8038589" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:50:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquired lock "refresh_cache-02c75b00-a1b4-4ef9-ae96-bc67d8038589" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:50:55 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Forcefully refreshing network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 29 14:50:56 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-d731df7b-b6c3-4109-a1db-2aada032e039 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Acquiring lock "1f7989ca-77e9-440f-bd2f-60e46e005557" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:50:56 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-d731df7b-b6c3-4109-a1db-2aada032e039 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lock "1f7989ca-77e9-440f-bd2f-60e46e005557" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:50:56 user nova-compute[70924]: INFO nova.compute.manager [None req-d731df7b-b6c3-4109-a1db-2aada032e039 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Detaching volume 48b7d610-c3f3-46a6-a129-366e9ba5e18e
Jul 29 14:50:56 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Updating instance_info_cache with network_info: [{"id": "25798da4-8f4d-4db1-afd2-7fb85693bc16", "address": "fa:16:3e:59:2c:bb", "network": {"id": "d5876e18-e2af-45c2-aab5-2d0d552ebfe4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2035085552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9e5c78c1684c359cfab4e32b9c213f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25798da4-8f", "ovs_interfaceid": "25798da4-8f4d-4db1-afd2-7fb85693bc16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:50:56 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Releasing lock "refresh_cache-02c75b00-a1b4-4ef9-ae96-bc67d8038589" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:50:56 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Updated the network info_cache for instance {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 29 14:50:56 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:50:56 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:50:56 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:50:56 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:50:56 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:50:56 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:50:56 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70924) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 14:50:56 user nova-compute[70924]: INFO nova.virt.block_device [None req-d731df7b-b6c3-4109-a1db-2aada032e039 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Attempting to driver detach volume 48b7d610-c3f3-46a6-a129-366e9ba5e18e from mountpoint /dev/vdb
Jul 29 14:50:56 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-d731df7b-b6c3-4109-a1db-2aada032e039 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Attempting to detach device vdb from instance 1f7989ca-77e9-440f-bd2f-60e46e005557 from the persistent domain config. {{(pid=70924) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 29 14:50:56 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-d731df7b-b6c3-4109-a1db-2aada032e039 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 14:50:56 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:50:56 user nova-compute[70924]:   <source dev="/dev/sdg"/>
Jul 29 14:50:56 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 14:50:56 user nova-compute[70924]:   <serial>48b7d610-c3f3-46a6-a129-366e9ba5e18e</serial>
Jul 29 14:50:56 user nova-compute[70924]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 14:50:56 user nova-compute[70924]: </disk>
Jul 29 14:50:56 user nova-compute[70924]:  {{(pid=70924) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 14:50:56 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-d731df7b-b6c3-4109-a1db-2aada032e039 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Successfully detached device vdb from instance 1f7989ca-77e9-440f-bd2f-60e46e005557 from the persistent domain config.
Jul 29 14:50:56 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-d731df7b-b6c3-4109-a1db-2aada032e039 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1f7989ca-77e9-440f-bd2f-60e46e005557 from the live domain config. {{(pid=70924) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 29 14:50:56 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-d731df7b-b6c3-4109-a1db-2aada032e039 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 14:50:56 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:50:56 user nova-compute[70924]:   <source dev="/dev/sdg"/>
Jul 29 14:50:56 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 14:50:56 user nova-compute[70924]:   <serial>48b7d610-c3f3-46a6-a129-366e9ba5e18e</serial>
Jul 29 14:50:56 user nova-compute[70924]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 14:50:56 user nova-compute[70924]: </disk>
Jul 29 14:50:56 user nova-compute[70924]:  {{(pid=70924) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 14:50:56 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Received event <DeviceRemovedEvent: 1690642256.7989986, 1f7989ca-77e9-440f-bd2f-60e46e005557 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70924) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 29 14:50:56 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-d731df7b-b6c3-4109-a1db-2aada032e039 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1f7989ca-77e9-440f-bd2f-60e46e005557 {{(pid=70924) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 29 14:50:56 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-d731df7b-b6c3-4109-a1db-2aada032e039 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Successfully detached device vdb from instance 1f7989ca-77e9-440f-bd2f-60e46e005557 from the live domain config.
Jul 29 14:50:56 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d731df7b-b6c3-4109-a1db-2aada032e039 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] calling os-brick to detach iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 14:50:56 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-d731df7b-b6c3-4109-a1db-2aada032e039 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, {'target_iqns': ['iqn.2010-10.org.openstack:48b7d610-c3f3-46a6-a129-366e9ba5e18e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bAhftZYD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:50:56 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-d731df7b-b6c3-4109-a1db-2aada032e039 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:50:56 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-d731df7b-b6c3-4109-a1db-2aada032e039 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:50:56 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-d731df7b-b6c3-4109-a1db-2aada032e039 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:50:56 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-d731df7b-b6c3-4109-a1db-2aada032e039 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48b7d610-c3f3-46a6-a129-366e9ba5e18e', 0)] {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 14:50:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:56 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b17a8749-874a-4fb4-80c6-ec26c5ff38c0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48b7d610-c3f3-46a6-a129-366e9ba5e18e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:56 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da48efd-2fa4-4218-8651-3bf4b01d7a95]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b7d610-c3f3-46a6-a129-366e9ba5e18e (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:56 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-d731df7b-b6c3-4109-a1db-2aada032e039 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:50:56 user nova-compute[70924]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)
Jul 29 14:50:56 user nova-compute[70924]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:50:56 user nova-compute[70924]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)
Jul 29 14:50:56 user nova-compute[70924]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)
Jul 29 14:50:56 user nova-compute[70924]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b7d610-c3f3-46a6-a129-366e9ba5e18e (non-flash)
Jul 29 14:50:56 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:50:56 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-d731df7b-b6c3-4109-a1db-2aada032e039 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:50:56 user nova-compute[70924]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)
Jul 29 14:50:56 user nova-compute[70924]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:50:56 user nova-compute[70924]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)
Jul 29 14:50:56 user nova-compute[70924]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)
Jul 29 14:50:56 user nova-compute[70924]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b7d610-c3f3-46a6-a129-366e9ba5e18e (non-flash)
Jul 29 14:50:56 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:50:56 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-d731df7b-b6c3-4109-a1db-2aada032e039 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feedc4bd750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48b7d610-c3f3-46a6-a129-366e9ba5e18e'): ({'sdg'}, set())}) {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 14:50:56 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-d731df7b-b6c3-4109-a1db-2aada032e039 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Removing single pathed devices sdg {{(pid=70924) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 14:50:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:56 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3cdc2bb-4eb0-4fe6-ac3b-425fbd0522a7]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:56 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9e5cb2-bbda-475b-8891-321378fbaf00]: (4, ('ok\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:56 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-d731df7b-b6c3-4109-a1db-2aada032e039 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Flushing IO for device /dev/sdg {{(pid=70924) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 14:50:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:56 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6fe571-67f1-4ca0-8714-2a181a5783bf]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:56 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-d731df7b-b6c3-4109-a1db-2aada032e039 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=70924) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 14:50:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.040s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:56 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fce2bef-f1fb-4c16-a750-6744858694ed]: (4, ('1', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:56 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-d731df7b-b6c3-4109-a1db-2aada032e039 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 14:50:56 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-d731df7b-b6c3-4109-a1db-2aada032e039 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] SCSI volumes sdg have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 14:50:56 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-d731df7b-b6c3-4109-a1db-2aada032e039 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48b7d610-c3f3-46a6-a129-366e9ba5e18e')] {{(pid=70924) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 14:50:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b7d610-c3f3-46a6-a129-366e9ba5e18e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b7d610-c3f3-46a6-a129-366e9ba5e18e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:57 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[89aa0dfd-0203-40b1-bdcb-5462e3c8e8ae]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:57 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-d731df7b-b6c3-4109-a1db-2aada032e039 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:50:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b7d610-c3f3-46a6-a129-366e9ba5e18e -p 172.16.0.220:3260 --logout {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b7d610-c3f3-46a6-a129-366e9ba5e18e -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:57 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e583da3e-df11-4cb5-8ec6-d95bed252a7a]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:48b7d610-c3f3-46a6-a129-366e9ba5e18e, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:48b7d610-c3f3-46a6-a129-366e9ba5e18e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:57 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-d731df7b-b6c3-4109-a1db-2aada032e039 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:48b7d610-c3f3-46a6-a129-366e9ba5e18e, portal: 172.16.0.220,3260]
Jul 29 14:50:57 user nova-compute[70924]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:48b7d610-c3f3-46a6-a129-366e9ba5e18e, portal: 172.16.0.220,3260] successful.
Jul 29 14:50:57 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:50:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b7d610-c3f3-46a6-a129-366e9ba5e18e -p 172.16.0.220:3260 --op delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:50:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b7d610-c3f3-46a6-a129-366e9ba5e18e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:50:57 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[cefd0bc4-74be-444f-9610-af902b2291c2]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:50:57 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-d731df7b-b6c3-4109-a1db-2aada032e039 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:50:57 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-d731df7b-b6c3-4109-a1db-2aada032e039 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:50:57 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-d731df7b-b6c3-4109-a1db-2aada032e039 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] <== disconnect_volume: return (298ms) None {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:50:57 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d731df7b-b6c3-4109-a1db-2aada032e039 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Disconnected iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 14:50:57 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:50:57 user nova-compute[70924]: DEBUG nova.objects.instance [None req-d731df7b-b6c3-4109-a1db-2aada032e039 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lazy-loading 'flavor' on Instance uuid 1f7989ca-77e9-440f-bd2f-60e46e005557 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:50:57 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-d731df7b-b6c3-4109-a1db-2aada032e039 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lock "1f7989ca-77e9-440f-bd2f-60e46e005557" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.782s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:50:58 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:51:01 user nova-compute[70924]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690642246.2330744, bdaf1714-27f9-47ee-808b-206ec78c6067 => Stopped> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:51:01 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] VM Stopped (Lifecycle Event)
Jul 29 14:51:01 user nova-compute[70924]: DEBUG nova.compute.manager [None req-c3ec9770-3a41-469a-94a4-d22704b03fbd None None] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:51:02 user nova-compute[70924]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690642247.0678086, a8d47810-5115-41fd-a4be-86aa2f716c79 => Stopped> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:51:02 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] VM Stopped (Lifecycle Event)
Jul 29 14:51:02 user nova-compute[70924]: DEBUG nova.compute.manager [None req-dbe83c83-eed4-4202-9cb5-3ca22b1a51c8 None None] [instance: a8d47810-5115-41fd-a4be-86aa2f716c79] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:51:02 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:51:07 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:51:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:51:12 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:51:13 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:51:15 user nova-compute[70924]: INFO nova.compute.manager [None req-dc3fc96f-29d2-4117-a976-b44d3c803f6f tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Rescuing
Jul 29 14:51:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-dc3fc96f-29d2-4117-a976-b44d3c803f6f tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Acquiring lock "refresh_cache-091e384f-7851-4ac9-b566-990df0497fc5" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:51:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-dc3fc96f-29d2-4117-a976-b44d3c803f6f tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Acquired lock "refresh_cache-091e384f-7851-4ac9-b566-990df0497fc5" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:51:15 user nova-compute[70924]: DEBUG nova.network.neutron [None req-dc3fc96f-29d2-4117-a976-b44d3c803f6f tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 14:51:16 user nova-compute[70924]: DEBUG nova.network.neutron [None req-dc3fc96f-29d2-4117-a976-b44d3c803f6f tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Updating instance_info_cache with network_info: [{"id": "1da26b57-ec30-415a-8a43-fe0e662667e1", "address": "fa:16:3e:7c:7f:15", "network": {"id": "b2aee530-d195-47bb-b39d-c8bd15b81a08", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-421022738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcf4644e7a24bf68b407be2e3d9732c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1da26b57-ec", "ovs_interfaceid": "1da26b57-ec30-415a-8a43-fe0e662667e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:51:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-dc3fc96f-29d2-4117-a976-b44d3c803f6f tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Releasing lock "refresh_cache-091e384f-7851-4ac9-b566-990df0497fc5" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:51:16 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:51:16 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:51:16 user nova-compute[70924]: DEBUG nova.compute.manager [req-b99b40d7-a3b5-44bf-890b-6be672a13067 req-5585bbcd-aba7-4998-a52c-87bed364ef04 service nova] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Received event network-vif-unplugged-1da26b57-ec30-415a-8a43-fe0e662667e1 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:51:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b99b40d7-a3b5-44bf-890b-6be672a13067 req-5585bbcd-aba7-4998-a52c-87bed364ef04 service nova] Acquiring lock "091e384f-7851-4ac9-b566-990df0497fc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:51:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b99b40d7-a3b5-44bf-890b-6be672a13067 req-5585bbcd-aba7-4998-a52c-87bed364ef04 service nova] Lock "091e384f-7851-4ac9-b566-990df0497fc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:51:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b99b40d7-a3b5-44bf-890b-6be672a13067 req-5585bbcd-aba7-4998-a52c-87bed364ef04 service nova] Lock "091e384f-7851-4ac9-b566-990df0497fc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:51:16 user nova-compute[70924]: DEBUG nova.compute.manager [req-b99b40d7-a3b5-44bf-890b-6be672a13067 req-5585bbcd-aba7-4998-a52c-87bed364ef04 service nova] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] No waiting events found dispatching network-vif-unplugged-1da26b57-ec30-415a-8a43-fe0e662667e1 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:51:16 user nova-compute[70924]: WARNING nova.compute.manager [req-b99b40d7-a3b5-44bf-890b-6be672a13067 req-5585bbcd-aba7-4998-a52c-87bed364ef04 service nova] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Received unexpected event network-vif-unplugged-1da26b57-ec30-415a-8a43-fe0e662667e1 for instance with vm_state active and task_state rescuing.
Jul 29 14:51:16 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:51:16 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:51:17 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Instance destroyed successfully.
Jul 29 14:51:17 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-dc3fc96f-29d2-4117-a976-b44d3c803f6f tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Attempting rescue
Jul 29 14:51:17 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-dc3fc96f-29d2-4117-a976-b44d3c803f6f tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=70924) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 29 14:51:17 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-dc3fc96f-29d2-4117-a976-b44d3c803f6f tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Instance directory exists: not creating {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 29 14:51:17 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-dc3fc96f-29d2-4117-a976-b44d3c803f6f tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Creating image(s)
Jul 29 14:51:17 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-dc3fc96f-29d2-4117-a976-b44d3c803f6f tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Acquiring lock "/opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:51:17 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-dc3fc96f-29d2-4117-a976-b44d3c803f6f tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "/opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:51:17 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-dc3fc96f-29d2-4117-a976-b44d3c803f6f tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "/opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:51:17 user nova-compute[70924]: DEBUG nova.objects.instance [None req-dc3fc96f-29d2-4117-a976-b44d3c803f6f tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lazy-loading 'trusted_certs' on Instance uuid 091e384f-7851-4ac9-b566-990df0497fc5 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:51:17 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-dc3fc96f-29d2-4117-a976-b44d3c803f6f tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Acquiring lock "bd72453517468710f1de26b27fb0ea28688e9009" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:51:17 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-dc3fc96f-29d2-4117-a976-b44d3c803f6f tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:51:17 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-dc3fc96f-29d2-4117-a976-b44d3c803f6f tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:51:17 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-dc3fc96f-29d2-4117-a976-b44d3c803f6f tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.143s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:51:17 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-dc3fc96f-29d2-4117-a976-b44d3c803f6f tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk.rescue {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:51:17 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:51:17 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-dc3fc96f-29d2-4117-a976-b44d3c803f6f tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk.rescue" returned: 0 in 0.062s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:51:17 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-dc3fc96f-29d2-4117-a976-b44d3c803f6f tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.210s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:51:17 user nova-compute[70924]: DEBUG nova.objects.instance [None req-dc3fc96f-29d2-4117-a976-b44d3c803f6f tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lazy-loading 'migration_context' on Instance uuid 091e384f-7851-4ac9-b566-990df0497fc5 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:51:17 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-dc3fc96f-29d2-4117-a976-b44d3c803f6f tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Created local disks {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 14:51:17 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-dc3fc96f-29d2-4117-a976-b44d3c803f6f tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Start _get_guest_xml network_info=[{"id": "1da26b57-ec30-415a-8a43-fe0e662667e1", "address": "fa:16:3e:7c:7f:15", "network": {"id": "b2aee530-d195-47bb-b39d-c8bd15b81a08", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-421022738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-421022738-network", "vif_mac": "fa:16:3e:7c:7f:15"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcf4644e7a24bf68b407be2e3d9732c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1da26b57-ec", "ovs_interfaceid": "1da26b57-ec30-415a-8a43-fe0e662667e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '3aba2e73-6832-404b-8bd0-d0503ce82b8c', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 14:51:17 user nova-compute[70924]: DEBUG nova.objects.instance [None req-dc3fc96f-29d2-4117-a976-b44d3c803f6f tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lazy-loading 'resources' on Instance uuid 091e384f-7851-4ac9-b566-990df0497fc5 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:51:17 user nova-compute[70924]: DEBUG nova.objects.instance [None req-dc3fc96f-29d2-4117-a976-b44d3c803f6f tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lazy-loading 'numa_topology' on Instance uuid 091e384f-7851-4ac9-b566-990df0497fc5 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:51:17 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-dc3fc96f-29d2-4117-a976-b44d3c803f6f tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:51:17 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-dc3fc96f-29d2-4117-a976-b44d3c803f6f tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:51:17 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-dc3fc96f-29d2-4117-a976-b44d3c803f6f tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 14:51:17 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-dc3fc96f-29d2-4117-a976-b44d3c803f6f tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] CPU controller missing on host. {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 14:51:17 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-dc3fc96f-29d2-4117-a976-b44d3c803f6f tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 14:51:17 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-dc3fc96f-29d2-4117-a976-b44d3c803f6f tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] CPU controller found on host. {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 14:51:17 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-dc3fc96f-29d2-4117-a976-b44d3c803f6f tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70924) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 14:51:17 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-dc3fc96f-29d2-4117-a976-b44d3c803f6f tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T14:36:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 14:51:17 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-dc3fc96f-29d2-4117-a976-b44d3c803f6f tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Flavor limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 14:51:17 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-dc3fc96f-29d2-4117-a976-b44d3c803f6f tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Image limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 14:51:17 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-dc3fc96f-29d2-4117-a976-b44d3c803f6f tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Flavor pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 14:51:17 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-dc3fc96f-29d2-4117-a976-b44d3c803f6f tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Image pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 14:51:17 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-dc3fc96f-29d2-4117-a976-b44d3c803f6f tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 14:51:17 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-dc3fc96f-29d2-4117-a976-b44d3c803f6f tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 14:51:17 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-dc3fc96f-29d2-4117-a976-b44d3c803f6f tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 14:51:17 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-dc3fc96f-29d2-4117-a976-b44d3c803f6f tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Got 1 possible topologies {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 14:51:17 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-dc3fc96f-29d2-4117-a976-b44d3c803f6f tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 14:51:17 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-dc3fc96f-29d2-4117-a976-b44d3c803f6f tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 14:51:17 user nova-compute[70924]: DEBUG nova.objects.instance [None req-dc3fc96f-29d2-4117-a976-b44d3c803f6f tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lazy-loading 'vcpu_model' on Instance uuid 091e384f-7851-4ac9-b566-990df0497fc5 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:51:17 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-dc3fc96f-29d2-4117-a976-b44d3c803f6f tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:49:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-985418414',display_name='tempest-ServerRescueNegativeTestJSON-server-985418414',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-985418414',id=25,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:49:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8fcf4644e7a24bf68b407be2e3d9732c',ramdisk_id='',reservation_id='r-77bcp480',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1436708078',owner_user_name='tempest-ServerRescueNegativeTestJSON-1436708078-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:49:35Z,user_data=None,user_id='8ec7e735cfff48828e0c0c7618f50711',uuid=091e384f-7851-4ac9-b566-990df0497fc5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1da26b57-ec30-415a-8a43-fe0e662667e1", "address": "fa:16:3e:7c:7f:15", "network": {"id": "b2aee530-d195-47bb-b39d-c8bd15b81a08", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-421022738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-421022738-network", "vif_mac": "fa:16:3e:7c:7f:15"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcf4644e7a24bf68b407be2e3d9732c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1da26b57-ec", "ovs_interfaceid": "1da26b57-ec30-415a-8a43-fe0e662667e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:51:17 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-dc3fc96f-29d2-4117-a976-b44d3c803f6f tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Converting VIF {"id": "1da26b57-ec30-415a-8a43-fe0e662667e1", "address": "fa:16:3e:7c:7f:15", "network": {"id": "b2aee530-d195-47bb-b39d-c8bd15b81a08", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-421022738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-421022738-network", "vif_mac": "fa:16:3e:7c:7f:15"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcf4644e7a24bf68b407be2e3d9732c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1da26b57-ec", "ovs_interfaceid": "1da26b57-ec30-415a-8a43-fe0e662667e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:51:17 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-dc3fc96f-29d2-4117-a976-b44d3c803f6f tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:7f:15,bridge_name='br-int',has_traffic_filtering=True,id=1da26b57-ec30-415a-8a43-fe0e662667e1,network=Network(b2aee530-d195-47bb-b39d-c8bd15b81a08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1da26b57-ec') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:51:17 user nova-compute[70924]: DEBUG nova.objects.instance [None req-dc3fc96f-29d2-4117-a976-b44d3c803f6f tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lazy-loading 'pci_devices' on Instance uuid 091e384f-7851-4ac9-b566-990df0497fc5 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:51:17 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-dc3fc96f-29d2-4117-a976-b44d3c803f6f tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] End _get_guest_xml xml=<domain type="kvm">
Jul 29 14:51:17 user nova-compute[70924]:   <uuid>091e384f-7851-4ac9-b566-990df0497fc5</uuid>
Jul 29 14:51:17 user nova-compute[70924]:   <name>instance-00000019</name>
Jul 29 14:51:17 user nova-compute[70924]:   <memory>524288</memory>
Jul 29 14:51:17 user nova-compute[70924]:   <vcpu>1</vcpu>
Jul 29 14:51:17 user nova-compute[70924]:   <metadata>
Jul 29 14:51:17 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 14:51:17 user nova-compute[70924]:       <nova:package version="0.0.0"/>
Jul 29 14:51:17 user nova-compute[70924]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-985418414</nova:name>
Jul 29 14:51:17 user nova-compute[70924]:       <nova:creationTime>2023-07-29 14:51:17</nova:creationTime>
Jul 29 14:51:17 user nova-compute[70924]:       <nova:flavor name="m1.tiny">
Jul 29 14:51:17 user nova-compute[70924]:         <nova:memory>512</nova:memory>
Jul 29 14:51:17 user nova-compute[70924]:         <nova:disk>1</nova:disk>
Jul 29 14:51:17 user nova-compute[70924]:         <nova:swap>0</nova:swap>
Jul 29 14:51:17 user nova-compute[70924]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 14:51:17 user nova-compute[70924]:         <nova:vcpus>1</nova:vcpus>
Jul 29 14:51:17 user nova-compute[70924]:       </nova:flavor>
Jul 29 14:51:17 user nova-compute[70924]:       <nova:owner>
Jul 29 14:51:17 user nova-compute[70924]:         <nova:user uuid="8ec7e735cfff48828e0c0c7618f50711">tempest-ServerRescueNegativeTestJSON-1436708078-project-member</nova:user>
Jul 29 14:51:17 user nova-compute[70924]:         <nova:project uuid="8fcf4644e7a24bf68b407be2e3d9732c">tempest-ServerRescueNegativeTestJSON-1436708078</nova:project>
Jul 29 14:51:17 user nova-compute[70924]:       </nova:owner>
Jul 29 14:51:17 user nova-compute[70924]:       <nova:root type="image" uuid="3aba2e73-6832-404b-8bd0-d0503ce82b8c"/>
Jul 29 14:51:17 user nova-compute[70924]:       <nova:ports>
Jul 29 14:51:17 user nova-compute[70924]:         <nova:port uuid="1da26b57-ec30-415a-8a43-fe0e662667e1">
Jul 29 14:51:17 user nova-compute[70924]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 29 14:51:17 user nova-compute[70924]:         </nova:port>
Jul 29 14:51:17 user nova-compute[70924]:       </nova:ports>
Jul 29 14:51:17 user nova-compute[70924]:     </nova:instance>
Jul 29 14:51:17 user nova-compute[70924]:   </metadata>
Jul 29 14:51:17 user nova-compute[70924]:   <sysinfo type="smbios">
Jul 29 14:51:17 user nova-compute[70924]:     <system>
Jul 29 14:51:17 user nova-compute[70924]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 14:51:17 user nova-compute[70924]:       <entry name="product">OpenStack Nova</entry>
Jul 29 14:51:17 user nova-compute[70924]:       <entry name="version">0.0.0</entry>
Jul 29 14:51:17 user nova-compute[70924]:       <entry name="serial">091e384f-7851-4ac9-b566-990df0497fc5</entry>
Jul 29 14:51:17 user nova-compute[70924]:       <entry name="uuid">091e384f-7851-4ac9-b566-990df0497fc5</entry>
Jul 29 14:51:17 user nova-compute[70924]:       <entry name="family">Virtual Machine</entry>
Jul 29 14:51:17 user nova-compute[70924]:     </system>
Jul 29 14:51:17 user nova-compute[70924]:   </sysinfo>
Jul 29 14:51:17 user nova-compute[70924]:   <os>
Jul 29 14:51:17 user nova-compute[70924]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 14:51:17 user nova-compute[70924]:     <smbios mode="sysinfo"/>
Jul 29 14:51:17 user nova-compute[70924]:   </os>
Jul 29 14:51:17 user nova-compute[70924]:   <features>
Jul 29 14:51:17 user nova-compute[70924]:     <acpi/>
Jul 29 14:51:17 user nova-compute[70924]:     <apic/>
Jul 29 14:51:17 user nova-compute[70924]:     <vmcoreinfo/>
Jul 29 14:51:17 user nova-compute[70924]:   </features>
Jul 29 14:51:17 user nova-compute[70924]:   <clock offset="utc">
Jul 29 14:51:17 user nova-compute[70924]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 14:51:17 user nova-compute[70924]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 14:51:17 user nova-compute[70924]:     <timer name="hpet" present="no"/>
Jul 29 14:51:17 user nova-compute[70924]:   </clock>
Jul 29 14:51:17 user nova-compute[70924]:   <cpu mode="custom" match="exact">
Jul 29 14:51:17 user nova-compute[70924]:     <model>Nehalem</model>
Jul 29 14:51:17 user nova-compute[70924]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 14:51:17 user nova-compute[70924]:   </cpu>
Jul 29 14:51:17 user nova-compute[70924]:   <devices>
Jul 29 14:51:17 user nova-compute[70924]:     <disk type="file" device="disk">
Jul 29 14:51:17 user nova-compute[70924]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 14:51:17 user nova-compute[70924]:       <source file="/opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk.rescue"/>
Jul 29 14:51:17 user nova-compute[70924]:       <target dev="vda" bus="virtio"/>
Jul 29 14:51:17 user nova-compute[70924]:     </disk>
Jul 29 14:51:17 user nova-compute[70924]:     <disk type="file" device="disk">
Jul 29 14:51:17 user nova-compute[70924]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 14:51:17 user nova-compute[70924]:       <source file="/opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk"/>
Jul 29 14:51:17 user nova-compute[70924]:       <target dev="vdb" bus="virtio"/>
Jul 29 14:51:17 user nova-compute[70924]:     </disk>
Jul 29 14:51:17 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 14:51:17 user nova-compute[70924]:       <mac address="fa:16:3e:7c:7f:15"/>
Jul 29 14:51:17 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:51:17 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 14:51:17 user nova-compute[70924]:       <target dev="tap1da26b57-ec"/>
Jul 29 14:51:17 user nova-compute[70924]:     </interface>
Jul 29 14:51:17 user nova-compute[70924]:     <serial type="pty">
Jul 29 14:51:17 user nova-compute[70924]:       <log file="/opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/console.log" append="off"/>
Jul 29 14:51:17 user nova-compute[70924]:     </serial>
Jul 29 14:51:17 user nova-compute[70924]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 14:51:17 user nova-compute[70924]:     <video>
Jul 29 14:51:17 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:51:17 user nova-compute[70924]:     </video>
Jul 29 14:51:17 user nova-compute[70924]:     <rng model="virtio">
Jul 29 14:51:17 user nova-compute[70924]:       <backend model="random">/dev/urandom</backend>
Jul 29 14:51:17 user nova-compute[70924]:     </rng>
Jul 29 14:51:17 user nova-compute[70924]:     <controller type="usb" index="0" model="none"/>
Jul 29 14:51:17 user nova-compute[70924]:     <memballoon model="virtio">
Jul 29 14:51:17 user nova-compute[70924]:       <stats period="10"/>
Jul 29 14:51:17 user nova-compute[70924]:     </memballoon>
Jul 29 14:51:17 user nova-compute[70924]:   </devices>
Jul 29 14:51:17 user nova-compute[70924]: </domain>
Jul 29 14:51:17 user nova-compute[70924]:  {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 14:51:17 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Instance destroyed successfully.
Jul 29 14:51:17 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-dc3fc96f-29d2-4117-a976-b44d3c803f6f tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:51:17 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-dc3fc96f-29d2-4117-a976-b44d3c803f6f tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:51:17 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-dc3fc96f-29d2-4117-a976-b44d3c803f6f tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] No VIF found with MAC fa:16:3e:7c:7f:15, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:51:18 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d7419fb7-193b-4ca8-beff-23ef20c42aa8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:51:18 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:51:18 user nova-compute[70924]: INFO nova.compute.manager [None req-d7419fb7-193b-4ca8-beff-23ef20c42aa8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] instance snapshotting
Jul 29 14:51:18 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-d7419fb7-193b-4ca8-beff-23ef20c42aa8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] Beginning live snapshot process
Jul 29 14:51:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-d7419fb7-193b-4ca8-beff-23ef20c42aa8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c31a724f-3006-4e5d-a9b5-847fd6cd170a/disk --force-share --output=json -f qcow2 {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:51:18 user nova-compute[70924]: DEBUG nova.compute.manager [req-ddff1154-91b0-4fc5-afd8-064a6ccdb3a5 req-f87d5c9e-8c03-4471-a93f-e56e322426d0 service nova] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Received event network-vif-plugged-1da26b57-ec30-415a-8a43-fe0e662667e1 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:51:18 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-ddff1154-91b0-4fc5-afd8-064a6ccdb3a5 req-f87d5c9e-8c03-4471-a93f-e56e322426d0 service nova] Acquiring lock "091e384f-7851-4ac9-b566-990df0497fc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:51:18 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-ddff1154-91b0-4fc5-afd8-064a6ccdb3a5 req-f87d5c9e-8c03-4471-a93f-e56e322426d0 service nova] Lock "091e384f-7851-4ac9-b566-990df0497fc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:51:18 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-ddff1154-91b0-4fc5-afd8-064a6ccdb3a5 req-f87d5c9e-8c03-4471-a93f-e56e322426d0 service nova] Lock "091e384f-7851-4ac9-b566-990df0497fc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:51:18 user nova-compute[70924]: DEBUG nova.compute.manager [req-ddff1154-91b0-4fc5-afd8-064a6ccdb3a5 req-f87d5c9e-8c03-4471-a93f-e56e322426d0 service nova] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] No waiting events found dispatching network-vif-plugged-1da26b57-ec30-415a-8a43-fe0e662667e1 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:51:18 user nova-compute[70924]: WARNING nova.compute.manager [req-ddff1154-91b0-4fc5-afd8-064a6ccdb3a5 req-f87d5c9e-8c03-4471-a93f-e56e322426d0 service nova] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Received unexpected event network-vif-plugged-1da26b57-ec30-415a-8a43-fe0e662667e1 for instance with vm_state active and task_state rescuing.
Jul 29 14:51:19 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-d7419fb7-193b-4ca8-beff-23ef20c42aa8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c31a724f-3006-4e5d-a9b5-847fd6cd170a/disk --force-share --output=json -f qcow2" returned: 0 in 0.143s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:51:19 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-d7419fb7-193b-4ca8-beff-23ef20c42aa8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c31a724f-3006-4e5d-a9b5-847fd6cd170a/disk --force-share --output=json -f qcow2 {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:51:19 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:51:19 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:51:19 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:51:19 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-d7419fb7-193b-4ca8-beff-23ef20c42aa8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c31a724f-3006-4e5d-a9b5-847fd6cd170a/disk --force-share --output=json -f qcow2" returned: 0 in 0.161s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:51:19 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-d7419fb7-193b-4ca8-beff-23ef20c42aa8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:51:19 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-d7419fb7-193b-4ca8-beff-23ef20c42aa8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.140s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:51:19 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-d7419fb7-193b-4ca8-beff-23ef20c42aa8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpzj4d4f6z/acc45212e7b645099c3cf1bf8e478f01.delta 1073741824 {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:51:19 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:51:19 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:51:19 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-d7419fb7-193b-4ca8-beff-23ef20c42aa8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpzj4d4f6z/acc45212e7b645099c3cf1bf8e478f01.delta 1073741824" returned: 0 in 0.054s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:51:19 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-d7419fb7-193b-4ca8-beff-23ef20c42aa8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 29 14:51:19 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:51:20 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-d7419fb7-193b-4ca8-beff-23ef20c42aa8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] COPY block job progress, current cursor: 65536 final cursor: 75497472 {{(pid=70924) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 29 14:51:20 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-d7419fb7-193b-4ca8-beff-23ef20c42aa8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=70924) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 29 14:51:20 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-d7419fb7-193b-4ca8-beff-23ef20c42aa8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 29 14:51:20 user nova-compute[70924]: DEBUG nova.privsep.utils [None req-d7419fb7-193b-4ca8-beff-23ef20c42aa8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70924) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 29 14:51:20 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-d7419fb7-193b-4ca8-beff-23ef20c42aa8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpzj4d4f6z/acc45212e7b645099c3cf1bf8e478f01.delta /opt/stack/data/nova/instances/snapshots/tmpzj4d4f6z/acc45212e7b645099c3cf1bf8e478f01 {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:51:20 user nova-compute[70924]: DEBUG nova.compute.manager [req-d77bc5f2-003a-457b-b1f5-9896e8c1d1a9 req-e40a5997-9c4e-4b6a-84e6-65deac696b43 service nova] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Received event network-vif-plugged-1da26b57-ec30-415a-8a43-fe0e662667e1 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:51:20 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-d77bc5f2-003a-457b-b1f5-9896e8c1d1a9 req-e40a5997-9c4e-4b6a-84e6-65deac696b43 service nova] Acquiring lock "091e384f-7851-4ac9-b566-990df0497fc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:51:21 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-d77bc5f2-003a-457b-b1f5-9896e8c1d1a9 req-e40a5997-9c4e-4b6a-84e6-65deac696b43 service nova] Lock "091e384f-7851-4ac9-b566-990df0497fc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:51:21 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-d77bc5f2-003a-457b-b1f5-9896e8c1d1a9 req-e40a5997-9c4e-4b6a-84e6-65deac696b43 service nova] Lock "091e384f-7851-4ac9-b566-990df0497fc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:51:21 user nova-compute[70924]: DEBUG nova.compute.manager [req-d77bc5f2-003a-457b-b1f5-9896e8c1d1a9 req-e40a5997-9c4e-4b6a-84e6-65deac696b43 service nova] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] No waiting events found dispatching network-vif-plugged-1da26b57-ec30-415a-8a43-fe0e662667e1 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:51:21 user nova-compute[70924]: WARNING nova.compute.manager [req-d77bc5f2-003a-457b-b1f5-9896e8c1d1a9 req-e40a5997-9c4e-4b6a-84e6-65deac696b43 service nova] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Received unexpected event network-vif-plugged-1da26b57-ec30-415a-8a43-fe0e662667e1 for instance with vm_state active and task_state rescuing.
Jul 29 14:51:21 user nova-compute[70924]: DEBUG nova.compute.manager [req-d77bc5f2-003a-457b-b1f5-9896e8c1d1a9 req-e40a5997-9c4e-4b6a-84e6-65deac696b43 service nova] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Received event network-vif-plugged-1da26b57-ec30-415a-8a43-fe0e662667e1 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:51:21 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-d77bc5f2-003a-457b-b1f5-9896e8c1d1a9 req-e40a5997-9c4e-4b6a-84e6-65deac696b43 service nova] Acquiring lock "091e384f-7851-4ac9-b566-990df0497fc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:51:21 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-d77bc5f2-003a-457b-b1f5-9896e8c1d1a9 req-e40a5997-9c4e-4b6a-84e6-65deac696b43 service nova] Lock "091e384f-7851-4ac9-b566-990df0497fc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:51:21 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-d77bc5f2-003a-457b-b1f5-9896e8c1d1a9 req-e40a5997-9c4e-4b6a-84e6-65deac696b43 service nova] Lock "091e384f-7851-4ac9-b566-990df0497fc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:51:21 user nova-compute[70924]: DEBUG nova.compute.manager [req-d77bc5f2-003a-457b-b1f5-9896e8c1d1a9 req-e40a5997-9c4e-4b6a-84e6-65deac696b43 service nova] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] No waiting events found dispatching network-vif-plugged-1da26b57-ec30-415a-8a43-fe0e662667e1 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:51:21 user nova-compute[70924]: WARNING nova.compute.manager [req-d77bc5f2-003a-457b-b1f5-9896e8c1d1a9 req-e40a5997-9c4e-4b6a-84e6-65deac696b43 service nova] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Received unexpected event network-vif-plugged-1da26b57-ec30-415a-8a43-fe0e662667e1 for instance with vm_state active and task_state rescuing.
Jul 29 14:51:21 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-d7419fb7-193b-4ca8-beff-23ef20c42aa8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpzj4d4f6z/acc45212e7b645099c3cf1bf8e478f01.delta /opt/stack/data/nova/instances/snapshots/tmpzj4d4f6z/acc45212e7b645099c3cf1bf8e478f01" returned: 0 in 0.447s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:51:21 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-d7419fb7-193b-4ca8-beff-23ef20c42aa8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] Snapshot extracted, beginning image upload
Jul 29 14:51:22 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Removed pending event for 091e384f-7851-4ac9-b566-990df0497fc5 due to event {{(pid=70924) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 29 14:51:22 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642282.2456524, 091e384f-7851-4ac9-b566-990df0497fc5 => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:51:22 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] VM Resumed (Lifecycle Event)
Jul 29 14:51:22 user nova-compute[70924]: DEBUG nova.compute.manager [None req-dc3fc96f-29d2-4117-a976-b44d3c803f6f tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:51:22 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:51:22 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:51:22 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 29 14:51:22 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642282.247153, 091e384f-7851-4ac9-b566-990df0497fc5 => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:51:22 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] VM Started (Lifecycle Event)
Jul 29 14:51:22 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:51:22 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:51:22 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:51:23 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:51:23 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-d7419fb7-193b-4ca8-beff-23ef20c42aa8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] Snapshot image upload complete
Jul 29 14:51:23 user nova-compute[70924]: INFO nova.compute.manager [None req-d7419fb7-193b-4ca8-beff-23ef20c42aa8 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] Took 5.11 seconds to snapshot the instance on the hypervisor.
Jul 29 14:51:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:51:32 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:51:37 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:51:38 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:51:42 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:51:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:51:45 user nova-compute[70924]: DEBUG nova.compute.manager [req-56dc7852-aa1a-40ff-a7c2-fa74bc2fe6d2 req-6efb1c34-b74d-45ae-8b4c-10904a912ca0 service nova] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Received event network-changed-a9e045fe-1480-4254-ad3d-ce7a12c1b293 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:51:45 user nova-compute[70924]: DEBUG nova.compute.manager [req-56dc7852-aa1a-40ff-a7c2-fa74bc2fe6d2 req-6efb1c34-b74d-45ae-8b4c-10904a912ca0 service nova] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Refreshing instance network info cache due to event network-changed-a9e045fe-1480-4254-ad3d-ce7a12c1b293. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:51:45 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-56dc7852-aa1a-40ff-a7c2-fa74bc2fe6d2 req-6efb1c34-b74d-45ae-8b4c-10904a912ca0 service nova] Acquiring lock "refresh_cache-fd91d5fc-857d-4d63-ad83-8028c1d3309f" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:51:45 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-56dc7852-aa1a-40ff-a7c2-fa74bc2fe6d2 req-6efb1c34-b74d-45ae-8b4c-10904a912ca0 service nova] Acquired lock "refresh_cache-fd91d5fc-857d-4d63-ad83-8028c1d3309f" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:51:45 user nova-compute[70924]: DEBUG nova.network.neutron [req-56dc7852-aa1a-40ff-a7c2-fa74bc2fe6d2 req-6efb1c34-b74d-45ae-8b4c-10904a912ca0 service nova] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Refreshing network info cache for port a9e045fe-1480-4254-ad3d-ce7a12c1b293 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:51:45 user nova-compute[70924]: DEBUG nova.compute.manager [req-ee7e4e21-2ade-4813-9950-a6c8f9e2792a req-5bcb8c15-6d4f-4ce4-b2b5-09dd08224dca service nova] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Received event network-changed-4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:51:45 user nova-compute[70924]: DEBUG nova.compute.manager [req-ee7e4e21-2ade-4813-9950-a6c8f9e2792a req-5bcb8c15-6d4f-4ce4-b2b5-09dd08224dca service nova] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Refreshing instance network info cache due to event network-changed-4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:51:45 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-ee7e4e21-2ade-4813-9950-a6c8f9e2792a req-5bcb8c15-6d4f-4ce4-b2b5-09dd08224dca service nova] Acquiring lock "refresh_cache-86ecc6cb-88a8-4572-8e41-d4c5859036a6" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:51:45 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-ee7e4e21-2ade-4813-9950-a6c8f9e2792a req-5bcb8c15-6d4f-4ce4-b2b5-09dd08224dca service nova] Acquired lock "refresh_cache-86ecc6cb-88a8-4572-8e41-d4c5859036a6" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:51:45 user nova-compute[70924]: DEBUG nova.network.neutron [req-ee7e4e21-2ade-4813-9950-a6c8f9e2792a req-5bcb8c15-6d4f-4ce4-b2b5-09dd08224dca service nova] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Refreshing network info cache for port 4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:51:45 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-86821f7e-4ae8-4e48-9a71-0462d96716cd tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Acquiring lock "fd91d5fc-857d-4d63-ad83-8028c1d3309f" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:51:45 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-86821f7e-4ae8-4e48-9a71-0462d96716cd tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Lock "fd91d5fc-857d-4d63-ad83-8028c1d3309f" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:51:45 user nova-compute[70924]: INFO nova.compute.manager [None req-86821f7e-4ae8-4e48-9a71-0462d96716cd tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Shelve offloading
Jul 29 14:51:45 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:51:46 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:51:46 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:51:46 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:51:46 user nova-compute[70924]: DEBUG nova.compute.manager [req-173f8441-d221-4e25-805b-aed6c0fe1663 req-25785376-1dd0-472b-9c1f-c1cbb15cbc26 service nova] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Received event network-vif-unplugged-a9e045fe-1480-4254-ad3d-ce7a12c1b293 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:51:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-173f8441-d221-4e25-805b-aed6c0fe1663 req-25785376-1dd0-472b-9c1f-c1cbb15cbc26 service nova] Acquiring lock "fd91d5fc-857d-4d63-ad83-8028c1d3309f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:51:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-173f8441-d221-4e25-805b-aed6c0fe1663 req-25785376-1dd0-472b-9c1f-c1cbb15cbc26 service nova] Lock "fd91d5fc-857d-4d63-ad83-8028c1d3309f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:51:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-173f8441-d221-4e25-805b-aed6c0fe1663 req-25785376-1dd0-472b-9c1f-c1cbb15cbc26 service nova] Lock "fd91d5fc-857d-4d63-ad83-8028c1d3309f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:51:46 user nova-compute[70924]: DEBUG nova.compute.manager [req-173f8441-d221-4e25-805b-aed6c0fe1663 req-25785376-1dd0-472b-9c1f-c1cbb15cbc26 service nova] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] No waiting events found dispatching network-vif-unplugged-a9e045fe-1480-4254-ad3d-ce7a12c1b293 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:51:46 user nova-compute[70924]: WARNING nova.compute.manager [req-173f8441-d221-4e25-805b-aed6c0fe1663 req-25785376-1dd0-472b-9c1f-c1cbb15cbc26 service nova] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Received unexpected event network-vif-unplugged-a9e045fe-1480-4254-ad3d-ce7a12c1b293 for instance with vm_state active and task_state shelving.
Jul 29 14:51:46 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Instance destroyed successfully.
Jul 29 14:51:46 user nova-compute[70924]: DEBUG nova.compute.manager [None req-86821f7e-4ae8-4e48-9a71-0462d96716cd tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:51:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-86821f7e-4ae8-4e48-9a71-0462d96716cd tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Acquiring lock "refresh_cache-fd91d5fc-857d-4d63-ad83-8028c1d3309f" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:51:46 user nova-compute[70924]: DEBUG nova.network.neutron [req-56dc7852-aa1a-40ff-a7c2-fa74bc2fe6d2 req-6efb1c34-b74d-45ae-8b4c-10904a912ca0 service nova] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Updated VIF entry in instance network info cache for port a9e045fe-1480-4254-ad3d-ce7a12c1b293. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:51:46 user nova-compute[70924]: DEBUG nova.network.neutron [req-56dc7852-aa1a-40ff-a7c2-fa74bc2fe6d2 req-6efb1c34-b74d-45ae-8b4c-10904a912ca0 service nova] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Updating instance_info_cache with network_info: [{"id": "a9e045fe-1480-4254-ad3d-ce7a12c1b293", "address": "fa:16:3e:a4:a5:1c", "network": {"id": "fe4e60fb-1489-4a58-989a-1d81e33eddbc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1273087888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85e92f662b024b8a86d5fd646f169169", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9e045fe-14", "ovs_interfaceid": "a9e045fe-1480-4254-ad3d-ce7a12c1b293", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:51:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-56dc7852-aa1a-40ff-a7c2-fa74bc2fe6d2 req-6efb1c34-b74d-45ae-8b4c-10904a912ca0 service nova] Releasing lock "refresh_cache-fd91d5fc-857d-4d63-ad83-8028c1d3309f" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:51:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-86821f7e-4ae8-4e48-9a71-0462d96716cd tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Acquired lock "refresh_cache-fd91d5fc-857d-4d63-ad83-8028c1d3309f" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:51:46 user nova-compute[70924]: DEBUG nova.network.neutron [None req-86821f7e-4ae8-4e48-9a71-0462d96716cd tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 14:51:47 user nova-compute[70924]: DEBUG nova.network.neutron [req-ee7e4e21-2ade-4813-9950-a6c8f9e2792a req-5bcb8c15-6d4f-4ce4-b2b5-09dd08224dca service nova] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Updated VIF entry in instance network info cache for port 4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:51:47 user nova-compute[70924]: DEBUG nova.network.neutron [req-ee7e4e21-2ade-4813-9950-a6c8f9e2792a req-5bcb8c15-6d4f-4ce4-b2b5-09dd08224dca service nova] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Updating instance_info_cache with network_info: [{"id": "4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3", "address": "fa:16:3e:d6:b6:d3", "network": {"id": "55c18d07-a341-4678-9d1c-2dff057a9b1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1092921088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b33d01ba458f466b99b6bc5bba88d8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cd05bcc-ca", "ovs_interfaceid": "4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:51:47 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-ee7e4e21-2ade-4813-9950-a6c8f9e2792a req-5bcb8c15-6d4f-4ce4-b2b5-09dd08224dca service nova] Releasing lock "refresh_cache-86ecc6cb-88a8-4572-8e41-d4c5859036a6" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:51:47 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:51:47 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:51:47 user nova-compute[70924]: DEBUG nova.network.neutron [None req-86821f7e-4ae8-4e48-9a71-0462d96716cd tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Updating instance_info_cache with network_info: [{"id": "a9e045fe-1480-4254-ad3d-ce7a12c1b293", "address": "fa:16:3e:a4:a5:1c", "network": {"id": "fe4e60fb-1489-4a58-989a-1d81e33eddbc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1273087888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85e92f662b024b8a86d5fd646f169169", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9e045fe-14", "ovs_interfaceid": "a9e045fe-1480-4254-ad3d-ce7a12c1b293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:51:47 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-86821f7e-4ae8-4e48-9a71-0462d96716cd tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Releasing lock "refresh_cache-fd91d5fc-857d-4d63-ad83-8028c1d3309f" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:51:47 user nova-compute[70924]: DEBUG nova.compute.manager [req-f878d5e2-3a98-4400-a492-6cc9c972e0c6 req-59f3d5f5-2d05-4f4c-b76a-93a7aede0cc5 service nova] [instance: fd57baf8-6306-4553-a058-e915fb543405] Received event network-changed-c8f2eadb-705f-4b8b-9f67-c5280cf1f025 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:51:47 user nova-compute[70924]: DEBUG nova.compute.manager [req-f878d5e2-3a98-4400-a492-6cc9c972e0c6 req-59f3d5f5-2d05-4f4c-b76a-93a7aede0cc5 service nova] [instance: fd57baf8-6306-4553-a058-e915fb543405] Refreshing instance network info cache due to event network-changed-c8f2eadb-705f-4b8b-9f67-c5280cf1f025. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:51:47 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-f878d5e2-3a98-4400-a492-6cc9c972e0c6 req-59f3d5f5-2d05-4f4c-b76a-93a7aede0cc5 service nova] Acquiring lock "refresh_cache-fd57baf8-6306-4553-a058-e915fb543405" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:51:47 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-f878d5e2-3a98-4400-a492-6cc9c972e0c6 req-59f3d5f5-2d05-4f4c-b76a-93a7aede0cc5 service nova] Acquired lock "refresh_cache-fd57baf8-6306-4553-a058-e915fb543405" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:51:47 user nova-compute[70924]: DEBUG nova.network.neutron [req-f878d5e2-3a98-4400-a492-6cc9c972e0c6 req-59f3d5f5-2d05-4f4c-b76a-93a7aede0cc5 service nova] [instance: fd57baf8-6306-4553-a058-e915fb543405] Refreshing network info cache for port c8f2eadb-705f-4b8b-9f67-c5280cf1f025 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:51:48 user nova-compute[70924]: DEBUG nova.compute.manager [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] Stashing vm_state: active {{(pid=70924) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Jul 29 14:51:48 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:51:48 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:51:48 user nova-compute[70924]: DEBUG nova.objects.instance [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lazy-loading 'pci_requests' on Instance uuid fd57baf8-6306-4553-a058-e915fb543405 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:51:48 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70924) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 14:51:48 user nova-compute[70924]: INFO nova.compute.claims [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] Claim successful on node user
Jul 29 14:51:48 user nova-compute[70924]: DEBUG nova.objects.instance [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lazy-loading 'resources' on Instance uuid fd57baf8-6306-4553-a058-e915fb543405 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:51:48 user nova-compute[70924]: DEBUG nova.objects.instance [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lazy-loading 'pci_devices' on Instance uuid fd57baf8-6306-4553-a058-e915fb543405 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:51:48 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:51:48 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:51:48 user nova-compute[70924]: INFO nova.compute.resource_tracker [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] Updating resource usage from migration 89fefda8-4f7a-4616-af61-9c8f1289c480
Jul 29 14:51:48 user nova-compute[70924]: DEBUG nova.compute.manager [req-dbd7964a-e9fc-4d6f-ac5d-7a3fe4fe9236 req-e735b7fe-9848-4345-bab4-6984b1e2fa8d service nova] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Received event network-vif-plugged-a9e045fe-1480-4254-ad3d-ce7a12c1b293 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:51:48 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-dbd7964a-e9fc-4d6f-ac5d-7a3fe4fe9236 req-e735b7fe-9848-4345-bab4-6984b1e2fa8d service nova] Acquiring lock "fd91d5fc-857d-4d63-ad83-8028c1d3309f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:51:48 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-dbd7964a-e9fc-4d6f-ac5d-7a3fe4fe9236 req-e735b7fe-9848-4345-bab4-6984b1e2fa8d service nova] Lock "fd91d5fc-857d-4d63-ad83-8028c1d3309f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:51:48 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-dbd7964a-e9fc-4d6f-ac5d-7a3fe4fe9236 req-e735b7fe-9848-4345-bab4-6984b1e2fa8d service nova] Lock "fd91d5fc-857d-4d63-ad83-8028c1d3309f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:51:48 user nova-compute[70924]: DEBUG nova.compute.manager [req-dbd7964a-e9fc-4d6f-ac5d-7a3fe4fe9236 req-e735b7fe-9848-4345-bab4-6984b1e2fa8d service nova] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] No waiting events found dispatching network-vif-plugged-a9e045fe-1480-4254-ad3d-ce7a12c1b293 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:51:48 user nova-compute[70924]: WARNING nova.compute.manager [req-dbd7964a-e9fc-4d6f-ac5d-7a3fe4fe9236 req-e735b7fe-9848-4345-bab4-6984b1e2fa8d service nova] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Received unexpected event network-vif-plugged-a9e045fe-1480-4254-ad3d-ce7a12c1b293 for instance with vm_state active and task_state shelving.
Jul 29 14:51:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:51:48 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Instance destroyed successfully.
Jul 29 14:51:48 user nova-compute[70924]: DEBUG nova.objects.instance [None req-86821f7e-4ae8-4e48-9a71-0462d96716cd tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Lazy-loading 'resources' on Instance uuid fd91d5fc-857d-4d63-ad83-8028c1d3309f {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:51:48 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-86821f7e-4ae8-4e48-9a71-0462d96716cd tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:49:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-101620479',display_name='tempest-TestShelveInstance-server-101620479',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-101620479',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJl9SeKBDEFUdZXIRYxtj3V1LFrnLzpBI1BTadh9TNsH8fkqnHg5Fw+RxTHhcTZ72iicnrnvmeL33OTqSqXpIduQnNb3GyKNIEhQtAMHUQIlw02/VIbczFOLlqv70OZPgQ==',key_name='tempest-TestShelveInstance-614764253',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:50:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='85e92f662b024b8a86d5fd646f169169',ramdisk_id='',reservation_id='r-npw3a429',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1828854384',owner_user_name='tempest-TestShelveInstance-1828854384-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:50:09Z,user_data=None,user_id='53f2f7de42a74fb997661c7d579f508d',uuid=fd91d5fc-857d-4d63-ad83-8028c1d3309f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a9e045fe-1480-4254-ad3d-ce7a12c1b293", "address": "fa:16:3e:a4:a5:1c", "network": {"id": "fe4e60fb-1489-4a58-989a-1d81e33eddbc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1273087888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85e92f662b024b8a86d5fd646f169169", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9e045fe-14", "ovs_interfaceid": "a9e045fe-1480-4254-ad3d-ce7a12c1b293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 14:51:48 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-86821f7e-4ae8-4e48-9a71-0462d96716cd tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Converting VIF {"id": "a9e045fe-1480-4254-ad3d-ce7a12c1b293", "address": "fa:16:3e:a4:a5:1c", "network": {"id": "fe4e60fb-1489-4a58-989a-1d81e33eddbc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1273087888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85e92f662b024b8a86d5fd646f169169", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9e045fe-14", "ovs_interfaceid": "a9e045fe-1480-4254-ad3d-ce7a12c1b293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:51:48 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-86821f7e-4ae8-4e48-9a71-0462d96716cd tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:a5:1c,bridge_name='br-int',has_traffic_filtering=True,id=a9e045fe-1480-4254-ad3d-ce7a12c1b293,network=Network(fe4e60fb-1489-4a58-989a-1d81e33eddbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9e045fe-14') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:51:48 user nova-compute[70924]: DEBUG os_vif [None req-86821f7e-4ae8-4e48-9a71-0462d96716cd tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:a5:1c,bridge_name='br-int',has_traffic_filtering=True,id=a9e045fe-1480-4254-ad3d-ce7a12c1b293,network=Network(fe4e60fb-1489-4a58-989a-1d81e33eddbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9e045fe-14') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 14:51:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:51:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa9e045fe-14, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:51:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:51:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:51:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:51:48 user nova-compute[70924]: INFO os_vif [None req-86821f7e-4ae8-4e48-9a71-0462d96716cd tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:a5:1c,bridge_name='br-int',has_traffic_filtering=True,id=a9e045fe-1480-4254-ad3d-ce7a12c1b293,network=Network(fe4e60fb-1489-4a58-989a-1d81e33eddbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9e045fe-14')
Jul 29 14:51:48 user nova-compute[70924]: DEBUG nova.network.neutron [req-f878d5e2-3a98-4400-a492-6cc9c972e0c6 req-59f3d5f5-2d05-4f4c-b76a-93a7aede0cc5 service nova] [instance: fd57baf8-6306-4553-a058-e915fb543405] Updated VIF entry in instance network info cache for port c8f2eadb-705f-4b8b-9f67-c5280cf1f025. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:51:48 user nova-compute[70924]: DEBUG nova.network.neutron [req-f878d5e2-3a98-4400-a492-6cc9c972e0c6 req-59f3d5f5-2d05-4f4c-b76a-93a7aede0cc5 service nova] [instance: fd57baf8-6306-4553-a058-e915fb543405] Updating instance_info_cache with network_info: [{"id": "c8f2eadb-705f-4b8b-9f67-c5280cf1f025", "address": "fa:16:3e:15:d2:44", "network": {"id": "55c18d07-a341-4678-9d1c-2dff057a9b1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1092921088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b33d01ba458f466b99b6bc5bba88d8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8f2eadb-70", "ovs_interfaceid": "c8f2eadb-705f-4b8b-9f67-c5280cf1f025", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:51:48 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86821f7e-4ae8-4e48-9a71-0462d96716cd tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] calling os-brick to detach iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 14:51:48 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-86821f7e-4ae8-4e48-9a71-0462d96716cd tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, {'target_iqns': ['iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tvIfOzwR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:51:48 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-86821f7e-4ae8-4e48-9a71-0462d96716cd tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:51:48 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-86821f7e-4ae8-4e48-9a71-0462d96716cd tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:51:48 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-86821f7e-4ae8-4e48-9a71-0462d96716cd tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:51:48 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-86821f7e-4ae8-4e48-9a71-0462d96716cd tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495', 0)] {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 14:51:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:51:48 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-f878d5e2-3a98-4400-a492-6cc9c972e0c6 req-59f3d5f5-2d05-4f4c-b76a-93a7aede0cc5 service nova] Releasing lock "refresh_cache-fd57baf8-6306-4553-a058-e915fb543405" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:51:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:51:48 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cbbea4a-977a-46f0-9cb7-2586ee0571c9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb604e64-0e9f-4297-89ed-18feb25b6a41\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:51:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:51:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:51:48 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b716d69-9baa-4bb9-926b-9b1729a83bb9]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb604e64-0e9f-4297-89ed-18feb25b6a41 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:51:48 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-86821f7e-4ae8-4e48-9a71-0462d96716cd tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:51:48 user nova-compute[70924]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)
Jul 29 14:51:48 user nova-compute[70924]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:51:48 user nova-compute[70924]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)
Jul 29 14:51:48 user nova-compute[70924]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)
Jul 29 14:51:48 user nova-compute[70924]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb604e64-0e9f-4297-89ed-18feb25b6a41 (non-flash)
Jul 29 14:51:48 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:51:48 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-86821f7e-4ae8-4e48-9a71-0462d96716cd tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:51:48 user nova-compute[70924]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)
Jul 29 14:51:48 user nova-compute[70924]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:51:48 user nova-compute[70924]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)
Jul 29 14:51:48 user nova-compute[70924]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)
Jul 29 14:51:48 user nova-compute[70924]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb604e64-0e9f-4297-89ed-18feb25b6a41 (non-flash)
Jul 29 14:51:48 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:51:48 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-86821f7e-4ae8-4e48-9a71-0462d96716cd tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feecc537520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495'): ({'sdc'}, set())}) {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 14:51:48 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-86821f7e-4ae8-4e48-9a71-0462d96716cd tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Removing single pathed devices sdc {{(pid=70924) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 14:51:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:51:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:51:48 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[424303a1-b73b-4c59-8c0c-9b59ea833c62]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:51:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:51:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:51:49 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a117b31-1dcf-43d2-8a90-6f6f388fe61c]: (4, ('ok\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:51:49 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-86821f7e-4ae8-4e48-9a71-0462d96716cd tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Flushing IO for device /dev/sdc {{(pid=70924) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 14:51:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:51:49 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:51:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:51:49 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f911bb-aeed-4532-9d7f-5c64bcc26104]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:51:49 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-86821f7e-4ae8-4e48-9a71-0462d96716cd tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70924) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 14:51:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:51:49 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:51:49 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.738s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:51:49 user nova-compute[70924]: INFO nova.compute.manager [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] Migrating
Jul 29 14:51:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:51:49 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f2118f-a6ad-4ec6-b2c0-4d2e6c0fe6b0]: (4, ('1', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:51:49 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.659s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:51:49 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:51:49 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Auditing locally available compute resources for user (node: user) {{(pid=70924) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 14:51:49 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-86821f7e-4ae8-4e48-9a71-0462d96716cd tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 14:51:49 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-86821f7e-4ae8-4e48-9a71-0462d96716cd tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] SCSI volumes sdc have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 14:51:49 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-86821f7e-4ae8-4e48-9a71-0462d96716cd tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495')] {{(pid=70924) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 14:51:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:51:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:51:49 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ae1244-89e1-4b41-ab91-30b400691bbf]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:51:49 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-86821f7e-4ae8-4e48-9a71-0462d96716cd tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:51:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 -p 172.16.0.220:3260 --logout {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:51:49 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Acquiring lock "refresh_cache-fd57baf8-6306-4553-a058-e915fb543405" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:51:49 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Acquired lock "refresh_cache-fd57baf8-6306-4553-a058-e915fb543405" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:51:49 user nova-compute[70924]: DEBUG nova.network.neutron [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 14:51:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:51:49 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3dac217-a89d-40c3-a7bc-c5d6ded63e32]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:51:49 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-86821f7e-4ae8-4e48-9a71-0462d96716cd tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495, portal: 172.16.0.220,3260]
Jul 29 14:51:49 user nova-compute[70924]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495, portal: 172.16.0.220,3260] successful.
Jul 29 14:51:49 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:51:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 -p 172.16.0.220:3260 --op delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:51:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:51:49 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd3c2c5-c126-44b5-b2a3-24cff25b1aa0]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:51:49 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-86821f7e-4ae8-4e48-9a71-0462d96716cd tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:51:49 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-86821f7e-4ae8-4e48-9a71-0462d96716cd tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:51:49 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-86821f7e-4ae8-4e48-9a71-0462d96716cd tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] <== disconnect_volume: return (365ms) None {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:51:49 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86821f7e-4ae8-4e48-9a71-0462d96716cd tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Disconnected iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 14:51:49 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-86821f7e-4ae8-4e48-9a71-0462d96716cd tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Deleting instance files /opt/stack/data/nova/instances/fd91d5fc-857d-4d63-ad83-8028c1d3309f_del
Jul 29 14:51:49 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-86821f7e-4ae8-4e48-9a71-0462d96716cd tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Deletion of /opt/stack/data/nova/instances/fd91d5fc-857d-4d63-ad83-8028c1d3309f_del complete
Jul 29 14:51:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:51:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:51:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:51:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:51:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0776c81-190d-41da-99c5-7419ed69b92c/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:51:49 user nova-compute[70924]: DEBUG nova.network.neutron [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] Updating instance_info_cache with network_info: [{"id": "c8f2eadb-705f-4b8b-9f67-c5280cf1f025", "address": "fa:16:3e:15:d2:44", "network": {"id": "55c18d07-a341-4678-9d1c-2dff057a9b1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1092921088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b33d01ba458f466b99b6bc5bba88d8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8f2eadb-70", "ovs_interfaceid": "c8f2eadb-705f-4b8b-9f67-c5280cf1f025", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:51:49 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Releasing lock "refresh_cache-fd57baf8-6306-4553-a058-e915fb543405" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:51:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0776c81-190d-41da-99c5-7419ed69b92c/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:51:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0776c81-190d-41da-99c5-7419ed69b92c/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:51:49 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] Starting migrate_disk_and_power_off {{(pid=70924) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Jul 29 14:51:49 user nova-compute[70924]: DEBUG nova.compute.manager [req-66b6373c-23a5-4932-8183-1bca4ed70e2c req-d3ef5f31-57b6-46df-84e4-912398e4e1af service nova] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Received event network-changed-a9e045fe-1480-4254-ad3d-ce7a12c1b293 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:51:49 user nova-compute[70924]: DEBUG nova.compute.manager [req-66b6373c-23a5-4932-8183-1bca4ed70e2c req-d3ef5f31-57b6-46df-84e4-912398e4e1af service nova] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Refreshing instance network info cache due to event network-changed-a9e045fe-1480-4254-ad3d-ce7a12c1b293. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:51:49 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-66b6373c-23a5-4932-8183-1bca4ed70e2c req-d3ef5f31-57b6-46df-84e4-912398e4e1af service nova] Acquiring lock "refresh_cache-fd91d5fc-857d-4d63-ad83-8028c1d3309f" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:51:49 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-66b6373c-23a5-4932-8183-1bca4ed70e2c req-d3ef5f31-57b6-46df-84e4-912398e4e1af service nova] Acquired lock "refresh_cache-fd91d5fc-857d-4d63-ad83-8028c1d3309f" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:51:49 user nova-compute[70924]: DEBUG nova.network.neutron [req-66b6373c-23a5-4932-8183-1bca4ed70e2c req-d3ef5f31-57b6-46df-84e4-912398e4e1af service nova] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Refreshing network info cache for port a9e045fe-1480-4254-ad3d-ce7a12c1b293 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:51:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0776c81-190d-41da-99c5-7419ed69b92c/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:51:49 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:51:49 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 14:51:49 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:51:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c31a724f-3006-4e5d-a9b5-847fd6cd170a/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:51:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c31a724f-3006-4e5d-a9b5-847fd6cd170a/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:51:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c31a724f-3006-4e5d-a9b5-847fd6cd170a/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:51:50 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:51:50 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:51:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c31a724f-3006-4e5d-a9b5-847fd6cd170a/disk --force-share --output=json" returned: 0 in 0.557s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:51:50 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Error from libvirt while getting description of instance-0000001b: [Error Code 42] Domain not found: no domain with matching uuid 'fd91d5fc-857d-4d63-ad83-8028c1d3309f' (instance-0000001b): libvirt.libvirtError: Domain not found: no domain with matching uuid 'fd91d5fc-857d-4d63-ad83-8028c1d3309f' (instance-0000001b)
Jul 29 14:51:50 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: fd57baf8-6306-4553-a058-e915fb543405] Instance destroyed successfully.
Jul 29 14:51:50 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:49:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1631866093',display_name='tempest-ServerActionsTestOtherA-server-1631866093',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1631866093',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfg71Q+cjedfRarcbIler9POuKvX/jsQII2ANgknh6qTEvuHJAE8T34RCDfGUcAvd9SbwZCzhWP8ikNDBjVZKRBIySMsLhBLIX0hKsMOAV+S3aIT6/Yawicov1EmjAkDw==',key_name='tempest-keypair-1866871140',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:50:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b33d01ba458f466b99b6bc5bba88d8c0',ramdisk_id='',reservation_id='r-gzlw9uxq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-166265056',owner_user_name='tempest-ServerActionsTestOtherA-166265056-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:51:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55b9032bef2d4d3586dc5d18cdc1ee55',uuid=fd57baf8-6306-4553-a058-e915fb543405,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c8f2eadb-705f-4b8b-9f67-c5280cf1f025", "address": "fa:16:3e:15:d2:44", "network": {"id": "55c18d07-a341-4678-9d1c-2dff057a9b1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1092921088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1092921088-network", "vif_mac": "fa:16:3e:15:d2:44"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b33d01ba458f466b99b6bc5bba88d8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8f2eadb-70", "ovs_interfaceid": "c8f2eadb-705f-4b8b-9f67-c5280cf1f025", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 14:51:50 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Converting VIF {"id": "c8f2eadb-705f-4b8b-9f67-c5280cf1f025", "address": "fa:16:3e:15:d2:44", "network": {"id": "55c18d07-a341-4678-9d1c-2dff057a9b1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1092921088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1092921088-network", "vif_mac": "fa:16:3e:15:d2:44"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b33d01ba458f466b99b6bc5bba88d8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8f2eadb-70", "ovs_interfaceid": "c8f2eadb-705f-4b8b-9f67-c5280cf1f025", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:51:50 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:d2:44,bridge_name='br-int',has_traffic_filtering=True,id=c8f2eadb-705f-4b8b-9f67-c5280cf1f025,network=Network(55c18d07-a341-4678-9d1c-2dff057a9b1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8f2eadb-70') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:51:50 user nova-compute[70924]: DEBUG os_vif [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:d2:44,bridge_name='br-int',has_traffic_filtering=True,id=c8f2eadb-705f-4b8b-9f67-c5280cf1f025,network=Network(55c18d07-a341-4678-9d1c-2dff057a9b1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8f2eadb-70') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 14:51:50 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:51:50 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc8f2eadb-70, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:51:50 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:51:50 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-b5f504fe-f179-45d1-9d43-d6337b0c2271 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Acquiring lock "1f7989ca-77e9-440f-bd2f-60e46e005557" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:51:50 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-b5f504fe-f179-45d1-9d43-d6337b0c2271 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lock "1f7989ca-77e9-440f-bd2f-60e46e005557" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:51:50 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 14:51:50 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:51:50 user nova-compute[70924]: INFO os_vif [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:d2:44,bridge_name='br-int',has_traffic_filtering=True,id=c8f2eadb-705f-4b8b-9f67-c5280cf1f025,network=Network(55c18d07-a341-4678-9d1c-2dff057a9b1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8f2eadb-70')
Jul 29 14:51:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:51:50 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] calling os-brick to detach iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 14:51:50 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, {'target_iqns': ['iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zKwhpaCm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:51:50 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:51:50 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:51:50 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:51:50 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464', 0)] {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 14:51:50 user nova-compute[70924]: DEBUG nova.objects.instance [None req-b5f504fe-f179-45d1-9d43-d6337b0c2271 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lazy-loading 'flavor' on Instance uuid 1f7989ca-77e9-440f-bd2f-60e46e005557 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:51:50 user nova-compute[70924]: INFO nova.scheduler.client.report [None req-86821f7e-4ae8-4e48-9a71-0462d96716cd tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Deleted allocations for instance fd91d5fc-857d-4d63-ad83-8028c1d3309f
Jul 29 14:51:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:51:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:51:50 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[501bf67a-98ef-49e8-95c1-1a176b67285c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb604e64-0e9f-4297-89ed-18feb25b6a41\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:51:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:51:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:51:50 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[3614842b-78b1-43ab-8578-162cb59b420f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb604e64-0e9f-4297-89ed-18feb25b6a41 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:51:50 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:51:50 user nova-compute[70924]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:51:50 user nova-compute[70924]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)
Jul 29 14:51:50 user nova-compute[70924]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)
Jul 29 14:51:50 user nova-compute[70924]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb604e64-0e9f-4297-89ed-18feb25b6a41 (non-flash)
Jul 29 14:51:50 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:51:50 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:51:50 user nova-compute[70924]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:51:50 user nova-compute[70924]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)
Jul 29 14:51:50 user nova-compute[70924]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)
Jul 29 14:51:50 user nova-compute[70924]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb604e64-0e9f-4297-89ed-18feb25b6a41 (non-flash)
Jul 29 14:51:50 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:51:50 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feecc68d120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464'): ({'sdd'}, set())}) {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 14:51:50 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Removing single pathed devices sdd {{(pid=70924) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 14:51:50 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-b5f504fe-f179-45d1-9d43-d6337b0c2271 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lock "1f7989ca-77e9-440f-bd2f-60e46e005557" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.170s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:51:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:51:50 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-86821f7e-4ae8-4e48-9a71-0462d96716cd tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:51:50 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-86821f7e-4ae8-4e48-9a71-0462d96716cd tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:51:50 user nova-compute[70924]: DEBUG nova.objects.instance [None req-86821f7e-4ae8-4e48-9a71-0462d96716cd tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Lazy-loading 'numa_topology' on Instance uuid fd91d5fc-857d-4d63-ad83-8028c1d3309f {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:51:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:51:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.047s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0d015a-b7a0-4147-a20b-f2f49cc2141c]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a8c303-ef44-462e-8431-8c438f7d4b43]: (4, ('ok\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Flushing IO for device /dev/sdd {{(pid=70924) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b34230a0-1b13-43f2-98ad-0cc89043aa8a]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70924) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba43cdef-0ee4-41a5-9799-cddd9142b354]: (4, ('1', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] SCSI volumes sdd have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464')] {{(pid=70924) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-b5f504fe-f179-45d1-9d43-d6337b0c2271 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Acquiring lock "1f7989ca-77e9-440f-bd2f-60e46e005557" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-b5f504fe-f179-45d1-9d43-d6337b0c2271 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lock "1f7989ca-77e9-440f-bd2f-60e46e005557" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:51:51 user nova-compute[70924]: INFO nova.compute.manager [None req-b5f504fe-f179-45d1-9d43-d6337b0c2271 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Attaching volume 77c2fd5b-ad43-4309-901b-6201b6f0eaba to /dev/vdb
Jul 29 14:51:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f7989ca-77e9-440f-bd2f-60e46e005557/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.037s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92c5170-ce39-4929-8af8-eeb29ee53eb8]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 -p 172.16.0.220:3260 --logout {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG nova.network.neutron [req-66b6373c-23a5-4932-8183-1bca4ed70e2c req-d3ef5f31-57b6-46df-84e4-912398e4e1af service nova] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Updated VIF entry in instance network info cache for port a9e045fe-1480-4254-ad3d-ce7a12c1b293. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG nova.network.neutron [req-66b6373c-23a5-4932-8183-1bca4ed70e2c req-d3ef5f31-57b6-46df-84e4-912398e4e1af service nova] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Updating instance_info_cache with network_info: [{"id": "a9e045fe-1480-4254-ad3d-ce7a12c1b293", "address": "fa:16:3e:a4:a5:1c", "network": {"id": "fe4e60fb-1489-4a58-989a-1d81e33eddbc", "bridge": null, "label": "tempest-TestShelveInstance-1273087888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85e92f662b024b8a86d5fd646f169169", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapa9e045fe-14", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-66b6373c-23a5-4932-8183-1bca4ed70e2c req-d3ef5f31-57b6-46df-84e4-912398e4e1af service nova] Releasing lock "refresh_cache-fd91d5fc-857d-4d63-ad83-8028c1d3309f" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG os_brick.utils [None req-b5f504fe-f179-45d1-9d43-d6337b0c2271 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9daa74-bd81-42e0-b800-2bf9d2bee7a8]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464, portal: 172.16.0.220,3260]
Jul 29 14:51:51 user nova-compute[70924]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464, portal: 172.16.0.220,3260] successful.
Jul 29 14:51:51 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 -p 172.16.0.220:3260 --op delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[010ff662-cd07-42a8-8a3b-0eeb80f29149]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f2127c4a30d9\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f7989ca-77e9-440f-bd2f-60e46e005557/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f7989ca-77e9-440f-bd2f-60e46e005557/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca80e533-3e10-4e89-925b-7fa09afa2e57]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7fd5e6-2552-45d0-99e9-d73d159ecb67]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.549s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] <== disconnect_volume: return (550ms) None {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] Disconnected iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aac491f-21a6-4edf-adc4-16a1b6fe101e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c90769-ace8-440e-bddc-326b009a53ce]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-b5f504fe-f179-45d1-9d43-d6337b0c2271 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Running cmd (subprocess): nvme version {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-b5f504fe-f179-45d1-9d43-d6337b0c2271 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] 'nvme version' failed. Not Retrying. {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b5f504fe-f179-45d1-9d43-d6337b0c2271 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] nvme not present on system {{(pid=70924) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f7989ca-77e9-440f-bd2f-60e46e005557/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7171083a-00aa-4faf-9732-88cab8a0d83d/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:51:51 user nova-compute[70924]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 14:51:51 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ecb4fed-964a-49dd-9214-cd3a2628d7dc]: (4, '') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-b5f504fe-f179-45d1-9d43-d6337b0c2271 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70924) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-b5f504fe-f179-45d1-9d43-d6337b0c2271 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-b5f504fe-f179-45d1-9d43-d6337b0c2271 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] LIGHTOS: no hostnqn found. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG os_brick.utils [None req-b5f504fe-f179-45d1-9d43-d6337b0c2271 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] <== get_connector_properties: return (251ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f2127c4a30d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG nova.virt.block_device [None req-b5f504fe-f179-45d1-9d43-d6337b0c2271 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Updating existing volume attachment record: d8442c62-585f-40b9-8061-9e2192e59bec {{(pid=70924) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7171083a-00aa-4faf-9732-88cab8a0d83d/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7171083a-00aa-4faf-9732-88cab8a0d83d/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-86821f7e-4ae8-4e48-9a71-0462d96716cd tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7171083a-00aa-4faf-9732-88cab8a0d83d/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-86821f7e-4ae8-4e48-9a71-0462d96716cd tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cb12b3e-de44-4887-ab74-2a68164b5f7d/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-86821f7e-4ae8-4e48-9a71-0462d96716cd tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.935s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG nova.compute.manager [req-e815eb57-47d9-48d5-908b-b00f183c508d req-239cbc12-6d33-4af3-b0e6-19271c21ac8b service nova] [instance: fd57baf8-6306-4553-a058-e915fb543405] Received event network-vif-unplugged-c8f2eadb-705f-4b8b-9f67-c5280cf1f025 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-e815eb57-47d9-48d5-908b-b00f183c508d req-239cbc12-6d33-4af3-b0e6-19271c21ac8b service nova] Acquiring lock "fd57baf8-6306-4553-a058-e915fb543405-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-e815eb57-47d9-48d5-908b-b00f183c508d req-239cbc12-6d33-4af3-b0e6-19271c21ac8b service nova] Lock "fd57baf8-6306-4553-a058-e915fb543405-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-e815eb57-47d9-48d5-908b-b00f183c508d req-239cbc12-6d33-4af3-b0e6-19271c21ac8b service nova] Lock "fd57baf8-6306-4553-a058-e915fb543405-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:51:51 user nova-compute[70924]: DEBUG nova.compute.manager [req-e815eb57-47d9-48d5-908b-b00f183c508d req-239cbc12-6d33-4af3-b0e6-19271c21ac8b service nova] [instance: fd57baf8-6306-4553-a058-e915fb543405] No waiting events found dispatching network-vif-unplugged-c8f2eadb-705f-4b8b-9f67-c5280cf1f025 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:51:51 user nova-compute[70924]: WARNING nova.compute.manager [req-e815eb57-47d9-48d5-908b-b00f183c508d req-239cbc12-6d33-4af3-b0e6-19271c21ac8b service nova] [instance: fd57baf8-6306-4553-a058-e915fb543405] Received unexpected event network-vif-unplugged-c8f2eadb-705f-4b8b-9f67-c5280cf1f025 for instance with vm_state active and task_state resize_migrating.
Jul 29 14:51:52 user nova-compute[70924]: DEBUG nova.compute.manager [req-e815eb57-47d9-48d5-908b-b00f183c508d req-239cbc12-6d33-4af3-b0e6-19271c21ac8b service nova] [instance: fd57baf8-6306-4553-a058-e915fb543405] Received event network-vif-plugged-c8f2eadb-705f-4b8b-9f67-c5280cf1f025 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:51:52 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-e815eb57-47d9-48d5-908b-b00f183c508d req-239cbc12-6d33-4af3-b0e6-19271c21ac8b service nova] Acquiring lock "fd57baf8-6306-4553-a058-e915fb543405-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:51:52 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-e815eb57-47d9-48d5-908b-b00f183c508d req-239cbc12-6d33-4af3-b0e6-19271c21ac8b service nova] Lock "fd57baf8-6306-4553-a058-e915fb543405-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:51:52 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-e815eb57-47d9-48d5-908b-b00f183c508d req-239cbc12-6d33-4af3-b0e6-19271c21ac8b service nova] Lock "fd57baf8-6306-4553-a058-e915fb543405-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:51:52 user nova-compute[70924]: DEBUG nova.compute.manager [req-e815eb57-47d9-48d5-908b-b00f183c508d req-239cbc12-6d33-4af3-b0e6-19271c21ac8b service nova] [instance: fd57baf8-6306-4553-a058-e915fb543405] No waiting events found dispatching network-vif-plugged-c8f2eadb-705f-4b8b-9f67-c5280cf1f025 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:51:52 user nova-compute[70924]: WARNING nova.compute.manager [req-e815eb57-47d9-48d5-908b-b00f183c508d req-239cbc12-6d33-4af3-b0e6-19271c21ac8b service nova] [instance: fd57baf8-6306-4553-a058-e915fb543405] Received unexpected event network-vif-plugged-c8f2eadb-705f-4b8b-9f67-c5280cf1f025 for instance with vm_state active and task_state resize_migrating.
Jul 29 14:51:52 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cb12b3e-de44-4887-ab74-2a68164b5f7d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:51:52 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cb12b3e-de44-4887-ab74-2a68164b5f7d/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:51:52 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-86821f7e-4ae8-4e48-9a71-0462d96716cd tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Lock "fd91d5fc-857d-4d63-ad83-8028c1d3309f" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 6.188s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:51:52 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cb12b3e-de44-4887-ab74-2a68164b5f7d/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:51:52 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 14:51:52 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:51:52 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:51:52 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:51:52 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:51:52 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 14:51:52 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:51:52 user nova-compute[70924]: DEBUG nova.network.neutron [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] Port c8f2eadb-705f-4b8b-9f67-c5280cf1f025 binding to destination host user is already ACTIVE {{(pid=70924) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Jul 29 14:51:52 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:51:52 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:51:52 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Acquiring lock "fd57baf8-6306-4553-a058-e915fb543405-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:51:52 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "fd57baf8-6306-4553-a058-e915fb543405-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.004s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:51:52 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "fd57baf8-6306-4553-a058-e915fb543405-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:51:52 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:51:52 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk.rescue --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:51:52 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Acquiring lock "refresh_cache-fd57baf8-6306-4553-a058-e915fb543405" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:51:52 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Acquired lock "refresh_cache-fd57baf8-6306-4553-a058-e915fb543405" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:51:52 user nova-compute[70924]: DEBUG nova.network.neutron [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 14:51:53 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:51:53 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk.rescue --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:51:53 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:51:53 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:51:53 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:51:53 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk --force-share --output=json" returned: 0 in 0.315s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:51:53 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:51:53 user nova-compute[70924]: DEBUG nova.network.neutron [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] Updating instance_info_cache with network_info: [{"id": "c8f2eadb-705f-4b8b-9f67-c5280cf1f025", "address": "fa:16:3e:15:d2:44", "network": {"id": "55c18d07-a341-4678-9d1c-2dff057a9b1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1092921088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b33d01ba458f466b99b6bc5bba88d8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8f2eadb-70", "ovs_interfaceid": "c8f2eadb-705f-4b8b-9f67-c5280cf1f025", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:51:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Releasing lock "refresh_cache-fd57baf8-6306-4553-a058-e915fb543405" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:51:53 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk --force-share --output=json" returned: 0 in 0.350s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:51:55 user nova-compute[70924]: DEBUG os_brick.utils [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:51:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:51:55 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:51:55 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:51:55 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Hypervisor/Node resource view: name=user free_ram=7086MB free_disk=25.246761322021484GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70924) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 14:51:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:51:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:51:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.028s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:51:55 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ee9ecc-2f0a-44ea-912d-ab3056db5b48]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f2127c4a30d9\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:51:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:51:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:51:55 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0311d184-a283-47a7-b6b0-21324841eff4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:51:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:51:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:51:55 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[786a6dee-2233-4819-9ff2-09b888b8ab6a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:51:55 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e42362d-19f3-4d5b-a43a-ff19ac1e6782]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:51:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Running cmd (subprocess): nvme version {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:51:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] 'nvme version' failed. Not Retrying. {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:51:55 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] nvme not present on system {{(pid=70924) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 14:51:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:51:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:51:55 user nova-compute[70924]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 14:51:55 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4df318-b284-49a8-8395-c57364b637f7]: (4, '') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:51:55 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70924) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 14:51:55 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 14:51:55 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] LIGHTOS: no hostnqn found. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 14:51:55 user nova-compute[70924]: DEBUG os_brick.utils [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f2127c4a30d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:51:55 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Applying migration context for instance f5350fb5-9460-490b-a47e-74f88c8eb51c as it has an incoming, in-progress migration 34c17454-041c-408f-80d8-2702f06cc0d4. Migration status is finished {{(pid=70924) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Jul 29 14:51:55 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Applying migration context for instance fd57baf8-6306-4553-a058-e915fb543405 as it has an incoming, in-progress migration 89fefda8-4f7a-4616-af61-9c8f1289c480. Migration status is post-migrating {{(pid=70924) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Jul 29 14:51:55 user nova-compute[70924]: INFO nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Updating resource usage from migration 34c17454-041c-408f-80d8-2702f06cc0d4
Jul 29 14:51:55 user nova-compute[70924]: INFO nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: fd57baf8-6306-4553-a058-e915fb543405] Updating resource usage from migration 89fefda8-4f7a-4616-af61-9c8f1289c480
Jul 29 14:51:55 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance db656346-c4af-43da-9600-fd39f1b9e4dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:51:55 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 86ecc6cb-88a8-4572-8e41-d4c5859036a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:51:55 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 02c75b00-a1b4-4ef9-ae96-bc67d8038589 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:51:55 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 1f7989ca-77e9-440f-bd2f-60e46e005557 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:51:55 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 7cb12b3e-de44-4887-ab74-2a68164b5f7d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:51:55 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 7171083a-00aa-4faf-9732-88cab8a0d83d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:51:55 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 9ec07c62-951b-4e3a-bffa-e01dfb4665ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:51:55 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 091e384f-7851-4ac9-b566-990df0497fc5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:51:55 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance c31a724f-3006-4e5d-a9b5-847fd6cd170a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:51:55 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance d0776c81-190d-41da-99c5-7419ed69b92c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:51:55 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Migration 34c17454-041c-408f-80d8-2702f06cc0d4 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Jul 29 14:51:55 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance f5350fb5-9460-490b-a47e-74f88c8eb51c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:51:55 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Migration 89fefda8-4f7a-4616-af61-9c8f1289c480 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Jul 29 14:51:55 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance fd57baf8-6306-4553-a058-e915fb543405 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:51:55 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 14:51:55 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Final resource view: name=user phys_ram=16011MB used_ram=10752MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 14:51:55 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:51:55 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:51:55 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:51:55 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Compute_service record updated for user:user {{(pid=70924) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 14:51:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.728s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:51:55 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:51:55 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Cleaning up deleted instances {{(pid=70924) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 29 14:51:55 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] There are 0 instances to clean {{(pid=70924) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 29 14:51:55 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:51:55 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Cleaning up deleted instances with incomplete migration  {{(pid=70924) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 29 14:51:57 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:51:57 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:51:57 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Starting heal instance info cache {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 14:51:57 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "refresh_cache-f5350fb5-9460-490b-a47e-74f88c8eb51c" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:51:57 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquired lock "refresh_cache-f5350fb5-9460-490b-a47e-74f88c8eb51c" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:51:57 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Forcefully refreshing network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 29 14:51:58 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Updating instance_info_cache with network_info: [{"id": "c4a5a7c9-34d6-4040-87a3-78c4fd26b170", "address": "fa:16:3e:90:f1:53", "network": {"id": "d87dd51f-8870-4dfa-b608-7c4b662219ca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1964327887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd007df2b3e04ab784369809178e4240", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a5a7c9-34", "ovs_interfaceid": "c4a5a7c9-34d6-4040-87a3-78c4fd26b170", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:51:58 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Releasing lock "refresh_cache-f5350fb5-9460-490b-a47e-74f88c8eb51c" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:51:58 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Updated the network info_cache for instance {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 29 14:51:58 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:51:58 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:51:58 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:51:58 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:51:58 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:51:58 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:51:58 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70924) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 14:52:00 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5f504fe-f179-45d1-9d43-d6337b0c2271 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Calling os-brick to attach iSCSI Volume {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 14:52:00 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5f504fe-f179-45d1-9d43-d6337b0c2271 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:77c2fd5b-ad43-4309-901b-6201b6f0eaba'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DHxGAvkl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:52:00 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-b5f504fe-f179-45d1-9d43-d6337b0c2271 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:52:00 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-b5f504fe-f179-45d1-9d43-d6337b0c2271 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:52:00 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-b5f504fe-f179-45d1-9d43-d6337b0c2271 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:52:00 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-b5f504fe-f179-45d1-9d43-d6337b0c2271 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:52:00 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-b5f504fe-f179-45d1-9d43-d6337b0c2271 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77c2fd5b-ad43-4309-901b-6201b6f0eaba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:52:00 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-b5f504fe-f179-45d1-9d43-d6337b0c2271 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77c2fd5b-ad43-4309-901b-6201b6f0eaba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:52:00 user nova-compute[70924]: INFO os_brick.initiator.connectors.iscsi [None req-b5f504fe-f179-45d1-9d43-d6337b0c2271 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 14:52:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77c2fd5b-ad43-4309-901b-6201b6f0eaba -p 172.16.0.220:3260 {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77c2fd5b-ad43-4309-901b-6201b6f0eaba -p 172.16.0.220:3260" returned: 21 in 0.126s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:00 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b65b8d4-8218-49f4-999d-302ad0d49589]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:00 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5f504fe-f179-45d1-9d43-d6337b0c2271 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 14:52:00 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:52:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77c2fd5b-ad43-4309-901b-6201b6f0eaba -p 172.16.0.220:3260 --interface default --op new {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77c2fd5b-ad43-4309-901b-6201b6f0eaba -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:00 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16c5793-53f0-4288-91e0-a6ffd4dd87c9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77c2fd5b-ad43-4309-901b-6201b6f0eaba] added\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:00 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5f504fe-f179-45d1-9d43-d6337b0c2271 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77c2fd5b-ad43-4309-901b-6201b6f0eaba] added
Jul 29 14:52:00 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:52:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77c2fd5b-ad43-4309-901b-6201b6f0eaba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77c2fd5b-ad43-4309-901b-6201b6f0eaba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:00 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cfc44e7-6ced-4e02-b016-cfbec02991aa]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:00 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5f504fe-f179-45d1-9d43-d6337b0c2271 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:52:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77c2fd5b-ad43-4309-901b-6201b6f0eaba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77c2fd5b-ad43-4309-901b-6201b6f0eaba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:00 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[338939b2-b3f0-4544-b3e0-e841ba35c14e]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:00 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5f504fe-f179-45d1-9d43-d6337b0c2271 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:52:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77c2fd5b-ad43-4309-901b-6201b6f0eaba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DHxGAvkl {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77c2fd5b-ad43-4309-901b-6201b6f0eaba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DHxGAvkl" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:00 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c946bc30-a074-4d6e-a194-d5694c9354da]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:00 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5f504fe-f179-45d1-9d43-d6337b0c2271 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DHxGAvkl'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:52:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77c2fd5b-ad43-4309-901b-6201b6f0eaba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77c2fd5b-ad43-4309-901b-6201b6f0eaba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:00 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[407776b6-5cb4-41eb-8ebd-235549f89cf5]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:00 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5f504fe-f179-45d1-9d43-d6337b0c2271 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:52:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:00 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4a9953-57a5-4ff8-a7b9-494a8585df6e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb604e64-0e9f-4297-89ed-18feb25b6a41 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:00 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5f504fe-f179-45d1-9d43-d6337b0c2271 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:52:00 user nova-compute[70924]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)
Jul 29 14:52:00 user nova-compute[70924]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)
Jul 29 14:52:00 user nova-compute[70924]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb604e64-0e9f-4297-89ed-18feb25b6a41 (non-flash)
Jul 29 14:52:00 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:52:00 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5f504fe-f179-45d1-9d43-d6337b0c2271 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:52:00 user nova-compute[70924]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)
Jul 29 14:52:00 user nova-compute[70924]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)
Jul 29 14:52:00 user nova-compute[70924]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb604e64-0e9f-4297-89ed-18feb25b6a41 (non-flash)
Jul 29 14:52:00 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:52:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77c2fd5b-ad43-4309-901b-6201b6f0eaba -p 172.16.0.220:3260 --login {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77c2fd5b-ad43-4309-901b-6201b6f0eaba -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:00 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e6ff8f-e271-4420-8a2f-d8044415f617]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:77c2fd5b-ad43-4309-901b-6201b6f0eaba, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:77c2fd5b-ad43-4309-901b-6201b6f0eaba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:00 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5f504fe-f179-45d1-9d43-d6337b0c2271 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:77c2fd5b-ad43-4309-901b-6201b6f0eaba, portal: 172.16.0.220,3260]
Jul 29 14:52:00 user nova-compute[70924]: Login to [iface: default, target: iqn.2010-10.org.openstack:77c2fd5b-ad43-4309-901b-6201b6f0eaba, portal: 172.16.0.220,3260] successful.
Jul 29 14:52:00 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:52:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77c2fd5b-ad43-4309-901b-6201b6f0eaba -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:00 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77c2fd5b-ad43-4309-901b-6201b6f0eaba -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.066s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:00 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[913d3961-216a-4570-8900-5a5d073223a7]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:00 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5f504fe-f179-45d1-9d43-d6337b0c2271 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:52:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:00 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd13792a-5b62-481a-86f0-4ccf1b04616c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb604e64-0e9f-4297-89ed-18feb25b6a41 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77c2fd5b-ad43-4309-901b-6201b6f0eaba (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:00 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5f504fe-f179-45d1-9d43-d6337b0c2271 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:52:00 user nova-compute[70924]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)
Jul 29 14:52:00 user nova-compute[70924]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)
Jul 29 14:52:00 user nova-compute[70924]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb604e64-0e9f-4297-89ed-18feb25b6a41 (non-flash)
Jul 29 14:52:00 user nova-compute[70924]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77c2fd5b-ad43-4309-901b-6201b6f0eaba (non-flash)
Jul 29 14:52:00 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:52:00 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5f504fe-f179-45d1-9d43-d6337b0c2271 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:52:00 user nova-compute[70924]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)
Jul 29 14:52:00 user nova-compute[70924]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)
Jul 29 14:52:00 user nova-compute[70924]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb604e64-0e9f-4297-89ed-18feb25b6a41 (non-flash)
Jul 29 14:52:00 user nova-compute[70924]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77c2fd5b-ad43-4309-901b-6201b6f0eaba (non-flash)
Jul 29 14:52:00 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:52:00 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-b5f504fe-f179-45d1-9d43-d6337b0c2271 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77c2fd5b-ad43-4309-901b-6201b6f0eaba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.479s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:52:00 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5f504fe-f179-45d1-9d43-d6337b0c2271 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Connected to 172.16.0.220:3260 {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 14:52:00 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-b5f504fe-f179-45d1-9d43-d6337b0c2271 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] HCTL ('34', '-', '-', 0) found on session 30 with lun 0 {{(pid=70924) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 14:52:00 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-b5f504fe-f179-45d1-9d43-d6337b0c2271 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70924) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 14:52:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:00 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b412388-cb03-452b-9cd7-b77594d36c77]: (4, ('- - 0', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:00 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-b5f504fe-f179-45d1-9d43-d6337b0c2271 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: None {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 14:52:01 user nova-compute[70924]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690642306.7334583, fd91d5fc-857d-4d63-ad83-8028c1d3309f => Stopped> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:52:01 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] VM Stopped (Lifecycle Event)
Jul 29 14:52:01 user nova-compute[70924]: DEBUG nova.compute.manager [None req-b119fedb-ef57-42ce-95f1-9ac14fd663e3 None None] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:52:01 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-b5f504fe-f179-45d1-9d43-d6337b0c2271 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 14:52:01 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5f504fe-f179-45d1-9d43-d6337b0c2271 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DHxGAvkl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 14:52:01 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-b5f504fe-f179-45d1-9d43-d6337b0c2271 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.512s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:52:01 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5f504fe-f179-45d1-9d43-d6337b0c2271 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] <== connect_volume: return (1514ms) {'type': 'block', 'scsi_wwn': '23362356132646537', 'path': '/dev/sdc'} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:52:01 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5f504fe-f179-45d1-9d43-d6337b0c2271 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23362356132646537', 'path': '/dev/sdc'} {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 14:52:01 user nova-compute[70924]: DEBUG nova.objects.instance [None req-b5f504fe-f179-45d1-9d43-d6337b0c2271 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lazy-loading 'flavor' on Instance uuid 1f7989ca-77e9-440f-bd2f-60e46e005557 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:52:01 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-b5f504fe-f179-45d1-9d43-d6337b0c2271 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] attach device xml: <disk type="block" device="disk">
Jul 29 14:52:01 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:52:01 user nova-compute[70924]:   <source dev="/dev/sdc"/>
Jul 29 14:52:01 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 14:52:01 user nova-compute[70924]:   <serial>77c2fd5b-ad43-4309-901b-6201b6f0eaba</serial>
Jul 29 14:52:01 user nova-compute[70924]: </disk>
Jul 29 14:52:01 user nova-compute[70924]:  {{(pid=70924) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 29 14:52:02 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-b5f504fe-f179-45d1-9d43-d6337b0c2271 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:52:02 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-b5f504fe-f179-45d1-9d43-d6337b0c2271 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:52:02 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-b5f504fe-f179-45d1-9d43-d6337b0c2271 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] No VIF found with MAC fa:16:3e:09:43:b7, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:52:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-b5f504fe-f179-45d1-9d43-d6337b0c2271 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lock "1f7989ca-77e9-440f-bd2f-60e46e005557" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.572s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:52:03 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] Starting finish_migration {{(pid=70924) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] Instance directory exists: not creating {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 29 14:52:04 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] Creating image(s)
Jul 29 14:52:04 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] Did not create local disks {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] Ensure instance console log exists: /opt/stack/data/nova/instances/fd57baf8-6306-4553-a058-e915fb543405/console.log {{(pid=70924) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] Start _get_guest_xml network_info=[{"id": "c8f2eadb-705f-4b8b-9f67-c5280cf1f025", "address": "fa:16:3e:15:d2:44", "network": {"id": "55c18d07-a341-4678-9d1c-2dff057a9b1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1092921088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1092921088-network", "vif_mac": "fa:16:3e:15:d2:44"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b33d01ba458f466b99b6bc5bba88d8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8f2eadb-70", "ovs_interfaceid": "c8f2eadb-705f-4b8b-9f67-c5280cf1f025", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zKwhpaCm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'fd57baf8-6306-4553-a058-e915fb543405', 'attached_at': '2023-07-29T14:52:04.000000', 'detached_at': '', 'volume_id': '60c129c4-a916-49f7-86b6-ff1a2339a464', 'serial': '60c129c4-a916-49f7-86b6-ff1a2339a464'}, 'attachment_id': '7adee552-8c3a-4832-ae0b-39876a911583', 'volume_type': None} {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 14:52:04 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:52:04 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:52:04 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] CPU controller missing on host. {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] CPU controller found on host. {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70924) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T14:36:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Flavor limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Image limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Flavor pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Image pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Got 1 possible topologies {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG nova.objects.instance [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lazy-loading 'vcpu_model' on Instance uuid fd57baf8-6306-4553-a058-e915fb543405 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] Calling os-brick to attach iSCSI Volume {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zKwhpaCm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:52:04 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:52:04 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:52:04 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:52:04 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:52:04 user nova-compute[70924]: INFO os_brick.initiator.connectors.iscsi [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 14:52:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 -p 172.16.0.220:3260 {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6bc5e9e-fe37-47e2-9a97-76279c4ceb6f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 14:52:04 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 -p 172.16.0.220:3260 --interface default --op new {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[295a85f7-58f2-42cc-a0c1-450181d32fb2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464] added\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464] added
Jul 29 14:52:04 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd113eb1-e235-47b3-b5c8-71bc0a9a25b2]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83e0336-0647-498f-ada4-38616b38aaa2]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zKwhpaCm {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zKwhpaCm" returned: 0 in 0.028s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd921074-72f6-42b1-8a9e-d9b1d61c4a72]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zKwhpaCm'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[343730d5-535b-48fb-afe2-48b0ac0f0f96]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[7823d9cb-3dcc-490e-88c0-d60d0da60a4c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb604e64-0e9f-4297-89ed-18feb25b6a41 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77c2fd5b-ad43-4309-901b-6201b6f0eaba (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:52:04 user nova-compute[70924]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)
Jul 29 14:52:04 user nova-compute[70924]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)
Jul 29 14:52:04 user nova-compute[70924]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb604e64-0e9f-4297-89ed-18feb25b6a41 (non-flash)
Jul 29 14:52:04 user nova-compute[70924]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77c2fd5b-ad43-4309-901b-6201b6f0eaba (non-flash)
Jul 29 14:52:04 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:52:04 user nova-compute[70924]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)
Jul 29 14:52:04 user nova-compute[70924]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)
Jul 29 14:52:04 user nova-compute[70924]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb604e64-0e9f-4297-89ed-18feb25b6a41 (non-flash)
Jul 29 14:52:04 user nova-compute[70924]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77c2fd5b-ad43-4309-901b-6201b6f0eaba (non-flash)
Jul 29 14:52:04 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 -p 172.16.0.220:3260 --login {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95ab062-8bdf-4811-ae87-d4845b67bf1a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464, portal: 172.16.0.220,3260]
Jul 29 14:52:04 user nova-compute[70924]: Login to [iface: default, target: iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464, portal: 172.16.0.220,3260] successful.
Jul 29 14:52:04 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f693ccad-7ca7-4c8f-ab77-a26bff44e40b]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[261cf511-e55b-41eb-b634-f708e6ee876e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb604e64-0e9f-4297-89ed-18feb25b6a41 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77c2fd5b-ad43-4309-901b-6201b6f0eaba (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:52:04 user nova-compute[70924]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)
Jul 29 14:52:04 user nova-compute[70924]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)
Jul 29 14:52:04 user nova-compute[70924]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb604e64-0e9f-4297-89ed-18feb25b6a41 (non-flash)
Jul 29 14:52:04 user nova-compute[70924]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77c2fd5b-ad43-4309-901b-6201b6f0eaba (non-flash)
Jul 29 14:52:04 user nova-compute[70924]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:52:04 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:52:04 user nova-compute[70924]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)
Jul 29 14:52:04 user nova-compute[70924]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)
Jul 29 14:52:04 user nova-compute[70924]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb604e64-0e9f-4297-89ed-18feb25b6a41 (non-flash)
Jul 29 14:52:04 user nova-compute[70924]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77c2fd5b-ad43-4309-901b-6201b6f0eaba (non-flash)
Jul 29 14:52:04 user nova-compute[70924]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:52:04 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Connected to 172.16.0.220:3260 {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] HCTL ('35', '-', '-', 0) found on session 31 with lun 0 {{(pid=70924) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70924) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[115cd1e9-c8cc-43b1-ae74-f5ffce364172]: (4, ('- - 0', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 14:52:04 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zKwhpaCm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 14:52:05 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1f6be909-2137-413a-8f59-1ade40ffa0e6 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Acquiring lock "1f7989ca-77e9-440f-bd2f-60e46e005557" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:52:05 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1f6be909-2137-413a-8f59-1ade40ffa0e6 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lock "1f7989ca-77e9-440f-bd2f-60e46e005557" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:52:05 user nova-compute[70924]: INFO nova.compute.manager [None req-1f6be909-2137-413a-8f59-1ade40ffa0e6 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Detaching volume 77c2fd5b-ad43-4309-901b-6201b6f0eaba
Jul 29 14:52:05 user nova-compute[70924]: INFO nova.virt.block_device [None req-1f6be909-2137-413a-8f59-1ade40ffa0e6 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Attempting to driver detach volume 77c2fd5b-ad43-4309-901b-6201b6f0eaba from mountpoint /dev/vdb
Jul 29 14:52:05 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-1f6be909-2137-413a-8f59-1ade40ffa0e6 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Attempting to detach device vdb from instance 1f7989ca-77e9-440f-bd2f-60e46e005557 from the persistent domain config. {{(pid=70924) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 29 14:52:05 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-1f6be909-2137-413a-8f59-1ade40ffa0e6 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 14:52:05 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:52:05 user nova-compute[70924]:   <source dev="/dev/sdc"/>
Jul 29 14:52:05 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 14:52:05 user nova-compute[70924]:   <serial>77c2fd5b-ad43-4309-901b-6201b6f0eaba</serial>
Jul 29 14:52:05 user nova-compute[70924]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 14:52:05 user nova-compute[70924]: </disk>
Jul 29 14:52:05 user nova-compute[70924]:  {{(pid=70924) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 14:52:05 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-1f6be909-2137-413a-8f59-1ade40ffa0e6 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Successfully detached device vdb from instance 1f7989ca-77e9-440f-bd2f-60e46e005557 from the persistent domain config.
Jul 29 14:52:05 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-1f6be909-2137-413a-8f59-1ade40ffa0e6 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1f7989ca-77e9-440f-bd2f-60e46e005557 from the live domain config. {{(pid=70924) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 29 14:52:05 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-1f6be909-2137-413a-8f59-1ade40ffa0e6 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 14:52:05 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:52:05 user nova-compute[70924]:   <source dev="/dev/sdc"/>
Jul 29 14:52:05 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 14:52:05 user nova-compute[70924]:   <serial>77c2fd5b-ad43-4309-901b-6201b6f0eaba</serial>
Jul 29 14:52:05 user nova-compute[70924]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 14:52:05 user nova-compute[70924]: </disk>
Jul 29 14:52:05 user nova-compute[70924]:  {{(pid=70924) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 14:52:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:52:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '26637313937346466', 'path': '/dev/sdd'} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:52:05 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637313937346466', 'path': '/dev/sdd'} {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 14:52:05 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:49:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1631866093',display_name='tempest-ServerActionsTestOtherA-server-1631866093',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1631866093',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfg71Q+cjedfRarcbIler9POuKvX/jsQII2ANgknh6qTEvuHJAE8T34RCDfGUcAvd9SbwZCzhWP8ikNDBjVZKRBIySMsLhBLIX0hKsMOAV+S3aIT6/Yawicov1EmjAkDw==',key_name='tempest-keypair-1866871140',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:50:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b33d01ba458f466b99b6bc5bba88d8c0',ramdisk_id='',reservation_id='r-gzlw9uxq',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-166265056',owner_user_name='tempest-ServerActionsTestOtherA-166265056-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:51:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55b9032bef2d4d3586dc5d18cdc1ee55',uuid=fd57baf8-6306-4553-a058-e915fb543405,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c8f2eadb-705f-4b8b-9f67-c5280cf1f025", "address": "fa:16:3e:15:d2:44", "network": {"id": "55c18d07-a341-4678-9d1c-2dff057a9b1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1092921088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1092921088-network", "vif_mac": "fa:16:3e:15:d2:44"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b33d01ba458f466b99b6bc5bba88d8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8f2eadb-70", "ovs_interfaceid": "c8f2eadb-705f-4b8b-9f67-c5280cf1f025", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:52:05 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Converting VIF {"id": "c8f2eadb-705f-4b8b-9f67-c5280cf1f025", "address": "fa:16:3e:15:d2:44", "network": {"id": "55c18d07-a341-4678-9d1c-2dff057a9b1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1092921088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1092921088-network", "vif_mac": "fa:16:3e:15:d2:44"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b33d01ba458f466b99b6bc5bba88d8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8f2eadb-70", "ovs_interfaceid": "c8f2eadb-705f-4b8b-9f67-c5280cf1f025", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:52:05 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:d2:44,bridge_name='br-int',has_traffic_filtering=True,id=c8f2eadb-705f-4b8b-9f67-c5280cf1f025,network=Network(55c18d07-a341-4678-9d1c-2dff057a9b1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8f2eadb-70') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:52:05 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] End _get_guest_xml xml=<domain type="kvm">
Jul 29 14:52:05 user nova-compute[70924]:   <uuid>fd57baf8-6306-4553-a058-e915fb543405</uuid>
Jul 29 14:52:05 user nova-compute[70924]:   <name>instance-0000001c</name>
Jul 29 14:52:05 user nova-compute[70924]:   <memory>2097152</memory>
Jul 29 14:52:05 user nova-compute[70924]:   <vcpu>1</vcpu>
Jul 29 14:52:05 user nova-compute[70924]:   <metadata>
Jul 29 14:52:05 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 14:52:05 user nova-compute[70924]:       <nova:package version="0.0.0"/>
Jul 29 14:52:05 user nova-compute[70924]:       <nova:name>tempest-ServerActionsTestOtherA-server-1631866093</nova:name>
Jul 29 14:52:05 user nova-compute[70924]:       <nova:creationTime>2023-07-29 14:52:04</nova:creationTime>
Jul 29 14:52:05 user nova-compute[70924]:       <nova:flavor name="m1.small">
Jul 29 14:52:05 user nova-compute[70924]:         <nova:memory>2048</nova:memory>
Jul 29 14:52:05 user nova-compute[70924]:         <nova:disk>20</nova:disk>
Jul 29 14:52:05 user nova-compute[70924]:         <nova:swap>0</nova:swap>
Jul 29 14:52:05 user nova-compute[70924]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 14:52:05 user nova-compute[70924]:         <nova:vcpus>1</nova:vcpus>
Jul 29 14:52:05 user nova-compute[70924]:       </nova:flavor>
Jul 29 14:52:05 user nova-compute[70924]:       <nova:owner>
Jul 29 14:52:05 user nova-compute[70924]:         <nova:user uuid="55b9032bef2d4d3586dc5d18cdc1ee55">tempest-ServerActionsTestOtherA-166265056-project-member</nova:user>
Jul 29 14:52:05 user nova-compute[70924]:         <nova:project uuid="b33d01ba458f466b99b6bc5bba88d8c0">tempest-ServerActionsTestOtherA-166265056</nova:project>
Jul 29 14:52:05 user nova-compute[70924]:       </nova:owner>
Jul 29 14:52:05 user nova-compute[70924]:       <nova:ports>
Jul 29 14:52:05 user nova-compute[70924]:         <nova:port uuid="c8f2eadb-705f-4b8b-9f67-c5280cf1f025">
Jul 29 14:52:05 user nova-compute[70924]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 29 14:52:05 user nova-compute[70924]:         </nova:port>
Jul 29 14:52:05 user nova-compute[70924]:       </nova:ports>
Jul 29 14:52:05 user nova-compute[70924]:     </nova:instance>
Jul 29 14:52:05 user nova-compute[70924]:   </metadata>
Jul 29 14:52:05 user nova-compute[70924]:   <sysinfo type="smbios">
Jul 29 14:52:05 user nova-compute[70924]:     <system>
Jul 29 14:52:05 user nova-compute[70924]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 14:52:05 user nova-compute[70924]:       <entry name="product">OpenStack Nova</entry>
Jul 29 14:52:05 user nova-compute[70924]:       <entry name="version">0.0.0</entry>
Jul 29 14:52:05 user nova-compute[70924]:       <entry name="serial">fd57baf8-6306-4553-a058-e915fb543405</entry>
Jul 29 14:52:05 user nova-compute[70924]:       <entry name="uuid">fd57baf8-6306-4553-a058-e915fb543405</entry>
Jul 29 14:52:05 user nova-compute[70924]:       <entry name="family">Virtual Machine</entry>
Jul 29 14:52:05 user nova-compute[70924]:     </system>
Jul 29 14:52:05 user nova-compute[70924]:   </sysinfo>
Jul 29 14:52:05 user nova-compute[70924]:   <os>
Jul 29 14:52:05 user nova-compute[70924]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 14:52:05 user nova-compute[70924]:     <boot dev="hd"/>
Jul 29 14:52:05 user nova-compute[70924]:     <smbios mode="sysinfo"/>
Jul 29 14:52:05 user nova-compute[70924]:   </os>
Jul 29 14:52:05 user nova-compute[70924]:   <features>
Jul 29 14:52:05 user nova-compute[70924]:     <acpi/>
Jul 29 14:52:05 user nova-compute[70924]:     <apic/>
Jul 29 14:52:05 user nova-compute[70924]:     <vmcoreinfo/>
Jul 29 14:52:05 user nova-compute[70924]:   </features>
Jul 29 14:52:05 user nova-compute[70924]:   <clock offset="utc">
Jul 29 14:52:05 user nova-compute[70924]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 14:52:05 user nova-compute[70924]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 14:52:05 user nova-compute[70924]:     <timer name="hpet" present="no"/>
Jul 29 14:52:05 user nova-compute[70924]:   </clock>
Jul 29 14:52:05 user nova-compute[70924]:   <cpu mode="custom" match="exact">
Jul 29 14:52:05 user nova-compute[70924]:     <model>Nehalem</model>
Jul 29 14:52:05 user nova-compute[70924]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 14:52:05 user nova-compute[70924]:   </cpu>
Jul 29 14:52:05 user nova-compute[70924]:   <devices>
Jul 29 14:52:05 user nova-compute[70924]:     <disk type="block" device="disk">
Jul 29 14:52:05 user nova-compute[70924]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:52:05 user nova-compute[70924]:       <source dev="/dev/sdd"/>
Jul 29 14:52:05 user nova-compute[70924]:       <target dev="vda" bus="virtio"/>
Jul 29 14:52:05 user nova-compute[70924]:       <serial>60c129c4-a916-49f7-86b6-ff1a2339a464</serial>
Jul 29 14:52:05 user nova-compute[70924]:     </disk>
Jul 29 14:52:05 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 14:52:05 user nova-compute[70924]:       <mac address="fa:16:3e:15:d2:44"/>
Jul 29 14:52:05 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:52:05 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 14:52:05 user nova-compute[70924]:       <target dev="tapc8f2eadb-70"/>
Jul 29 14:52:05 user nova-compute[70924]:     </interface>
Jul 29 14:52:05 user nova-compute[70924]:     <serial type="pty">
Jul 29 14:52:05 user nova-compute[70924]:       <log file="/opt/stack/data/nova/instances/fd57baf8-6306-4553-a058-e915fb543405/console.log" append="off"/>
Jul 29 14:52:05 user nova-compute[70924]:     </serial>
Jul 29 14:52:05 user nova-compute[70924]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 14:52:05 user nova-compute[70924]:     <video>
Jul 29 14:52:05 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:52:05 user nova-compute[70924]:     </video>
Jul 29 14:52:05 user nova-compute[70924]:     <rng model="virtio">
Jul 29 14:52:05 user nova-compute[70924]:       <backend model="random">/dev/urandom</backend>
Jul 29 14:52:05 user nova-compute[70924]:     </rng>
Jul 29 14:52:05 user nova-compute[70924]:     <controller type="usb" index="0" model="none"/>
Jul 29 14:52:05 user nova-compute[70924]:     <memballoon model="virtio">
Jul 29 14:52:05 user nova-compute[70924]:       <stats period="10"/>
Jul 29 14:52:05 user nova-compute[70924]:     </memballoon>
Jul 29 14:52:05 user nova-compute[70924]:   </devices>
Jul 29 14:52:05 user nova-compute[70924]: </domain>
Jul 29 14:52:05 user nova-compute[70924]:  {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 14:52:05 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:49:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1631866093',display_name='tempest-ServerActionsTestOtherA-server-1631866093',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1631866093',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfg71Q+cjedfRarcbIler9POuKvX/jsQII2ANgknh6qTEvuHJAE8T34RCDfGUcAvd9SbwZCzhWP8ikNDBjVZKRBIySMsLhBLIX0hKsMOAV+S3aIT6/Yawicov1EmjAkDw==',key_name='tempest-keypair-1866871140',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:50:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b33d01ba458f466b99b6bc5bba88d8c0',ramdisk_id='',reservation_id='r-gzlw9uxq',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-166265056',owner_user_name='tempest-ServerActionsTestOtherA-166265056-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:51:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55b9032bef2d4d3586dc5d18cdc1ee55',uuid=fd57baf8-6306-4553-a058-e915fb543405,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c8f2eadb-705f-4b8b-9f67-c5280cf1f025", "address": "fa:16:3e:15:d2:44", "network": {"id": "55c18d07-a341-4678-9d1c-2dff057a9b1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1092921088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1092921088-network", "vif_mac": "fa:16:3e:15:d2:44"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b33d01ba458f466b99b6bc5bba88d8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8f2eadb-70", "ovs_interfaceid": "c8f2eadb-705f-4b8b-9f67-c5280cf1f025", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 14:52:05 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Converting VIF {"id": "c8f2eadb-705f-4b8b-9f67-c5280cf1f025", "address": "fa:16:3e:15:d2:44", "network": {"id": "55c18d07-a341-4678-9d1c-2dff057a9b1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1092921088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1092921088-network", "vif_mac": "fa:16:3e:15:d2:44"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b33d01ba458f466b99b6bc5bba88d8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8f2eadb-70", "ovs_interfaceid": "c8f2eadb-705f-4b8b-9f67-c5280cf1f025", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:52:05 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:d2:44,bridge_name='br-int',has_traffic_filtering=True,id=c8f2eadb-705f-4b8b-9f67-c5280cf1f025,network=Network(55c18d07-a341-4678-9d1c-2dff057a9b1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8f2eadb-70') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:52:05 user nova-compute[70924]: DEBUG os_vif [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:d2:44,bridge_name='br-int',has_traffic_filtering=True,id=c8f2eadb-705f-4b8b-9f67-c5280cf1f025,network=Network(55c18d07-a341-4678-9d1c-2dff057a9b1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8f2eadb-70') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 14:52:05 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:05 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:52:05 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 14:52:05 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:05 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc8f2eadb-70, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:52:05 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc8f2eadb-70, col_values=(('external_ids', {'iface-id': 'c8f2eadb-705f-4b8b-9f67-c5280cf1f025', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:d2:44', 'vm-uuid': 'fd57baf8-6306-4553-a058-e915fb543405'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:52:05 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:05 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:52:05 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:05 user nova-compute[70924]: INFO os_vif [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:d2:44,bridge_name='br-int',has_traffic_filtering=True,id=c8f2eadb-705f-4b8b-9f67-c5280cf1f025,network=Network(55c18d07-a341-4678-9d1c-2dff057a9b1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8f2eadb-70')
Jul 29 14:52:05 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:52:05 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] No VIF found with MAC fa:16:3e:15:d2:44, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:52:05 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Received event <DeviceRemovedEvent: 1690642325.6195612, 1f7989ca-77e9-440f-bd2f-60e46e005557 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70924) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 29 14:52:05 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-1f6be909-2137-413a-8f59-1ade40ffa0e6 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1f7989ca-77e9-440f-bd2f-60e46e005557 {{(pid=70924) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 29 14:52:05 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-1f6be909-2137-413a-8f59-1ade40ffa0e6 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Successfully detached device vdb from instance 1f7989ca-77e9-440f-bd2f-60e46e005557 from the live domain config.
Jul 29 14:52:05 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f6be909-2137-413a-8f59-1ade40ffa0e6 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] calling os-brick to detach iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 14:52:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f6be909-2137-413a-8f59-1ade40ffa0e6 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, {'target_iqns': ['iqn.2010-10.org.openstack:77c2fd5b-ad43-4309-901b-6201b6f0eaba'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DHxGAvkl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:52:05 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-1f6be909-2137-413a-8f59-1ade40ffa0e6 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:52:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-1f6be909-2137-413a-8f59-1ade40ffa0e6 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:52:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-1f6be909-2137-413a-8f59-1ade40ffa0e6 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:52:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f6be909-2137-413a-8f59-1ade40ffa0e6 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77c2fd5b-ad43-4309-901b-6201b6f0eaba', 0)] {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 14:52:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:05 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1008af-48ed-4c44-9c8e-99d41feb7c7a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77c2fd5b-ad43-4309-901b-6201b6f0eaba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb604e64-0e9f-4297-89ed-18feb25b6a41\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:05 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5d14fd-ce23-485e-bbc2-4514c6149022]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb604e64-0e9f-4297-89ed-18feb25b6a41 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77c2fd5b-ad43-4309-901b-6201b6f0eaba (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f6be909-2137-413a-8f59-1ade40ffa0e6 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:52:05 user nova-compute[70924]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)
Jul 29 14:52:05 user nova-compute[70924]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)
Jul 29 14:52:05 user nova-compute[70924]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb604e64-0e9f-4297-89ed-18feb25b6a41 (non-flash)
Jul 29 14:52:05 user nova-compute[70924]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77c2fd5b-ad43-4309-901b-6201b6f0eaba (non-flash)
Jul 29 14:52:05 user nova-compute[70924]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:52:05 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:52:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f6be909-2137-413a-8f59-1ade40ffa0e6 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:52:05 user nova-compute[70924]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)
Jul 29 14:52:05 user nova-compute[70924]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)
Jul 29 14:52:05 user nova-compute[70924]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb604e64-0e9f-4297-89ed-18feb25b6a41 (non-flash)
Jul 29 14:52:05 user nova-compute[70924]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77c2fd5b-ad43-4309-901b-6201b6f0eaba (non-flash)
Jul 29 14:52:05 user nova-compute[70924]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:52:05 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:52:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f6be909-2137-413a-8f59-1ade40ffa0e6 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feecc68ec20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77c2fd5b-ad43-4309-901b-6201b6f0eaba'): ({'sdc'}, set())}) {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 14:52:05 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-1f6be909-2137-413a-8f59-1ade40ffa0e6 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Removing single pathed devices sdc {{(pid=70924) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 14:52:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:05 user nova-compute[70924]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690642310.7367148, fd57baf8-6306-4553-a058-e915fb543405 => Stopped> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:52:05 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: fd57baf8-6306-4553-a058-e915fb543405] VM Stopped (Lifecycle Event)
Jul 29 14:52:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:05 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e709e0f-00e1-42e6-ae2f-e524c518f0b3]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:05 user nova-compute[70924]: DEBUG nova.compute.manager [None req-180cbc30-0621-4ba0-bb64-ad9947dfb775 None None] [instance: fd57baf8-6306-4553-a058-e915fb543405] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:52:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:05 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[a97314cd-a350-4201-8a21-37aec1f94133]: (4, ('ok\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:05 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-1f6be909-2137-413a-8f59-1ade40ffa0e6 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Flushing IO for device /dev/sdc {{(pid=70924) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 14:52:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.045s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:05 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[17bb212e-9736-4da1-aa6a-b1ffd7450bb6]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:05 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-1f6be909-2137-413a-8f59-1ade40ffa0e6 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70924) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 14:52:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:05 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9858a07b-5b3c-4f8a-9a82-9d5e77d7a3cc]: (4, ('1', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:05 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-1f6be909-2137-413a-8f59-1ade40ffa0e6 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 14:52:05 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-1f6be909-2137-413a-8f59-1ade40ffa0e6 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] SCSI volumes sdc have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 14:52:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f6be909-2137-413a-8f59-1ade40ffa0e6 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77c2fd5b-ad43-4309-901b-6201b6f0eaba')] {{(pid=70924) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 14:52:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77c2fd5b-ad43-4309-901b-6201b6f0eaba -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77c2fd5b-ad43-4309-901b-6201b6f0eaba -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:05 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d358135d-4e4f-4ede-87b3-afd7d5dde59b]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f6be909-2137-413a-8f59-1ade40ffa0e6 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:52:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77c2fd5b-ad43-4309-901b-6201b6f0eaba -p 172.16.0.220:3260 --logout {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77c2fd5b-ad43-4309-901b-6201b6f0eaba -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:05 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef9fe1b-4ead-4709-91e5-d81a2d7f0c98]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:77c2fd5b-ad43-4309-901b-6201b6f0eaba, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:77c2fd5b-ad43-4309-901b-6201b6f0eaba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f6be909-2137-413a-8f59-1ade40ffa0e6 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:77c2fd5b-ad43-4309-901b-6201b6f0eaba, portal: 172.16.0.220,3260]
Jul 29 14:52:05 user nova-compute[70924]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:77c2fd5b-ad43-4309-901b-6201b6f0eaba, portal: 172.16.0.220,3260] successful.
Jul 29 14:52:05 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:52:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77c2fd5b-ad43-4309-901b-6201b6f0eaba -p 172.16.0.220:3260 --op delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:06 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77c2fd5b-ad43-4309-901b-6201b6f0eaba -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:06 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d55a9d-3e35-48d2-a275-3f6266bfde00]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:06 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f6be909-2137-413a-8f59-1ade40ffa0e6 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:52:06 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-1f6be909-2137-413a-8f59-1ade40ffa0e6 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:52:06 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f6be909-2137-413a-8f59-1ade40ffa0e6 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] <== disconnect_volume: return (368ms) None {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:52:06 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f6be909-2137-413a-8f59-1ade40ffa0e6 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Disconnected iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 14:52:06 user nova-compute[70924]: DEBUG nova.objects.instance [None req-1f6be909-2137-413a-8f59-1ade40ffa0e6 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lazy-loading 'flavor' on Instance uuid 1f7989ca-77e9-440f-bd2f-60e46e005557 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:52:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:06 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1f6be909-2137-413a-8f59-1ade40ffa0e6 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lock "1f7989ca-77e9-440f-bd2f-60e46e005557" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.823s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:52:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:07 user nova-compute[70924]: DEBUG nova.compute.manager [req-2b97b32c-a60b-4b32-beb0-a4fac599472f req-31d336b4-ef4a-4eb8-b841-2450bb4ec69a service nova] [instance: fd57baf8-6306-4553-a058-e915fb543405] Received event network-vif-plugged-c8f2eadb-705f-4b8b-9f67-c5280cf1f025 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:52:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-2b97b32c-a60b-4b32-beb0-a4fac599472f req-31d336b4-ef4a-4eb8-b841-2450bb4ec69a service nova] Acquiring lock "fd57baf8-6306-4553-a058-e915fb543405-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:52:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-2b97b32c-a60b-4b32-beb0-a4fac599472f req-31d336b4-ef4a-4eb8-b841-2450bb4ec69a service nova] Lock "fd57baf8-6306-4553-a058-e915fb543405-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:52:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-2b97b32c-a60b-4b32-beb0-a4fac599472f req-31d336b4-ef4a-4eb8-b841-2450bb4ec69a service nova] Lock "fd57baf8-6306-4553-a058-e915fb543405-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:52:07 user nova-compute[70924]: DEBUG nova.compute.manager [req-2b97b32c-a60b-4b32-beb0-a4fac599472f req-31d336b4-ef4a-4eb8-b841-2450bb4ec69a service nova] [instance: fd57baf8-6306-4553-a058-e915fb543405] No waiting events found dispatching network-vif-plugged-c8f2eadb-705f-4b8b-9f67-c5280cf1f025 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:52:07 user nova-compute[70924]: WARNING nova.compute.manager [req-2b97b32c-a60b-4b32-beb0-a4fac599472f req-31d336b4-ef4a-4eb8-b841-2450bb4ec69a service nova] [instance: fd57baf8-6306-4553-a058-e915fb543405] Received unexpected event network-vif-plugged-c8f2eadb-705f-4b8b-9f67-c5280cf1f025 for instance with vm_state active and task_state resize_finish.
Jul 29 14:52:07 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:07 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:07 user nova-compute[70924]: DEBUG nova.objects.instance [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lazy-loading 'flavor' on Instance uuid 7cb12b3e-de44-4887-ab74-2a68164b5f7d {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:52:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Acquiring lock "refresh_cache-7cb12b3e-de44-4887-ab74-2a68164b5f7d" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:52:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Acquired lock "refresh_cache-7cb12b3e-de44-4887-ab74-2a68164b5f7d" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:52:07 user nova-compute[70924]: DEBUG nova.network.neutron [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 14:52:07 user nova-compute[70924]: DEBUG nova.objects.instance [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lazy-loading 'info_cache' on Instance uuid 7cb12b3e-de44-4887-ab74-2a68164b5f7d {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG nova.network.neutron [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Updating instance_info_cache with network_info: [{"id": "e41d642f-f559-4294-b5ff-5ec478fb3438", "address": "fa:16:3e:f7:ee:73", "network": {"id": "46d2cfde-13db-4cf3-af0e-4d6742f37044", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1642265305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0388bcf487e492082e85b183f38765c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape41d642f-f5", "ovs_interfaceid": "e41d642f-f559-4294-b5ff-5ec478fb3438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Releasing lock "refresh_cache-7cb12b3e-de44-4887-ab74-2a68164b5f7d" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:52:08 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Instance destroyed successfully.
Jul 29 14:52:08 user nova-compute[70924]: DEBUG nova.objects.instance [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lazy-loading 'resources' on Instance uuid 7cb12b3e-de44-4887-ab74-2a68164b5f7d {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:48:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1090583774',display_name='tempest-AttachVolumeTestJSON-server-1090583774',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1090583774',id=20,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxYeAuUdgBDENKjW9KGfUkDITpquweWjsClM8apGgMwschv+svyuQ0OvGCeunIrF1Cf2sPzGMDx0GWfQ+3b5oeX2ZZAH8S+9X0B99z5roSd+MxfrhgBDxbU7z4pZrnyqA==',key_name='tempest-keypair-571943859',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:48:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a0388bcf487e492082e85b183f38765c',ramdisk_id='',reservation_id='r-4dtac58j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-651630277',owner_user_name='tempest-AttachVolumeTestJSON-651630277-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:50:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='761e4287afb94bf4ad93c09a43bada1f',uuid=7cb12b3e-de44-4887-ab74-2a68164b5f7d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e41d642f-f559-4294-b5ff-5ec478fb3438", "address": "fa:16:3e:f7:ee:73", "network": {"id": "46d2cfde-13db-4cf3-af0e-4d6742f37044", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1642265305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0388bcf487e492082e85b183f38765c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape41d642f-f5", "ovs_interfaceid": "e41d642f-f559-4294-b5ff-5ec478fb3438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Converting VIF {"id": "e41d642f-f559-4294-b5ff-5ec478fb3438", "address": "fa:16:3e:f7:ee:73", "network": {"id": "46d2cfde-13db-4cf3-af0e-4d6742f37044", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1642265305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0388bcf487e492082e85b183f38765c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape41d642f-f5", "ovs_interfaceid": "e41d642f-f559-4294-b5ff-5ec478fb3438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:ee:73,bridge_name='br-int',has_traffic_filtering=True,id=e41d642f-f559-4294-b5ff-5ec478fb3438,network=Network(46d2cfde-13db-4cf3-af0e-4d6742f37044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape41d642f-f5') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG os_vif [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:ee:73,bridge_name='br-int',has_traffic_filtering=True,id=e41d642f-f559-4294-b5ff-5ec478fb3438,network=Network(46d2cfde-13db-4cf3-af0e-4d6742f37044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape41d642f-f5') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape41d642f-f5, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:52:08 user nova-compute[70924]: INFO os_vif [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:ee:73,bridge_name='br-int',has_traffic_filtering=True,id=e41d642f-f559-4294-b5ff-5ec478fb3438,network=Network(46d2cfde-13db-4cf3-af0e-4d6742f37044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape41d642f-f5')
Jul 29 14:52:08 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] calling os-brick to detach iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, {'target_iqns': ['iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jVrAgyeu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:52:08 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:52:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe', 0)] {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[194b5f1d-59c8-4dce-b78a-5cbdf9cf84c6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8528c1-7c85-4bd8-8953-dc3359fd5762]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:52:08 user nova-compute[70924]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)
Jul 29 14:52:08 user nova-compute[70924]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)
Jul 29 14:52:08 user nova-compute[70924]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:52:08 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:52:08 user nova-compute[70924]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)
Jul 29 14:52:08 user nova-compute[70924]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)
Jul 29 14:52:08 user nova-compute[70924]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:52:08 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feecc5e8ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe'): ({'sde'}, set())}) {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Removing single pathed devices sde {{(pid=70924) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a50567e-a4b0-4e7f-a77b-dd6f2b1e3078]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a61b640-5974-426e-af1c-9cdcd863f4f9]: (4, ('ok\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Flushing IO for device /dev/sde {{(pid=70924) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ffab3bf9-34be-49fe-8f50-9bec7a60ca12 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Acquiring lock "d0776c81-190d-41da-99c5-7419ed69b92c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ffab3bf9-34be-49fe-8f50-9bec7a60ca12 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Lock "d0776c81-190d-41da-99c5-7419ed69b92c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ffab3bf9-34be-49fe-8f50-9bec7a60ca12 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Acquiring lock "d0776c81-190d-41da-99c5-7419ed69b92c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ffab3bf9-34be-49fe-8f50-9bec7a60ca12 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Lock "d0776c81-190d-41da-99c5-7419ed69b92c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ffab3bf9-34be-49fe-8f50-9bec7a60ca12 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Lock "d0776c81-190d-41da-99c5-7419ed69b92c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:52:08 user nova-compute[70924]: INFO nova.compute.manager [None req-ffab3bf9-34be-49fe-8f50-9bec7a60ca12 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: d0776c81-190d-41da-99c5-7419ed69b92c] Terminating instance
Jul 29 14:52:08 user nova-compute[70924]: DEBUG nova.compute.manager [None req-ffab3bf9-34be-49fe-8f50-9bec7a60ca12 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: d0776c81-190d-41da-99c5-7419ed69b92c] Start destroying the instance on the hypervisor. {{(pid=70924) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3900fc-8c1a-4fc7-9906-3fb25ef59418]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70924) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4e7ec2-1ce5-4670-ada4-6a065eaa5d79]: (4, ('1', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] SCSI volumes sde have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe')] {{(pid=70924) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c61dfc3-94e3-48f2-8af8-a58e9a741d7a]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe -p 172.16.0.220:3260 --logout {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e6fc08-4095-4245-ae2e-54bf1f8f1689]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe, portal: 172.16.0.220,3260]
Jul 29 14:52:08 user nova-compute[70924]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe, portal: 172.16.0.220,3260] successful.
Jul 29 14:52:08 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe -p 172.16.0.220:3260 --op delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e095364-8c71-4656-8f6a-86bfa6482a7f]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] <== disconnect_volume: return (333ms) None {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Disconnected iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Start _get_guest_xml network_info=[{"id": "e41d642f-f559-4294-b5ff-5ec478fb3438", "address": "fa:16:3e:f7:ee:73", "network": {"id": "46d2cfde-13db-4cf3-af0e-4d6742f37044", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1642265305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0388bcf487e492082e85b183f38765c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape41d642f-f5", "ovs_interfaceid": "e41d642f-f559-4294-b5ff-5ec478fb3438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '3aba2e73-6832-404b-8bd0-d0503ce82b8c'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'boot_index': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jVrAgyeu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '7cb12b3e-de44-4887-ab74-2a68164b5f7d', 'attached_at': '', 'detached_at': '', 'volume_id': 'd8cda795-fcae-41e3-80f3-2066316032fe', 'serial': 'd8cda795-fcae-41e3-80f3-2066316032fe'}, 'attachment_id': '3310f0f1-bcde-4689-9d46-4f641d9e7e3e', 'volume_type': None} {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG nova.objects.instance [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lazy-loading 'numa_topology' on Instance uuid 7cb12b3e-de44-4887-ab74-2a68164b5f7d {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:52:08 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:52:08 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:52:08 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] CPU controller missing on host. {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] CPU controller found on host. {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70924) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T14:36:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Flavor limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Image limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Flavor pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Image pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Got 1 possible topologies {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG nova.objects.instance [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7cb12b3e-de44-4887-ab74-2a68164b5f7d {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Calling os-brick to attach iSCSI Volume {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jVrAgyeu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:52:08 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:52:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:52:08 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:52:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:52:08 user nova-compute[70924]: INFO os_brick.initiator.connectors.iscsi [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 14:52:08 user nova-compute[70924]: DEBUG nova.compute.manager [req-73093866-cc87-4889-8a7f-a3a0cb0fd151 req-c913f53e-e78a-46e6-a4ab-d11f97e90f5a service nova] [instance: d0776c81-190d-41da-99c5-7419ed69b92c] Received event network-vif-unplugged-77586dcd-0ed2-4e9c-a29f-324b2726a962 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-73093866-cc87-4889-8a7f-a3a0cb0fd151 req-c913f53e-e78a-46e6-a4ab-d11f97e90f5a service nova] Acquiring lock "d0776c81-190d-41da-99c5-7419ed69b92c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-73093866-cc87-4889-8a7f-a3a0cb0fd151 req-c913f53e-e78a-46e6-a4ab-d11f97e90f5a service nova] Lock "d0776c81-190d-41da-99c5-7419ed69b92c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-73093866-cc87-4889-8a7f-a3a0cb0fd151 req-c913f53e-e78a-46e6-a4ab-d11f97e90f5a service nova] Lock "d0776c81-190d-41da-99c5-7419ed69b92c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG nova.compute.manager [req-73093866-cc87-4889-8a7f-a3a0cb0fd151 req-c913f53e-e78a-46e6-a4ab-d11f97e90f5a service nova] [instance: d0776c81-190d-41da-99c5-7419ed69b92c] No waiting events found dispatching network-vif-unplugged-77586dcd-0ed2-4e9c-a29f-324b2726a962 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG nova.compute.manager [req-73093866-cc87-4889-8a7f-a3a0cb0fd151 req-c913f53e-e78a-46e6-a4ab-d11f97e90f5a service nova] [instance: d0776c81-190d-41da-99c5-7419ed69b92c] Received event network-vif-unplugged-77586dcd-0ed2-4e9c-a29f-324b2726a962 for instance with task_state deleting. {{(pid=70924) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe -p 172.16.0.220:3260 {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[8616f5e1-e6e7-4fa0-8d54-520342e8bb85]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 14:52:08 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe -p 172.16.0.220:3260 --interface default --op new {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3258db9-1494-452a-8ee3-5f2dae43003a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe] added\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe] added
Jul 29 14:52:08 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[801e57f5-38a6-449f-a926-87998dc912b2]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[388096e9-ad46-4c6e-8a9f-7e3bbc22e536]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jVrAgyeu {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jVrAgyeu" returned: 0 in 0.023s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c649a844-c74d-437b-9f4f-81a6dbb362a2]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jVrAgyeu'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ee6ee1-d08d-46db-b62f-8aae47b126e3]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[4952fc69-acf2-45a8-894f-7f8103e8be7a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:52:08 user nova-compute[70924]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)
Jul 29 14:52:08 user nova-compute[70924]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:52:08 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:52:08 user nova-compute[70924]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)
Jul 29 14:52:08 user nova-compute[70924]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:52:08 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:52:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe -p 172.16.0.220:3260 --login {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:09 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642329.0265841, fd57baf8-6306-4553-a058-e915fb543405 => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:52:09 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: fd57baf8-6306-4553-a058-e915fb543405] VM Resumed (Lifecycle Event)
Jul 29 14:52:09 user nova-compute[70924]: DEBUG nova.compute.manager [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] Instance event wait completed in 0 seconds for  {{(pid=70924) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 14:52:09 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: fd57baf8-6306-4553-a058-e915fb543405] Instance running successfully.
Jul 29 14:52:09 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] Failed to set time: agent not configured {{(pid=70924) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Jul 29 14:52:09 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-c6e29cf9-ae85-49a8-ada1-86e457db195a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] finish_migration finished successfully. {{(pid=70924) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Jul 29 14:52:09 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: fd57baf8-6306-4553-a058-e915fb543405] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:52:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:09 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9715eefb-c241-40c9-9ff5-2dd8206bf6c3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:09 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe, portal: 172.16.0.220,3260]
Jul 29 14:52:09 user nova-compute[70924]: Login to [iface: default, target: iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe, portal: 172.16.0.220,3260] successful.
Jul 29 14:52:09 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:52:09 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: fd57baf8-6306-4553-a058-e915fb543405] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:52:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:09 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4cb46bf-d388-44b4-a77b-08bc4cfcdde3]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:09 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:52:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:09 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: fd57baf8-6306-4553-a058-e915fb543405] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 29 14:52:09 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642329.0317373, fd57baf8-6306-4553-a058-e915fb543405 => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:52:09 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: fd57baf8-6306-4553-a058-e915fb543405] VM Started (Lifecycle Event)
Jul 29 14:52:09 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: fd57baf8-6306-4553-a058-e915fb543405] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:52:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:09 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[29370056-d3ef-4a21-a387-c7079064a31f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:09 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:52:09 user nova-compute[70924]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)
Jul 29 14:52:09 user nova-compute[70924]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:52:09 user nova-compute[70924]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)
Jul 29 14:52:09 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:52:09 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:52:09 user nova-compute[70924]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)
Jul 29 14:52:09 user nova-compute[70924]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:52:09 user nova-compute[70924]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)
Jul 29 14:52:09 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:52:09 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.350s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:52:09 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Connected to 172.16.0.220:3260 {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 14:52:09 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] HCTL ('34', '-', '-', 0) found on session 32 with lun 0 {{(pid=70924) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 14:52:09 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70924) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 14:52:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:09 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: fd57baf8-6306-4553-a058-e915fb543405] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:52:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:09 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c011ed3-3f68-436e-89f1-76d1fba0253c]: (4, ('- - 0', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:09 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Searching for a device in session 32 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 14:52:09 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jVrAgyeu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 14:52:09 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: fd57baf8-6306-4553-a058-e915fb543405] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 29 14:52:09 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: d0776c81-190d-41da-99c5-7419ed69b92c] Instance destroyed successfully.
Jul 29 14:52:09 user nova-compute[70924]: DEBUG nova.objects.instance [None req-ffab3bf9-34be-49fe-8f50-9bec7a60ca12 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Lazy-loading 'resources' on Instance uuid d0776c81-190d-41da-99c5-7419ed69b92c {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:52:09 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-ffab3bf9-34be-49fe-8f50-9bec7a60ca12 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:50:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2134470961',display_name='tempest-ServersNegativeTestJSON-server-2134470961',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2134470961',id=29,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:50:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8d5793d2e5b9451f9ef38fa61cb877d5',ramdisk_id='',reservation_id='r-9ij64diu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1209083119',owner_user_name='tempest-ServersNegativeTestJSON-1209083119-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:50:25Z,user_data=None,user_id='0fe49a3ddecb49d78f668df836df4ce8',uuid=d0776c81-190d-41da-99c5-7419ed69b92c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "77586dcd-0ed2-4e9c-a29f-324b2726a962", "address": "fa:16:3e:8e:67:39", "network": {"id": "cb1ab4d5-0cba-4628-bca8-015a7acce83b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-875103426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d5793d2e5b9451f9ef38fa61cb877d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77586dcd-0e", "ovs_interfaceid": "77586dcd-0ed2-4e9c-a29f-324b2726a962", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 14:52:09 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-ffab3bf9-34be-49fe-8f50-9bec7a60ca12 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Converting VIF {"id": "77586dcd-0ed2-4e9c-a29f-324b2726a962", "address": "fa:16:3e:8e:67:39", "network": {"id": "cb1ab4d5-0cba-4628-bca8-015a7acce83b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-875103426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d5793d2e5b9451f9ef38fa61cb877d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77586dcd-0e", "ovs_interfaceid": "77586dcd-0ed2-4e9c-a29f-324b2726a962", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:52:09 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-ffab3bf9-34be-49fe-8f50-9bec7a60ca12 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:67:39,bridge_name='br-int',has_traffic_filtering=True,id=77586dcd-0ed2-4e9c-a29f-324b2726a962,network=Network(cb1ab4d5-0cba-4628-bca8-015a7acce83b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77586dcd-0e') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:52:09 user nova-compute[70924]: DEBUG os_vif [None req-ffab3bf9-34be-49fe-8f50-9bec7a60ca12 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:67:39,bridge_name='br-int',has_traffic_filtering=True,id=77586dcd-0ed2-4e9c-a29f-324b2726a962,network=Network(cb1ab4d5-0cba-4628-bca8-015a7acce83b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77586dcd-0e') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 14:52:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap77586dcd-0e, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:52:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:52:09 user nova-compute[70924]: INFO os_vif [None req-ffab3bf9-34be-49fe-8f50-9bec7a60ca12 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:67:39,bridge_name='br-int',has_traffic_filtering=True,id=77586dcd-0ed2-4e9c-a29f-324b2726a962,network=Network(cb1ab4d5-0cba-4628-bca8-015a7acce83b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77586dcd-0e')
Jul 29 14:52:09 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-ffab3bf9-34be-49fe-8f50-9bec7a60ca12 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: d0776c81-190d-41da-99c5-7419ed69b92c] Deleting instance files /opt/stack/data/nova/instances/d0776c81-190d-41da-99c5-7419ed69b92c_del
Jul 29 14:52:09 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-ffab3bf9-34be-49fe-8f50-9bec7a60ca12 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: d0776c81-190d-41da-99c5-7419ed69b92c] Deletion of /opt/stack/data/nova/instances/d0776c81-190d-41da-99c5-7419ed69b92c_del complete
Jul 29 14:52:09 user nova-compute[70924]: INFO nova.compute.manager [None req-ffab3bf9-34be-49fe-8f50-9bec7a60ca12 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: d0776c81-190d-41da-99c5-7419ed69b92c] Took 0.94 seconds to destroy the instance on the hypervisor.
Jul 29 14:52:09 user nova-compute[70924]: DEBUG oslo.service.loopingcall [None req-ffab3bf9-34be-49fe-8f50-9bec7a60ca12 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70924) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 14:52:09 user nova-compute[70924]: DEBUG nova.compute.manager [-] [instance: d0776c81-190d-41da-99c5-7419ed69b92c] Deallocating network for instance {{(pid=70924) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 14:52:09 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: d0776c81-190d-41da-99c5-7419ed69b92c] deallocate_for_instance() {{(pid=70924) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 14:52:09 user nova-compute[70924]: DEBUG nova.compute.manager [req-56d4625e-5f34-4e16-8c65-7a9356b88055 req-82255d38-6875-4c45-bf71-b1031c20593a service nova] [instance: fd57baf8-6306-4553-a058-e915fb543405] Received event network-vif-plugged-c8f2eadb-705f-4b8b-9f67-c5280cf1f025 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:52:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-56d4625e-5f34-4e16-8c65-7a9356b88055 req-82255d38-6875-4c45-bf71-b1031c20593a service nova] Acquiring lock "fd57baf8-6306-4553-a058-e915fb543405-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:52:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-56d4625e-5f34-4e16-8c65-7a9356b88055 req-82255d38-6875-4c45-bf71-b1031c20593a service nova] Lock "fd57baf8-6306-4553-a058-e915fb543405-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:52:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-56d4625e-5f34-4e16-8c65-7a9356b88055 req-82255d38-6875-4c45-bf71-b1031c20593a service nova] Lock "fd57baf8-6306-4553-a058-e915fb543405-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:52:09 user nova-compute[70924]: DEBUG nova.compute.manager [req-56d4625e-5f34-4e16-8c65-7a9356b88055 req-82255d38-6875-4c45-bf71-b1031c20593a service nova] [instance: fd57baf8-6306-4553-a058-e915fb543405] No waiting events found dispatching network-vif-plugged-c8f2eadb-705f-4b8b-9f67-c5280cf1f025 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:52:09 user nova-compute[70924]: WARNING nova.compute.manager [req-56d4625e-5f34-4e16-8c65-7a9356b88055 req-82255d38-6875-4c45-bf71-b1031c20593a service nova] [instance: fd57baf8-6306-4553-a058-e915fb543405] Received unexpected event network-vif-plugged-c8f2eadb-705f-4b8b-9f67-c5280cf1f025 for instance with vm_state resized and task_state None.
Jul 29 14:52:09 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: d0776c81-190d-41da-99c5-7419ed69b92c] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:52:09 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: d0776c81-190d-41da-99c5-7419ed69b92c] Took 0.48 seconds to deallocate network for instance.
Jul 29 14:52:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ffab3bf9-34be-49fe-8f50-9bec7a60ca12 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:52:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ffab3bf9-34be-49fe-8f50-9bec7a60ca12 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:52:10 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.384s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:52:10 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] <== connect_volume: return (1386ms) {'type': 'block', 'scsi_wwn': '23765353663643934', 'path': '/dev/sdc'} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:52:10 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765353663643934', 'path': '/dev/sdc'} {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 14:52:10 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:48:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1090583774',display_name='tempest-AttachVolumeTestJSON-server-1090583774',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1090583774',id=20,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxYeAuUdgBDENKjW9KGfUkDITpquweWjsClM8apGgMwschv+svyuQ0OvGCeunIrF1Cf2sPzGMDx0GWfQ+3b5oeX2ZZAH8S+9X0B99z5roSd+MxfrhgBDxbU7z4pZrnyqA==',key_name='tempest-keypair-571943859',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:48:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a0388bcf487e492082e85b183f38765c',ramdisk_id='',reservation_id='r-4dtac58j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-651630277',owner_user_name='tempest-AttachVolumeTestJSON-651630277-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:50:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='761e4287afb94bf4ad93c09a43bada1f',uuid=7cb12b3e-de44-4887-ab74-2a68164b5f7d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e41d642f-f559-4294-b5ff-5ec478fb3438", "address": "fa:16:3e:f7:ee:73", "network": {"id": "46d2cfde-13db-4cf3-af0e-4d6742f37044", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1642265305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0388bcf487e492082e85b183f38765c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape41d642f-f5", "ovs_interfaceid": "e41d642f-f559-4294-b5ff-5ec478fb3438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:52:10 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Converting VIF {"id": "e41d642f-f559-4294-b5ff-5ec478fb3438", "address": "fa:16:3e:f7:ee:73", "network": {"id": "46d2cfde-13db-4cf3-af0e-4d6742f37044", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1642265305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0388bcf487e492082e85b183f38765c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape41d642f-f5", "ovs_interfaceid": "e41d642f-f559-4294-b5ff-5ec478fb3438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:52:10 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:ee:73,bridge_name='br-int',has_traffic_filtering=True,id=e41d642f-f559-4294-b5ff-5ec478fb3438,network=Network(46d2cfde-13db-4cf3-af0e-4d6742f37044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape41d642f-f5') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:52:10 user nova-compute[70924]: DEBUG nova.objects.instance [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lazy-loading 'pci_devices' on Instance uuid 7cb12b3e-de44-4887-ab74-2a68164b5f7d {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:52:10 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] End _get_guest_xml xml=<domain type="kvm">
Jul 29 14:52:10 user nova-compute[70924]:   <uuid>7cb12b3e-de44-4887-ab74-2a68164b5f7d</uuid>
Jul 29 14:52:10 user nova-compute[70924]:   <name>instance-00000014</name>
Jul 29 14:52:10 user nova-compute[70924]:   <memory>524288</memory>
Jul 29 14:52:10 user nova-compute[70924]:   <vcpu>1</vcpu>
Jul 29 14:52:10 user nova-compute[70924]:   <metadata>
Jul 29 14:52:10 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 14:52:10 user nova-compute[70924]:       <nova:package version="0.0.0"/>
Jul 29 14:52:10 user nova-compute[70924]:       <nova:name>tempest-AttachVolumeTestJSON-server-1090583774</nova:name>
Jul 29 14:52:10 user nova-compute[70924]:       <nova:creationTime>2023-07-29 14:52:08</nova:creationTime>
Jul 29 14:52:10 user nova-compute[70924]:       <nova:flavor name="m1.tiny">
Jul 29 14:52:10 user nova-compute[70924]:         <nova:memory>512</nova:memory>
Jul 29 14:52:10 user nova-compute[70924]:         <nova:disk>1</nova:disk>
Jul 29 14:52:10 user nova-compute[70924]:         <nova:swap>0</nova:swap>
Jul 29 14:52:10 user nova-compute[70924]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 14:52:10 user nova-compute[70924]:         <nova:vcpus>1</nova:vcpus>
Jul 29 14:52:10 user nova-compute[70924]:       </nova:flavor>
Jul 29 14:52:10 user nova-compute[70924]:       <nova:owner>
Jul 29 14:52:10 user nova-compute[70924]:         <nova:user uuid="761e4287afb94bf4ad93c09a43bada1f">tempest-AttachVolumeTestJSON-651630277-project-member</nova:user>
Jul 29 14:52:10 user nova-compute[70924]:         <nova:project uuid="a0388bcf487e492082e85b183f38765c">tempest-AttachVolumeTestJSON-651630277</nova:project>
Jul 29 14:52:10 user nova-compute[70924]:       </nova:owner>
Jul 29 14:52:10 user nova-compute[70924]:       <nova:root type="image" uuid="3aba2e73-6832-404b-8bd0-d0503ce82b8c"/>
Jul 29 14:52:10 user nova-compute[70924]:       <nova:ports>
Jul 29 14:52:10 user nova-compute[70924]:         <nova:port uuid="e41d642f-f559-4294-b5ff-5ec478fb3438">
Jul 29 14:52:10 user nova-compute[70924]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 29 14:52:10 user nova-compute[70924]:         </nova:port>
Jul 29 14:52:10 user nova-compute[70924]:       </nova:ports>
Jul 29 14:52:10 user nova-compute[70924]:     </nova:instance>
Jul 29 14:52:10 user nova-compute[70924]:   </metadata>
Jul 29 14:52:10 user nova-compute[70924]:   <sysinfo type="smbios">
Jul 29 14:52:10 user nova-compute[70924]:     <system>
Jul 29 14:52:10 user nova-compute[70924]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 14:52:10 user nova-compute[70924]:       <entry name="product">OpenStack Nova</entry>
Jul 29 14:52:10 user nova-compute[70924]:       <entry name="version">0.0.0</entry>
Jul 29 14:52:10 user nova-compute[70924]:       <entry name="serial">7cb12b3e-de44-4887-ab74-2a68164b5f7d</entry>
Jul 29 14:52:10 user nova-compute[70924]:       <entry name="uuid">7cb12b3e-de44-4887-ab74-2a68164b5f7d</entry>
Jul 29 14:52:10 user nova-compute[70924]:       <entry name="family">Virtual Machine</entry>
Jul 29 14:52:10 user nova-compute[70924]:     </system>
Jul 29 14:52:10 user nova-compute[70924]:   </sysinfo>
Jul 29 14:52:10 user nova-compute[70924]:   <os>
Jul 29 14:52:10 user nova-compute[70924]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 14:52:10 user nova-compute[70924]:     <boot dev="hd"/>
Jul 29 14:52:10 user nova-compute[70924]:     <smbios mode="sysinfo"/>
Jul 29 14:52:10 user nova-compute[70924]:   </os>
Jul 29 14:52:10 user nova-compute[70924]:   <features>
Jul 29 14:52:10 user nova-compute[70924]:     <acpi/>
Jul 29 14:52:10 user nova-compute[70924]:     <apic/>
Jul 29 14:52:10 user nova-compute[70924]:     <vmcoreinfo/>
Jul 29 14:52:10 user nova-compute[70924]:   </features>
Jul 29 14:52:10 user nova-compute[70924]:   <clock offset="utc">
Jul 29 14:52:10 user nova-compute[70924]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 14:52:10 user nova-compute[70924]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 14:52:10 user nova-compute[70924]:     <timer name="hpet" present="no"/>
Jul 29 14:52:10 user nova-compute[70924]:   </clock>
Jul 29 14:52:10 user nova-compute[70924]:   <cpu mode="custom" match="exact">
Jul 29 14:52:10 user nova-compute[70924]:     <model>Nehalem</model>
Jul 29 14:52:10 user nova-compute[70924]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 14:52:10 user nova-compute[70924]:   </cpu>
Jul 29 14:52:10 user nova-compute[70924]:   <devices>
Jul 29 14:52:10 user nova-compute[70924]:     <disk type="file" device="disk">
Jul 29 14:52:10 user nova-compute[70924]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 14:52:10 user nova-compute[70924]:       <source file="/opt/stack/data/nova/instances/7cb12b3e-de44-4887-ab74-2a68164b5f7d/disk"/>
Jul 29 14:52:10 user nova-compute[70924]:       <target dev="vda" bus="virtio"/>
Jul 29 14:52:10 user nova-compute[70924]:     </disk>
Jul 29 14:52:10 user nova-compute[70924]:     <disk type="block" device="disk">
Jul 29 14:52:10 user nova-compute[70924]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:52:10 user nova-compute[70924]:       <source dev="/dev/sdc"/>
Jul 29 14:52:10 user nova-compute[70924]:       <target dev="vdb" bus="virtio"/>
Jul 29 14:52:10 user nova-compute[70924]:       <serial>d8cda795-fcae-41e3-80f3-2066316032fe</serial>
Jul 29 14:52:10 user nova-compute[70924]:     </disk>
Jul 29 14:52:10 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 14:52:10 user nova-compute[70924]:       <mac address="fa:16:3e:f7:ee:73"/>
Jul 29 14:52:10 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:52:10 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 14:52:10 user nova-compute[70924]:       <target dev="tape41d642f-f5"/>
Jul 29 14:52:10 user nova-compute[70924]:     </interface>
Jul 29 14:52:10 user nova-compute[70924]:     <serial type="pty">
Jul 29 14:52:10 user nova-compute[70924]:       <log file="/opt/stack/data/nova/instances/7cb12b3e-de44-4887-ab74-2a68164b5f7d/console.log" append="off"/>
Jul 29 14:52:10 user nova-compute[70924]:     </serial>
Jul 29 14:52:10 user nova-compute[70924]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 14:52:10 user nova-compute[70924]:     <video>
Jul 29 14:52:10 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:52:10 user nova-compute[70924]:     </video>
Jul 29 14:52:10 user nova-compute[70924]:     <rng model="virtio">
Jul 29 14:52:10 user nova-compute[70924]:       <backend model="random">/dev/urandom</backend>
Jul 29 14:52:10 user nova-compute[70924]:     </rng>
Jul 29 14:52:10 user nova-compute[70924]:     <controller type="usb" index="0" model="none"/>
Jul 29 14:52:10 user nova-compute[70924]:     <memballoon model="virtio">
Jul 29 14:52:10 user nova-compute[70924]:       <stats period="10"/>
Jul 29 14:52:10 user nova-compute[70924]:     </memballoon>
Jul 29 14:52:10 user nova-compute[70924]:   </devices>
Jul 29 14:52:10 user nova-compute[70924]: </domain>
Jul 29 14:52:10 user nova-compute[70924]:  {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 14:52:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cb12b3e-de44-4887-ab74-2a68164b5f7d/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:10 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-ffab3bf9-34be-49fe-8f50-9bec7a60ca12 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:52:10 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-ffab3bf9-34be-49fe-8f50-9bec7a60ca12 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:52:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ffab3bf9-34be-49fe-8f50-9bec7a60ca12 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.469s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:52:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cb12b3e-de44-4887-ab74-2a68164b5f7d/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cb12b3e-de44-4887-ab74-2a68164b5f7d/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cb12b3e-de44-4887-ab74-2a68164b5f7d/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:10 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 14:52:10 user nova-compute[70924]: DEBUG nova.objects.instance [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7cb12b3e-de44-4887-ab74-2a68164b5f7d {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:52:10 user nova-compute[70924]: INFO nova.scheduler.client.report [None req-ffab3bf9-34be-49fe-8f50-9bec7a60ca12 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Deleted allocations for instance d0776c81-190d-41da-99c5-7419ed69b92c
Jul 29 14:52:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:10 user nova-compute[70924]: DEBUG nova.compute.manager [req-88b403cb-d8ca-4a46-bf24-c452f9e35c8a req-1345344d-7f40-41e7-925e-fbe63859c790 service nova] [instance: d0776c81-190d-41da-99c5-7419ed69b92c] Received event network-vif-plugged-77586dcd-0ed2-4e9c-a29f-324b2726a962 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:52:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-88b403cb-d8ca-4a46-bf24-c452f9e35c8a req-1345344d-7f40-41e7-925e-fbe63859c790 service nova] Acquiring lock "d0776c81-190d-41da-99c5-7419ed69b92c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:52:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-88b403cb-d8ca-4a46-bf24-c452f9e35c8a req-1345344d-7f40-41e7-925e-fbe63859c790 service nova] Lock "d0776c81-190d-41da-99c5-7419ed69b92c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:52:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-88b403cb-d8ca-4a46-bf24-c452f9e35c8a req-1345344d-7f40-41e7-925e-fbe63859c790 service nova] Lock "d0776c81-190d-41da-99c5-7419ed69b92c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:52:10 user nova-compute[70924]: DEBUG nova.compute.manager [req-88b403cb-d8ca-4a46-bf24-c452f9e35c8a req-1345344d-7f40-41e7-925e-fbe63859c790 service nova] [instance: d0776c81-190d-41da-99c5-7419ed69b92c] No waiting events found dispatching network-vif-plugged-77586dcd-0ed2-4e9c-a29f-324b2726a962 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:52:10 user nova-compute[70924]: WARNING nova.compute.manager [req-88b403cb-d8ca-4a46-bf24-c452f9e35c8a req-1345344d-7f40-41e7-925e-fbe63859c790 service nova] [instance: d0776c81-190d-41da-99c5-7419ed69b92c] Received unexpected event network-vif-plugged-77586dcd-0ed2-4e9c-a29f-324b2726a962 for instance with vm_state deleted and task_state None.
Jul 29 14:52:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ffab3bf9-34be-49fe-8f50-9bec7a60ca12 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Lock "d0776c81-190d-41da-99c5-7419ed69b92c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.399s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:52:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.172s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:10 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7cb12b3e-de44-4887-ab74-2a68164b5f7d/disk. size=1073741824 {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 14:52:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cb12b3e-de44-4887-ab74-2a68164b5f7d/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:11 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cb12b3e-de44-4887-ab74-2a68164b5f7d/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:11 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Cannot resize image /opt/stack/data/nova/instances/7cb12b3e-de44-4887-ab74-2a68164b5f7d/disk to a smaller size. {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 14:52:11 user nova-compute[70924]: DEBUG nova.objects.instance [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lazy-loading 'migration_context' on Instance uuid 7cb12b3e-de44-4887-ab74-2a68164b5f7d {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:52:11 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:48:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1090583774',display_name='tempest-AttachVolumeTestJSON-server-1090583774',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1090583774',id=20,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxYeAuUdgBDENKjW9KGfUkDITpquweWjsClM8apGgMwschv+svyuQ0OvGCeunIrF1Cf2sPzGMDx0GWfQ+3b5oeX2ZZAH8S+9X0B99z5roSd+MxfrhgBDxbU7z4pZrnyqA==',key_name='tempest-keypair-571943859',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:48:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='a0388bcf487e492082e85b183f38765c',ramdisk_id='',reservation_id='r-4dtac58j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-651630277',owner_user_name='tempest-AttachVolumeTestJSON-651630277-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:50:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='761e4287afb94bf4ad93c09a43bada1f',uuid=7cb12b3e-de44-4887-ab74-2a68164b5f7d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e41d642f-f559-4294-b5ff-5ec478fb3438", "address": "fa:16:3e:f7:ee:73", "network": {"id": "46d2cfde-13db-4cf3-af0e-4d6742f37044", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1642265305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0388bcf487e492082e85b183f38765c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape41d642f-f5", "ovs_interfaceid": "e41d642f-f559-4294-b5ff-5ec478fb3438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 14:52:11 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Converting VIF {"id": "e41d642f-f559-4294-b5ff-5ec478fb3438", "address": "fa:16:3e:f7:ee:73", "network": {"id": "46d2cfde-13db-4cf3-af0e-4d6742f37044", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1642265305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0388bcf487e492082e85b183f38765c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape41d642f-f5", "ovs_interfaceid": "e41d642f-f559-4294-b5ff-5ec478fb3438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:52:11 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:ee:73,bridge_name='br-int',has_traffic_filtering=True,id=e41d642f-f559-4294-b5ff-5ec478fb3438,network=Network(46d2cfde-13db-4cf3-af0e-4d6742f37044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape41d642f-f5') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:52:11 user nova-compute[70924]: DEBUG os_vif [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:ee:73,bridge_name='br-int',has_traffic_filtering=True,id=e41d642f-f559-4294-b5ff-5ec478fb3438,network=Network(46d2cfde-13db-4cf3-af0e-4d6742f37044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape41d642f-f5') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 14:52:11 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:11 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:52:11 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 14:52:11 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:11 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape41d642f-f5, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:52:11 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape41d642f-f5, col_values=(('external_ids', {'iface-id': 'e41d642f-f559-4294-b5ff-5ec478fb3438', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:ee:73', 'vm-uuid': '7cb12b3e-de44-4887-ab74-2a68164b5f7d'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:52:11 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:11 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:52:11 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:11 user nova-compute[70924]: INFO os_vif [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:ee:73,bridge_name='br-int',has_traffic_filtering=True,id=e41d642f-f559-4294-b5ff-5ec478fb3438,network=Network(46d2cfde-13db-4cf3-af0e-4d6742f37044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape41d642f-f5')
Jul 29 14:52:11 user nova-compute[70924]: DEBUG nova.compute.manager [req-37b7df6b-ca15-467b-bd24-90f4b9126551 req-7166a1bb-5947-4b22-9957-ba989adc0393 service nova] [instance: d0776c81-190d-41da-99c5-7419ed69b92c] Received event network-vif-deleted-77586dcd-0ed2-4e9c-a29f-324b2726a962 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:52:12 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:12 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:12 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:12 user nova-compute[70924]: DEBUG nova.compute.manager [req-9d0f80db-a3ef-412e-9bf4-fdc581746a13 req-7f550583-b7cc-4f61-a414-1667596e4a32 service nova] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Received event network-vif-plugged-e41d642f-f559-4294-b5ff-5ec478fb3438 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:52:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-9d0f80db-a3ef-412e-9bf4-fdc581746a13 req-7f550583-b7cc-4f61-a414-1667596e4a32 service nova] Acquiring lock "7cb12b3e-de44-4887-ab74-2a68164b5f7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:52:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-9d0f80db-a3ef-412e-9bf4-fdc581746a13 req-7f550583-b7cc-4f61-a414-1667596e4a32 service nova] Lock "7cb12b3e-de44-4887-ab74-2a68164b5f7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:52:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-9d0f80db-a3ef-412e-9bf4-fdc581746a13 req-7f550583-b7cc-4f61-a414-1667596e4a32 service nova] Lock "7cb12b3e-de44-4887-ab74-2a68164b5f7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:52:12 user nova-compute[70924]: DEBUG nova.compute.manager [req-9d0f80db-a3ef-412e-9bf4-fdc581746a13 req-7f550583-b7cc-4f61-a414-1667596e4a32 service nova] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] No waiting events found dispatching network-vif-plugged-e41d642f-f559-4294-b5ff-5ec478fb3438 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:52:12 user nova-compute[70924]: WARNING nova.compute.manager [req-9d0f80db-a3ef-412e-9bf4-fdc581746a13 req-7f550583-b7cc-4f61-a414-1667596e4a32 service nova] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Received unexpected event network-vif-plugged-e41d642f-f559-4294-b5ff-5ec478fb3438 for instance with vm_state stopped and task_state powering-on.
Jul 29 14:52:13 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:13 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:13 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:13 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:13 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:15 user nova-compute[70924]: DEBUG nova.compute.manager [req-0e35d1a0-37b0-4c06-894d-c5dc4e29a048 req-9913a3b2-bc70-4394-b0f1-4e094707b823 service nova] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Received event network-vif-plugged-e41d642f-f559-4294-b5ff-5ec478fb3438 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:52:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-0e35d1a0-37b0-4c06-894d-c5dc4e29a048 req-9913a3b2-bc70-4394-b0f1-4e094707b823 service nova] Acquiring lock "7cb12b3e-de44-4887-ab74-2a68164b5f7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:52:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-0e35d1a0-37b0-4c06-894d-c5dc4e29a048 req-9913a3b2-bc70-4394-b0f1-4e094707b823 service nova] Lock "7cb12b3e-de44-4887-ab74-2a68164b5f7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:52:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-0e35d1a0-37b0-4c06-894d-c5dc4e29a048 req-9913a3b2-bc70-4394-b0f1-4e094707b823 service nova] Lock "7cb12b3e-de44-4887-ab74-2a68164b5f7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:52:15 user nova-compute[70924]: DEBUG nova.compute.manager [req-0e35d1a0-37b0-4c06-894d-c5dc4e29a048 req-9913a3b2-bc70-4394-b0f1-4e094707b823 service nova] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] No waiting events found dispatching network-vif-plugged-e41d642f-f559-4294-b5ff-5ec478fb3438 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:52:15 user nova-compute[70924]: WARNING nova.compute.manager [req-0e35d1a0-37b0-4c06-894d-c5dc4e29a048 req-9913a3b2-bc70-4394-b0f1-4e094707b823 service nova] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Received unexpected event network-vif-plugged-e41d642f-f559-4294-b5ff-5ec478fb3438 for instance with vm_state stopped and task_state powering-on.
Jul 29 14:52:15 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642335.1153064, 7cb12b3e-de44-4887-ab74-2a68164b5f7d => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:52:15 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] VM Resumed (Lifecycle Event)
Jul 29 14:52:15 user nova-compute[70924]: DEBUG nova.compute.manager [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Instance event wait completed in 0 seconds for  {{(pid=70924) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 14:52:15 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Instance rebooted successfully.
Jul 29 14:52:15 user nova-compute[70924]: DEBUG nova.compute.manager [None req-f0648a3a-18d5-4ca5-87cc-5a74581a448a tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:52:15 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:52:15 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:52:15 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] During sync_power_state the instance has a pending task (powering-on). Skip.
Jul 29 14:52:15 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642335.1201985, 7cb12b3e-de44-4887-ab74-2a68164b5f7d => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:52:15 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] VM Started (Lifecycle Event)
Jul 29 14:52:15 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:52:15 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:52:15 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:16 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:17 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:18 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:21 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:23 user nova-compute[70924]: DEBUG nova.network.neutron [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Port c4a5a7c9-34d6-4040-87a3-78c4fd26b170 binding to destination host user is already ACTIVE {{(pid=70924) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Jul 29 14:52:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Acquiring lock "refresh_cache-f5350fb5-9460-490b-a47e-74f88c8eb51c" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:52:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Acquired lock "refresh_cache-f5350fb5-9460-490b-a47e-74f88c8eb51c" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:52:23 user nova-compute[70924]: DEBUG nova.network.neutron [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 14:52:23 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:23 user nova-compute[70924]: DEBUG nova.network.neutron [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Updating instance_info_cache with network_info: [{"id": "c4a5a7c9-34d6-4040-87a3-78c4fd26b170", "address": "fa:16:3e:90:f1:53", "network": {"id": "d87dd51f-8870-4dfa-b608-7c4b662219ca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1964327887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd007df2b3e04ab784369809178e4240", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a5a7c9-34", "ovs_interfaceid": "c4a5a7c9-34d6-4040-87a3-78c4fd26b170", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:52:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Releasing lock "refresh_cache-f5350fb5-9460-490b-a47e-74f88c8eb51c" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:52:23 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Creating tmpfile /opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c/tmp77k2myz9 to verify with other compute node that the instance is on the same shared storage. {{(pid=70924) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Jul 29 14:52:24 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:24 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:24 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:24 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:24 user nova-compute[70924]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690642329.2355397, d0776c81-190d-41da-99c5-7419ed69b92c => Stopped> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:52:24 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: d0776c81-190d-41da-99c5-7419ed69b92c] VM Stopped (Lifecycle Event)
Jul 29 14:52:24 user nova-compute[70924]: DEBUG nova.compute.manager [None req-7ae702b5-517e-4188-bd02-fd48803aedf1 None None] [instance: d0776c81-190d-41da-99c5-7419ed69b92c] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:52:24 user nova-compute[70924]: DEBUG nova.compute.manager [req-dc4b6705-956a-4c51-b0db-df3dc5e59bbd req-8ab93763-a8f2-42a4-bba0-29424a34be37 service nova] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Received event network-vif-unplugged-c4a5a7c9-34d6-4040-87a3-78c4fd26b170 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:52:24 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-dc4b6705-956a-4c51-b0db-df3dc5e59bbd req-8ab93763-a8f2-42a4-bba0-29424a34be37 service nova] Acquiring lock "f5350fb5-9460-490b-a47e-74f88c8eb51c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:52:24 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-dc4b6705-956a-4c51-b0db-df3dc5e59bbd req-8ab93763-a8f2-42a4-bba0-29424a34be37 service nova] Lock "f5350fb5-9460-490b-a47e-74f88c8eb51c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:52:24 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-dc4b6705-956a-4c51-b0db-df3dc5e59bbd req-8ab93763-a8f2-42a4-bba0-29424a34be37 service nova] Lock "f5350fb5-9460-490b-a47e-74f88c8eb51c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:52:24 user nova-compute[70924]: DEBUG nova.compute.manager [req-dc4b6705-956a-4c51-b0db-df3dc5e59bbd req-8ab93763-a8f2-42a4-bba0-29424a34be37 service nova] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] No waiting events found dispatching network-vif-unplugged-c4a5a7c9-34d6-4040-87a3-78c4fd26b170 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:52:24 user nova-compute[70924]: WARNING nova.compute.manager [req-dc4b6705-956a-4c51-b0db-df3dc5e59bbd req-8ab93763-a8f2-42a4-bba0-29424a34be37 service nova] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Received unexpected event network-vif-unplugged-c4a5a7c9-34d6-4040-87a3-78c4fd26b170 for instance with vm_state resized and task_state resize_reverting.
Jul 29 14:52:24 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Instance destroyed successfully.
Jul 29 14:52:24 user nova-compute[70924]: DEBUG nova.objects.instance [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Lazy-loading 'resources' on Instance uuid f5350fb5-9460-490b-a47e-74f88c8eb51c {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:52:24 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:46:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1255761132',display_name='tempest-ServerActionsTestOtherB-server-1255761132',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1255761132',id=18,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIBMm7U7DNUnZfHvCCwqmdK01H/F7FPPtGEiHdQU/UfZbvDiHS9WyDAl4KpLKXM2BWrjymDoAA5PpeT/LkSZzEFYL6ZRKv5TsemED0bunybXK/h2EPtICo6kFvAJz1A93g==',key_name='tempest-keypair-566023039',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:50:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fd007df2b3e04ab784369809178e4240',ramdisk_id='',reservation_id='r-z4t1omey',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-298005467',owner_user_name='tempest-ServerActionsTestOtherB-298005467-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:50:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6e2628064a66492e9f85e99332ac3ceb',uuid=f5350fb5-9460-490b-a47e-74f88c8eb51c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "c4a5a7c9-34d6-4040-87a3-78c4fd26b170", "address": "fa:16:3e:90:f1:53", "network": {"id": "d87dd51f-8870-4dfa-b608-7c4b662219ca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1964327887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd007df2b3e04ab784369809178e4240", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a5a7c9-34", "ovs_interfaceid": "c4a5a7c9-34d6-4040-87a3-78c4fd26b170", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 14:52:24 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Converting VIF {"id": "c4a5a7c9-34d6-4040-87a3-78c4fd26b170", "address": "fa:16:3e:90:f1:53", "network": {"id": "d87dd51f-8870-4dfa-b608-7c4b662219ca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1964327887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd007df2b3e04ab784369809178e4240", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a5a7c9-34", "ovs_interfaceid": "c4a5a7c9-34d6-4040-87a3-78c4fd26b170", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:52:24 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:90:f1:53,bridge_name='br-int',has_traffic_filtering=True,id=c4a5a7c9-34d6-4040-87a3-78c4fd26b170,network=Network(d87dd51f-8870-4dfa-b608-7c4b662219ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4a5a7c9-34') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:52:24 user nova-compute[70924]: DEBUG os_vif [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:f1:53,bridge_name='br-int',has_traffic_filtering=True,id=c4a5a7c9-34d6-4040-87a3-78c4fd26b170,network=Network(d87dd51f-8870-4dfa-b608-7c4b662219ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4a5a7c9-34') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 14:52:24 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:24 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc4a5a7c9-34, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:52:24 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:24 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:52:24 user nova-compute[70924]: INFO os_vif [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:f1:53,bridge_name='br-int',has_traffic_filtering=True,id=c4a5a7c9-34d6-4040-87a3-78c4fd26b170,network=Network(d87dd51f-8870-4dfa-b608-7c4b662219ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4a5a7c9-34')
Jul 29 14:52:24 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] calling os-brick to detach iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 14:52:24 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, {'target_iqns': ['iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xWibJIcX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:52:24 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:52:24 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:52:24 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:52:24 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef', 0)] {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 14:52:24 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:24 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:24 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[136bdbbc-ee32-41a2-896e-846800777d11]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:24 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:24 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:24 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[82403f0b-9cba-4069-ab47-06a80b063739]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:24 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:52:24 user nova-compute[70924]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)
Jul 29 14:52:24 user nova-compute[70924]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:52:24 user nova-compute[70924]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)
Jul 29 14:52:24 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:52:24 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:52:24 user nova-compute[70924]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)
Jul 29 14:52:24 user nova-compute[70924]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:52:24 user nova-compute[70924]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)
Jul 29 14:52:24 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:52:24 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feecc68d360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef'): ({'sdf'}, set())}) {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 14:52:24 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Removing single pathed devices sdf {{(pid=70924) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 14:52:24 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:24 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:24 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b67434c-6ebd-4602-96a2-f105025a121b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:24 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:24 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:24 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[aebc2343-d538-480c-ae45-404a50512abc]: (4, ('ok\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:24 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Flushing IO for device /dev/sdf {{(pid=70924) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 14:52:24 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:24 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:24 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9bcdbf1-4547-4d8b-a903-7838dc7da530]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:24 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=70924) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 14:52:24 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:24 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.038s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:24 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[630fad02-d9c5-4722-85ad-12b04b940fa4]: (4, ('1', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:24 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 14:52:24 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] SCSI volumes sdf have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 14:52:24 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef')] {{(pid=70924) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 14:52:24 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:24 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:24 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d258db-3d4f-46e7-b274-6cb18c0e7021]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:24 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:52:24 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef -p 172.16.0.220:3260 --logout {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:24 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:25 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f3767c-e902-42ee-ae9f-9ec10b4b93e9]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:25 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef, portal: 172.16.0.220,3260]
Jul 29 14:52:25 user nova-compute[70924]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef, portal: 172.16.0.220,3260] successful.
Jul 29 14:52:25 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:52:25 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef -p 172.16.0.220:3260 --op delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:25 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:25 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b17fbf-2148-4526-89c4-ebf3405ef2fe]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:25 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:52:25 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:52:25 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] <== disconnect_volume: return (287ms) None {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:52:25 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Disconnected iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 14:52:25 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:52:25 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:52:25 user nova-compute[70924]: DEBUG nova.objects.instance [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Lazy-loading 'migration_context' on Instance uuid f5350fb5-9460-490b-a47e-74f88c8eb51c {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:52:26 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Refreshing inventories for resource provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 29 14:52:26 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Updating ProviderTree inventory for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 29 14:52:26 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Updating inventory in ProviderTree for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 29 14:52:26 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Refreshing aggregate associations for resource provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832, aggregates: None {{(pid=70924) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 29 14:52:26 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Refreshing trait associations for resource provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832, traits: COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=70924) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 29 14:52:26 user nova-compute[70924]: DEBUG nova.compute.manager [req-e5fc25c7-3d21-4ece-a711-440ad41b147d req-ac3677e1-48a1-4619-baa8-16fde6f1eb29 service nova] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Received event network-vif-plugged-c4a5a7c9-34d6-4040-87a3-78c4fd26b170 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:52:26 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-e5fc25c7-3d21-4ece-a711-440ad41b147d req-ac3677e1-48a1-4619-baa8-16fde6f1eb29 service nova] Acquiring lock "f5350fb5-9460-490b-a47e-74f88c8eb51c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:52:26 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-e5fc25c7-3d21-4ece-a711-440ad41b147d req-ac3677e1-48a1-4619-baa8-16fde6f1eb29 service nova] Lock "f5350fb5-9460-490b-a47e-74f88c8eb51c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:52:26 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-e5fc25c7-3d21-4ece-a711-440ad41b147d req-ac3677e1-48a1-4619-baa8-16fde6f1eb29 service nova] Lock "f5350fb5-9460-490b-a47e-74f88c8eb51c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:52:26 user nova-compute[70924]: DEBUG nova.compute.manager [req-e5fc25c7-3d21-4ece-a711-440ad41b147d req-ac3677e1-48a1-4619-baa8-16fde6f1eb29 service nova] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] No waiting events found dispatching network-vif-plugged-c4a5a7c9-34d6-4040-87a3-78c4fd26b170 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:52:26 user nova-compute[70924]: WARNING nova.compute.manager [req-e5fc25c7-3d21-4ece-a711-440ad41b147d req-ac3677e1-48a1-4619-baa8-16fde6f1eb29 service nova] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Received unexpected event network-vif-plugged-c4a5a7c9-34d6-4040-87a3-78c4fd26b170 for instance with vm_state resized and task_state resize_reverting.
Jul 29 14:52:26 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:52:26 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:52:26 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.864s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:52:26 user nova-compute[70924]: INFO nova.compute.manager [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Swapping old allocation on dict_keys(['e285c8ee-f39c-4daa-8d15-3de9c4f5f832']) held by migration 34c17454-041c-408f-80d8-2702f06cc0d4 for instance
Jul 29 14:52:26 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Overwriting current allocation {'allocations': {'e285c8ee-f39c-4daa-8d15-3de9c4f5f832': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 35}}, 'project_id': 'fd007df2b3e04ab784369809178e4240', 'user_id': '6e2628064a66492e9f85e99332ac3ceb', 'consumer_generation': 1} on consumer f5350fb5-9460-490b-a47e-74f88c8eb51c {{(pid=70924) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Jul 29 14:52:27 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Acquiring lock "refresh_cache-f5350fb5-9460-490b-a47e-74f88c8eb51c" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:52:27 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Acquired lock "refresh_cache-f5350fb5-9460-490b-a47e-74f88c8eb51c" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:52:27 user nova-compute[70924]: DEBUG nova.network.neutron [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 14:52:27 user nova-compute[70924]: DEBUG nova.network.neutron [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Updating instance_info_cache with network_info: [{"id": "c4a5a7c9-34d6-4040-87a3-78c4fd26b170", "address": "fa:16:3e:90:f1:53", "network": {"id": "d87dd51f-8870-4dfa-b608-7c4b662219ca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1964327887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd007df2b3e04ab784369809178e4240", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a5a7c9-34", "ovs_interfaceid": "c4a5a7c9-34d6-4040-87a3-78c4fd26b170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:52:27 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Releasing lock "refresh_cache-f5350fb5-9460-490b-a47e-74f88c8eb51c" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:52:27 user nova-compute[70924]: DEBUG os_brick.utils [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:52:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:27 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7bae60-495d-4b9b-8059-9c5bfb8496be]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f2127c4a30d9\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:27 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01acec8-5fe6-45a1-8b05-2ca9dd35129e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:27 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bfe851a-ba2f-49b7-a6e3-35cab6e60db2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:27 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ccca44-91a6-4cb8-9ff6-0cf512e683b1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Running cmd (subprocess): nvme version {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] 'nvme version' failed. Not Retrying. {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:52:27 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] nvme not present on system {{(pid=70924) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 14:52:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:52:27 user nova-compute[70924]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 14:52:27 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c82300-902f-4dab-bd29-73484d0c7583]: (4, '') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:27 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70924) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 14:52:27 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 14:52:27 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] LIGHTOS: no hostnqn found. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 14:52:27 user nova-compute[70924]: DEBUG os_brick.utils [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f2127c4a30d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:52:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:29 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:33 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:35 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Starting finish_revert_migration {{(pid=70924) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Jul 29 14:52:35 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Start _get_guest_xml network_info=[{"id": "c4a5a7c9-34d6-4040-87a3-78c4fd26b170", "address": "fa:16:3e:90:f1:53", "network": {"id": "d87dd51f-8870-4dfa-b608-7c4b662219ca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1964327887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd007df2b3e04ab784369809178e4240", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a5a7c9-34", "ovs_interfaceid": "c4a5a7c9-34d6-4040-87a3-78c4fd26b170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '3aba2e73-6832-404b-8bd0-d0503ce82b8c'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'boot_index': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xWibJIcX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'f5350fb5-9460-490b-a47e-74f88c8eb51c', 'attached_at': '2023-07-29T14:52:35.000000', 'detached_at': '', 'volume_id': '40240a39-c2db-4b14-bc97-0fb20849bdef', 'serial': '40240a39-c2db-4b14-bc97-0fb20849bdef'}, 'attachment_id': '4dc80cb5-fa0b-4ed7-8bb5-ea104536f93e', 'volume_type': None} {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 14:52:35 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:52:35 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:52:35 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 14:52:35 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] CPU controller missing on host. {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 14:52:35 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 14:52:35 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] CPU controller found on host. {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 14:52:35 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70924) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 14:52:35 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T14:36:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 14:52:35 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Flavor limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 14:52:35 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Image limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 14:52:35 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Flavor pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 14:52:35 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Image pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 14:52:35 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 14:52:35 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 14:52:35 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 14:52:35 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Got 1 possible topologies {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 14:52:35 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 14:52:35 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 14:52:35 user nova-compute[70924]: DEBUG nova.objects.instance [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Lazy-loading 'vcpu_model' on Instance uuid f5350fb5-9460-490b-a47e-74f88c8eb51c {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:52:35 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Calling os-brick to attach iSCSI Volume {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 14:52:35 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xWibJIcX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:52:35 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:52:35 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:52:35 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:52:35 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:52:35 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:52:35 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:52:35 user nova-compute[70924]: INFO os_brick.initiator.connectors.iscsi [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 14:52:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef -p 172.16.0.220:3260 {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:35 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3de7610-7e5f-414c-a9ad-f67da2609b5f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:35 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 14:52:35 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:52:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef -p 172.16.0.220:3260 --interface default --op new {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:35 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[04aa130a-196f-4d15-bd87-8d7db0a8cae1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef] added\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:35 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef] added
Jul 29 14:52:35 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:52:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:35 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96f47bc-793d-4c63-9408-b155ceeb98d9]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:35 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:52:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:35 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f2f499c-4760-4bca-9cbd-6f4bf3cd00c4]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:35 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:52:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xWibJIcX {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xWibJIcX" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:35 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[21162fa3-fe89-4235-98d6-d986184e3935]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:35 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xWibJIcX'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:52:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:35 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1a7603-e3b9-4216-a018-d9653e902b7d]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:35 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:52:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:35 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5089cdf5-556a-4a1d-a494-7d2e28b151f4]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:35 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:52:35 user nova-compute[70924]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:52:35 user nova-compute[70924]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)
Jul 29 14:52:35 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:52:35 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:52:35 user nova-compute[70924]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:52:35 user nova-compute[70924]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)
Jul 29 14:52:35 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:52:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef -p 172.16.0.220:3260 --login {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:35 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03b9d69-90d1-4f74-bcc1-d366c0d25ef9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:35 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef, portal: 172.16.0.220,3260]
Jul 29 14:52:35 user nova-compute[70924]: Login to [iface: default, target: iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef, portal: 172.16.0.220,3260] successful.
Jul 29 14:52:35 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:52:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:35 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5f7fee-5985-4a0d-b7f9-fdad7956698d]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:35 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:52:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:35 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc31fba-2ee2-4bcf-a0a2-0bc1be31e281]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:35 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:52:35 user nova-compute[70924]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:52:35 user nova-compute[70924]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)
Jul 29 14:52:35 user nova-compute[70924]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)
Jul 29 14:52:35 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:52:35 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:52:35 user nova-compute[70924]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:52:35 user nova-compute[70924]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)
Jul 29 14:52:35 user nova-compute[70924]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)
Jul 29 14:52:35 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:52:35 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:52:35 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Connected to 172.16.0.220:3260 {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 14:52:35 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] HCTL ('36', '-', '-', 0) found on session 33 with lun 0 {{(pid=70924) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 14:52:35 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70924) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 14:52:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:35 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8fcf27b-17b2-493e-940d-f531407b7500]: (4, ('- - 0', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:35 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Searching for a device in session 33 and hctl ['36', '*', '*', 0] yield: None {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 14:52:36 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Searching for a device in session 33 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 14:52:36 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xWibJIcX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 14:52:36 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:52:36 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '23863623333313730', 'path': '/dev/sde'} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:52:36 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23863623333313730', 'path': '/dev/sde'} {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 14:52:36 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:46:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1255761132',display_name='tempest-ServerActionsTestOtherB-server-1255761132',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1255761132',id=18,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIBMm7U7DNUnZfHvCCwqmdK01H/F7FPPtGEiHdQU/UfZbvDiHS9WyDAl4KpLKXM2BWrjymDoAA5PpeT/LkSZzEFYL6ZRKv5TsemED0bunybXK/h2EPtICo6kFvAJz1A93g==',key_name='tempest-keypair-566023039',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:50:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fd007df2b3e04ab784369809178e4240',ramdisk_id='',reservation_id='r-z4t1omey',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-298005467',owner_user_name='tempest-ServerActionsTestOtherB-298005467-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:52:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6e2628064a66492e9f85e99332ac3ceb',uuid=f5350fb5-9460-490b-a47e-74f88c8eb51c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "c4a5a7c9-34d6-4040-87a3-78c4fd26b170", "address": "fa:16:3e:90:f1:53", "network": {"id": "d87dd51f-8870-4dfa-b608-7c4b662219ca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1964327887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd007df2b3e04ab784369809178e4240", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a5a7c9-34", "ovs_interfaceid": "c4a5a7c9-34d6-4040-87a3-78c4fd26b170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:52:36 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Converting VIF {"id": "c4a5a7c9-34d6-4040-87a3-78c4fd26b170", "address": "fa:16:3e:90:f1:53", "network": {"id": "d87dd51f-8870-4dfa-b608-7c4b662219ca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1964327887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd007df2b3e04ab784369809178e4240", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a5a7c9-34", "ovs_interfaceid": "c4a5a7c9-34d6-4040-87a3-78c4fd26b170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:52:36 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:f1:53,bridge_name='br-int',has_traffic_filtering=True,id=c4a5a7c9-34d6-4040-87a3-78c4fd26b170,network=Network(d87dd51f-8870-4dfa-b608-7c4b662219ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4a5a7c9-34') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:52:36 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] End _get_guest_xml xml=<domain type="kvm">
Jul 29 14:52:36 user nova-compute[70924]:   <uuid>f5350fb5-9460-490b-a47e-74f88c8eb51c</uuid>
Jul 29 14:52:36 user nova-compute[70924]:   <name>instance-00000012</name>
Jul 29 14:52:36 user nova-compute[70924]:   <memory>524288</memory>
Jul 29 14:52:36 user nova-compute[70924]:   <vcpu>1</vcpu>
Jul 29 14:52:36 user nova-compute[70924]:   <metadata>
Jul 29 14:52:36 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 14:52:36 user nova-compute[70924]:       <nova:package version="0.0.0"/>
Jul 29 14:52:36 user nova-compute[70924]:       <nova:name>tempest-ServerActionsTestOtherB-server-1255761132</nova:name>
Jul 29 14:52:36 user nova-compute[70924]:       <nova:creationTime>2023-07-29 14:52:35</nova:creationTime>
Jul 29 14:52:36 user nova-compute[70924]:       <nova:flavor name="m1.tiny">
Jul 29 14:52:36 user nova-compute[70924]:         <nova:memory>512</nova:memory>
Jul 29 14:52:36 user nova-compute[70924]:         <nova:disk>1</nova:disk>
Jul 29 14:52:36 user nova-compute[70924]:         <nova:swap>0</nova:swap>
Jul 29 14:52:36 user nova-compute[70924]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 14:52:36 user nova-compute[70924]:         <nova:vcpus>1</nova:vcpus>
Jul 29 14:52:36 user nova-compute[70924]:       </nova:flavor>
Jul 29 14:52:36 user nova-compute[70924]:       <nova:owner>
Jul 29 14:52:36 user nova-compute[70924]:         <nova:user uuid="6e2628064a66492e9f85e99332ac3ceb">tempest-ServerActionsTestOtherB-298005467-project-member</nova:user>
Jul 29 14:52:36 user nova-compute[70924]:         <nova:project uuid="fd007df2b3e04ab784369809178e4240">tempest-ServerActionsTestOtherB-298005467</nova:project>
Jul 29 14:52:36 user nova-compute[70924]:       </nova:owner>
Jul 29 14:52:36 user nova-compute[70924]:       <nova:root type="image" uuid="3aba2e73-6832-404b-8bd0-d0503ce82b8c"/>
Jul 29 14:52:36 user nova-compute[70924]:       <nova:ports>
Jul 29 14:52:36 user nova-compute[70924]:         <nova:port uuid="c4a5a7c9-34d6-4040-87a3-78c4fd26b170">
Jul 29 14:52:36 user nova-compute[70924]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 29 14:52:36 user nova-compute[70924]:         </nova:port>
Jul 29 14:52:36 user nova-compute[70924]:       </nova:ports>
Jul 29 14:52:36 user nova-compute[70924]:     </nova:instance>
Jul 29 14:52:36 user nova-compute[70924]:   </metadata>
Jul 29 14:52:36 user nova-compute[70924]:   <sysinfo type="smbios">
Jul 29 14:52:36 user nova-compute[70924]:     <system>
Jul 29 14:52:36 user nova-compute[70924]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 14:52:36 user nova-compute[70924]:       <entry name="product">OpenStack Nova</entry>
Jul 29 14:52:36 user nova-compute[70924]:       <entry name="version">0.0.0</entry>
Jul 29 14:52:36 user nova-compute[70924]:       <entry name="serial">f5350fb5-9460-490b-a47e-74f88c8eb51c</entry>
Jul 29 14:52:36 user nova-compute[70924]:       <entry name="uuid">f5350fb5-9460-490b-a47e-74f88c8eb51c</entry>
Jul 29 14:52:36 user nova-compute[70924]:       <entry name="family">Virtual Machine</entry>
Jul 29 14:52:36 user nova-compute[70924]:     </system>
Jul 29 14:52:36 user nova-compute[70924]:   </sysinfo>
Jul 29 14:52:36 user nova-compute[70924]:   <os>
Jul 29 14:52:36 user nova-compute[70924]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 14:52:36 user nova-compute[70924]:     <boot dev="hd"/>
Jul 29 14:52:36 user nova-compute[70924]:     <smbios mode="sysinfo"/>
Jul 29 14:52:36 user nova-compute[70924]:   </os>
Jul 29 14:52:36 user nova-compute[70924]:   <features>
Jul 29 14:52:36 user nova-compute[70924]:     <acpi/>
Jul 29 14:52:36 user nova-compute[70924]:     <apic/>
Jul 29 14:52:36 user nova-compute[70924]:     <vmcoreinfo/>
Jul 29 14:52:36 user nova-compute[70924]:   </features>
Jul 29 14:52:36 user nova-compute[70924]:   <clock offset="utc">
Jul 29 14:52:36 user nova-compute[70924]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 14:52:36 user nova-compute[70924]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 14:52:36 user nova-compute[70924]:     <timer name="hpet" present="no"/>
Jul 29 14:52:36 user nova-compute[70924]:   </clock>
Jul 29 14:52:36 user nova-compute[70924]:   <cpu mode="custom" match="exact">
Jul 29 14:52:36 user nova-compute[70924]:     <model>Nehalem</model>
Jul 29 14:52:36 user nova-compute[70924]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 14:52:36 user nova-compute[70924]:   </cpu>
Jul 29 14:52:36 user nova-compute[70924]:   <devices>
Jul 29 14:52:36 user nova-compute[70924]:     <disk type="file" device="disk">
Jul 29 14:52:36 user nova-compute[70924]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 14:52:36 user nova-compute[70924]:       <source file="/opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c/disk"/>
Jul 29 14:52:36 user nova-compute[70924]:       <target dev="vda" bus="virtio"/>
Jul 29 14:52:36 user nova-compute[70924]:     </disk>
Jul 29 14:52:36 user nova-compute[70924]:     <disk type="block" device="disk">
Jul 29 14:52:36 user nova-compute[70924]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:52:36 user nova-compute[70924]:       <source dev="/dev/sde"/>
Jul 29 14:52:36 user nova-compute[70924]:       <target dev="vdb" bus="virtio"/>
Jul 29 14:52:36 user nova-compute[70924]:       <serial>40240a39-c2db-4b14-bc97-0fb20849bdef</serial>
Jul 29 14:52:36 user nova-compute[70924]:     </disk>
Jul 29 14:52:36 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 14:52:36 user nova-compute[70924]:       <mac address="fa:16:3e:90:f1:53"/>
Jul 29 14:52:36 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:52:36 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 14:52:36 user nova-compute[70924]:       <target dev="tapc4a5a7c9-34"/>
Jul 29 14:52:36 user nova-compute[70924]:     </interface>
Jul 29 14:52:36 user nova-compute[70924]:     <serial type="pty">
Jul 29 14:52:36 user nova-compute[70924]:       <log file="/opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c/console.log" append="off"/>
Jul 29 14:52:36 user nova-compute[70924]:     </serial>
Jul 29 14:52:36 user nova-compute[70924]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 14:52:36 user nova-compute[70924]:     <video>
Jul 29 14:52:36 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:52:36 user nova-compute[70924]:     </video>
Jul 29 14:52:36 user nova-compute[70924]:     <rng model="virtio">
Jul 29 14:52:36 user nova-compute[70924]:       <backend model="random">/dev/urandom</backend>
Jul 29 14:52:36 user nova-compute[70924]:     </rng>
Jul 29 14:52:36 user nova-compute[70924]:     <controller type="usb" index="0" model="none"/>
Jul 29 14:52:36 user nova-compute[70924]:     <memballoon model="virtio">
Jul 29 14:52:36 user nova-compute[70924]:       <stats period="10"/>
Jul 29 14:52:36 user nova-compute[70924]:     </memballoon>
Jul 29 14:52:36 user nova-compute[70924]:   </devices>
Jul 29 14:52:36 user nova-compute[70924]: </domain>
Jul 29 14:52:36 user nova-compute[70924]:  {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 14:52:36 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:46:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1255761132',display_name='tempest-ServerActionsTestOtherB-server-1255761132',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1255761132',id=18,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIBMm7U7DNUnZfHvCCwqmdK01H/F7FPPtGEiHdQU/UfZbvDiHS9WyDAl4KpLKXM2BWrjymDoAA5PpeT/LkSZzEFYL6ZRKv5TsemED0bunybXK/h2EPtICo6kFvAJz1A93g==',key_name='tempest-keypair-566023039',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:50:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fd007df2b3e04ab784369809178e4240',ramdisk_id='',reservation_id='r-z4t1omey',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-298005467',owner_user_name='tempest-ServerActionsTestOtherB-298005467-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:52:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6e2628064a66492e9f85e99332ac3ceb',uuid=f5350fb5-9460-490b-a47e-74f88c8eb51c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "c4a5a7c9-34d6-4040-87a3-78c4fd26b170", "address": "fa:16:3e:90:f1:53", "network": {"id": "d87dd51f-8870-4dfa-b608-7c4b662219ca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1964327887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd007df2b3e04ab784369809178e4240", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a5a7c9-34", "ovs_interfaceid": "c4a5a7c9-34d6-4040-87a3-78c4fd26b170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 14:52:36 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Converting VIF {"id": "c4a5a7c9-34d6-4040-87a3-78c4fd26b170", "address": "fa:16:3e:90:f1:53", "network": {"id": "d87dd51f-8870-4dfa-b608-7c4b662219ca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1964327887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd007df2b3e04ab784369809178e4240", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a5a7c9-34", "ovs_interfaceid": "c4a5a7c9-34d6-4040-87a3-78c4fd26b170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:52:36 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:f1:53,bridge_name='br-int',has_traffic_filtering=True,id=c4a5a7c9-34d6-4040-87a3-78c4fd26b170,network=Network(d87dd51f-8870-4dfa-b608-7c4b662219ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4a5a7c9-34') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:52:36 user nova-compute[70924]: DEBUG os_vif [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:f1:53,bridge_name='br-int',has_traffic_filtering=True,id=c4a5a7c9-34d6-4040-87a3-78c4fd26b170,network=Network(d87dd51f-8870-4dfa-b608-7c4b662219ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4a5a7c9-34') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 14:52:36 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:36 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:52:36 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 14:52:36 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:36 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc4a5a7c9-34, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:52:36 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc4a5a7c9-34, col_values=(('external_ids', {'iface-id': 'c4a5a7c9-34d6-4040-87a3-78c4fd26b170', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:f1:53', 'vm-uuid': 'f5350fb5-9460-490b-a47e-74f88c8eb51c'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:52:36 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:36 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:52:36 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:36 user nova-compute[70924]: INFO os_vif [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:f1:53,bridge_name='br-int',has_traffic_filtering=True,id=c4a5a7c9-34d6-4040-87a3-78c4fd26b170,network=Network(d87dd51f-8870-4dfa-b608-7c4b662219ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4a5a7c9-34')
Jul 29 14:52:38 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:38 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:38 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:38 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Acquiring lock "bdaf1714-27f9-47ee-808b-206ec78c6067" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:52:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "bdaf1714-27f9-47ee-808b-206ec78c6067" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:52:38 user nova-compute[70924]: INFO nova.compute.manager [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Unshelving
Jul 29 14:52:38 user nova-compute[70924]: INFO nova.virt.block_device [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Booting with volume f56651ac-e14a-456e-8195-3627842873e4 at /dev/vdc
Jul 29 14:52:38 user nova-compute[70924]: DEBUG nova.compute.manager [req-a6d8e6f2-f03d-4fa5-aaef-4e309612e925 req-b54c9de7-ade3-4ff4-9287-0743d8e00fa2 service nova] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Received event network-vif-plugged-c4a5a7c9-34d6-4040-87a3-78c4fd26b170 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:52:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a6d8e6f2-f03d-4fa5-aaef-4e309612e925 req-b54c9de7-ade3-4ff4-9287-0743d8e00fa2 service nova] Acquiring lock "f5350fb5-9460-490b-a47e-74f88c8eb51c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:52:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a6d8e6f2-f03d-4fa5-aaef-4e309612e925 req-b54c9de7-ade3-4ff4-9287-0743d8e00fa2 service nova] Lock "f5350fb5-9460-490b-a47e-74f88c8eb51c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:52:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a6d8e6f2-f03d-4fa5-aaef-4e309612e925 req-b54c9de7-ade3-4ff4-9287-0743d8e00fa2 service nova] Lock "f5350fb5-9460-490b-a47e-74f88c8eb51c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:52:38 user nova-compute[70924]: DEBUG nova.compute.manager [req-a6d8e6f2-f03d-4fa5-aaef-4e309612e925 req-b54c9de7-ade3-4ff4-9287-0743d8e00fa2 service nova] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] No waiting events found dispatching network-vif-plugged-c4a5a7c9-34d6-4040-87a3-78c4fd26b170 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:52:38 user nova-compute[70924]: WARNING nova.compute.manager [req-a6d8e6f2-f03d-4fa5-aaef-4e309612e925 req-b54c9de7-ade3-4ff4-9287-0743d8e00fa2 service nova] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Received unexpected event network-vif-plugged-c4a5a7c9-34d6-4040-87a3-78c4fd26b170 for instance with vm_state resized and task_state resize_reverting.
Jul 29 14:52:38 user nova-compute[70924]: DEBUG os_brick.utils [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:52:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:38 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0976d5-b250-4f03-a2c7-fba7ddf7bf72]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f2127c4a30d9\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:38 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c14594-dbd6-4640-aa2e-506679103f84]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:38 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fcba245-6875-4b17-b1ad-3411e6db57c0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:38 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e494ace-b92a-4cbf-a9a6-30d2ead63fa1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Running cmd (subprocess): nvme version {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] 'nvme version' failed. Not Retrying. {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:52:38 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:38 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.nvmeof [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] nvme not present on system {{(pid=70924) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 14:52:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:52:38 user nova-compute[70924]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 14:52:38 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[180a5072-507e-43dc-9ca4-acb97d3d44d7]: (4, '') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:38 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70924) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 14:52:38 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 14:52:38 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] LIGHTOS: no hostnqn found. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 14:52:38 user nova-compute[70924]: DEBUG os_brick.utils [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] <== get_connector_properties: return (168ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f2127c4a30d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:52:38 user nova-compute[70924]: DEBUG nova.virt.block_device [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Updating existing volume attachment record: 770dad70-c2e9-48c7-b57a-82659027a45a {{(pid=70924) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 14:52:38 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:38 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:39 user nova-compute[70924]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690642344.6807334, f5350fb5-9460-490b-a47e-74f88c8eb51c => Stopped> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:52:39 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] VM Stopped (Lifecycle Event)
Jul 29 14:52:39 user nova-compute[70924]: DEBUG nova.compute.manager [None req-37b48753-4d16-41e2-9c55-5ea73baec5e6 None None] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:52:40 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642360.3078303, f5350fb5-9460-490b-a47e-74f88c8eb51c => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:52:40 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] VM Resumed (Lifecycle Event)
Jul 29 14:52:40 user nova-compute[70924]: DEBUG nova.compute.manager [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Instance event wait completed in 0 seconds for  {{(pid=70924) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 14:52:40 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Instance running successfully.
Jul 29 14:52:40 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] finish_revert_migration finished successfully. {{(pid=70924) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Jul 29 14:52:40 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:52:40 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:52:40 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Jul 29 14:52:40 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642360.3092709, f5350fb5-9460-490b-a47e-74f88c8eb51c => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:52:40 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] VM Started (Lifecycle Event)
Jul 29 14:52:40 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:52:40 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:52:40 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Jul 29 14:52:40 user nova-compute[70924]: INFO nova.compute.manager [None req-bb6c002c-a620-4359-9d4c-06c320f349bd tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Updating instance to original state: 'active'
Jul 29 14:52:40 user nova-compute[70924]: DEBUG nova.compute.manager [req-d04f312f-e325-41b4-911a-48b12266b7ff req-252bd2b4-170a-43e5-a7eb-4a7290df8036 service nova] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Received event network-vif-plugged-c4a5a7c9-34d6-4040-87a3-78c4fd26b170 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:52:40 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-d04f312f-e325-41b4-911a-48b12266b7ff req-252bd2b4-170a-43e5-a7eb-4a7290df8036 service nova] Acquiring lock "f5350fb5-9460-490b-a47e-74f88c8eb51c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:52:40 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-d04f312f-e325-41b4-911a-48b12266b7ff req-252bd2b4-170a-43e5-a7eb-4a7290df8036 service nova] Lock "f5350fb5-9460-490b-a47e-74f88c8eb51c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:52:40 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-d04f312f-e325-41b4-911a-48b12266b7ff req-252bd2b4-170a-43e5-a7eb-4a7290df8036 service nova] Lock "f5350fb5-9460-490b-a47e-74f88c8eb51c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:52:40 user nova-compute[70924]: DEBUG nova.compute.manager [req-d04f312f-e325-41b4-911a-48b12266b7ff req-252bd2b4-170a-43e5-a7eb-4a7290df8036 service nova] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] No waiting events found dispatching network-vif-plugged-c4a5a7c9-34d6-4040-87a3-78c4fd26b170 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:52:40 user nova-compute[70924]: WARNING nova.compute.manager [req-d04f312f-e325-41b4-911a-48b12266b7ff req-252bd2b4-170a-43e5-a7eb-4a7290df8036 service nova] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Received unexpected event network-vif-plugged-c4a5a7c9-34d6-4040-87a3-78c4fd26b170 for instance with vm_state resized and task_state resize_reverting.
Jul 29 14:52:41 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:52:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:52:46 user nova-compute[70924]: DEBUG nova.objects.instance [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lazy-loading 'pci_requests' on Instance uuid bdaf1714-27f9-47ee-808b-206ec78c6067 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:52:46 user nova-compute[70924]: DEBUG nova.objects.instance [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lazy-loading 'numa_topology' on Instance uuid bdaf1714-27f9-47ee-808b-206ec78c6067 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:52:46 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70924) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 14:52:46 user nova-compute[70924]: INFO nova.compute.claims [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Claim successful on node user
Jul 29 14:52:46 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:47 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:52:47 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:52:47 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.685s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:52:47 user nova-compute[70924]: INFO nova.network.neutron [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Updating port d95eba18-cd83-40e6-847a-c36b2e084f89 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Jul 29 14:52:48 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Acquiring lock "refresh_cache-bdaf1714-27f9-47ee-808b-206ec78c6067" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:52:48 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Acquired lock "refresh_cache-bdaf1714-27f9-47ee-808b-206ec78c6067" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:52:48 user nova-compute[70924]: DEBUG nova.network.neutron [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 14:52:48 user nova-compute[70924]: DEBUG nova.compute.manager [req-24e57c9a-75c5-4e31-91e7-d87c1ccb55ed req-7f5b9561-22f7-41f2-bb03-3ac46f2ad814 service nova] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Received event network-changed-d95eba18-cd83-40e6-847a-c36b2e084f89 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:52:48 user nova-compute[70924]: DEBUG nova.compute.manager [req-24e57c9a-75c5-4e31-91e7-d87c1ccb55ed req-7f5b9561-22f7-41f2-bb03-3ac46f2ad814 service nova] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Refreshing instance network info cache due to event network-changed-d95eba18-cd83-40e6-847a-c36b2e084f89. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:52:48 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-24e57c9a-75c5-4e31-91e7-d87c1ccb55ed req-7f5b9561-22f7-41f2-bb03-3ac46f2ad814 service nova] Acquiring lock "refresh_cache-bdaf1714-27f9-47ee-808b-206ec78c6067" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:52:48 user nova-compute[70924]: DEBUG nova.network.neutron [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Updating instance_info_cache with network_info: [{"id": "d95eba18-cd83-40e6-847a-c36b2e084f89", "address": "fa:16:3e:45:15:fc", "network": {"id": "ff833b6e-b3ce-44ac-88ec-775f193cdfe4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-546934977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f5f9f30926f47afad3cb4c9e89d55c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd95eba18-cd", "ovs_interfaceid": "d95eba18-cd83-40e6-847a-c36b2e084f89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:52:48 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Releasing lock "refresh_cache-bdaf1714-27f9-47ee-808b-206ec78c6067" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:52:48 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Creating instance directory {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 14:52:48 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Creating image(s)
Jul 29 14:52:48 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Acquiring lock "/opt/stack/data/nova/instances/bdaf1714-27f9-47ee-808b-206ec78c6067/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:52:48 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "/opt/stack/data/nova/instances/bdaf1714-27f9-47ee-808b-206ec78c6067/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:52:48 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "/opt/stack/data/nova/instances/bdaf1714-27f9-47ee-808b-206ec78c6067/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:52:48 user nova-compute[70924]: DEBUG nova.objects.instance [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lazy-loading 'trusted_certs' on Instance uuid bdaf1714-27f9-47ee-808b-206ec78c6067 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:52:48 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-24e57c9a-75c5-4e31-91e7-d87c1ccb55ed req-7f5b9561-22f7-41f2-bb03-3ac46f2ad814 service nova] Acquired lock "refresh_cache-bdaf1714-27f9-47ee-808b-206ec78c6067" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:52:48 user nova-compute[70924]: DEBUG nova.network.neutron [req-24e57c9a-75c5-4e31-91e7-d87c1ccb55ed req-7f5b9561-22f7-41f2-bb03-3ac46f2ad814 service nova] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Refreshing network info cache for port d95eba18-cd83-40e6-847a-c36b2e084f89 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:52:48 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Acquiring lock "c325354c6f96ae6ca58201cc6312f0237ea2d2bf" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:52:48 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "c325354c6f96ae6ca58201cc6312f0237ea2d2bf" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:52:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c325354c6f96ae6ca58201cc6312f0237ea2d2bf.part --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c325354c6f96ae6ca58201cc6312f0237ea2d2bf.part --force-share --output=json" returned: 0 in 0.153s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:49 user nova-compute[70924]: DEBUG nova.virt.images [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] 24784092-a866-4b07-b0dc-41421ee6964a was qcow2, converting to raw {{(pid=70924) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 29 14:52:49 user nova-compute[70924]: DEBUG nova.privsep.utils [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70924) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 29 14:52:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c325354c6f96ae6ca58201cc6312f0237ea2d2bf.part /opt/stack/data/nova/instances/_base/c325354c6f96ae6ca58201cc6312f0237ea2d2bf.converted {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:50 user nova-compute[70924]: DEBUG nova.network.neutron [req-24e57c9a-75c5-4e31-91e7-d87c1ccb55ed req-7f5b9561-22f7-41f2-bb03-3ac46f2ad814 service nova] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Updated VIF entry in instance network info cache for port d95eba18-cd83-40e6-847a-c36b2e084f89. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:52:50 user nova-compute[70924]: DEBUG nova.network.neutron [req-24e57c9a-75c5-4e31-91e7-d87c1ccb55ed req-7f5b9561-22f7-41f2-bb03-3ac46f2ad814 service nova] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Updating instance_info_cache with network_info: [{"id": "d95eba18-cd83-40e6-847a-c36b2e084f89", "address": "fa:16:3e:45:15:fc", "network": {"id": "ff833b6e-b3ce-44ac-88ec-775f193cdfe4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-546934977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f5f9f30926f47afad3cb4c9e89d55c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd95eba18-cd", "ovs_interfaceid": "d95eba18-cd83-40e6-847a-c36b2e084f89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:52:50 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-24e57c9a-75c5-4e31-91e7-d87c1ccb55ed req-7f5b9561-22f7-41f2-bb03-3ac46f2ad814 service nova] Releasing lock "refresh_cache-bdaf1714-27f9-47ee-808b-206ec78c6067" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:52:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c325354c6f96ae6ca58201cc6312f0237ea2d2bf.part /opt/stack/data/nova/instances/_base/c325354c6f96ae6ca58201cc6312f0237ea2d2bf.converted" returned: 0 in 0.274s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c325354c6f96ae6ca58201cc6312f0237ea2d2bf.converted --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:50 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:52:50 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:52:50 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:52:50 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:52:50 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:52:50 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Auditing locally available compute resources for user (node: user) {{(pid=70924) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 14:52:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c325354c6f96ae6ca58201cc6312f0237ea2d2bf.converted --force-share --output=json" returned: 0 in 0.170s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:50 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "c325354c6f96ae6ca58201cc6312f0237ea2d2bf" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.691s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:52:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c325354c6f96ae6ca58201cc6312f0237ea2d2bf --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c325354c6f96ae6ca58201cc6312f0237ea2d2bf --force-share --output=json" returned: 0 in 0.159s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:50 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Acquiring lock "c325354c6f96ae6ca58201cc6312f0237ea2d2bf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:52:50 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "c325354c6f96ae6ca58201cc6312f0237ea2d2bf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:52:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c325354c6f96ae6ca58201cc6312f0237ea2d2bf --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c325354c6f96ae6ca58201cc6312f0237ea2d2bf --force-share --output=json" returned: 0 in 0.144s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c325354c6f96ae6ca58201cc6312f0237ea2d2bf,backing_fmt=raw /opt/stack/data/nova/instances/bdaf1714-27f9-47ee-808b-206ec78c6067/disk 1073741824 {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c325354c6f96ae6ca58201cc6312f0237ea2d2bf,backing_fmt=raw /opt/stack/data/nova/instances/bdaf1714-27f9-47ee-808b-206ec78c6067/disk 1073741824" returned: 0 in 0.048s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:50 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "c325354c6f96ae6ca58201cc6312f0237ea2d2bf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.199s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:52:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c325354c6f96ae6ca58201cc6312f0237ea2d2bf --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c325354c6f96ae6ca58201cc6312f0237ea2d2bf --force-share --output=json" returned: 0 in 0.158s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:50 user nova-compute[70924]: DEBUG nova.objects.instance [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lazy-loading 'migration_context' on Instance uuid bdaf1714-27f9-47ee-808b-206ec78c6067 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:52:51 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Rebasing disk image.
Jul 29 14:52:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:51 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 14:52:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c31a724f-3006-4e5d-a9b5-847fd6cd170a/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.131s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 -F raw /opt/stack/data/nova/instances/bdaf1714-27f9-47ee-808b-206ec78c6067/disk {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c31a724f-3006-4e5d-a9b5-847fd6cd170a/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c31a724f-3006-4e5d-a9b5-847fd6cd170a/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c31a724f-3006-4e5d-a9b5-847fd6cd170a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:51 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 14:52:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:51 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:52:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:52 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:52 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 14:52:52 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f7989ca-77e9-440f-bd2f-60e46e005557/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:52 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f7989ca-77e9-440f-bd2f-60e46e005557/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:52 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f7989ca-77e9-440f-bd2f-60e46e005557/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:52 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f7989ca-77e9-440f-bd2f-60e46e005557/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:52 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7171083a-00aa-4faf-9732-88cab8a0d83d/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:52 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7171083a-00aa-4faf-9732-88cab8a0d83d/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:52 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7171083a-00aa-4faf-9732-88cab8a0d83d/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:52 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7171083a-00aa-4faf-9732-88cab8a0d83d/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:52 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cb12b3e-de44-4887-ab74-2a68164b5f7d/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:52 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:52 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cb12b3e-de44-4887-ab74-2a68164b5f7d/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:52 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cb12b3e-de44-4887-ab74-2a68164b5f7d/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cb12b3e-de44-4887-ab74-2a68164b5f7d/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 -F raw /opt/stack/data/nova/instances/bdaf1714-27f9-47ee-808b-206ec78c6067/disk" returned: 0 in 1.948s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Created local disks {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Ensure instance console log exists: /opt/stack/data/nova/instances/bdaf1714-27f9-47ee-808b-206ec78c6067/console.log {{(pid=70924) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Start _get_guest_xml network_info=[{"id": "d95eba18-cd83-40e6-847a-c36b2e084f89", "address": "fa:16:3e:45:15:fc", "network": {"id": "ff833b6e-b3ce-44ac-88ec-775f193cdfe4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-546934977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f5f9f30926f47afad3cb4c9e89d55c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd95eba18-cd", "ovs_interfaceid": "d95eba18-cd83-40e6-847a-c36b2e084f89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='aecd4bfc2a780f602e198c80020cba2c',container_format='bare',created_at=2023-07-29T14:50:45Z,direct_url=<?>,disk_format='qcow2',id=24784092-a866-4b07-b0dc-41421ee6964a,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-54166973-shelved',owner='6f5f9f30926f47afad3cb4c9e89d55c5',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-07-29T14:50:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '3aba2e73-6832-404b-8bd0-d0503ce82b8c'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdc', 'boot_index': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OonHpJYc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'bdaf1714-27f9-47ee-808b-206ec78c6067', 'attached_at': '', 'detached_at': '', 'volume_id': 'f56651ac-e14a-456e-8195-3627842873e4', 'serial': 'f56651ac-e14a-456e-8195-3627842873e4'}, 'attachment_id': '770dad70-c2e9-48c7-b57a-82659027a45a', 'volume_type': None} {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 14:52:53 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:52:53 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:52:53 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] CPU controller missing on host. {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] CPU controller found on host. {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70924) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T14:36:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='aecd4bfc2a780f602e198c80020cba2c',container_format='bare',created_at=2023-07-29T14:50:45Z,direct_url=<?>,disk_format='qcow2',id=24784092-a866-4b07-b0dc-41421ee6964a,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-54166973-shelved',owner='6f5f9f30926f47afad3cb4c9e89d55c5',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-07-29T14:50:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Flavor limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Image limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Flavor pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Image pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Got 1 possible topologies {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG nova.objects.instance [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lazy-loading 'vcpu_model' on Instance uuid bdaf1714-27f9-47ee-808b-206ec78c6067 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Calling os-brick to attach iSCSI Volume {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OonHpJYc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:52:53 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:52:53 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:52:53 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:52:53 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:52:53 user nova-compute[70924]: INFO os_brick.initiator.connectors.iscsi [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 14:52:53 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4 -p 172.16.0.220:3260 {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f59b95c2-8111-471a-af39-e71bb7da909a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 14:52:53 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4 -p 172.16.0.220:3260 --interface default --op new {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8990350-bfe1-478b-9dea-e1778bf9b2de]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4] added\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4] added
Jul 29 14:52:53 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[3173e8f3-7e4d-40da-9afb-9660b13725cb]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[45439e49-a886-4746-93f8-3b644fd19c18]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OonHpJYc {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OonHpJYc" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3aafec-5d52-45af-9875-8c8310a92775]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OonHpJYc'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b96f18-1f4d-4b7a-bab9-8b622d628be5]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk.rescue --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d18760a-65bb-4679-ab42-b381d8f71fa3]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:52:53 user nova-compute[70924]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:52:53 user nova-compute[70924]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)
Jul 29 14:52:53 user nova-compute[70924]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)
Jul 29 14:52:53 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:52:53 user nova-compute[70924]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:52:53 user nova-compute[70924]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)
Jul 29 14:52:53 user nova-compute[70924]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)
Jul 29 14:52:53 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4 -p 172.16.0.220:3260 --login {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4 -p 172.16.0.220:3260 --login" returned: 0 in 0.099s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed44ac10-41da-48e2-be06-01dfdcb7ed1e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4, portal: 172.16.0.220,3260]
Jul 29 14:52:53 user nova-compute[70924]: Login to [iface: default, target: iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4, portal: 172.16.0.220,3260] successful.
Jul 29 14:52:53 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk.rescue --force-share --output=json" returned: 0 in 0.162s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk.rescue --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa672013-22ec-4491-9b79-72dac9d2dff1]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[43148eef-024d-49f4-957c-e627949a8311]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:52:53 user nova-compute[70924]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:52:53 user nova-compute[70924]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)
Jul 29 14:52:53 user nova-compute[70924]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)
Jul 29 14:52:53 user nova-compute[70924]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4 (non-flash)
Jul 29 14:52:53 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:52:53 user nova-compute[70924]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:52:53 user nova-compute[70924]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)
Jul 29 14:52:53 user nova-compute[70924]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)
Jul 29 14:52:53 user nova-compute[70924]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4 (non-flash)
Jul 29 14:52:53 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.446s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Connected to 172.16.0.220:3260 {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] HCTL ('37', '-', '-', 0) found on session 34 with lun 0 {{(pid=70924) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=70924) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.030s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22916d0-8964-495e-adab-4f017db41888]: (4, ('- - 0', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Searching for a device in session 34 and hctl ['37', '*', '*', 0] yield: None {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk.rescue --force-share --output=json" returned: 0 in 0.163s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:53 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:54 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:54 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:52:54 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:52:54 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Hypervisor/Node resource view: name=user free_ram=7239MB free_disk=25.202991485595703GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70924) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 14:52:54 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:52:54 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:52:54 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Searching for a device in session 34 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 14:52:54 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OonHpJYc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 14:52:54 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.491s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:52:54 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] <== connect_volume: return (1494ms) {'type': 'block', 'scsi_wwn': '23239653439343465', 'path': '/dev/sdf'} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:52:54 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23239653439343465', 'path': '/dev/sdf'} {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 14:52:54 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-29T14:48:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-54166973',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-54166973',id=22,image_ref='24784092-a866-4b07-b0dc-41421ee6964a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1998502930',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:48:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='6f5f9f30926f47afad3cb4c9e89d55c5',ramdisk_id='',reservation_id='r-zgo1dppv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-130200384',owner_user_name='tempest-AttachVolumeShelveTestJSON-130200384-project-member',shelved_at='2023-07-29T14:50:50.604172',shelved_host='user',shelved_image_id='24784092-a866-4b07-b0dc-41421ee6964a'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:52:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c9562451ffa45b2aad975335d83fa8c',uuid=bdaf1714-27f9-47ee-808b-206ec78c6067,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d95eba18-cd83-40e6-847a-c36b2e084f89", "address": "fa:16:3e:45:15:fc", "network": {"id": "ff833b6e-b3ce-44ac-88ec-775f193cdfe4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-546934977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f5f9f30926f47afad3cb4c9e89d55c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd95eba18-cd", "ovs_interfaceid": "d95eba18-cd83-40e6-847a-c36b2e084f89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:52:54 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Converting VIF {"id": "d95eba18-cd83-40e6-847a-c36b2e084f89", "address": "fa:16:3e:45:15:fc", "network": {"id": "ff833b6e-b3ce-44ac-88ec-775f193cdfe4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-546934977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f5f9f30926f47afad3cb4c9e89d55c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd95eba18-cd", "ovs_interfaceid": "d95eba18-cd83-40e6-847a-c36b2e084f89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:52:54 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:15:fc,bridge_name='br-int',has_traffic_filtering=True,id=d95eba18-cd83-40e6-847a-c36b2e084f89,network=Network(ff833b6e-b3ce-44ac-88ec-775f193cdfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd95eba18-cd') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:52:54 user nova-compute[70924]: DEBUG nova.objects.instance [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lazy-loading 'pci_devices' on Instance uuid bdaf1714-27f9-47ee-808b-206ec78c6067 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:52:54 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] End _get_guest_xml xml=<domain type="kvm">
Jul 29 14:52:54 user nova-compute[70924]:   <uuid>bdaf1714-27f9-47ee-808b-206ec78c6067</uuid>
Jul 29 14:52:54 user nova-compute[70924]:   <name>instance-00000016</name>
Jul 29 14:52:54 user nova-compute[70924]:   <memory>524288</memory>
Jul 29 14:52:54 user nova-compute[70924]:   <vcpu>1</vcpu>
Jul 29 14:52:54 user nova-compute[70924]:   <metadata>
Jul 29 14:52:54 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 14:52:54 user nova-compute[70924]:       <nova:package version="0.0.0"/>
Jul 29 14:52:54 user nova-compute[70924]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-54166973</nova:name>
Jul 29 14:52:54 user nova-compute[70924]:       <nova:creationTime>2023-07-29 14:52:53</nova:creationTime>
Jul 29 14:52:54 user nova-compute[70924]:       <nova:flavor name="m1.tiny">
Jul 29 14:52:54 user nova-compute[70924]:         <nova:memory>512</nova:memory>
Jul 29 14:52:54 user nova-compute[70924]:         <nova:disk>1</nova:disk>
Jul 29 14:52:54 user nova-compute[70924]:         <nova:swap>0</nova:swap>
Jul 29 14:52:54 user nova-compute[70924]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 14:52:54 user nova-compute[70924]:         <nova:vcpus>1</nova:vcpus>
Jul 29 14:52:54 user nova-compute[70924]:       </nova:flavor>
Jul 29 14:52:54 user nova-compute[70924]:       <nova:owner>
Jul 29 14:52:54 user nova-compute[70924]:         <nova:user uuid="7c9562451ffa45b2aad975335d83fa8c">tempest-AttachVolumeShelveTestJSON-130200384-project-member</nova:user>
Jul 29 14:52:54 user nova-compute[70924]:         <nova:project uuid="6f5f9f30926f47afad3cb4c9e89d55c5">tempest-AttachVolumeShelveTestJSON-130200384</nova:project>
Jul 29 14:52:54 user nova-compute[70924]:       </nova:owner>
Jul 29 14:52:54 user nova-compute[70924]:       <nova:root type="image" uuid="24784092-a866-4b07-b0dc-41421ee6964a"/>
Jul 29 14:52:54 user nova-compute[70924]:       <nova:ports>
Jul 29 14:52:54 user nova-compute[70924]:         <nova:port uuid="d95eba18-cd83-40e6-847a-c36b2e084f89">
Jul 29 14:52:54 user nova-compute[70924]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 29 14:52:54 user nova-compute[70924]:         </nova:port>
Jul 29 14:52:54 user nova-compute[70924]:       </nova:ports>
Jul 29 14:52:54 user nova-compute[70924]:     </nova:instance>
Jul 29 14:52:54 user nova-compute[70924]:   </metadata>
Jul 29 14:52:54 user nova-compute[70924]:   <sysinfo type="smbios">
Jul 29 14:52:54 user nova-compute[70924]:     <system>
Jul 29 14:52:54 user nova-compute[70924]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 14:52:54 user nova-compute[70924]:       <entry name="product">OpenStack Nova</entry>
Jul 29 14:52:54 user nova-compute[70924]:       <entry name="version">0.0.0</entry>
Jul 29 14:52:54 user nova-compute[70924]:       <entry name="serial">bdaf1714-27f9-47ee-808b-206ec78c6067</entry>
Jul 29 14:52:54 user nova-compute[70924]:       <entry name="uuid">bdaf1714-27f9-47ee-808b-206ec78c6067</entry>
Jul 29 14:52:54 user nova-compute[70924]:       <entry name="family">Virtual Machine</entry>
Jul 29 14:52:54 user nova-compute[70924]:     </system>
Jul 29 14:52:54 user nova-compute[70924]:   </sysinfo>
Jul 29 14:52:54 user nova-compute[70924]:   <os>
Jul 29 14:52:54 user nova-compute[70924]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 14:52:54 user nova-compute[70924]:     <boot dev="hd"/>
Jul 29 14:52:54 user nova-compute[70924]:     <smbios mode="sysinfo"/>
Jul 29 14:52:54 user nova-compute[70924]:   </os>
Jul 29 14:52:54 user nova-compute[70924]:   <features>
Jul 29 14:52:54 user nova-compute[70924]:     <acpi/>
Jul 29 14:52:54 user nova-compute[70924]:     <apic/>
Jul 29 14:52:54 user nova-compute[70924]:     <vmcoreinfo/>
Jul 29 14:52:54 user nova-compute[70924]:   </features>
Jul 29 14:52:54 user nova-compute[70924]:   <clock offset="utc">
Jul 29 14:52:54 user nova-compute[70924]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 14:52:54 user nova-compute[70924]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 14:52:54 user nova-compute[70924]:     <timer name="hpet" present="no"/>
Jul 29 14:52:54 user nova-compute[70924]:   </clock>
Jul 29 14:52:54 user nova-compute[70924]:   <cpu mode="custom" match="exact">
Jul 29 14:52:54 user nova-compute[70924]:     <model>Nehalem</model>
Jul 29 14:52:54 user nova-compute[70924]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 14:52:54 user nova-compute[70924]:   </cpu>
Jul 29 14:52:54 user nova-compute[70924]:   <devices>
Jul 29 14:52:54 user nova-compute[70924]:     <disk type="file" device="disk">
Jul 29 14:52:54 user nova-compute[70924]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 14:52:54 user nova-compute[70924]:       <source file="/opt/stack/data/nova/instances/bdaf1714-27f9-47ee-808b-206ec78c6067/disk"/>
Jul 29 14:52:54 user nova-compute[70924]:       <target dev="vda" bus="virtio"/>
Jul 29 14:52:54 user nova-compute[70924]:     </disk>
Jul 29 14:52:54 user nova-compute[70924]:     <disk type="block" device="disk">
Jul 29 14:52:54 user nova-compute[70924]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:52:54 user nova-compute[70924]:       <source dev="/dev/sdf"/>
Jul 29 14:52:54 user nova-compute[70924]:       <target dev="vdc" bus="virtio"/>
Jul 29 14:52:54 user nova-compute[70924]:       <serial>f56651ac-e14a-456e-8195-3627842873e4</serial>
Jul 29 14:52:54 user nova-compute[70924]:     </disk>
Jul 29 14:52:54 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 14:52:54 user nova-compute[70924]:       <mac address="fa:16:3e:45:15:fc"/>
Jul 29 14:52:54 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:52:54 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 14:52:54 user nova-compute[70924]:       <target dev="tapd95eba18-cd"/>
Jul 29 14:52:54 user nova-compute[70924]:     </interface>
Jul 29 14:52:54 user nova-compute[70924]:     <serial type="pty">
Jul 29 14:52:54 user nova-compute[70924]:       <log file="/opt/stack/data/nova/instances/bdaf1714-27f9-47ee-808b-206ec78c6067/console.log" append="off"/>
Jul 29 14:52:54 user nova-compute[70924]:     </serial>
Jul 29 14:52:54 user nova-compute[70924]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 14:52:54 user nova-compute[70924]:     <video>
Jul 29 14:52:54 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:52:54 user nova-compute[70924]:     </video>
Jul 29 14:52:54 user nova-compute[70924]:     <rng model="virtio">
Jul 29 14:52:54 user nova-compute[70924]:       <backend model="random">/dev/urandom</backend>
Jul 29 14:52:54 user nova-compute[70924]:     </rng>
Jul 29 14:52:54 user nova-compute[70924]:     <controller type="usb" index="0" model="none"/>
Jul 29 14:52:54 user nova-compute[70924]:     <memballoon model="virtio">
Jul 29 14:52:54 user nova-compute[70924]:       <stats period="10"/>
Jul 29 14:52:54 user nova-compute[70924]:     </memballoon>
Jul 29 14:52:54 user nova-compute[70924]:   </devices>
Jul 29 14:52:54 user nova-compute[70924]: </domain>
Jul 29 14:52:54 user nova-compute[70924]:  {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 14:52:54 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-29T14:48:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-54166973',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-54166973',id=22,image_ref='24784092-a866-4b07-b0dc-41421ee6964a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1998502930',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:48:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='6f5f9f30926f47afad3cb4c9e89d55c5',ramdisk_id='',reservation_id='r-zgo1dppv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-130200384',owner_user_name='tempest-AttachVolumeShelveTestJSON-130200384-project-member',shelved_at='2023-07-29T14:50:50.604172',shelved_host='user',shelved_image_id='24784092-a866-4b07-b0dc-41421ee6964a'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:52:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c9562451ffa45b2aad975335d83fa8c',uuid=bdaf1714-27f9-47ee-808b-206ec78c6067,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d95eba18-cd83-40e6-847a-c36b2e084f89", "address": "fa:16:3e:45:15:fc", "network": {"id": "ff833b6e-b3ce-44ac-88ec-775f193cdfe4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-546934977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f5f9f30926f47afad3cb4c9e89d55c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd95eba18-cd", "ovs_interfaceid": "d95eba18-cd83-40e6-847a-c36b2e084f89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 14:52:54 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Converting VIF {"id": "d95eba18-cd83-40e6-847a-c36b2e084f89", "address": "fa:16:3e:45:15:fc", "network": {"id": "ff833b6e-b3ce-44ac-88ec-775f193cdfe4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-546934977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f5f9f30926f47afad3cb4c9e89d55c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd95eba18-cd", "ovs_interfaceid": "d95eba18-cd83-40e6-847a-c36b2e084f89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:52:54 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:15:fc,bridge_name='br-int',has_traffic_filtering=True,id=d95eba18-cd83-40e6-847a-c36b2e084f89,network=Network(ff833b6e-b3ce-44ac-88ec-775f193cdfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd95eba18-cd') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:52:54 user nova-compute[70924]: DEBUG os_vif [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:15:fc,bridge_name='br-int',has_traffic_filtering=True,id=d95eba18-cd83-40e6-847a-c36b2e084f89,network=Network(ff833b6e-b3ce-44ac-88ec-775f193cdfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd95eba18-cd') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 14:52:54 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:54 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:52:54 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 14:52:54 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:54 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd95eba18-cd, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:52:54 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd95eba18-cd, col_values=(('external_ids', {'iface-id': 'd95eba18-cd83-40e6-847a-c36b2e084f89', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:15:fc', 'vm-uuid': 'bdaf1714-27f9-47ee-808b-206ec78c6067'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:52:54 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:54 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:54 user nova-compute[70924]: INFO os_vif [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:15:fc,bridge_name='br-int',has_traffic_filtering=True,id=d95eba18-cd83-40e6-847a-c36b2e084f89,network=Network(ff833b6e-b3ce-44ac-88ec-775f193cdfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd95eba18-cd')
Jul 29 14:52:54 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Applying migration context for instance fd57baf8-6306-4553-a058-e915fb543405 as it has an incoming, in-progress migration 89fefda8-4f7a-4616-af61-9c8f1289c480. Migration status is finished {{(pid=70924) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Jul 29 14:52:54 user nova-compute[70924]: INFO nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: fd57baf8-6306-4553-a058-e915fb543405] Updating resource usage from migration 89fefda8-4f7a-4616-af61-9c8f1289c480
Jul 29 14:52:54 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance db656346-c4af-43da-9600-fd39f1b9e4dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:52:54 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 86ecc6cb-88a8-4572-8e41-d4c5859036a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:52:54 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 02c75b00-a1b4-4ef9-ae96-bc67d8038589 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:52:54 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 1f7989ca-77e9-440f-bd2f-60e46e005557 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:52:54 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 7cb12b3e-de44-4887-ab74-2a68164b5f7d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:52:54 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 7171083a-00aa-4faf-9732-88cab8a0d83d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:52:54 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 9ec07c62-951b-4e3a-bffa-e01dfb4665ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:52:54 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 091e384f-7851-4ac9-b566-990df0497fc5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:52:54 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance c31a724f-3006-4e5d-a9b5-847fd6cd170a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:52:54 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance f5350fb5-9460-490b-a47e-74f88c8eb51c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:52:54 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Migration 89fefda8-4f7a-4616-af61-9c8f1289c480 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Jul 29 14:52:54 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance fd57baf8-6306-4553-a058-e915fb543405 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:52:54 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (e285c8ee-f39c-4daa-8d15-3de9c4f5f832): {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Jul 29 14:52:54 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 14:52:54 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 14:52:54 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:52:54 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] No BDM found with device name vdc, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:52:54 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] No VIF found with MAC fa:16:3e:45:15:fc, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:52:55 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:52:55 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:52:55 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Compute_service record updated for user:user {{(pid=70924) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 14:52:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.621s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:52:55 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:56 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:56 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:56 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:56 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:56 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:52:56 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:52:56 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:52:56 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:52:56 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:52:56 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70924) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 14:52:56 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:52:56 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Starting heal instance info cache {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 14:52:56 user nova-compute[70924]: DEBUG nova.compute.manager [req-6b6dce8d-ebc3-47b5-9bcd-80c6e29802f4 req-c084e748-fcb4-4123-8516-a710340d0c15 service nova] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Received event network-vif-plugged-d95eba18-cd83-40e6-847a-c36b2e084f89 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:52:56 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-6b6dce8d-ebc3-47b5-9bcd-80c6e29802f4 req-c084e748-fcb4-4123-8516-a710340d0c15 service nova] Acquiring lock "bdaf1714-27f9-47ee-808b-206ec78c6067-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:52:56 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-6b6dce8d-ebc3-47b5-9bcd-80c6e29802f4 req-c084e748-fcb4-4123-8516-a710340d0c15 service nova] Lock "bdaf1714-27f9-47ee-808b-206ec78c6067-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:52:56 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-6b6dce8d-ebc3-47b5-9bcd-80c6e29802f4 req-c084e748-fcb4-4123-8516-a710340d0c15 service nova] Lock "bdaf1714-27f9-47ee-808b-206ec78c6067-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:52:56 user nova-compute[70924]: DEBUG nova.compute.manager [req-6b6dce8d-ebc3-47b5-9bcd-80c6e29802f4 req-c084e748-fcb4-4123-8516-a710340d0c15 service nova] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] No waiting events found dispatching network-vif-plugged-d95eba18-cd83-40e6-847a-c36b2e084f89 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:52:56 user nova-compute[70924]: WARNING nova.compute.manager [req-6b6dce8d-ebc3-47b5-9bcd-80c6e29802f4 req-c084e748-fcb4-4123-8516-a710340d0c15 service nova] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Received unexpected event network-vif-plugged-d95eba18-cd83-40e6-847a-c36b2e084f89 for instance with vm_state shelved_offloaded and task_state spawning.
Jul 29 14:52:56 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "refresh_cache-1f7989ca-77e9-440f-bd2f-60e46e005557" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:52:56 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquired lock "refresh_cache-1f7989ca-77e9-440f-bd2f-60e46e005557" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:52:56 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Forcefully refreshing network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 29 14:52:56 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:56 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:57 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Updating instance_info_cache with network_info: [{"id": "4fdb3c78-791e-4638-8def-ec63abfa254d", "address": "fa:16:3e:09:43:b7", "network": {"id": "14a35b1f-254b-4eae-8c5f-d18ab7e0cb3c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1329518083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4a2f0557d16467f8f1c7f8a2890e9e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fdb3c78-79", "ovs_interfaceid": "4fdb3c78-791e-4638-8def-ec63abfa254d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:52:57 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Releasing lock "refresh_cache-1f7989ca-77e9-440f-bd2f-60e46e005557" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:52:57 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Updated the network info_cache for instance {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 29 14:52:58 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:52:58 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:52:58 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642378.5101755, bdaf1714-27f9-47ee-808b-206ec78c6067 => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:52:58 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] VM Resumed (Lifecycle Event)
Jul 29 14:52:58 user nova-compute[70924]: DEBUG nova.compute.manager [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Instance event wait completed in 0 seconds for  {{(pid=70924) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 14:52:58 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Guest created on hypervisor {{(pid=70924) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 14:52:58 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Instance spawned successfully.
Jul 29 14:52:58 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:52:58 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:52:58 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:52:58 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642378.5106072, bdaf1714-27f9-47ee-808b-206ec78c6067 => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:52:58 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] VM Started (Lifecycle Event)
Jul 29 14:52:58 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:52:58 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:52:58 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:52:58 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:52:58 user nova-compute[70924]: DEBUG nova.compute.manager [req-017c1db4-3f94-43be-8f28-acb957f2cf93 req-030d7b56-35b7-4d05-b9c7-d2cdf97e114a service nova] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Received event network-vif-plugged-d95eba18-cd83-40e6-847a-c36b2e084f89 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:52:58 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-017c1db4-3f94-43be-8f28-acb957f2cf93 req-030d7b56-35b7-4d05-b9c7-d2cdf97e114a service nova] Acquiring lock "bdaf1714-27f9-47ee-808b-206ec78c6067-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:52:58 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-017c1db4-3f94-43be-8f28-acb957f2cf93 req-030d7b56-35b7-4d05-b9c7-d2cdf97e114a service nova] Lock "bdaf1714-27f9-47ee-808b-206ec78c6067-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:52:58 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-017c1db4-3f94-43be-8f28-acb957f2cf93 req-030d7b56-35b7-4d05-b9c7-d2cdf97e114a service nova] Lock "bdaf1714-27f9-47ee-808b-206ec78c6067-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:52:58 user nova-compute[70924]: DEBUG nova.compute.manager [req-017c1db4-3f94-43be-8f28-acb957f2cf93 req-030d7b56-35b7-4d05-b9c7-d2cdf97e114a service nova] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] No waiting events found dispatching network-vif-plugged-d95eba18-cd83-40e6-847a-c36b2e084f89 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:52:58 user nova-compute[70924]: WARNING nova.compute.manager [req-017c1db4-3f94-43be-8f28-acb957f2cf93 req-030d7b56-35b7-4d05-b9c7-d2cdf97e114a service nova] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Received unexpected event network-vif-plugged-d95eba18-cd83-40e6-847a-c36b2e084f89 for instance with vm_state shelved_offloaded and task_state spawning.
Jul 29 14:52:58 user nova-compute[70924]: DEBUG nova.compute.manager [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:52:58 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-08ad1a0b-3561-4eb9-a5cb-033f4a6d8898 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "bdaf1714-27f9-47ee-808b-206ec78c6067" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 20.478s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:52:59 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-d6745b04-11b7-4255-b6ee-76f02474d985 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Acquiring lock "1f7989ca-77e9-440f-bd2f-60e46e005557" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:52:59 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-d6745b04-11b7-4255-b6ee-76f02474d985 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lock "1f7989ca-77e9-440f-bd2f-60e46e005557" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:52:59 user nova-compute[70924]: DEBUG nova.objects.instance [None req-d6745b04-11b7-4255-b6ee-76f02474d985 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lazy-loading 'flavor' on Instance uuid 1f7989ca-77e9-440f-bd2f-60e46e005557 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:52:59 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-d6745b04-11b7-4255-b6ee-76f02474d985 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lock "1f7989ca-77e9-440f-bd2f-60e46e005557" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.090s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:52:59 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-d6745b04-11b7-4255-b6ee-76f02474d985 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Acquiring lock "1f7989ca-77e9-440f-bd2f-60e46e005557" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:52:59 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-d6745b04-11b7-4255-b6ee-76f02474d985 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lock "1f7989ca-77e9-440f-bd2f-60e46e005557" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:52:59 user nova-compute[70924]: INFO nova.compute.manager [None req-d6745b04-11b7-4255-b6ee-76f02474d985 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Attaching volume 11cecc2d-0f0a-459b-a8e1-a0fff2e76278 to /dev/vdb
Jul 29 14:52:59 user nova-compute[70924]: DEBUG os_brick.utils [None req-d6745b04-11b7-4255-b6ee-76f02474d985 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:52:59 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:59 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:59 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b956006c-a6cc-42fe-8645-d4e4db8178ca]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f2127c4a30d9\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:59 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:59 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:59 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[07378e86-42f2-4b35-b76b-4ab7a2a9dada]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:59 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:59 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:52:59 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be24e49-e2f2-4ba0-8e3b-fc902e96788d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:59 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[98882512-26ff-4fc1-aa24-48b461ef024a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:59 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-d6745b04-11b7-4255-b6ee-76f02474d985 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Running cmd (subprocess): nvme version {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:59 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-d6745b04-11b7-4255-b6ee-76f02474d985 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] 'nvme version' failed. Not Retrying. {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:52:59 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d6745b04-11b7-4255-b6ee-76f02474d985 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] nvme not present on system {{(pid=70924) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 14:52:59 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:52:59 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:52:59 user nova-compute[70924]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 14:52:59 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[421a9674-344e-4142-adc2-5f9836c31a09]: (4, '') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:52:59 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-d6745b04-11b7-4255-b6ee-76f02474d985 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70924) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 14:52:59 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-d6745b04-11b7-4255-b6ee-76f02474d985 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 14:52:59 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-d6745b04-11b7-4255-b6ee-76f02474d985 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] LIGHTOS: no hostnqn found. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 14:52:59 user nova-compute[70924]: DEBUG os_brick.utils [None req-d6745b04-11b7-4255-b6ee-76f02474d985 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f2127c4a30d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:52:59 user nova-compute[70924]: DEBUG nova.virt.block_device [None req-d6745b04-11b7-4255-b6ee-76f02474d985 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Updating existing volume attachment record: 7acbaca8-53ee-47db-b6e4-aaa22eb9e6f2 {{(pid=70924) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 14:52:59 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:53:00 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:53:03 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:53:03 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:53:04 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:53:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Acquiring lock "710f0d5a-8420-49c4-bf70-27305dd85bd3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:53:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lock "710f0d5a-8420-49c4-bf70-27305dd85bd3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:53:07 user nova-compute[70924]: DEBUG nova.compute.manager [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Starting instance... {{(pid=70924) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 14:53:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:53:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:53:07 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70924) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 14:53:07 user nova-compute[70924]: INFO nova.compute.claims [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Claim successful on node user
Jul 29 14:53:07 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6745b04-11b7-4255-b6ee-76f02474d985 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Calling os-brick to attach iSCSI Volume {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 14:53:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6745b04-11b7-4255-b6ee-76f02474d985 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:11cecc2d-0f0a-459b-a8e1-a0fff2e76278'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zagELUrM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:53:07 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-d6745b04-11b7-4255-b6ee-76f02474d985 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:53:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-d6745b04-11b7-4255-b6ee-76f02474d985 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:53:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-d6745b04-11b7-4255-b6ee-76f02474d985 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:53:07 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-d6745b04-11b7-4255-b6ee-76f02474d985 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:53:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-d6745b04-11b7-4255-b6ee-76f02474d985 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11cecc2d-0f0a-459b-a8e1-a0fff2e76278" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:53:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-d6745b04-11b7-4255-b6ee-76f02474d985 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11cecc2d-0f0a-459b-a8e1-a0fff2e76278" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:53:07 user nova-compute[70924]: INFO os_brick.initiator.connectors.iscsi [None req-d6745b04-11b7-4255-b6ee-76f02474d985 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 14:53:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11cecc2d-0f0a-459b-a8e1-a0fff2e76278 -p 172.16.0.220:3260 {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11cecc2d-0f0a-459b-a8e1-a0fff2e76278 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:07 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[a041a4c7-f3d2-4bf6-92cb-2f4ee6ad5224]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:53:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6745b04-11b7-4255-b6ee-76f02474d985 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 14:53:07 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:53:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11cecc2d-0f0a-459b-a8e1-a0fff2e76278 -p 172.16.0.220:3260 --interface default --op new {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11cecc2d-0f0a-459b-a8e1-a0fff2e76278 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:07 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[143c71e8-2ca9-4321-b37b-679e07a0b49d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:11cecc2d-0f0a-459b-a8e1-a0fff2e76278] added\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:53:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6745b04-11b7-4255-b6ee-76f02474d985 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:11cecc2d-0f0a-459b-a8e1-a0fff2e76278] added
Jul 29 14:53:07 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:53:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11cecc2d-0f0a-459b-a8e1-a0fff2e76278 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11cecc2d-0f0a-459b-a8e1-a0fff2e76278 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:07 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f74a3b7-b39c-405f-9586-07f6ce078b8e]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:53:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6745b04-11b7-4255-b6ee-76f02474d985 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:53:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11cecc2d-0f0a-459b-a8e1-a0fff2e76278 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11cecc2d-0f0a-459b-a8e1-a0fff2e76278 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:07 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f17a03-fb7c-4473-874d-1281cd9f4dfd]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:53:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6745b04-11b7-4255-b6ee-76f02474d985 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:53:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11cecc2d-0f0a-459b-a8e1-a0fff2e76278 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zagELUrM {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11cecc2d-0f0a-459b-a8e1-a0fff2e76278 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zagELUrM" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:07 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2788c0f-f71d-454f-808f-1987d448d0f4]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:53:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6745b04-11b7-4255-b6ee-76f02474d985 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zagELUrM'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:53:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11cecc2d-0f0a-459b-a8e1-a0fff2e76278 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11cecc2d-0f0a-459b-a8e1-a0fff2e76278 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:07 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e7f3df-cd16-40ca-b123-ada9c2fd8f80]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:53:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6745b04-11b7-4255-b6ee-76f02474d985 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:53:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:07 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa4482a9-1a5f-4741-80d8-fd1d7a1145fc]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:53:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6745b04-11b7-4255-b6ee-76f02474d985 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:53:07 user nova-compute[70924]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:53:07 user nova-compute[70924]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)
Jul 29 14:53:07 user nova-compute[70924]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)
Jul 29 14:53:07 user nova-compute[70924]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4 (non-flash)
Jul 29 14:53:07 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:53:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6745b04-11b7-4255-b6ee-76f02474d985 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:53:07 user nova-compute[70924]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:53:07 user nova-compute[70924]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)
Jul 29 14:53:07 user nova-compute[70924]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)
Jul 29 14:53:07 user nova-compute[70924]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4 (non-flash)
Jul 29 14:53:07 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:53:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11cecc2d-0f0a-459b-a8e1-a0fff2e76278 -p 172.16.0.220:3260 --login {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11cecc2d-0f0a-459b-a8e1-a0fff2e76278 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:07 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf5229a-e0c4-420d-a660-a4845c2355ce]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:11cecc2d-0f0a-459b-a8e1-a0fff2e76278, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:11cecc2d-0f0a-459b-a8e1-a0fff2e76278, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:53:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6745b04-11b7-4255-b6ee-76f02474d985 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:11cecc2d-0f0a-459b-a8e1-a0fff2e76278, portal: 172.16.0.220,3260]
Jul 29 14:53:07 user nova-compute[70924]: Login to [iface: default, target: iqn.2010-10.org.openstack:11cecc2d-0f0a-459b-a8e1-a0fff2e76278, portal: 172.16.0.220,3260] successful.
Jul 29 14:53:07 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:53:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11cecc2d-0f0a-459b-a8e1-a0fff2e76278 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11cecc2d-0f0a-459b-a8e1-a0fff2e76278 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:07 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1605c6-4a26-4063-b8ea-891460cca4c2]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:53:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6745b04-11b7-4255-b6ee-76f02474d985 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:53:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:08 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1f4028-1ab9-408a-a9e0-6818bd8723ff]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11cecc2d-0f0a-459b-a8e1-a0fff2e76278 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:53:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6745b04-11b7-4255-b6ee-76f02474d985 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:53:08 user nova-compute[70924]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:53:08 user nova-compute[70924]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)
Jul 29 14:53:08 user nova-compute[70924]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)
Jul 29 14:53:08 user nova-compute[70924]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4 (non-flash)
Jul 29 14:53:08 user nova-compute[70924]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11cecc2d-0f0a-459b-a8e1-a0fff2e76278 (non-flash)
Jul 29 14:53:08 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:53:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6745b04-11b7-4255-b6ee-76f02474d985 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:53:08 user nova-compute[70924]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:53:08 user nova-compute[70924]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)
Jul 29 14:53:08 user nova-compute[70924]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)
Jul 29 14:53:08 user nova-compute[70924]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4 (non-flash)
Jul 29 14:53:08 user nova-compute[70924]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11cecc2d-0f0a-459b-a8e1-a0fff2e76278 (non-flash)
Jul 29 14:53:08 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:53:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-d6745b04-11b7-4255-b6ee-76f02474d985 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11cecc2d-0f0a-459b-a8e1-a0fff2e76278" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:53:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6745b04-11b7-4255-b6ee-76f02474d985 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Connected to 172.16.0.220:3260 {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 14:53:08 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-d6745b04-11b7-4255-b6ee-76f02474d985 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] HCTL ('38', '-', '-', 0) found on session 35 with lun 0 {{(pid=70924) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 14:53:08 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-d6745b04-11b7-4255-b6ee-76f02474d985 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=70924) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 14:53:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:08 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f4f011-f3c7-475a-a8f1-d7cd72be8a47]: (4, ('- - 0', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:53:08 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-d6745b04-11b7-4255-b6ee-76f02474d985 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Searching for a device in session 35 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 14:53:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6745b04-11b7-4255-b6ee-76f02474d985 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zagELUrM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 14:53:08 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:53:08 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:53:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.586s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:53:08 user nova-compute[70924]: DEBUG nova.compute.manager [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Start building networks asynchronously for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 14:53:08 user nova-compute[70924]: DEBUG nova.compute.manager [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Allocating IP information in the background. {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 14:53:08 user nova-compute[70924]: DEBUG nova.network.neutron [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] allocate_for_instance() {{(pid=70924) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 14:53:08 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 14:53:08 user nova-compute[70924]: DEBUG nova.compute.manager [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Start building block device mappings for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 14:53:08 user nova-compute[70924]: DEBUG nova.policy [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7aa9677ce659431db31a0e513277d692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a03844d646454b6ea55e1b5625f7909a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70924) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 14:53:08 user nova-compute[70924]: DEBUG nova.compute.manager [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Start spawning the instance on the hypervisor. {{(pid=70924) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 14:53:08 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Creating instance directory {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 14:53:08 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Creating image(s)
Jul 29 14:53:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Acquiring lock "/opt/stack/data/nova/instances/710f0d5a-8420-49c4-bf70-27305dd85bd3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:53:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lock "/opt/stack/data/nova/instances/710f0d5a-8420-49c4-bf70-27305dd85bd3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:53:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lock "/opt/stack/data/nova/instances/710f0d5a-8420-49c4-bf70-27305dd85bd3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:53:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Acquiring lock "5a4ae6046779fbcd27dd45012e98584ad882af3a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:53:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lock "5a4ae6046779fbcd27dd45012e98584ad882af3a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:53:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4ae6046779fbcd27dd45012e98584ad882af3a.part --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:53:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4ae6046779fbcd27dd45012e98584ad882af3a.part --force-share --output=json" returned: 0 in 0.161s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:09 user nova-compute[70924]: DEBUG nova.virt.images [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] 8f3dcf97-8b65-45cb-b52e-bff81d80db70 was qcow2, converting to raw {{(pid=70924) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 29 14:53:09 user nova-compute[70924]: DEBUG nova.privsep.utils [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70924) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 29 14:53:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5a4ae6046779fbcd27dd45012e98584ad882af3a.part /opt/stack/data/nova/instances/_base/5a4ae6046779fbcd27dd45012e98584ad882af3a.converted {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:09 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-d6745b04-11b7-4255-b6ee-76f02474d985 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:53:09 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6745b04-11b7-4255-b6ee-76f02474d985 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '23334323530383731', 'path': '/dev/sdg'} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:53:09 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6745b04-11b7-4255-b6ee-76f02474d985 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334323530383731', 'path': '/dev/sdg'} {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 14:53:09 user nova-compute[70924]: DEBUG nova.network.neutron [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Successfully created port: fa798159-0d64-40e0-8418-5889396f6a5f {{(pid=70924) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 14:53:09 user nova-compute[70924]: DEBUG nova.objects.instance [None req-d6745b04-11b7-4255-b6ee-76f02474d985 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lazy-loading 'flavor' on Instance uuid 1f7989ca-77e9-440f-bd2f-60e46e005557 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:53:09 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-d6745b04-11b7-4255-b6ee-76f02474d985 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] attach device xml: <disk type="block" device="disk">
Jul 29 14:53:09 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:53:09 user nova-compute[70924]:   <source dev="/dev/sdg"/>
Jul 29 14:53:09 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 14:53:09 user nova-compute[70924]:   <serial>11cecc2d-0f0a-459b-a8e1-a0fff2e76278</serial>
Jul 29 14:53:09 user nova-compute[70924]: </disk>
Jul 29 14:53:09 user nova-compute[70924]:  {{(pid=70924) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 29 14:53:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5a4ae6046779fbcd27dd45012e98584ad882af3a.part /opt/stack/data/nova/instances/_base/5a4ae6046779fbcd27dd45012e98584ad882af3a.converted" returned: 0 in 0.232s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4ae6046779fbcd27dd45012e98584ad882af3a.converted --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4ae6046779fbcd27dd45012e98584ad882af3a.converted --force-share --output=json" returned: 0 in 0.141s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lock "5a4ae6046779fbcd27dd45012e98584ad882af3a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.956s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:53:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4ae6046779fbcd27dd45012e98584ad882af3a --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:09 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-d6745b04-11b7-4255-b6ee-76f02474d985 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:53:09 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-d6745b04-11b7-4255-b6ee-76f02474d985 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:53:09 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-d6745b04-11b7-4255-b6ee-76f02474d985 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] No VIF found with MAC fa:16:3e:09:43:b7, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:53:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4ae6046779fbcd27dd45012e98584ad882af3a --force-share --output=json" returned: 0 in 0.147s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Acquiring lock "5a4ae6046779fbcd27dd45012e98584ad882af3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:53:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lock "5a4ae6046779fbcd27dd45012e98584ad882af3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:53:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4ae6046779fbcd27dd45012e98584ad882af3a --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4ae6046779fbcd27dd45012e98584ad882af3a --force-share --output=json" returned: 0 in 0.153s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-d6745b04-11b7-4255-b6ee-76f02474d985 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lock "1f7989ca-77e9-440f-bd2f-60e46e005557" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.090s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:53:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4ae6046779fbcd27dd45012e98584ad882af3a,backing_fmt=raw /opt/stack/data/nova/instances/710f0d5a-8420-49c4-bf70-27305dd85bd3/disk 1073741824 {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5a4ae6046779fbcd27dd45012e98584ad882af3a,backing_fmt=raw /opt/stack/data/nova/instances/710f0d5a-8420-49c4-bf70-27305dd85bd3/disk 1073741824" returned: 0 in 0.051s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lock "5a4ae6046779fbcd27dd45012e98584ad882af3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.215s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:53:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4ae6046779fbcd27dd45012e98584ad882af3a --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:53:09 user nova-compute[70924]: DEBUG nova.network.neutron [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Successfully updated port: fa798159-0d64-40e0-8418-5889396f6a5f {{(pid=70924) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 14:53:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Acquiring lock "refresh_cache-710f0d5a-8420-49c4-bf70-27305dd85bd3" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:53:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Acquired lock "refresh_cache-710f0d5a-8420-49c4-bf70-27305dd85bd3" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:53:09 user nova-compute[70924]: DEBUG nova.network.neutron [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 14:53:09 user nova-compute[70924]: DEBUG nova.compute.manager [req-b5cadd75-0f68-408d-b4fe-3c247e6304c5 req-28c5e129-983a-4610-b918-f13ba68007fa service nova] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Received event network-changed-fa798159-0d64-40e0-8418-5889396f6a5f {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:53:09 user nova-compute[70924]: DEBUG nova.compute.manager [req-b5cadd75-0f68-408d-b4fe-3c247e6304c5 req-28c5e129-983a-4610-b918-f13ba68007fa service nova] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Refreshing instance network info cache due to event network-changed-fa798159-0d64-40e0-8418-5889396f6a5f. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:53:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b5cadd75-0f68-408d-b4fe-3c247e6304c5 req-28c5e129-983a-4610-b918-f13ba68007fa service nova] Acquiring lock "refresh_cache-710f0d5a-8420-49c4-bf70-27305dd85bd3" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:53:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4ae6046779fbcd27dd45012e98584ad882af3a --force-share --output=json" returned: 0 in 0.143s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:09 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Checking if we can resize image /opt/stack/data/nova/instances/710f0d5a-8420-49c4-bf70-27305dd85bd3/disk. size=1073741824 {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 14:53:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710f0d5a-8420-49c4-bf70-27305dd85bd3/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:09 user nova-compute[70924]: DEBUG nova.network.neutron [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Instance cache missing network info. {{(pid=70924) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 14:53:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710f0d5a-8420-49c4-bf70-27305dd85bd3/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:10 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Cannot resize image /opt/stack/data/nova/instances/710f0d5a-8420-49c4-bf70-27305dd85bd3/disk to a smaller size. {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 14:53:10 user nova-compute[70924]: DEBUG nova.objects.instance [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lazy-loading 'migration_context' on Instance uuid 710f0d5a-8420-49c4-bf70-27305dd85bd3 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:53:10 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Created local disks {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 14:53:10 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Ensure instance console log exists: /opt/stack/data/nova/instances/710f0d5a-8420-49c4-bf70-27305dd85bd3/console.log {{(pid=70924) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 14:53:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:53:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:53:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:53:10 user nova-compute[70924]: DEBUG nova.network.neutron [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Updating instance_info_cache with network_info: [{"id": "fa798159-0d64-40e0-8418-5889396f6a5f", "address": "fa:16:3e:67:60:2e", "network": {"id": "21a19801-8526-40a2-9bcb-dda6cfb435fe", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-761511746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a03844d646454b6ea55e1b5625f7909a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa798159-0d", "ovs_interfaceid": "fa798159-0d64-40e0-8418-5889396f6a5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:53:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Releasing lock "refresh_cache-710f0d5a-8420-49c4-bf70-27305dd85bd3" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:53:10 user nova-compute[70924]: DEBUG nova.compute.manager [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Instance network_info: |[{"id": "fa798159-0d64-40e0-8418-5889396f6a5f", "address": "fa:16:3e:67:60:2e", "network": {"id": "21a19801-8526-40a2-9bcb-dda6cfb435fe", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-761511746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a03844d646454b6ea55e1b5625f7909a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa798159-0d", "ovs_interfaceid": "fa798159-0d64-40e0-8418-5889396f6a5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 14:53:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b5cadd75-0f68-408d-b4fe-3c247e6304c5 req-28c5e129-983a-4610-b918-f13ba68007fa service nova] Acquired lock "refresh_cache-710f0d5a-8420-49c4-bf70-27305dd85bd3" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:53:10 user nova-compute[70924]: DEBUG nova.network.neutron [req-b5cadd75-0f68-408d-b4fe-3c247e6304c5 req-28c5e129-983a-4610-b918-f13ba68007fa service nova] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Refreshing network info cache for port fa798159-0d64-40e0-8418-5889396f6a5f {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:53:10 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Start _get_guest_xml network_info=[{"id": "fa798159-0d64-40e0-8418-5889396f6a5f", "address": "fa:16:3e:67:60:2e", "network": {"id": "21a19801-8526-40a2-9bcb-dda6cfb435fe", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-761511746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a03844d646454b6ea55e1b5625f7909a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa798159-0d", "ovs_interfaceid": "fa798159-0d64-40e0-8418-5889396f6a5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:53:05Z,direct_url=<?>,disk_format='qcow2',id=8f3dcf97-8b65-45cb-b52e-bff81d80db70,min_disk=0,min_ram=0,name='tempest-scenario-img--1580546372',owner='a03844d646454b6ea55e1b5625f7909a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:53:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '8f3dcf97-8b65-45cb-b52e-bff81d80db70'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 14:53:10 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:53:10 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:53:10 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 14:53:10 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] CPU controller missing on host. {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 14:53:10 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 14:53:10 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] CPU controller found on host. {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 14:53:10 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70924) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 14:53:10 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T14:36:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:53:05Z,direct_url=<?>,disk_format='qcow2',id=8f3dcf97-8b65-45cb-b52e-bff81d80db70,min_disk=0,min_ram=0,name='tempest-scenario-img--1580546372',owner='a03844d646454b6ea55e1b5625f7909a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:53:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 14:53:10 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Flavor limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 14:53:10 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Image limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 14:53:10 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Flavor pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 14:53:10 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Image pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 14:53:10 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 14:53:10 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 14:53:10 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 14:53:10 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Got 1 possible topologies {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 14:53:10 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 14:53:10 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 14:53:10 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:53:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-813512746',display_name='tempest-TestMinimumBasicScenario-server-813512746',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-813512746',id=30,image_ref='8f3dcf97-8b65-45cb-b52e-bff81d80db70',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA76T/51PTdIphAR5vmKjW5tUtLn/sQuimAbsDwwFMd+B+5p2qZFOwSM1z2S0WxRqwOdkFbLSkcByFgSatE660bvOjkxrQaY0j/lDrcZkHXhqDCNe3n8ezCtGkqt/N+vPw==',key_name='tempest-TestMinimumBasicScenario-2130533388',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a03844d646454b6ea55e1b5625f7909a',ramdisk_id='',reservation_id='r-idexnh0b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8f3dcf97-8b65-45cb-b52e-bff81d80db70',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-944069199',owner_user_name='tempest-TestMinimumBasicScenario-944069199-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:53:08Z,user_data=None,user_id='7aa9677ce659431db31a0e513277d692',uuid=710f0d5a-8420-49c4-bf70-27305dd85bd3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa798159-0d64-40e0-8418-5889396f6a5f", "address": "fa:16:3e:67:60:2e", "network": {"id": "21a19801-8526-40a2-9bcb-dda6cfb435fe", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-761511746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a03844d646454b6ea55e1b5625f7909a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa798159-0d", "ovs_interfaceid": "fa798159-0d64-40e0-8418-5889396f6a5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:53:10 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Converting VIF {"id": "fa798159-0d64-40e0-8418-5889396f6a5f", "address": "fa:16:3e:67:60:2e", "network": {"id": "21a19801-8526-40a2-9bcb-dda6cfb435fe", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-761511746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a03844d646454b6ea55e1b5625f7909a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa798159-0d", "ovs_interfaceid": "fa798159-0d64-40e0-8418-5889396f6a5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:53:10 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:60:2e,bridge_name='br-int',has_traffic_filtering=True,id=fa798159-0d64-40e0-8418-5889396f6a5f,network=Network(21a19801-8526-40a2-9bcb-dda6cfb435fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa798159-0d') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:53:10 user nova-compute[70924]: DEBUG nova.objects.instance [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lazy-loading 'pci_devices' on Instance uuid 710f0d5a-8420-49c4-bf70-27305dd85bd3 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:53:10 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] End _get_guest_xml xml=<domain type="kvm">
Jul 29 14:53:10 user nova-compute[70924]:   <uuid>710f0d5a-8420-49c4-bf70-27305dd85bd3</uuid>
Jul 29 14:53:10 user nova-compute[70924]:   <name>instance-0000001e</name>
Jul 29 14:53:10 user nova-compute[70924]:   <memory>524288</memory>
Jul 29 14:53:10 user nova-compute[70924]:   <vcpu>1</vcpu>
Jul 29 14:53:10 user nova-compute[70924]:   <metadata>
Jul 29 14:53:10 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 14:53:10 user nova-compute[70924]:       <nova:package version="0.0.0"/>
Jul 29 14:53:10 user nova-compute[70924]:       <nova:name>tempest-TestMinimumBasicScenario-server-813512746</nova:name>
Jul 29 14:53:10 user nova-compute[70924]:       <nova:creationTime>2023-07-29 14:53:10</nova:creationTime>
Jul 29 14:53:10 user nova-compute[70924]:       <nova:flavor name="m1.tiny">
Jul 29 14:53:10 user nova-compute[70924]:         <nova:memory>512</nova:memory>
Jul 29 14:53:10 user nova-compute[70924]:         <nova:disk>1</nova:disk>
Jul 29 14:53:10 user nova-compute[70924]:         <nova:swap>0</nova:swap>
Jul 29 14:53:10 user nova-compute[70924]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 14:53:10 user nova-compute[70924]:         <nova:vcpus>1</nova:vcpus>
Jul 29 14:53:10 user nova-compute[70924]:       </nova:flavor>
Jul 29 14:53:10 user nova-compute[70924]:       <nova:owner>
Jul 29 14:53:10 user nova-compute[70924]:         <nova:user uuid="7aa9677ce659431db31a0e513277d692">tempest-TestMinimumBasicScenario-944069199-project-member</nova:user>
Jul 29 14:53:10 user nova-compute[70924]:         <nova:project uuid="a03844d646454b6ea55e1b5625f7909a">tempest-TestMinimumBasicScenario-944069199</nova:project>
Jul 29 14:53:10 user nova-compute[70924]:       </nova:owner>
Jul 29 14:53:10 user nova-compute[70924]:       <nova:root type="image" uuid="8f3dcf97-8b65-45cb-b52e-bff81d80db70"/>
Jul 29 14:53:10 user nova-compute[70924]:       <nova:ports>
Jul 29 14:53:10 user nova-compute[70924]:         <nova:port uuid="fa798159-0d64-40e0-8418-5889396f6a5f">
Jul 29 14:53:10 user nova-compute[70924]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 29 14:53:10 user nova-compute[70924]:         </nova:port>
Jul 29 14:53:10 user nova-compute[70924]:       </nova:ports>
Jul 29 14:53:10 user nova-compute[70924]:     </nova:instance>
Jul 29 14:53:10 user nova-compute[70924]:   </metadata>
Jul 29 14:53:10 user nova-compute[70924]:   <sysinfo type="smbios">
Jul 29 14:53:10 user nova-compute[70924]:     <system>
Jul 29 14:53:10 user nova-compute[70924]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 14:53:10 user nova-compute[70924]:       <entry name="product">OpenStack Nova</entry>
Jul 29 14:53:10 user nova-compute[70924]:       <entry name="version">0.0.0</entry>
Jul 29 14:53:10 user nova-compute[70924]:       <entry name="serial">710f0d5a-8420-49c4-bf70-27305dd85bd3</entry>
Jul 29 14:53:10 user nova-compute[70924]:       <entry name="uuid">710f0d5a-8420-49c4-bf70-27305dd85bd3</entry>
Jul 29 14:53:10 user nova-compute[70924]:       <entry name="family">Virtual Machine</entry>
Jul 29 14:53:10 user nova-compute[70924]:     </system>
Jul 29 14:53:10 user nova-compute[70924]:   </sysinfo>
Jul 29 14:53:10 user nova-compute[70924]:   <os>
Jul 29 14:53:10 user nova-compute[70924]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 14:53:10 user nova-compute[70924]:     <boot dev="hd"/>
Jul 29 14:53:10 user nova-compute[70924]:     <smbios mode="sysinfo"/>
Jul 29 14:53:10 user nova-compute[70924]:   </os>
Jul 29 14:53:10 user nova-compute[70924]:   <features>
Jul 29 14:53:10 user nova-compute[70924]:     <acpi/>
Jul 29 14:53:10 user nova-compute[70924]:     <apic/>
Jul 29 14:53:10 user nova-compute[70924]:     <vmcoreinfo/>
Jul 29 14:53:10 user nova-compute[70924]:   </features>
Jul 29 14:53:10 user nova-compute[70924]:   <clock offset="utc">
Jul 29 14:53:10 user nova-compute[70924]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 14:53:10 user nova-compute[70924]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 14:53:10 user nova-compute[70924]:     <timer name="hpet" present="no"/>
Jul 29 14:53:10 user nova-compute[70924]:   </clock>
Jul 29 14:53:10 user nova-compute[70924]:   <cpu mode="custom" match="exact">
Jul 29 14:53:10 user nova-compute[70924]:     <model>Nehalem</model>
Jul 29 14:53:10 user nova-compute[70924]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 14:53:10 user nova-compute[70924]:   </cpu>
Jul 29 14:53:10 user nova-compute[70924]:   <devices>
Jul 29 14:53:10 user nova-compute[70924]:     <disk type="file" device="disk">
Jul 29 14:53:10 user nova-compute[70924]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 14:53:10 user nova-compute[70924]:       <source file="/opt/stack/data/nova/instances/710f0d5a-8420-49c4-bf70-27305dd85bd3/disk"/>
Jul 29 14:53:10 user nova-compute[70924]:       <target dev="vda" bus="virtio"/>
Jul 29 14:53:10 user nova-compute[70924]:     </disk>
Jul 29 14:53:10 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 14:53:10 user nova-compute[70924]:       <mac address="fa:16:3e:67:60:2e"/>
Jul 29 14:53:10 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:53:10 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 14:53:10 user nova-compute[70924]:       <target dev="tapfa798159-0d"/>
Jul 29 14:53:10 user nova-compute[70924]:     </interface>
Jul 29 14:53:10 user nova-compute[70924]:     <serial type="pty">
Jul 29 14:53:10 user nova-compute[70924]:       <log file="/opt/stack/data/nova/instances/710f0d5a-8420-49c4-bf70-27305dd85bd3/console.log" append="off"/>
Jul 29 14:53:10 user nova-compute[70924]:     </serial>
Jul 29 14:53:10 user nova-compute[70924]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 14:53:10 user nova-compute[70924]:     <video>
Jul 29 14:53:10 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:53:10 user nova-compute[70924]:     </video>
Jul 29 14:53:10 user nova-compute[70924]:     <rng model="virtio">
Jul 29 14:53:10 user nova-compute[70924]:       <backend model="random">/dev/urandom</backend>
Jul 29 14:53:10 user nova-compute[70924]:     </rng>
Jul 29 14:53:10 user nova-compute[70924]:     <controller type="usb" index="0" model="none"/>
Jul 29 14:53:10 user nova-compute[70924]:     <memballoon model="virtio">
Jul 29 14:53:10 user nova-compute[70924]:       <stats period="10"/>
Jul 29 14:53:10 user nova-compute[70924]:     </memballoon>
Jul 29 14:53:10 user nova-compute[70924]:   </devices>
Jul 29 14:53:10 user nova-compute[70924]: </domain>
Jul 29 14:53:10 user nova-compute[70924]:  {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 14:53:10 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:53:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-813512746',display_name='tempest-TestMinimumBasicScenario-server-813512746',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-813512746',id=30,image_ref='8f3dcf97-8b65-45cb-b52e-bff81d80db70',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA76T/51PTdIphAR5vmKjW5tUtLn/sQuimAbsDwwFMd+B+5p2qZFOwSM1z2S0WxRqwOdkFbLSkcByFgSatE660bvOjkxrQaY0j/lDrcZkHXhqDCNe3n8ezCtGkqt/N+vPw==',key_name='tempest-TestMinimumBasicScenario-2130533388',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a03844d646454b6ea55e1b5625f7909a',ramdisk_id='',reservation_id='r-idexnh0b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8f3dcf97-8b65-45cb-b52e-bff81d80db70',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-944069199',owner_user_name='tempest-TestMinimumBasicScenario-944069199-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:53:08Z,user_data=None,user_id='7aa9677ce659431db31a0e513277d692',uuid=710f0d5a-8420-49c4-bf70-27305dd85bd3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa798159-0d64-40e0-8418-5889396f6a5f", "address": "fa:16:3e:67:60:2e", "network": {"id": "21a19801-8526-40a2-9bcb-dda6cfb435fe", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-761511746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a03844d646454b6ea55e1b5625f7909a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa798159-0d", "ovs_interfaceid": "fa798159-0d64-40e0-8418-5889396f6a5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 14:53:10 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Converting VIF {"id": "fa798159-0d64-40e0-8418-5889396f6a5f", "address": "fa:16:3e:67:60:2e", "network": {"id": "21a19801-8526-40a2-9bcb-dda6cfb435fe", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-761511746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a03844d646454b6ea55e1b5625f7909a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa798159-0d", "ovs_interfaceid": "fa798159-0d64-40e0-8418-5889396f6a5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:53:10 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:60:2e,bridge_name='br-int',has_traffic_filtering=True,id=fa798159-0d64-40e0-8418-5889396f6a5f,network=Network(21a19801-8526-40a2-9bcb-dda6cfb435fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa798159-0d') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:53:10 user nova-compute[70924]: DEBUG os_vif [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:60:2e,bridge_name='br-int',has_traffic_filtering=True,id=fa798159-0d64-40e0-8418-5889396f6a5f,network=Network(21a19801-8526-40a2-9bcb-dda6cfb435fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa798159-0d') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 14:53:10 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:53:10 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:53:10 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 14:53:10 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:53:10 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfa798159-0d, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:53:10 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfa798159-0d, col_values=(('external_ids', {'iface-id': 'fa798159-0d64-40e0-8418-5889396f6a5f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:60:2e', 'vm-uuid': '710f0d5a-8420-49c4-bf70-27305dd85bd3'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:53:10 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:53:10 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:53:10 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:53:10 user nova-compute[70924]: INFO os_vif [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:60:2e,bridge_name='br-int',has_traffic_filtering=True,id=fa798159-0d64-40e0-8418-5889396f6a5f,network=Network(21a19801-8526-40a2-9bcb-dda6cfb435fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa798159-0d')
Jul 29 14:53:10 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:53:10 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] No VIF found with MAC fa:16:3e:67:60:2e, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:53:10 user nova-compute[70924]: DEBUG nova.network.neutron [req-b5cadd75-0f68-408d-b4fe-3c247e6304c5 req-28c5e129-983a-4610-b918-f13ba68007fa service nova] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Updated VIF entry in instance network info cache for port fa798159-0d64-40e0-8418-5889396f6a5f. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:53:10 user nova-compute[70924]: DEBUG nova.network.neutron [req-b5cadd75-0f68-408d-b4fe-3c247e6304c5 req-28c5e129-983a-4610-b918-f13ba68007fa service nova] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Updating instance_info_cache with network_info: [{"id": "fa798159-0d64-40e0-8418-5889396f6a5f", "address": "fa:16:3e:67:60:2e", "network": {"id": "21a19801-8526-40a2-9bcb-dda6cfb435fe", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-761511746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a03844d646454b6ea55e1b5625f7909a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa798159-0d", "ovs_interfaceid": "fa798159-0d64-40e0-8418-5889396f6a5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:53:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b5cadd75-0f68-408d-b4fe-3c247e6304c5 req-28c5e129-983a-4610-b918-f13ba68007fa service nova] Releasing lock "refresh_cache-710f0d5a-8420-49c4-bf70-27305dd85bd3" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:53:11 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:53:11 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:53:11 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:53:11 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:53:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-af4b167b-8a20-4d3a-8385-274b4dd1bf24 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Acquiring lock "1f7989ca-77e9-440f-bd2f-60e46e005557" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:53:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-af4b167b-8a20-4d3a-8385-274b4dd1bf24 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lock "1f7989ca-77e9-440f-bd2f-60e46e005557" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:53:11 user nova-compute[70924]: INFO nova.compute.manager [None req-af4b167b-8a20-4d3a-8385-274b4dd1bf24 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Detaching volume 11cecc2d-0f0a-459b-a8e1-a0fff2e76278
Jul 29 14:53:11 user nova-compute[70924]: INFO nova.virt.block_device [None req-af4b167b-8a20-4d3a-8385-274b4dd1bf24 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Attempting to driver detach volume 11cecc2d-0f0a-459b-a8e1-a0fff2e76278 from mountpoint /dev/vdb
Jul 29 14:53:11 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-af4b167b-8a20-4d3a-8385-274b4dd1bf24 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Attempting to detach device vdb from instance 1f7989ca-77e9-440f-bd2f-60e46e005557 from the persistent domain config. {{(pid=70924) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 29 14:53:11 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-af4b167b-8a20-4d3a-8385-274b4dd1bf24 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 14:53:11 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:53:11 user nova-compute[70924]:   <source dev="/dev/sdg"/>
Jul 29 14:53:11 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 14:53:11 user nova-compute[70924]:   <serial>11cecc2d-0f0a-459b-a8e1-a0fff2e76278</serial>
Jul 29 14:53:11 user nova-compute[70924]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 14:53:11 user nova-compute[70924]: </disk>
Jul 29 14:53:11 user nova-compute[70924]:  {{(pid=70924) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 14:53:11 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-af4b167b-8a20-4d3a-8385-274b4dd1bf24 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Successfully detached device vdb from instance 1f7989ca-77e9-440f-bd2f-60e46e005557 from the persistent domain config.
Jul 29 14:53:11 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-af4b167b-8a20-4d3a-8385-274b4dd1bf24 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1f7989ca-77e9-440f-bd2f-60e46e005557 from the live domain config. {{(pid=70924) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 29 14:53:11 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-af4b167b-8a20-4d3a-8385-274b4dd1bf24 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 14:53:11 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:53:11 user nova-compute[70924]:   <source dev="/dev/sdg"/>
Jul 29 14:53:11 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 14:53:11 user nova-compute[70924]:   <serial>11cecc2d-0f0a-459b-a8e1-a0fff2e76278</serial>
Jul 29 14:53:11 user nova-compute[70924]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 14:53:11 user nova-compute[70924]: </disk>
Jul 29 14:53:11 user nova-compute[70924]:  {{(pid=70924) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 14:53:12 user nova-compute[70924]: DEBUG nova.compute.manager [req-df37d973-30f9-40a3-8484-6c8badeb05a6 req-1d7bb118-e854-4d2d-bf21-1f7ef8500711 service nova] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Received event network-vif-plugged-fa798159-0d64-40e0-8418-5889396f6a5f {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:53:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-df37d973-30f9-40a3-8484-6c8badeb05a6 req-1d7bb118-e854-4d2d-bf21-1f7ef8500711 service nova] Acquiring lock "710f0d5a-8420-49c4-bf70-27305dd85bd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:53:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-df37d973-30f9-40a3-8484-6c8badeb05a6 req-1d7bb118-e854-4d2d-bf21-1f7ef8500711 service nova] Lock "710f0d5a-8420-49c4-bf70-27305dd85bd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:53:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-df37d973-30f9-40a3-8484-6c8badeb05a6 req-1d7bb118-e854-4d2d-bf21-1f7ef8500711 service nova] Lock "710f0d5a-8420-49c4-bf70-27305dd85bd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:53:12 user nova-compute[70924]: DEBUG nova.compute.manager [req-df37d973-30f9-40a3-8484-6c8badeb05a6 req-1d7bb118-e854-4d2d-bf21-1f7ef8500711 service nova] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] No waiting events found dispatching network-vif-plugged-fa798159-0d64-40e0-8418-5889396f6a5f {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:53:12 user nova-compute[70924]: WARNING nova.compute.manager [req-df37d973-30f9-40a3-8484-6c8badeb05a6 req-1d7bb118-e854-4d2d-bf21-1f7ef8500711 service nova] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Received unexpected event network-vif-plugged-fa798159-0d64-40e0-8418-5889396f6a5f for instance with vm_state building and task_state spawning.
Jul 29 14:53:12 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Received event <DeviceRemovedEvent: 1690642392.4384534, 1f7989ca-77e9-440f-bd2f-60e46e005557 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70924) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 29 14:53:12 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-af4b167b-8a20-4d3a-8385-274b4dd1bf24 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1f7989ca-77e9-440f-bd2f-60e46e005557 {{(pid=70924) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 29 14:53:12 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-af4b167b-8a20-4d3a-8385-274b4dd1bf24 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Successfully detached device vdb from instance 1f7989ca-77e9-440f-bd2f-60e46e005557 from the live domain config.
Jul 29 14:53:12 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af4b167b-8a20-4d3a-8385-274b4dd1bf24 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] calling os-brick to detach iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 14:53:12 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-af4b167b-8a20-4d3a-8385-274b4dd1bf24 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, {'target_iqns': ['iqn.2010-10.org.openstack:11cecc2d-0f0a-459b-a8e1-a0fff2e76278'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zagELUrM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:53:12 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-af4b167b-8a20-4d3a-8385-274b4dd1bf24 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:53:12 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-af4b167b-8a20-4d3a-8385-274b4dd1bf24 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:53:12 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-af4b167b-8a20-4d3a-8385-274b4dd1bf24 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:53:12 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-af4b167b-8a20-4d3a-8385-274b4dd1bf24 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11cecc2d-0f0a-459b-a8e1-a0fff2e76278', 0)] {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 14:53:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:12 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:53:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:12 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c697c4-6fb7-4357-b93a-28f61556f7ac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11cecc2d-0f0a-459b-a8e1-a0fff2e76278\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:53:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:12 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:53:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:12 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eaf7a0a-ad81-4218-bfcc-27de67ba8a98]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11cecc2d-0f0a-459b-a8e1-a0fff2e76278 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:53:12 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-af4b167b-8a20-4d3a-8385-274b4dd1bf24 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:53:12 user nova-compute[70924]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:53:12 user nova-compute[70924]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)
Jul 29 14:53:12 user nova-compute[70924]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)
Jul 29 14:53:12 user nova-compute[70924]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4 (non-flash)
Jul 29 14:53:12 user nova-compute[70924]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11cecc2d-0f0a-459b-a8e1-a0fff2e76278 (non-flash)
Jul 29 14:53:12 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:53:12 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-af4b167b-8a20-4d3a-8385-274b4dd1bf24 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:53:12 user nova-compute[70924]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:53:12 user nova-compute[70924]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)
Jul 29 14:53:12 user nova-compute[70924]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)
Jul 29 14:53:12 user nova-compute[70924]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4 (non-flash)
Jul 29 14:53:12 user nova-compute[70924]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11cecc2d-0f0a-459b-a8e1-a0fff2e76278 (non-flash)
Jul 29 14:53:12 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:53:12 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-af4b167b-8a20-4d3a-8385-274b4dd1bf24 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feedc526dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11cecc2d-0f0a-459b-a8e1-a0fff2e76278'): ({'sdg'}, set())}) {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 14:53:12 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-af4b167b-8a20-4d3a-8385-274b4dd1bf24 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Removing single pathed devices sdg {{(pid=70924) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 14:53:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:12 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[254fec9d-b2c1-41f3-93d1-f80218932f6e]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:53:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:12 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[8072675d-30be-4140-a432-ad42156c24be]: (4, ('ok\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:53:12 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-af4b167b-8a20-4d3a-8385-274b4dd1bf24 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Flushing IO for device /dev/sdg {{(pid=70924) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 14:53:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:12 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba83bb3b-db72-4d97-8a4b-61e0e02e3417]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:53:12 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-af4b167b-8a20-4d3a-8385-274b4dd1bf24 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=70924) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 14:53:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.057s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:12 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9181dbdd-c956-4207-aa33-4cb7e9549d96]: (4, ('1', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:53:12 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-af4b167b-8a20-4d3a-8385-274b4dd1bf24 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 14:53:12 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-af4b167b-8a20-4d3a-8385-274b4dd1bf24 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] SCSI volumes sdg have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 14:53:12 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-af4b167b-8a20-4d3a-8385-274b4dd1bf24 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11cecc2d-0f0a-459b-a8e1-a0fff2e76278')] {{(pid=70924) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 14:53:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11cecc2d-0f0a-459b-a8e1-a0fff2e76278 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11cecc2d-0f0a-459b-a8e1-a0fff2e76278 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:12 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f80469b-7ffb-487a-ba5c-cb4391bc76e8]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:53:12 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-af4b167b-8a20-4d3a-8385-274b4dd1bf24 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:53:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11cecc2d-0f0a-459b-a8e1-a0fff2e76278 -p 172.16.0.220:3260 --logout {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11cecc2d-0f0a-459b-a8e1-a0fff2e76278 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:12 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ada61e2-54c6-4262-85c5-e926de788a61]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:11cecc2d-0f0a-459b-a8e1-a0fff2e76278, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:11cecc2d-0f0a-459b-a8e1-a0fff2e76278, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:53:12 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-af4b167b-8a20-4d3a-8385-274b4dd1bf24 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:11cecc2d-0f0a-459b-a8e1-a0fff2e76278, portal: 172.16.0.220,3260]
Jul 29 14:53:12 user nova-compute[70924]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:11cecc2d-0f0a-459b-a8e1-a0fff2e76278, portal: 172.16.0.220,3260] successful.
Jul 29 14:53:12 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:53:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11cecc2d-0f0a-459b-a8e1-a0fff2e76278 -p 172.16.0.220:3260 --op delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11cecc2d-0f0a-459b-a8e1-a0fff2e76278 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:12 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7cb99d-b937-4409-8d78-8d587519798d]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:53:12 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-af4b167b-8a20-4d3a-8385-274b4dd1bf24 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:53:12 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-af4b167b-8a20-4d3a-8385-274b4dd1bf24 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:53:12 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-af4b167b-8a20-4d3a-8385-274b4dd1bf24 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] <== disconnect_volume: return (317ms) None {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:53:12 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af4b167b-8a20-4d3a-8385-274b4dd1bf24 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Disconnected iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 14:53:13 user nova-compute[70924]: DEBUG nova.objects.instance [None req-af4b167b-8a20-4d3a-8385-274b4dd1bf24 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lazy-loading 'flavor' on Instance uuid 1f7989ca-77e9-440f-bd2f-60e46e005557 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:53:13 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-af4b167b-8a20-4d3a-8385-274b4dd1bf24 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lock "1f7989ca-77e9-440f-bd2f-60e46e005557" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.661s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:53:13 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:53:14 user nova-compute[70924]: DEBUG nova.compute.manager [req-a989caa8-47c0-4890-8339-d80e55716fbc req-30daf257-83b5-4771-8e7b-cef42a8b16e8 service nova] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Received event network-vif-plugged-fa798159-0d64-40e0-8418-5889396f6a5f {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:53:14 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a989caa8-47c0-4890-8339-d80e55716fbc req-30daf257-83b5-4771-8e7b-cef42a8b16e8 service nova] Acquiring lock "710f0d5a-8420-49c4-bf70-27305dd85bd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:53:14 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a989caa8-47c0-4890-8339-d80e55716fbc req-30daf257-83b5-4771-8e7b-cef42a8b16e8 service nova] Lock "710f0d5a-8420-49c4-bf70-27305dd85bd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:53:14 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a989caa8-47c0-4890-8339-d80e55716fbc req-30daf257-83b5-4771-8e7b-cef42a8b16e8 service nova] Lock "710f0d5a-8420-49c4-bf70-27305dd85bd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:53:14 user nova-compute[70924]: DEBUG nova.compute.manager [req-a989caa8-47c0-4890-8339-d80e55716fbc req-30daf257-83b5-4771-8e7b-cef42a8b16e8 service nova] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] No waiting events found dispatching network-vif-plugged-fa798159-0d64-40e0-8418-5889396f6a5f {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:53:14 user nova-compute[70924]: WARNING nova.compute.manager [req-a989caa8-47c0-4890-8339-d80e55716fbc req-30daf257-83b5-4771-8e7b-cef42a8b16e8 service nova] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Received unexpected event network-vif-plugged-fa798159-0d64-40e0-8418-5889396f6a5f for instance with vm_state building and task_state spawning.
Jul 29 14:53:14 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642394.2359602, 710f0d5a-8420-49c4-bf70-27305dd85bd3 => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:53:14 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] VM Resumed (Lifecycle Event)
Jul 29 14:53:14 user nova-compute[70924]: DEBUG nova.compute.manager [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Instance event wait completed in 0 seconds for  {{(pid=70924) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 14:53:14 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Guest created on hypervisor {{(pid=70924) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 14:53:14 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Instance spawned successfully.
Jul 29 14:53:14 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 14:53:14 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:53:14 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:53:14 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Found default for hw_cdrom_bus of ide {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:53:14 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Found default for hw_disk_bus of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:53:14 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Found default for hw_input_bus of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:53:14 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Found default for hw_pointer_model of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:53:14 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Found default for hw_video_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:53:14 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Found default for hw_vif_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:53:14 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:53:14 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642394.2373428, 710f0d5a-8420-49c4-bf70-27305dd85bd3 => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:53:14 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] VM Started (Lifecycle Event)
Jul 29 14:53:14 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:53:14 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:53:14 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:53:14 user nova-compute[70924]: INFO nova.compute.manager [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Took 5.91 seconds to spawn the instance on the hypervisor.
Jul 29 14:53:14 user nova-compute[70924]: DEBUG nova.compute.manager [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:53:14 user nova-compute[70924]: INFO nova.compute.manager [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Took 6.84 seconds to build instance.
Jul 29 14:53:14 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-b3205174-8240-4fa0-8172-a683a96b62b8 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lock "710f0d5a-8420-49c4-bf70-27305dd85bd3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.944s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:53:15 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:53:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Acquiring lock "b001d812-892a-4756-9f37-fc0c5ef5f0a7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:53:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "b001d812-892a-4756-9f37-fc0c5ef5f0a7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:53:15 user nova-compute[70924]: DEBUG nova.compute.manager [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Starting instance... {{(pid=70924) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 14:53:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:53:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:53:15 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70924) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 14:53:15 user nova-compute[70924]: INFO nova.compute.claims [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Claim successful on node user
Jul 29 14:53:16 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:53:16 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:53:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.488s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:53:16 user nova-compute[70924]: DEBUG nova.compute.manager [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Start building networks asynchronously for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 14:53:16 user nova-compute[70924]: DEBUG nova.compute.manager [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Allocating IP information in the background. {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 14:53:16 user nova-compute[70924]: DEBUG nova.network.neutron [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] allocate_for_instance() {{(pid=70924) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 14:53:16 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 14:53:16 user nova-compute[70924]: DEBUG nova.compute.manager [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Start building block device mappings for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 14:53:16 user nova-compute[70924]: INFO nova.virt.block_device [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Booting with volume-backed-image 3aba2e73-6832-404b-8bd0-d0503ce82b8c at /dev/vda
Jul 29 14:53:16 user nova-compute[70924]: DEBUG nova.policy [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '43582a8a85c54b5e9d16d11b12bf50d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9e5c78c1684c359cfab4e32b9c213f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70924) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 14:53:17 user nova-compute[70924]: DEBUG nova.network.neutron [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Successfully created port: a17ada4e-69e7-42ef-b08d-f405a5da6368 {{(pid=70924) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 14:53:17 user nova-compute[70924]: DEBUG nova.network.neutron [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Successfully updated port: a17ada4e-69e7-42ef-b08d-f405a5da6368 {{(pid=70924) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 14:53:17 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Acquiring lock "refresh_cache-b001d812-892a-4756-9f37-fc0c5ef5f0a7" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:53:17 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Acquired lock "refresh_cache-b001d812-892a-4756-9f37-fc0c5ef5f0a7" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:53:17 user nova-compute[70924]: DEBUG nova.network.neutron [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 14:53:17 user nova-compute[70924]: DEBUG nova.compute.manager [req-dff49b01-11d4-4a8a-953a-63e00901f7ce req-cdf741eb-58ca-4fd0-8841-008ac1bca084 service nova] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Received event network-changed-a17ada4e-69e7-42ef-b08d-f405a5da6368 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:53:17 user nova-compute[70924]: DEBUG nova.compute.manager [req-dff49b01-11d4-4a8a-953a-63e00901f7ce req-cdf741eb-58ca-4fd0-8841-008ac1bca084 service nova] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Refreshing instance network info cache due to event network-changed-a17ada4e-69e7-42ef-b08d-f405a5da6368. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:53:17 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-dff49b01-11d4-4a8a-953a-63e00901f7ce req-cdf741eb-58ca-4fd0-8841-008ac1bca084 service nova] Acquiring lock "refresh_cache-b001d812-892a-4756-9f37-fc0c5ef5f0a7" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:53:17 user nova-compute[70924]: DEBUG nova.network.neutron [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Instance cache missing network info. {{(pid=70924) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 14:53:18 user nova-compute[70924]: DEBUG nova.network.neutron [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Updating instance_info_cache with network_info: [{"id": "a17ada4e-69e7-42ef-b08d-f405a5da6368", "address": "fa:16:3e:62:06:29", "network": {"id": "d5876e18-e2af-45c2-aab5-2d0d552ebfe4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2035085552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9e5c78c1684c359cfab4e32b9c213f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa17ada4e-69", "ovs_interfaceid": "a17ada4e-69e7-42ef-b08d-f405a5da6368", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:53:18 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Releasing lock "refresh_cache-b001d812-892a-4756-9f37-fc0c5ef5f0a7" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:53:18 user nova-compute[70924]: DEBUG nova.compute.manager [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Instance network_info: |[{"id": "a17ada4e-69e7-42ef-b08d-f405a5da6368", "address": "fa:16:3e:62:06:29", "network": {"id": "d5876e18-e2af-45c2-aab5-2d0d552ebfe4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2035085552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9e5c78c1684c359cfab4e32b9c213f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa17ada4e-69", "ovs_interfaceid": "a17ada4e-69e7-42ef-b08d-f405a5da6368", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 14:53:18 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-dff49b01-11d4-4a8a-953a-63e00901f7ce req-cdf741eb-58ca-4fd0-8841-008ac1bca084 service nova] Acquired lock "refresh_cache-b001d812-892a-4756-9f37-fc0c5ef5f0a7" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:53:18 user nova-compute[70924]: DEBUG nova.network.neutron [req-dff49b01-11d4-4a8a-953a-63e00901f7ce req-cdf741eb-58ca-4fd0-8841-008ac1bca084 service nova] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Refreshing network info cache for port a17ada4e-69e7-42ef-b08d-f405a5da6368 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:53:18 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:53:19 user nova-compute[70924]: DEBUG nova.network.neutron [req-dff49b01-11d4-4a8a-953a-63e00901f7ce req-cdf741eb-58ca-4fd0-8841-008ac1bca084 service nova] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Updated VIF entry in instance network info cache for port a17ada4e-69e7-42ef-b08d-f405a5da6368. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:53:19 user nova-compute[70924]: DEBUG nova.network.neutron [req-dff49b01-11d4-4a8a-953a-63e00901f7ce req-cdf741eb-58ca-4fd0-8841-008ac1bca084 service nova] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Updating instance_info_cache with network_info: [{"id": "a17ada4e-69e7-42ef-b08d-f405a5da6368", "address": "fa:16:3e:62:06:29", "network": {"id": "d5876e18-e2af-45c2-aab5-2d0d552ebfe4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2035085552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9e5c78c1684c359cfab4e32b9c213f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa17ada4e-69", "ovs_interfaceid": "a17ada4e-69e7-42ef-b08d-f405a5da6368", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:53:19 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-dff49b01-11d4-4a8a-953a-63e00901f7ce req-cdf741eb-58ca-4fd0-8841-008ac1bca084 service nova] Releasing lock "refresh_cache-b001d812-892a-4756-9f37-fc0c5ef5f0a7" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:53:20 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:53:22 user nova-compute[70924]: DEBUG os_brick.utils [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:53:22 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:22 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:22 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[624cd816-c3a0-4f86-a5b6-eb5931c0c4ea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f2127c4a30d9\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:53:22 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:22 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:22 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd22509-ce90-49f9-8367-015786d04808]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:53:22 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:22 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:22 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67b2b71-8148-431e-b0ad-3e991a3d32dc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:53:22 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebee3ea7-7f58-486f-a172-6d0062cfaf64]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:53:22 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Running cmd (subprocess): nvme version {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:22 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] 'nvme version' failed. Not Retrying. {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:53:22 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.nvmeof [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] nvme not present on system {{(pid=70924) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 14:53:22 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:22 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:53:22 user nova-compute[70924]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 14:53:22 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ef9ef3-e7cc-4b05-9ad5-4ea889f98c0d]: (4, '') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:53:22 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70924) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 14:53:22 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 14:53:22 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] LIGHTOS: no hostnqn found. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 14:53:22 user nova-compute[70924]: DEBUG os_brick.utils [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f2127c4a30d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:53:22 user nova-compute[70924]: DEBUG nova.virt.block_device [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Updating existing volume attachment record: e9b7dad9-67b5-4df2-afc9-3c9514d9e0f4 {{(pid=70924) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 14:53:23 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:53:25 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:53:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:53:29 user nova-compute[70924]: DEBUG nova.compute.manager [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Start spawning the instance on the hypervisor. {{(pid=70924) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 14:53:29 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Creating instance directory {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 14:53:29 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Creating image(s)
Jul 29 14:53:29 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Did not create local disks {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 29 14:53:29 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Ensure instance console log exists: /opt/stack/data/nova/instances/b001d812-892a-4756-9f37-fc0c5ef5f0a7/console.log {{(pid=70924) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 14:53:29 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:53:29 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:53:29 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:53:29 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Start _get_guest_xml network_info=[{"id": "a17ada4e-69e7-42ef-b08d-f405a5da6368", "address": "fa:16:3e:62:06:29", "network": {"id": "d5876e18-e2af-45c2-aab5-2d0d552ebfe4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2035085552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9e5c78c1684c359cfab4e32b9c213f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa17ada4e-69", "ovs_interfaceid": "a17ada4e-69e7-42ef-b08d-f405a5da6368", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mDXsQUNA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b001d812-892a-4756-9f37-fc0c5ef5f0a7', 'attached_at': '', 'detached_at': '', 'volume_id': 'cbf3a486-19b2-4b15-b277-e028bef200fb', 'serial': 'cbf3a486-19b2-4b15-b277-e028bef200fb'}, 'attachment_id': 'e9b7dad9-67b5-4df2-afc9-3c9514d9e0f4', 'volume_type': None} {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 14:53:29 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:53:29 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:53:29 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 14:53:29 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] CPU controller missing on host. {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 14:53:29 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 14:53:29 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] CPU controller found on host. {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 14:53:29 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70924) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 14:53:29 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T14:36:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 14:53:29 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Flavor limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 14:53:29 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Image limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 14:53:29 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Flavor pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 14:53:29 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Image pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 14:53:29 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 14:53:29 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 14:53:29 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 14:53:29 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Got 1 possible topologies {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 14:53:29 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 14:53:29 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 14:53:29 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Calling os-brick to attach iSCSI Volume {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 14:53:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mDXsQUNA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:53:29 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:53:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:53:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:53:29 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:53:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:53:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:53:29 user nova-compute[70924]: INFO os_brick.initiator.connectors.iscsi [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 14:53:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb -p 172.16.0.220:3260 {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:29 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[49dfa8d8-5e43-41c2-abb0-8dddaa1fde02]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:53:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 14:53:29 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:53:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb -p 172.16.0.220:3260 --interface default --op new {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:29 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b1deb0-476b-4dae-a749-518586129596]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb] added\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:53:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb] added
Jul 29 14:53:29 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:53:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:29 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[bafd5344-a68b-4bda-86b2-806c9e4089be]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:53:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:53:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:29 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd915b18-e4a9-4d2c-b6a3-ed452c644605]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:53:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:53:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mDXsQUNA {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mDXsQUNA" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:29 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6342f0-6902-4e25-8b14-e0c8257be2f8]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:53:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mDXsQUNA'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:53:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:30 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c22e0db-5fcf-4e99-8adc-8a6dd21f9d8e]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:53:30 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:53:30 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:30 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:30 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[301a169e-faae-4d05-ba80-dd722cd833db]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:53:30 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:53:30 user nova-compute[70924]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:53:30 user nova-compute[70924]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)
Jul 29 14:53:30 user nova-compute[70924]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)
Jul 29 14:53:30 user nova-compute[70924]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4 (non-flash)
Jul 29 14:53:30 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:53:30 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:53:30 user nova-compute[70924]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:53:30 user nova-compute[70924]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)
Jul 29 14:53:30 user nova-compute[70924]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)
Jul 29 14:53:30 user nova-compute[70924]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4 (non-flash)
Jul 29 14:53:30 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:53:30 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb -p 172.16.0.220:3260 --login {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:30 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:30 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[7888df22-0611-4900-afec-24520f858aa3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:53:30 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb, portal: 172.16.0.220,3260]
Jul 29 14:53:30 user nova-compute[70924]: Login to [iface: default, target: iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb, portal: 172.16.0.220,3260] successful.
Jul 29 14:53:30 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:53:30 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:30 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:30 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[397570a4-63e9-4f57-9544-712ec2235519]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:53:30 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:53:30 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:30 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:30 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4736b56-5441-46bb-8c1b-db9b1a997081]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:53:30 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:53:30 user nova-compute[70924]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:53:30 user nova-compute[70924]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)
Jul 29 14:53:30 user nova-compute[70924]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)
Jul 29 14:53:30 user nova-compute[70924]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4 (non-flash)
Jul 29 14:53:30 user nova-compute[70924]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb (non-flash)
Jul 29 14:53:30 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:53:30 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:53:30 user nova-compute[70924]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:53:30 user nova-compute[70924]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)
Jul 29 14:53:30 user nova-compute[70924]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)
Jul 29 14:53:30 user nova-compute[70924]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4 (non-flash)
Jul 29 14:53:30 user nova-compute[70924]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb (non-flash)
Jul 29 14:53:30 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:53:30 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:53:30 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Connected to 172.16.0.220:3260 {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 14:53:30 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] HCTL ('38', '-', '-', 0) found on session 36 with lun 0 {{(pid=70924) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 14:53:30 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=70924) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 14:53:30 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:30 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:30 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed4f98d-579c-4106-95e5-e40ea7b1101a]: (4, ('- - 0', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:53:30 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Searching for a device in session 36 and hctl ['38', '*', '*', 0] yield: None {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 14:53:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:53:31 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Searching for a device in session 36 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 14:53:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mDXsQUNA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 14:53:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:53:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '26264376561306238', 'path': '/dev/sdg'} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:53:31 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26264376561306238', 'path': '/dev/sdg'} {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 14:53:31 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:53:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-987712595',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-987712595',id=31,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a9e5c78c1684c359cfab4e32b9c213f',ramdisk_id='',reservation_id='r-r6j2fqy4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2089253815',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:53:16Z,user_data=None,user_id='43582a8a85c54b5e9d16d11b12bf50d4',uuid=b001d812-892a-4756-9f37-fc0c5ef5f0a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a17ada4e-69e7-42ef-b08d-f405a5da6368", "address": "fa:16:3e:62:06:29", "network": {"id": "d5876e18-e2af-45c2-aab5-2d0d552ebfe4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2035085552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9e5c78c1684c359cfab4e32b9c213f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa17ada4e-69", "ovs_interfaceid": "a17ada4e-69e7-42ef-b08d-f405a5da6368", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:53:31 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Converting VIF {"id": "a17ada4e-69e7-42ef-b08d-f405a5da6368", "address": "fa:16:3e:62:06:29", "network": {"id": "d5876e18-e2af-45c2-aab5-2d0d552ebfe4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2035085552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9e5c78c1684c359cfab4e32b9c213f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa17ada4e-69", "ovs_interfaceid": "a17ada4e-69e7-42ef-b08d-f405a5da6368", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:53:31 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:06:29,bridge_name='br-int',has_traffic_filtering=True,id=a17ada4e-69e7-42ef-b08d-f405a5da6368,network=Network(d5876e18-e2af-45c2-aab5-2d0d552ebfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa17ada4e-69') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:53:31 user nova-compute[70924]: DEBUG nova.objects.instance [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lazy-loading 'pci_devices' on Instance uuid b001d812-892a-4756-9f37-fc0c5ef5f0a7 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:53:31 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] End _get_guest_xml xml=<domain type="kvm">
Jul 29 14:53:31 user nova-compute[70924]:   <uuid>b001d812-892a-4756-9f37-fc0c5ef5f0a7</uuid>
Jul 29 14:53:31 user nova-compute[70924]:   <name>instance-0000001f</name>
Jul 29 14:53:31 user nova-compute[70924]:   <memory>524288</memory>
Jul 29 14:53:31 user nova-compute[70924]:   <vcpu>1</vcpu>
Jul 29 14:53:31 user nova-compute[70924]:   <metadata>
Jul 29 14:53:31 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 14:53:31 user nova-compute[70924]:       <nova:package version="0.0.0"/>
Jul 29 14:53:31 user nova-compute[70924]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-987712595</nova:name>
Jul 29 14:53:31 user nova-compute[70924]:       <nova:creationTime>2023-07-29 14:53:29</nova:creationTime>
Jul 29 14:53:31 user nova-compute[70924]:       <nova:flavor name="m1.tiny">
Jul 29 14:53:31 user nova-compute[70924]:         <nova:memory>512</nova:memory>
Jul 29 14:53:31 user nova-compute[70924]:         <nova:disk>1</nova:disk>
Jul 29 14:53:31 user nova-compute[70924]:         <nova:swap>0</nova:swap>
Jul 29 14:53:31 user nova-compute[70924]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 14:53:31 user nova-compute[70924]:         <nova:vcpus>1</nova:vcpus>
Jul 29 14:53:31 user nova-compute[70924]:       </nova:flavor>
Jul 29 14:53:31 user nova-compute[70924]:       <nova:owner>
Jul 29 14:53:31 user nova-compute[70924]:         <nova:user uuid="43582a8a85c54b5e9d16d11b12bf50d4">tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member</nova:user>
Jul 29 14:53:31 user nova-compute[70924]:         <nova:project uuid="5a9e5c78c1684c359cfab4e32b9c213f">tempest-ServerBootFromVolumeStableRescueTest-2089253815</nova:project>
Jul 29 14:53:31 user nova-compute[70924]:       </nova:owner>
Jul 29 14:53:31 user nova-compute[70924]:       <nova:root type="image" uuid="3aba2e73-6832-404b-8bd0-d0503ce82b8c"/>
Jul 29 14:53:31 user nova-compute[70924]:       <nova:ports>
Jul 29 14:53:31 user nova-compute[70924]:         <nova:port uuid="a17ada4e-69e7-42ef-b08d-f405a5da6368">
Jul 29 14:53:31 user nova-compute[70924]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 29 14:53:31 user nova-compute[70924]:         </nova:port>
Jul 29 14:53:31 user nova-compute[70924]:       </nova:ports>
Jul 29 14:53:31 user nova-compute[70924]:     </nova:instance>
Jul 29 14:53:31 user nova-compute[70924]:   </metadata>
Jul 29 14:53:31 user nova-compute[70924]:   <sysinfo type="smbios">
Jul 29 14:53:31 user nova-compute[70924]:     <system>
Jul 29 14:53:31 user nova-compute[70924]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 14:53:31 user nova-compute[70924]:       <entry name="product">OpenStack Nova</entry>
Jul 29 14:53:31 user nova-compute[70924]:       <entry name="version">0.0.0</entry>
Jul 29 14:53:31 user nova-compute[70924]:       <entry name="serial">b001d812-892a-4756-9f37-fc0c5ef5f0a7</entry>
Jul 29 14:53:31 user nova-compute[70924]:       <entry name="uuid">b001d812-892a-4756-9f37-fc0c5ef5f0a7</entry>
Jul 29 14:53:31 user nova-compute[70924]:       <entry name="family">Virtual Machine</entry>
Jul 29 14:53:31 user nova-compute[70924]:     </system>
Jul 29 14:53:31 user nova-compute[70924]:   </sysinfo>
Jul 29 14:53:31 user nova-compute[70924]:   <os>
Jul 29 14:53:31 user nova-compute[70924]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 14:53:31 user nova-compute[70924]:     <boot dev="hd"/>
Jul 29 14:53:31 user nova-compute[70924]:     <smbios mode="sysinfo"/>
Jul 29 14:53:31 user nova-compute[70924]:   </os>
Jul 29 14:53:31 user nova-compute[70924]:   <features>
Jul 29 14:53:31 user nova-compute[70924]:     <acpi/>
Jul 29 14:53:31 user nova-compute[70924]:     <apic/>
Jul 29 14:53:31 user nova-compute[70924]:     <vmcoreinfo/>
Jul 29 14:53:31 user nova-compute[70924]:   </features>
Jul 29 14:53:31 user nova-compute[70924]:   <clock offset="utc">
Jul 29 14:53:31 user nova-compute[70924]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 14:53:31 user nova-compute[70924]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 14:53:31 user nova-compute[70924]:     <timer name="hpet" present="no"/>
Jul 29 14:53:31 user nova-compute[70924]:   </clock>
Jul 29 14:53:31 user nova-compute[70924]:   <cpu mode="custom" match="exact">
Jul 29 14:53:31 user nova-compute[70924]:     <model>Nehalem</model>
Jul 29 14:53:31 user nova-compute[70924]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 14:53:31 user nova-compute[70924]:   </cpu>
Jul 29 14:53:31 user nova-compute[70924]:   <devices>
Jul 29 14:53:31 user nova-compute[70924]:     <disk type="block" device="disk">
Jul 29 14:53:31 user nova-compute[70924]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:53:31 user nova-compute[70924]:       <source dev="/dev/sdg"/>
Jul 29 14:53:31 user nova-compute[70924]:       <target dev="vda" bus="virtio"/>
Jul 29 14:53:31 user nova-compute[70924]:       <serial>cbf3a486-19b2-4b15-b277-e028bef200fb</serial>
Jul 29 14:53:31 user nova-compute[70924]:     </disk>
Jul 29 14:53:31 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 14:53:31 user nova-compute[70924]:       <mac address="fa:16:3e:62:06:29"/>
Jul 29 14:53:31 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:53:31 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 14:53:31 user nova-compute[70924]:       <target dev="tapa17ada4e-69"/>
Jul 29 14:53:31 user nova-compute[70924]:     </interface>
Jul 29 14:53:31 user nova-compute[70924]:     <serial type="pty">
Jul 29 14:53:31 user nova-compute[70924]:       <log file="/opt/stack/data/nova/instances/b001d812-892a-4756-9f37-fc0c5ef5f0a7/console.log" append="off"/>
Jul 29 14:53:31 user nova-compute[70924]:     </serial>
Jul 29 14:53:31 user nova-compute[70924]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 14:53:31 user nova-compute[70924]:     <video>
Jul 29 14:53:31 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:53:31 user nova-compute[70924]:     </video>
Jul 29 14:53:31 user nova-compute[70924]:     <rng model="virtio">
Jul 29 14:53:31 user nova-compute[70924]:       <backend model="random">/dev/urandom</backend>
Jul 29 14:53:31 user nova-compute[70924]:     </rng>
Jul 29 14:53:31 user nova-compute[70924]:     <controller type="usb" index="0" model="none"/>
Jul 29 14:53:31 user nova-compute[70924]:     <memballoon model="virtio">
Jul 29 14:53:31 user nova-compute[70924]:       <stats period="10"/>
Jul 29 14:53:31 user nova-compute[70924]:     </memballoon>
Jul 29 14:53:31 user nova-compute[70924]:   </devices>
Jul 29 14:53:31 user nova-compute[70924]: </domain>
Jul 29 14:53:31 user nova-compute[70924]:  {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 14:53:31 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:53:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-987712595',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-987712595',id=31,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a9e5c78c1684c359cfab4e32b9c213f',ramdisk_id='',reservation_id='r-r6j2fqy4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2089253815',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:53:16Z,user_data=None,user_id='43582a8a85c54b5e9d16d11b12bf50d4',uuid=b001d812-892a-4756-9f37-fc0c5ef5f0a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a17ada4e-69e7-42ef-b08d-f405a5da6368", "address": "fa:16:3e:62:06:29", "network": {"id": "d5876e18-e2af-45c2-aab5-2d0d552ebfe4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2035085552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9e5c78c1684c359cfab4e32b9c213f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa17ada4e-69", "ovs_interfaceid": "a17ada4e-69e7-42ef-b08d-f405a5da6368", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 14:53:31 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Converting VIF {"id": "a17ada4e-69e7-42ef-b08d-f405a5da6368", "address": "fa:16:3e:62:06:29", "network": {"id": "d5876e18-e2af-45c2-aab5-2d0d552ebfe4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2035085552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9e5c78c1684c359cfab4e32b9c213f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa17ada4e-69", "ovs_interfaceid": "a17ada4e-69e7-42ef-b08d-f405a5da6368", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:53:31 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:06:29,bridge_name='br-int',has_traffic_filtering=True,id=a17ada4e-69e7-42ef-b08d-f405a5da6368,network=Network(d5876e18-e2af-45c2-aab5-2d0d552ebfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa17ada4e-69') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:53:31 user nova-compute[70924]: DEBUG os_vif [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:06:29,bridge_name='br-int',has_traffic_filtering=True,id=a17ada4e-69e7-42ef-b08d-f405a5da6368,network=Network(d5876e18-e2af-45c2-aab5-2d0d552ebfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa17ada4e-69') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 14:53:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:53:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:53:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 14:53:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:53:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa17ada4e-69, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:53:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa17ada4e-69, col_values=(('external_ids', {'iface-id': 'a17ada4e-69e7-42ef-b08d-f405a5da6368', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:06:29', 'vm-uuid': 'b001d812-892a-4756-9f37-fc0c5ef5f0a7'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:53:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:53:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:53:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:53:31 user nova-compute[70924]: INFO os_vif [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:06:29,bridge_name='br-int',has_traffic_filtering=True,id=a17ada4e-69e7-42ef-b08d-f405a5da6368,network=Network(d5876e18-e2af-45c2-aab5-2d0d552ebfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa17ada4e-69')
Jul 29 14:53:31 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:53:31 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] No VIF found with MAC fa:16:3e:62:06:29, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:53:32 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:53:32 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:53:32 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:53:32 user nova-compute[70924]: DEBUG nova.compute.manager [req-9c5a0697-f040-4df4-81e4-a099c1ad6b62 req-ad3791f3-9b76-4ee8-8212-6db3fe519353 service nova] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Received event network-vif-plugged-a17ada4e-69e7-42ef-b08d-f405a5da6368 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:53:32 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-9c5a0697-f040-4df4-81e4-a099c1ad6b62 req-ad3791f3-9b76-4ee8-8212-6db3fe519353 service nova] Acquiring lock "b001d812-892a-4756-9f37-fc0c5ef5f0a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:53:32 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-9c5a0697-f040-4df4-81e4-a099c1ad6b62 req-ad3791f3-9b76-4ee8-8212-6db3fe519353 service nova] Lock "b001d812-892a-4756-9f37-fc0c5ef5f0a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:53:32 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-9c5a0697-f040-4df4-81e4-a099c1ad6b62 req-ad3791f3-9b76-4ee8-8212-6db3fe519353 service nova] Lock "b001d812-892a-4756-9f37-fc0c5ef5f0a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:53:32 user nova-compute[70924]: DEBUG nova.compute.manager [req-9c5a0697-f040-4df4-81e4-a099c1ad6b62 req-ad3791f3-9b76-4ee8-8212-6db3fe519353 service nova] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] No waiting events found dispatching network-vif-plugged-a17ada4e-69e7-42ef-b08d-f405a5da6368 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:53:32 user nova-compute[70924]: WARNING nova.compute.manager [req-9c5a0697-f040-4df4-81e4-a099c1ad6b62 req-ad3791f3-9b76-4ee8-8212-6db3fe519353 service nova] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Received unexpected event network-vif-plugged-a17ada4e-69e7-42ef-b08d-f405a5da6368 for instance with vm_state building and task_state spawning.
Jul 29 14:53:33 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:53:33 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:53:33 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:53:34 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642414.6439662, b001d812-892a-4756-9f37-fc0c5ef5f0a7 => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:53:34 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] VM Resumed (Lifecycle Event)
Jul 29 14:53:34 user nova-compute[70924]: DEBUG nova.compute.manager [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Instance event wait completed in 0 seconds for  {{(pid=70924) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 14:53:34 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Guest created on hypervisor {{(pid=70924) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 14:53:34 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Instance spawned successfully.
Jul 29 14:53:34 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 14:53:34 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:53:34 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:53:34 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Found default for hw_cdrom_bus of ide {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:53:34 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Found default for hw_disk_bus of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:53:34 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Found default for hw_input_bus of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:53:34 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Found default for hw_pointer_model of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:53:34 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Found default for hw_video_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:53:34 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Found default for hw_vif_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:53:34 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:53:34 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642414.6490927, b001d812-892a-4756-9f37-fc0c5ef5f0a7 => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:53:34 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] VM Started (Lifecycle Event)
Jul 29 14:53:34 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:53:34 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:53:34 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:53:34 user nova-compute[70924]: INFO nova.compute.manager [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Took 4.96 seconds to spawn the instance on the hypervisor.
Jul 29 14:53:34 user nova-compute[70924]: DEBUG nova.compute.manager [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:53:34 user nova-compute[70924]: INFO nova.compute.manager [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Took 19.12 seconds to build instance.
Jul 29 14:53:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-babc4454-3106-4b47-bea2-fba42f7ed11d tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "b001d812-892a-4756-9f37-fc0c5ef5f0a7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.212s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:53:34 user nova-compute[70924]: DEBUG nova.compute.manager [req-757b57a2-9e5a-49b1-bdd0-78e65e173d63 req-b130053e-01d8-43a8-8ebb-1f391e510835 service nova] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Received event network-vif-plugged-a17ada4e-69e7-42ef-b08d-f405a5da6368 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:53:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-757b57a2-9e5a-49b1-bdd0-78e65e173d63 req-b130053e-01d8-43a8-8ebb-1f391e510835 service nova] Acquiring lock "b001d812-892a-4756-9f37-fc0c5ef5f0a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:53:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-757b57a2-9e5a-49b1-bdd0-78e65e173d63 req-b130053e-01d8-43a8-8ebb-1f391e510835 service nova] Lock "b001d812-892a-4756-9f37-fc0c5ef5f0a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:53:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-757b57a2-9e5a-49b1-bdd0-78e65e173d63 req-b130053e-01d8-43a8-8ebb-1f391e510835 service nova] Lock "b001d812-892a-4756-9f37-fc0c5ef5f0a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:53:34 user nova-compute[70924]: DEBUG nova.compute.manager [req-757b57a2-9e5a-49b1-bdd0-78e65e173d63 req-b130053e-01d8-43a8-8ebb-1f391e510835 service nova] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] No waiting events found dispatching network-vif-plugged-a17ada4e-69e7-42ef-b08d-f405a5da6368 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:53:34 user nova-compute[70924]: WARNING nova.compute.manager [req-757b57a2-9e5a-49b1-bdd0-78e65e173d63 req-b130053e-01d8-43a8-8ebb-1f391e510835 service nova] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Received unexpected event network-vif-plugged-a17ada4e-69e7-42ef-b08d-f405a5da6368 for instance with vm_state active and task_state None.
Jul 29 14:53:36 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:53:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-c090bf02-082c-48c4-af5b-3ddf79c53713 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Acquiring lock "fd57baf8-6306-4553-a058-e915fb543405" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:53:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-c090bf02-082c-48c4-af5b-3ddf79c53713 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "fd57baf8-6306-4553-a058-e915fb543405" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:53:37 user nova-compute[70924]: DEBUG nova.compute.manager [None req-c090bf02-082c-48c4-af5b-3ddf79c53713 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] Going to confirm migration 2 {{(pid=70924) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Jul 29 14:53:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Acquiring lock "fd91d5fc-857d-4d63-ad83-8028c1d3309f" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:53:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Lock "fd91d5fc-857d-4d63-ad83-8028c1d3309f" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:53:37 user nova-compute[70924]: INFO nova.compute.manager [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Unshelving
Jul 29 14:53:37 user nova-compute[70924]: INFO nova.virt.block_device [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Booting with volume 229cbfa1-ea7a-4400-b9c6-9df461306495 at /dev/vda
Jul 29 14:53:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-c090bf02-082c-48c4-af5b-3ddf79c53713 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Acquiring lock "refresh_cache-fd57baf8-6306-4553-a058-e915fb543405" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:53:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-c090bf02-082c-48c4-af5b-3ddf79c53713 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Acquired lock "refresh_cache-fd57baf8-6306-4553-a058-e915fb543405" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:53:37 user nova-compute[70924]: DEBUG nova.network.neutron [None req-c090bf02-082c-48c4-af5b-3ddf79c53713 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 14:53:37 user nova-compute[70924]: DEBUG nova.objects.instance [None req-c090bf02-082c-48c4-af5b-3ddf79c53713 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lazy-loading 'info_cache' on Instance uuid fd57baf8-6306-4553-a058-e915fb543405 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:53:37 user nova-compute[70924]: DEBUG os_brick.utils [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:53:37 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:37 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:37 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[abee6cd2-0f09-4524-b7ce-ecd462b8c0bf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f2127c4a30d9\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:53:37 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:37 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:37 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da86be7-5395-44c5-93f5-e084fbd8469b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:53:37 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:38 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6fd3ce2-1b31-4a59-8f60-c9dbd8baa4eb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:53:38 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b91e430-85fc-4868-9cc6-34c12b0fd292]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:53:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Running cmd (subprocess): nvme version {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] 'nvme version' failed. Not Retrying. {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:53:38 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] nvme not present on system {{(pid=70924) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 14:53:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:53:38 user nova-compute[70924]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 14:53:38 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb07c02e-08b4-4025-b4bb-acf36597ad4e]: (4, '') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:53:38 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70924) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 14:53:38 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 14:53:38 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] LIGHTOS: no hostnqn found. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 14:53:38 user nova-compute[70924]: DEBUG os_brick.utils [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f2127c4a30d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:53:38 user nova-compute[70924]: DEBUG nova.virt.block_device [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Updating existing volume attachment record: bcf740bd-b40d-4bd7-825f-3254d77567a0 {{(pid=70924) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 14:53:38 user nova-compute[70924]: DEBUG nova.network.neutron [None req-c090bf02-082c-48c4-af5b-3ddf79c53713 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] Updating instance_info_cache with network_info: [{"id": "c8f2eadb-705f-4b8b-9f67-c5280cf1f025", "address": "fa:16:3e:15:d2:44", "network": {"id": "55c18d07-a341-4678-9d1c-2dff057a9b1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1092921088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b33d01ba458f466b99b6bc5bba88d8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8f2eadb-70", "ovs_interfaceid": "c8f2eadb-705f-4b8b-9f67-c5280cf1f025", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:53:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-c090bf02-082c-48c4-af5b-3ddf79c53713 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Releasing lock "refresh_cache-fd57baf8-6306-4553-a058-e915fb543405" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:53:38 user nova-compute[70924]: DEBUG nova.objects.instance [None req-c090bf02-082c-48c4-af5b-3ddf79c53713 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lazy-loading 'migration_context' on Instance uuid fd57baf8-6306-4553-a058-e915fb543405 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:53:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-c090bf02-082c-48c4-af5b-3ddf79c53713 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:53:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-c090bf02-082c-48c4-af5b-3ddf79c53713 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:53:38 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:53:38 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-c090bf02-082c-48c4-af5b-3ddf79c53713 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:53:38 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-c090bf02-082c-48c4-af5b-3ddf79c53713 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:53:39 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-c090bf02-082c-48c4-af5b-3ddf79c53713 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.578s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:53:39 user nova-compute[70924]: INFO nova.scheduler.client.report [None req-c090bf02-082c-48c4-af5b-3ddf79c53713 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Deleted allocation for migration 89fefda8-4f7a-4616-af61-9c8f1289c480
Jul 29 14:53:39 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-c090bf02-082c-48c4-af5b-3ddf79c53713 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "fd57baf8-6306-4553-a058-e915fb543405" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.673s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:53:41 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:53:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:53:45 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:53:45 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:53:45 user nova-compute[70924]: DEBUG nova.objects.instance [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Lazy-loading 'pci_requests' on Instance uuid fd91d5fc-857d-4d63-ad83-8028c1d3309f {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:53:45 user nova-compute[70924]: DEBUG nova.objects.instance [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Lazy-loading 'numa_topology' on Instance uuid fd91d5fc-857d-4d63-ad83-8028c1d3309f {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:53:45 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70924) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 14:53:45 user nova-compute[70924]: INFO nova.compute.claims [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Claim successful on node user
Jul 29 14:53:46 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:53:46 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:53:46 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:53:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.610s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:53:46 user nova-compute[70924]: INFO nova.network.neutron [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Updating port a9e045fe-1480-4254-ad3d-ce7a12c1b293 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Jul 29 14:53:47 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Acquiring lock "refresh_cache-fd91d5fc-857d-4d63-ad83-8028c1d3309f" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:53:47 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Acquired lock "refresh_cache-fd91d5fc-857d-4d63-ad83-8028c1d3309f" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:53:47 user nova-compute[70924]: DEBUG nova.network.neutron [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 14:53:47 user nova-compute[70924]: DEBUG nova.compute.manager [req-3d1f1427-5583-4103-9ea9-c44ecc358108 req-362232a0-66a7-4011-9556-34c0d768cbf0 service nova] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Received event network-changed-a9e045fe-1480-4254-ad3d-ce7a12c1b293 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:53:47 user nova-compute[70924]: DEBUG nova.compute.manager [req-3d1f1427-5583-4103-9ea9-c44ecc358108 req-362232a0-66a7-4011-9556-34c0d768cbf0 service nova] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Refreshing instance network info cache due to event network-changed-a9e045fe-1480-4254-ad3d-ce7a12c1b293. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:53:47 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-3d1f1427-5583-4103-9ea9-c44ecc358108 req-362232a0-66a7-4011-9556-34c0d768cbf0 service nova] Acquiring lock "refresh_cache-fd91d5fc-857d-4d63-ad83-8028c1d3309f" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG nova.network.neutron [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Updating instance_info_cache with network_info: [{"id": "a9e045fe-1480-4254-ad3d-ce7a12c1b293", "address": "fa:16:3e:a4:a5:1c", "network": {"id": "fe4e60fb-1489-4a58-989a-1d81e33eddbc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1273087888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85e92f662b024b8a86d5fd646f169169", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9e045fe-14", "ovs_interfaceid": "a9e045fe-1480-4254-ad3d-ce7a12c1b293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Releasing lock "refresh_cache-fd91d5fc-857d-4d63-ad83-8028c1d3309f" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Creating instance directory {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 14:53:48 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Creating image(s)
Jul 29 14:53:48 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Did not create local disks {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Ensure instance console log exists: /opt/stack/data/nova/instances/fd91d5fc-857d-4d63-ad83-8028c1d3309f/console.log {{(pid=70924) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Start _get_guest_xml network_info=[{"id": "a9e045fe-1480-4254-ad3d-ce7a12c1b293", "address": "fa:16:3e:a4:a5:1c", "network": {"id": "fe4e60fb-1489-4a58-989a-1d81e33eddbc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1273087888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85e92f662b024b8a86d5fd646f169169", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9e045fe-14", "ovs_interfaceid": "a9e045fe-1480-4254-ad3d-ce7a12c1b293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tvIfOzwR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fd91d5fc-857d-4d63-ad83-8028c1d3309f', 'attached_at': '', 'detached_at': '', 'volume_id': '229cbfa1-ea7a-4400-b9c6-9df461306495', 'serial': '229cbfa1-ea7a-4400-b9c6-9df461306495'}, 'attachment_id': 'bcf740bd-b40d-4bd7-825f-3254d77567a0', 'volume_type': None} {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-3d1f1427-5583-4103-9ea9-c44ecc358108 req-362232a0-66a7-4011-9556-34c0d768cbf0 service nova] Acquired lock "refresh_cache-fd91d5fc-857d-4d63-ad83-8028c1d3309f" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG nova.network.neutron [req-3d1f1427-5583-4103-9ea9-c44ecc358108 req-362232a0-66a7-4011-9556-34c0d768cbf0 service nova] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Refreshing network info cache for port a9e045fe-1480-4254-ad3d-ce7a12c1b293 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:53:48 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:53:48 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:53:48 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] CPU controller missing on host. {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] CPU controller found on host. {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70924) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T14:36:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Flavor limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Image limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Flavor pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Image pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Got 1 possible topologies {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG nova.objects.instance [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Lazy-loading 'vcpu_model' on Instance uuid fd91d5fc-857d-4d63-ad83-8028c1d3309f {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Calling os-brick to attach iSCSI Volume {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tvIfOzwR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:53:48 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:53:48 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:53:48 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:53:48 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:53:48 user nova-compute[70924]: INFO os_brick.initiator.connectors.iscsi [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 14:53:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 -p 172.16.0.220:3260 {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a7ce88-f94d-4bd2-9f19-f300d312d515]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 14:53:48 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 -p 172.16.0.220:3260 --interface default --op new {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a574f30-7488-4716-aa68-19f7e75acf1e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495] added\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495] added
Jul 29 14:53:48 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1bb53ee-36ec-456a-8b2a-dda076ca9d4c]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d570538-d44b-4236-b30a-cee5cdffced5]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tvIfOzwR {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tvIfOzwR" returned: 0 in 0.024s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1441c1-09f9-4d0f-bffc-8298d5e2f0a5]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tvIfOzwR'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b67562-65b7-4cca-aefb-4e48266131a1]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5cc96a-9c99-4337-a420-cddac9a12f36]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:53:48 user nova-compute[70924]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:53:48 user nova-compute[70924]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)
Jul 29 14:53:48 user nova-compute[70924]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)
Jul 29 14:53:48 user nova-compute[70924]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4 (non-flash)
Jul 29 14:53:48 user nova-compute[70924]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb (non-flash)
Jul 29 14:53:48 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:53:48 user nova-compute[70924]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:53:48 user nova-compute[70924]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)
Jul 29 14:53:48 user nova-compute[70924]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)
Jul 29 14:53:48 user nova-compute[70924]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4 (non-flash)
Jul 29 14:53:48 user nova-compute[70924]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb (non-flash)
Jul 29 14:53:48 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 -p 172.16.0.220:3260 --login {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab294470-35d6-450f-ac2b-9f81df05d958]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495, portal: 172.16.0.220,3260]
Jul 29 14:53:48 user nova-compute[70924]: Login to [iface: default, target: iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495, portal: 172.16.0.220,3260] successful.
Jul 29 14:53:48 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4cc44f6-6093-4d11-98f8-76a53e16fc9e]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[79fedbd3-cc0e-4bc1-950d-615b3bbb501c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:53:48 user nova-compute[70924]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:53:48 user nova-compute[70924]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)
Jul 29 14:53:48 user nova-compute[70924]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)
Jul 29 14:53:48 user nova-compute[70924]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4 (non-flash)
Jul 29 14:53:48 user nova-compute[70924]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb (non-flash)
Jul 29 14:53:48 user nova-compute[70924]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)
Jul 29 14:53:48 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:53:48 user nova-compute[70924]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:53:48 user nova-compute[70924]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)
Jul 29 14:53:48 user nova-compute[70924]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)
Jul 29 14:53:48 user nova-compute[70924]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4 (non-flash)
Jul 29 14:53:48 user nova-compute[70924]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb (non-flash)
Jul 29 14:53:48 user nova-compute[70924]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)
Jul 29 14:53:48 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Connected to 172.16.0.220:3260 {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] HCTL ('39', '-', '-', 0) found on session 37 with lun 0 {{(pid=70924) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=70924) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad03667-3092-4cd6-ae78-49617d7808d2]: (4, ('- - 0', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Searching for a device in session 37 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tvIfOzwR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG nova.network.neutron [req-3d1f1427-5583-4103-9ea9-c44ecc358108 req-362232a0-66a7-4011-9556-34c0d768cbf0 service nova] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Updated VIF entry in instance network info cache for port a9e045fe-1480-4254-ad3d-ce7a12c1b293. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG nova.network.neutron [req-3d1f1427-5583-4103-9ea9-c44ecc358108 req-362232a0-66a7-4011-9556-34c0d768cbf0 service nova] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Updating instance_info_cache with network_info: [{"id": "a9e045fe-1480-4254-ad3d-ce7a12c1b293", "address": "fa:16:3e:a4:a5:1c", "network": {"id": "fe4e60fb-1489-4a58-989a-1d81e33eddbc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1273087888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85e92f662b024b8a86d5fd646f169169", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9e045fe-14", "ovs_interfaceid": "a9e045fe-1480-4254-ad3d-ce7a12c1b293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:53:48 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-3d1f1427-5583-4103-9ea9-c44ecc358108 req-362232a0-66a7-4011-9556-34c0d768cbf0 service nova] Releasing lock "refresh_cache-fd91d5fc-857d-4d63-ad83-8028c1d3309f" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:53:49 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:53:49 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '26335353064353663', 'path': '/dev/sdh'} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:53:49 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26335353064353663', 'path': '/dev/sdh'} {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 14:53:49 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-29T14:49:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-101620479',display_name='tempest-TestShelveInstance-server-101620479',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-101620479',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-614764253',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:50:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='85e92f662b024b8a86d5fd646f169169',ramdisk_id='',reservation_id='r-npw3a429',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1828854384',owner_user_name='tempest-TestShelveInstance-1828854384-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:53:38Z,user_data=None,user_id='53f2f7de42a74fb997661c7d579f508d',uuid=fd91d5fc-857d-4d63-ad83-8028c1d3309f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "a9e045fe-1480-4254-ad3d-ce7a12c1b293", "address": "fa:16:3e:a4:a5:1c", "network": {"id": "fe4e60fb-1489-4a58-989a-1d81e33eddbc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1273087888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85e92f662b024b8a86d5fd646f169169", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9e045fe-14", "ovs_interfaceid": "a9e045fe-1480-4254-ad3d-ce7a12c1b293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:53:49 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Converting VIF {"id": "a9e045fe-1480-4254-ad3d-ce7a12c1b293", "address": "fa:16:3e:a4:a5:1c", "network": {"id": "fe4e60fb-1489-4a58-989a-1d81e33eddbc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1273087888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85e92f662b024b8a86d5fd646f169169", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9e045fe-14", "ovs_interfaceid": "a9e045fe-1480-4254-ad3d-ce7a12c1b293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:53:49 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:a5:1c,bridge_name='br-int',has_traffic_filtering=True,id=a9e045fe-1480-4254-ad3d-ce7a12c1b293,network=Network(fe4e60fb-1489-4a58-989a-1d81e33eddbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9e045fe-14') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:53:49 user nova-compute[70924]: DEBUG nova.objects.instance [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Lazy-loading 'pci_devices' on Instance uuid fd91d5fc-857d-4d63-ad83-8028c1d3309f {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:53:49 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] End _get_guest_xml xml=<domain type="kvm">
Jul 29 14:53:49 user nova-compute[70924]:   <uuid>fd91d5fc-857d-4d63-ad83-8028c1d3309f</uuid>
Jul 29 14:53:49 user nova-compute[70924]:   <name>instance-0000001b</name>
Jul 29 14:53:49 user nova-compute[70924]:   <memory>524288</memory>
Jul 29 14:53:49 user nova-compute[70924]:   <vcpu>1</vcpu>
Jul 29 14:53:49 user nova-compute[70924]:   <metadata>
Jul 29 14:53:49 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 14:53:49 user nova-compute[70924]:       <nova:package version="0.0.0"/>
Jul 29 14:53:49 user nova-compute[70924]:       <nova:name>tempest-TestShelveInstance-server-101620479</nova:name>
Jul 29 14:53:49 user nova-compute[70924]:       <nova:creationTime>2023-07-29 14:53:48</nova:creationTime>
Jul 29 14:53:49 user nova-compute[70924]:       <nova:flavor name="m1.tiny">
Jul 29 14:53:49 user nova-compute[70924]:         <nova:memory>512</nova:memory>
Jul 29 14:53:49 user nova-compute[70924]:         <nova:disk>1</nova:disk>
Jul 29 14:53:49 user nova-compute[70924]:         <nova:swap>0</nova:swap>
Jul 29 14:53:49 user nova-compute[70924]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 14:53:49 user nova-compute[70924]:         <nova:vcpus>1</nova:vcpus>
Jul 29 14:53:49 user nova-compute[70924]:       </nova:flavor>
Jul 29 14:53:49 user nova-compute[70924]:       <nova:owner>
Jul 29 14:53:49 user nova-compute[70924]:         <nova:user uuid="53f2f7de42a74fb997661c7d579f508d">tempest-TestShelveInstance-1828854384-project-member</nova:user>
Jul 29 14:53:49 user nova-compute[70924]:         <nova:project uuid="85e92f662b024b8a86d5fd646f169169">tempest-TestShelveInstance-1828854384</nova:project>
Jul 29 14:53:49 user nova-compute[70924]:       </nova:owner>
Jul 29 14:53:49 user nova-compute[70924]:       <nova:ports>
Jul 29 14:53:49 user nova-compute[70924]:         <nova:port uuid="a9e045fe-1480-4254-ad3d-ce7a12c1b293">
Jul 29 14:53:49 user nova-compute[70924]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 29 14:53:49 user nova-compute[70924]:         </nova:port>
Jul 29 14:53:49 user nova-compute[70924]:       </nova:ports>
Jul 29 14:53:49 user nova-compute[70924]:     </nova:instance>
Jul 29 14:53:49 user nova-compute[70924]:   </metadata>
Jul 29 14:53:49 user nova-compute[70924]:   <sysinfo type="smbios">
Jul 29 14:53:49 user nova-compute[70924]:     <system>
Jul 29 14:53:49 user nova-compute[70924]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 14:53:49 user nova-compute[70924]:       <entry name="product">OpenStack Nova</entry>
Jul 29 14:53:49 user nova-compute[70924]:       <entry name="version">0.0.0</entry>
Jul 29 14:53:49 user nova-compute[70924]:       <entry name="serial">fd91d5fc-857d-4d63-ad83-8028c1d3309f</entry>
Jul 29 14:53:49 user nova-compute[70924]:       <entry name="uuid">fd91d5fc-857d-4d63-ad83-8028c1d3309f</entry>
Jul 29 14:53:49 user nova-compute[70924]:       <entry name="family">Virtual Machine</entry>
Jul 29 14:53:49 user nova-compute[70924]:     </system>
Jul 29 14:53:49 user nova-compute[70924]:   </sysinfo>
Jul 29 14:53:49 user nova-compute[70924]:   <os>
Jul 29 14:53:49 user nova-compute[70924]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 14:53:49 user nova-compute[70924]:     <boot dev="hd"/>
Jul 29 14:53:49 user nova-compute[70924]:     <smbios mode="sysinfo"/>
Jul 29 14:53:49 user nova-compute[70924]:   </os>
Jul 29 14:53:49 user nova-compute[70924]:   <features>
Jul 29 14:53:49 user nova-compute[70924]:     <acpi/>
Jul 29 14:53:49 user nova-compute[70924]:     <apic/>
Jul 29 14:53:49 user nova-compute[70924]:     <vmcoreinfo/>
Jul 29 14:53:49 user nova-compute[70924]:   </features>
Jul 29 14:53:49 user nova-compute[70924]:   <clock offset="utc">
Jul 29 14:53:49 user nova-compute[70924]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 14:53:49 user nova-compute[70924]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 14:53:49 user nova-compute[70924]:     <timer name="hpet" present="no"/>
Jul 29 14:53:49 user nova-compute[70924]:   </clock>
Jul 29 14:53:49 user nova-compute[70924]:   <cpu mode="custom" match="exact">
Jul 29 14:53:49 user nova-compute[70924]:     <model>Nehalem</model>
Jul 29 14:53:49 user nova-compute[70924]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 14:53:49 user nova-compute[70924]:   </cpu>
Jul 29 14:53:49 user nova-compute[70924]:   <devices>
Jul 29 14:53:49 user nova-compute[70924]:     <disk type="block" device="disk">
Jul 29 14:53:49 user nova-compute[70924]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:53:49 user nova-compute[70924]:       <source dev="/dev/sdh"/>
Jul 29 14:53:49 user nova-compute[70924]:       <target dev="vda" bus="virtio"/>
Jul 29 14:53:49 user nova-compute[70924]:       <serial>229cbfa1-ea7a-4400-b9c6-9df461306495</serial>
Jul 29 14:53:49 user nova-compute[70924]:     </disk>
Jul 29 14:53:49 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 14:53:49 user nova-compute[70924]:       <mac address="fa:16:3e:a4:a5:1c"/>
Jul 29 14:53:49 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:53:49 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 14:53:49 user nova-compute[70924]:       <target dev="tapa9e045fe-14"/>
Jul 29 14:53:49 user nova-compute[70924]:     </interface>
Jul 29 14:53:49 user nova-compute[70924]:     <serial type="pty">
Jul 29 14:53:49 user nova-compute[70924]:       <log file="/opt/stack/data/nova/instances/fd91d5fc-857d-4d63-ad83-8028c1d3309f/console.log" append="off"/>
Jul 29 14:53:49 user nova-compute[70924]:     </serial>
Jul 29 14:53:49 user nova-compute[70924]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 14:53:49 user nova-compute[70924]:     <video>
Jul 29 14:53:49 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:53:49 user nova-compute[70924]:     </video>
Jul 29 14:53:49 user nova-compute[70924]:     <rng model="virtio">
Jul 29 14:53:49 user nova-compute[70924]:       <backend model="random">/dev/urandom</backend>
Jul 29 14:53:49 user nova-compute[70924]:     </rng>
Jul 29 14:53:49 user nova-compute[70924]:     <controller type="usb" index="0" model="none"/>
Jul 29 14:53:49 user nova-compute[70924]:     <memballoon model="virtio">
Jul 29 14:53:49 user nova-compute[70924]:       <stats period="10"/>
Jul 29 14:53:49 user nova-compute[70924]:     </memballoon>
Jul 29 14:53:49 user nova-compute[70924]:   </devices>
Jul 29 14:53:49 user nova-compute[70924]: </domain>
Jul 29 14:53:49 user nova-compute[70924]:  {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 14:53:49 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-29T14:49:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-101620479',display_name='tempest-TestShelveInstance-server-101620479',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-101620479',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-614764253',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:50:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='85e92f662b024b8a86d5fd646f169169',ramdisk_id='',reservation_id='r-npw3a429',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1828854384',owner_user_name='tempest-TestShelveInstance-1828854384-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:53:38Z,user_data=None,user_id='53f2f7de42a74fb997661c7d579f508d',uuid=fd91d5fc-857d-4d63-ad83-8028c1d3309f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "a9e045fe-1480-4254-ad3d-ce7a12c1b293", "address": "fa:16:3e:a4:a5:1c", "network": {"id": "fe4e60fb-1489-4a58-989a-1d81e33eddbc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1273087888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85e92f662b024b8a86d5fd646f169169", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9e045fe-14", "ovs_interfaceid": "a9e045fe-1480-4254-ad3d-ce7a12c1b293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 14:53:49 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Converting VIF {"id": "a9e045fe-1480-4254-ad3d-ce7a12c1b293", "address": "fa:16:3e:a4:a5:1c", "network": {"id": "fe4e60fb-1489-4a58-989a-1d81e33eddbc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1273087888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85e92f662b024b8a86d5fd646f169169", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9e045fe-14", "ovs_interfaceid": "a9e045fe-1480-4254-ad3d-ce7a12c1b293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:53:49 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:a5:1c,bridge_name='br-int',has_traffic_filtering=True,id=a9e045fe-1480-4254-ad3d-ce7a12c1b293,network=Network(fe4e60fb-1489-4a58-989a-1d81e33eddbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9e045fe-14') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:53:49 user nova-compute[70924]: DEBUG os_vif [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:a5:1c,bridge_name='br-int',has_traffic_filtering=True,id=a9e045fe-1480-4254-ad3d-ce7a12c1b293,network=Network(fe4e60fb-1489-4a58-989a-1d81e33eddbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9e045fe-14') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 14:53:49 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:53:49 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:53:49 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 14:53:49 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:53:49 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa9e045fe-14, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:53:49 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa9e045fe-14, col_values=(('external_ids', {'iface-id': 'a9e045fe-1480-4254-ad3d-ce7a12c1b293', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:a5:1c', 'vm-uuid': 'fd91d5fc-857d-4d63-ad83-8028c1d3309f'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:53:49 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:53:49 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:53:49 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:53:49 user nova-compute[70924]: INFO os_vif [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:a5:1c,bridge_name='br-int',has_traffic_filtering=True,id=a9e045fe-1480-4254-ad3d-ce7a12c1b293,network=Network(fe4e60fb-1489-4a58-989a-1d81e33eddbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9e045fe-14')
Jul 29 14:53:49 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:53:49 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] No VIF found with MAC fa:16:3e:a4:a5:1c, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:53:51 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:53:51 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:53:51 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:53:51 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:53:51 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:53:51 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Auditing locally available compute resources for user (node: user) {{(pid=70924) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 14:53:51 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:53:51 user nova-compute[70924]: DEBUG nova.compute.manager [req-dcba4b0e-abdd-47fd-a7ba-b99b7ed5b0ce req-a861154b-1524-45c4-847f-934c44b31c60 service nova] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Received event network-vif-plugged-a9e045fe-1480-4254-ad3d-ce7a12c1b293 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:53:51 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-dcba4b0e-abdd-47fd-a7ba-b99b7ed5b0ce req-a861154b-1524-45c4-847f-934c44b31c60 service nova] Acquiring lock "fd91d5fc-857d-4d63-ad83-8028c1d3309f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:53:51 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-dcba4b0e-abdd-47fd-a7ba-b99b7ed5b0ce req-a861154b-1524-45c4-847f-934c44b31c60 service nova] Lock "fd91d5fc-857d-4d63-ad83-8028c1d3309f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:53:51 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-dcba4b0e-abdd-47fd-a7ba-b99b7ed5b0ce req-a861154b-1524-45c4-847f-934c44b31c60 service nova] Lock "fd91d5fc-857d-4d63-ad83-8028c1d3309f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:53:51 user nova-compute[70924]: DEBUG nova.compute.manager [req-dcba4b0e-abdd-47fd-a7ba-b99b7ed5b0ce req-a861154b-1524-45c4-847f-934c44b31c60 service nova] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] No waiting events found dispatching network-vif-plugged-a9e045fe-1480-4254-ad3d-ce7a12c1b293 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:53:51 user nova-compute[70924]: WARNING nova.compute.manager [req-dcba4b0e-abdd-47fd-a7ba-b99b7ed5b0ce req-a861154b-1524-45c4-847f-934c44b31c60 service nova] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Received unexpected event network-vif-plugged-a9e045fe-1480-4254-ad3d-ce7a12c1b293 for instance with vm_state shelved_offloaded and task_state spawning.
Jul 29 14:53:51 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:53:52 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:53:52 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:53:52 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:53:53 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642433.5371625, fd91d5fc-857d-4d63-ad83-8028c1d3309f => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:53:53 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] VM Resumed (Lifecycle Event)
Jul 29 14:53:53 user nova-compute[70924]: DEBUG nova.compute.manager [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Instance event wait completed in 0 seconds for  {{(pid=70924) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 14:53:53 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Guest created on hypervisor {{(pid=70924) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 14:53:53 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Instance spawned successfully.
Jul 29 14:53:53 user nova-compute[70924]: DEBUG nova.compute.manager [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:53:53 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:53:53 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:53:53 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:53:53 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642433.5398107, fd91d5fc-857d-4d63-ad83-8028c1d3309f => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:53:53 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] VM Started (Lifecycle Event)
Jul 29 14:53:53 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:53:53 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:53:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-3b0e798b-f35a-48b9-b9a8-9b9511c9cca5 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Lock "fd91d5fc-857d-4d63-ad83-8028c1d3309f" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 15.873s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:53:53 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:53:53 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk.rescue --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:53 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:53 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk.rescue --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:53 user nova-compute[70924]: DEBUG nova.compute.manager [req-5a6e55c1-dfa7-439b-8db4-83746f94d9d5 req-5438b4ca-e8aa-499a-9599-20ca492afb33 service nova] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Received event network-vif-plugged-a9e045fe-1480-4254-ad3d-ce7a12c1b293 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:53:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-5a6e55c1-dfa7-439b-8db4-83746f94d9d5 req-5438b4ca-e8aa-499a-9599-20ca492afb33 service nova] Acquiring lock "fd91d5fc-857d-4d63-ad83-8028c1d3309f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:53:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-5a6e55c1-dfa7-439b-8db4-83746f94d9d5 req-5438b4ca-e8aa-499a-9599-20ca492afb33 service nova] Lock "fd91d5fc-857d-4d63-ad83-8028c1d3309f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:53:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-5a6e55c1-dfa7-439b-8db4-83746f94d9d5 req-5438b4ca-e8aa-499a-9599-20ca492afb33 service nova] Lock "fd91d5fc-857d-4d63-ad83-8028c1d3309f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:53:53 user nova-compute[70924]: DEBUG nova.compute.manager [req-5a6e55c1-dfa7-439b-8db4-83746f94d9d5 req-5438b4ca-e8aa-499a-9599-20ca492afb33 service nova] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] No waiting events found dispatching network-vif-plugged-a9e045fe-1480-4254-ad3d-ce7a12c1b293 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:53:53 user nova-compute[70924]: WARNING nova.compute.manager [req-5a6e55c1-dfa7-439b-8db4-83746f94d9d5 req-5438b4ca-e8aa-499a-9599-20ca492afb33 service nova] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Received unexpected event network-vif-plugged-a9e045fe-1480-4254-ad3d-ce7a12c1b293 for instance with vm_state active and task_state None.
Jul 29 14:53:54 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk.rescue --force-share --output=json" returned: 0 in 0.164s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:54 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:54 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:54 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:54 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:54 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:54 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:54 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:54 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:54 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 14:53:54 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:54 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:53:54 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:54 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:54 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:54 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f7989ca-77e9-440f-bd2f-60e46e005557/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f7989ca-77e9-440f-bd2f-60e46e005557/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f7989ca-77e9-440f-bd2f-60e46e005557/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f7989ca-77e9-440f-bd2f-60e46e005557/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c31a724f-3006-4e5d-a9b5-847fd6cd170a/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c31a724f-3006-4e5d-a9b5-847fd6cd170a/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c31a724f-3006-4e5d-a9b5-847fd6cd170a/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c31a724f-3006-4e5d-a9b5-847fd6cd170a/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:55 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 14:53:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cb12b3e-de44-4887-ab74-2a68164b5f7d/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cb12b3e-de44-4887-ab74-2a68164b5f7d/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cb12b3e-de44-4887-ab74-2a68164b5f7d/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cb12b3e-de44-4887-ab74-2a68164b5f7d/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:55 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 14:53:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7171083a-00aa-4faf-9732-88cab8a0d83d/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7171083a-00aa-4faf-9732-88cab8a0d83d/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7171083a-00aa-4faf-9732-88cab8a0d83d/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7171083a-00aa-4faf-9732-88cab8a0d83d/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:56 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 14:53:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710f0d5a-8420-49c4-bf70-27305dd85bd3/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710f0d5a-8420-49c4-bf70-27305dd85bd3/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710f0d5a-8420-49c4-bf70-27305dd85bd3/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710f0d5a-8420-49c4-bf70-27305dd85bd3/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:56 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 14:53:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdaf1714-27f9-47ee-808b-206ec78c6067/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdaf1714-27f9-47ee-808b-206ec78c6067/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdaf1714-27f9-47ee-808b-206ec78c6067/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdaf1714-27f9-47ee-808b-206ec78c6067/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:57 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 14:53:57 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 14:53:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:58 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:53:58 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:53:58 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Hypervisor/Node resource view: name=user free_ram=6714MB free_disk=25.170345306396484GB free_vcpus=-3 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70924) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 14:53:58 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:53:58 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:53:58 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance db656346-c4af-43da-9600-fd39f1b9e4dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:53:58 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 86ecc6cb-88a8-4572-8e41-d4c5859036a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:53:58 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 02c75b00-a1b4-4ef9-ae96-bc67d8038589 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:53:58 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 1f7989ca-77e9-440f-bd2f-60e46e005557 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:53:58 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 7cb12b3e-de44-4887-ab74-2a68164b5f7d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:53:58 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 7171083a-00aa-4faf-9732-88cab8a0d83d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:53:58 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 9ec07c62-951b-4e3a-bffa-e01dfb4665ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:53:58 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 091e384f-7851-4ac9-b566-990df0497fc5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:53:58 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance c31a724f-3006-4e5d-a9b5-847fd6cd170a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:53:58 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance f5350fb5-9460-490b-a47e-74f88c8eb51c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:53:58 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance fd57baf8-6306-4553-a058-e915fb543405 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:53:58 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance bdaf1714-27f9-47ee-808b-206ec78c6067 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:53:58 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 710f0d5a-8420-49c4-bf70-27305dd85bd3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:53:58 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance b001d812-892a-4756-9f37-fc0c5ef5f0a7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:53:58 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance fd91d5fc-857d-4d63-ad83-8028c1d3309f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:53:58 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 14:53:58 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Final resource view: name=user phys_ram=16011MB used_ram=9728MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 14:53:58 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:53:58 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:53:58 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:53:58 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Compute_service record updated for user:user {{(pid=70924) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 14:53:58 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.700s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:53:58 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-4946b76f-fa06-4d0c-8cd9-f099fd6faf7b tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Acquiring lock "7cb12b3e-de44-4887-ab74-2a68164b5f7d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:53:58 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-4946b76f-fa06-4d0c-8cd9-f099fd6faf7b tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "7cb12b3e-de44-4887-ab74-2a68164b5f7d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:53:58 user nova-compute[70924]: INFO nova.compute.manager [None req-4946b76f-fa06-4d0c-8cd9-f099fd6faf7b tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Detaching volume d8cda795-fcae-41e3-80f3-2066316032fe
Jul 29 14:53:58 user nova-compute[70924]: INFO nova.virt.block_device [None req-4946b76f-fa06-4d0c-8cd9-f099fd6faf7b tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Attempting to driver detach volume d8cda795-fcae-41e3-80f3-2066316032fe from mountpoint /dev/vdb
Jul 29 14:53:58 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-4946b76f-fa06-4d0c-8cd9-f099fd6faf7b tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Attempting to detach device vdb from instance 7cb12b3e-de44-4887-ab74-2a68164b5f7d from the persistent domain config. {{(pid=70924) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 29 14:53:58 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-4946b76f-fa06-4d0c-8cd9-f099fd6faf7b tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 14:53:58 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:53:58 user nova-compute[70924]:   <source dev="/dev/sdc"/>
Jul 29 14:53:58 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 14:53:58 user nova-compute[70924]:   <serial>d8cda795-fcae-41e3-80f3-2066316032fe</serial>
Jul 29 14:53:58 user nova-compute[70924]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 29 14:53:58 user nova-compute[70924]: </disk>
Jul 29 14:53:58 user nova-compute[70924]:  {{(pid=70924) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 14:53:58 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-4946b76f-fa06-4d0c-8cd9-f099fd6faf7b tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Successfully detached device vdb from instance 7cb12b3e-de44-4887-ab74-2a68164b5f7d from the persistent domain config.
Jul 29 14:53:58 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-4946b76f-fa06-4d0c-8cd9-f099fd6faf7b tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7cb12b3e-de44-4887-ab74-2a68164b5f7d from the live domain config. {{(pid=70924) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 29 14:53:58 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-4946b76f-fa06-4d0c-8cd9-f099fd6faf7b tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 14:53:58 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:53:58 user nova-compute[70924]:   <source dev="/dev/sdc"/>
Jul 29 14:53:58 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 14:53:58 user nova-compute[70924]:   <serial>d8cda795-fcae-41e3-80f3-2066316032fe</serial>
Jul 29 14:53:58 user nova-compute[70924]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 29 14:53:58 user nova-compute[70924]: </disk>
Jul 29 14:53:58 user nova-compute[70924]:  {{(pid=70924) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 14:53:59 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Received event <DeviceRemovedEvent: 1690642439.4486055, 7cb12b3e-de44-4887-ab74-2a68164b5f7d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70924) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 29 14:53:59 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-4946b76f-fa06-4d0c-8cd9-f099fd6faf7b tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7cb12b3e-de44-4887-ab74-2a68164b5f7d {{(pid=70924) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 29 14:53:59 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-4946b76f-fa06-4d0c-8cd9-f099fd6faf7b tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Successfully detached device vdb from instance 7cb12b3e-de44-4887-ab74-2a68164b5f7d from the live domain config.
Jul 29 14:53:59 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4946b76f-fa06-4d0c-8cd9-f099fd6faf7b tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] calling os-brick to detach iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 14:53:59 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-4946b76f-fa06-4d0c-8cd9-f099fd6faf7b tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, {'target_iqns': ['iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jVrAgyeu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:53:59 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-4946b76f-fa06-4d0c-8cd9-f099fd6faf7b tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:53:59 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-4946b76f-fa06-4d0c-8cd9-f099fd6faf7b tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:53:59 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-4946b76f-fa06-4d0c-8cd9-f099fd6faf7b tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:53:59 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-4946b76f-fa06-4d0c-8cd9-f099fd6faf7b tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe', 0)] {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 14:53:59 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:59 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:59 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[a112106e-dae3-4c7f-b687-87495fe70887]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:53:59 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:59 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:59 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e3716df-447c-42fa-83d1-ea117e7c9f55]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:53:59 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-4946b76f-fa06-4d0c-8cd9-f099fd6faf7b tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:53:59 user nova-compute[70924]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:53:59 user nova-compute[70924]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)
Jul 29 14:53:59 user nova-compute[70924]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)
Jul 29 14:53:59 user nova-compute[70924]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4 (non-flash)
Jul 29 14:53:59 user nova-compute[70924]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb (non-flash)
Jul 29 14:53:59 user nova-compute[70924]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)
Jul 29 14:53:59 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:53:59 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-4946b76f-fa06-4d0c-8cd9-f099fd6faf7b tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:53:59 user nova-compute[70924]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:53:59 user nova-compute[70924]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe (non-flash)
Jul 29 14:53:59 user nova-compute[70924]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)
Jul 29 14:53:59 user nova-compute[70924]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4 (non-flash)
Jul 29 14:53:59 user nova-compute[70924]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb (non-flash)
Jul 29 14:53:59 user nova-compute[70924]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)
Jul 29 14:53:59 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:53:59 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-4946b76f-fa06-4d0c-8cd9-f099fd6faf7b tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feecc5ebf40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe'): ({'sdc'}, set())}) {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 14:53:59 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-4946b76f-fa06-4d0c-8cd9-f099fd6faf7b tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Removing single pathed devices sdc {{(pid=70924) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 14:53:59 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:59 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:59 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d11581c-a5d7-4791-be37-c2331063eb4a]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:53:59 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:59 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:59 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e344eb-0bf9-47f8-8a4a-8ac4c94f8b35]: (4, ('ok\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:53:59 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-4946b76f-fa06-4d0c-8cd9-f099fd6faf7b tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Flushing IO for device /dev/sdc {{(pid=70924) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 14:53:59 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:59 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.025s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:59 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6726f4-6686-4e2e-aee5-878f63b526a2]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:53:59 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-4946b76f-fa06-4d0c-8cd9-f099fd6faf7b tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70924) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 14:53:59 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:59 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:59 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[91bac8fd-1c8d-40ed-83e0-19b6237364fb]: (4, ('1', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:53:59 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-4946b76f-fa06-4d0c-8cd9-f099fd6faf7b tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 14:53:59 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-4946b76f-fa06-4d0c-8cd9-f099fd6faf7b tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] SCSI volumes sdc have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 14:53:59 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-4946b76f-fa06-4d0c-8cd9-f099fd6faf7b tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe')] {{(pid=70924) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 14:53:59 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:59 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:59 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5c8691-90a4-4804-b799-40b0442cf652]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:53:59 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-4946b76f-fa06-4d0c-8cd9-f099fd6faf7b tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:53:59 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe -p 172.16.0.220:3260 --logout {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:59 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:53:59 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:59 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:53:59 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:53:59 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Starting heal instance info cache {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 14:53:59 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d9b796f-3a12-46a0-99a4-45d81f3e4b93]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:53:59 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-4946b76f-fa06-4d0c-8cd9-f099fd6faf7b tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe, portal: 172.16.0.220,3260]
Jul 29 14:53:59 user nova-compute[70924]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe, portal: 172.16.0.220,3260] successful.
Jul 29 14:53:59 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:53:59 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe -p 172.16.0.220:3260 --op delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:53:59 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8cda795-fcae-41e3-80f3-2066316032fe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:53:59 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c8e991-8a9c-47dd-b8fe-86620514dd0b]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:53:59 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-4946b76f-fa06-4d0c-8cd9-f099fd6faf7b tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:53:59 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-4946b76f-fa06-4d0c-8cd9-f099fd6faf7b tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.378s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:53:59 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-4946b76f-fa06-4d0c-8cd9-f099fd6faf7b tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] <== disconnect_volume: return (379ms) None {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:53:59 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4946b76f-fa06-4d0c-8cd9-f099fd6faf7b tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Disconnected iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 14:53:59 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "refresh_cache-7cb12b3e-de44-4887-ab74-2a68164b5f7d" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:53:59 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquired lock "refresh_cache-7cb12b3e-de44-4887-ab74-2a68164b5f7d" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:53:59 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Forcefully refreshing network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 29 14:54:00 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Updating instance_info_cache with network_info: [{"id": "e41d642f-f559-4294-b5ff-5ec478fb3438", "address": "fa:16:3e:f7:ee:73", "network": {"id": "46d2cfde-13db-4cf3-af0e-4d6742f37044", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1642265305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0388bcf487e492082e85b183f38765c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape41d642f-f5", "ovs_interfaceid": "e41d642f-f559-4294-b5ff-5ec478fb3438", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:54:00 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Releasing lock "refresh_cache-7cb12b3e-de44-4887-ab74-2a68164b5f7d" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:54:00 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Updated the network info_cache for instance {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 29 14:54:00 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:54:00 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:54:00 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:54:00 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:54:00 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:54:00 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:54:00 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70924) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 14:54:00 user nova-compute[70924]: DEBUG nova.objects.instance [None req-4946b76f-fa06-4d0c-8cd9-f099fd6faf7b tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lazy-loading 'flavor' on Instance uuid 7cb12b3e-de44-4887-ab74-2a68164b5f7d {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:54:00 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-4946b76f-fa06-4d0c-8cd9-f099fd6faf7b tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "7cb12b3e-de44-4887-ab74-2a68164b5f7d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.777s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:54:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-fa7e36f8-4f8a-4f5f-a13c-ce8fc9579031 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Acquiring lock "7cb12b3e-de44-4887-ab74-2a68164b5f7d" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:54:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-fa7e36f8-4f8a-4f5f-a13c-ce8fc9579031 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "7cb12b3e-de44-4887-ab74-2a68164b5f7d" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:54:01 user nova-compute[70924]: DEBUG nova.compute.manager [None req-fa7e36f8-4f8a-4f5f-a13c-ce8fc9579031 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:54:01 user nova-compute[70924]: DEBUG nova.compute.manager [None req-fa7e36f8-4f8a-4f5f-a13c-ce8fc9579031 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=70924) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Jul 29 14:54:01 user nova-compute[70924]: DEBUG nova.objects.instance [None req-fa7e36f8-4f8a-4f5f-a13c-ce8fc9579031 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lazy-loading 'flavor' on Instance uuid 7cb12b3e-de44-4887-ab74-2a68164b5f7d {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:54:01 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:54:01 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:54:01 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:54:01 user nova-compute[70924]: DEBUG nova.compute.manager [req-18e207a7-e3ab-4d60-b7ad-da1a345a0c63 req-edf509f8-81ad-42e1-ac01-74ceda7b6fb6 service nova] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Received event network-vif-unplugged-e41d642f-f559-4294-b5ff-5ec478fb3438 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:54:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-18e207a7-e3ab-4d60-b7ad-da1a345a0c63 req-edf509f8-81ad-42e1-ac01-74ceda7b6fb6 service nova] Acquiring lock "7cb12b3e-de44-4887-ab74-2a68164b5f7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:54:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-18e207a7-e3ab-4d60-b7ad-da1a345a0c63 req-edf509f8-81ad-42e1-ac01-74ceda7b6fb6 service nova] Lock "7cb12b3e-de44-4887-ab74-2a68164b5f7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:54:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-18e207a7-e3ab-4d60-b7ad-da1a345a0c63 req-edf509f8-81ad-42e1-ac01-74ceda7b6fb6 service nova] Lock "7cb12b3e-de44-4887-ab74-2a68164b5f7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:54:01 user nova-compute[70924]: DEBUG nova.compute.manager [req-18e207a7-e3ab-4d60-b7ad-da1a345a0c63 req-edf509f8-81ad-42e1-ac01-74ceda7b6fb6 service nova] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] No waiting events found dispatching network-vif-unplugged-e41d642f-f559-4294-b5ff-5ec478fb3438 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:54:01 user nova-compute[70924]: WARNING nova.compute.manager [req-18e207a7-e3ab-4d60-b7ad-da1a345a0c63 req-edf509f8-81ad-42e1-ac01-74ceda7b6fb6 service nova] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Received unexpected event network-vif-unplugged-e41d642f-f559-4294-b5ff-5ec478fb3438 for instance with vm_state active and task_state powering-off.
Jul 29 14:54:01 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Instance destroyed successfully.
Jul 29 14:54:01 user nova-compute[70924]: DEBUG nova.compute.manager [None req-fa7e36f8-4f8a-4f5f-a13c-ce8fc9579031 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:54:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-fa7e36f8-4f8a-4f5f-a13c-ce8fc9579031 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "7cb12b3e-de44-4887-ab74-2a68164b5f7d" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.859s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:54:03 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:54:03 user nova-compute[70924]: DEBUG nova.compute.manager [req-c9885d3a-b4ea-4252-860e-ba0757d925ef req-073fa95c-65f4-471d-8aeb-8bc6e24c0781 service nova] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Received event network-vif-plugged-e41d642f-f559-4294-b5ff-5ec478fb3438 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:54:03 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c9885d3a-b4ea-4252-860e-ba0757d925ef req-073fa95c-65f4-471d-8aeb-8bc6e24c0781 service nova] Acquiring lock "7cb12b3e-de44-4887-ab74-2a68164b5f7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:54:03 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c9885d3a-b4ea-4252-860e-ba0757d925ef req-073fa95c-65f4-471d-8aeb-8bc6e24c0781 service nova] Lock "7cb12b3e-de44-4887-ab74-2a68164b5f7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:54:03 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c9885d3a-b4ea-4252-860e-ba0757d925ef req-073fa95c-65f4-471d-8aeb-8bc6e24c0781 service nova] Lock "7cb12b3e-de44-4887-ab74-2a68164b5f7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:54:03 user nova-compute[70924]: DEBUG nova.compute.manager [req-c9885d3a-b4ea-4252-860e-ba0757d925ef req-073fa95c-65f4-471d-8aeb-8bc6e24c0781 service nova] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] No waiting events found dispatching network-vif-plugged-e41d642f-f559-4294-b5ff-5ec478fb3438 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:54:03 user nova-compute[70924]: WARNING nova.compute.manager [req-c9885d3a-b4ea-4252-860e-ba0757d925ef req-073fa95c-65f4-471d-8aeb-8bc6e24c0781 service nova] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Received unexpected event network-vif-plugged-e41d642f-f559-4294-b5ff-5ec478fb3438 for instance with vm_state stopped and task_state None.
Jul 29 14:54:04 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:54:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:54:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:54:10 user nova-compute[70924]: INFO nova.compute.manager [None req-3f700927-baa1-4e5d-a464-75b2590e9fe0 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Rescuing
Jul 29 14:54:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-3f700927-baa1-4e5d-a464-75b2590e9fe0 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Acquiring lock "refresh_cache-9ec07c62-951b-4e3a-bffa-e01dfb4665ec" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:54:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-3f700927-baa1-4e5d-a464-75b2590e9fe0 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Acquired lock "refresh_cache-9ec07c62-951b-4e3a-bffa-e01dfb4665ec" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:54:10 user nova-compute[70924]: DEBUG nova.network.neutron [None req-3f700927-baa1-4e5d-a464-75b2590e9fe0 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 14:54:10 user nova-compute[70924]: DEBUG nova.network.neutron [None req-3f700927-baa1-4e5d-a464-75b2590e9fe0 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Updating instance_info_cache with network_info: [{"id": "cb01658e-4dd9-426e-9b45-340ea19db056", "address": "fa:16:3e:75:a4:24", "network": {"id": "b2aee530-d195-47bb-b39d-c8bd15b81a08", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-421022738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcf4644e7a24bf68b407be2e3d9732c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb01658e-4d", "ovs_interfaceid": "cb01658e-4dd9-426e-9b45-340ea19db056", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:54:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-3f700927-baa1-4e5d-a464-75b2590e9fe0 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Releasing lock "refresh_cache-9ec07c62-951b-4e3a-bffa-e01dfb4665ec" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:54:11 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:54:11 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:54:11 user nova-compute[70924]: DEBUG nova.compute.manager [req-6ee48487-a28b-4ad4-9b6d-72110ec01626 req-c3624725-3675-427f-a097-11faaa997896 service nova] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Received event network-vif-unplugged-cb01658e-4dd9-426e-9b45-340ea19db056 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:54:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-6ee48487-a28b-4ad4-9b6d-72110ec01626 req-c3624725-3675-427f-a097-11faaa997896 service nova] Acquiring lock "9ec07c62-951b-4e3a-bffa-e01dfb4665ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:54:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-6ee48487-a28b-4ad4-9b6d-72110ec01626 req-c3624725-3675-427f-a097-11faaa997896 service nova] Lock "9ec07c62-951b-4e3a-bffa-e01dfb4665ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:54:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-6ee48487-a28b-4ad4-9b6d-72110ec01626 req-c3624725-3675-427f-a097-11faaa997896 service nova] Lock "9ec07c62-951b-4e3a-bffa-e01dfb4665ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:54:11 user nova-compute[70924]: DEBUG nova.compute.manager [req-6ee48487-a28b-4ad4-9b6d-72110ec01626 req-c3624725-3675-427f-a097-11faaa997896 service nova] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] No waiting events found dispatching network-vif-unplugged-cb01658e-4dd9-426e-9b45-340ea19db056 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:54:11 user nova-compute[70924]: WARNING nova.compute.manager [req-6ee48487-a28b-4ad4-9b6d-72110ec01626 req-c3624725-3675-427f-a097-11faaa997896 service nova] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Received unexpected event network-vif-unplugged-cb01658e-4dd9-426e-9b45-340ea19db056 for instance with vm_state active and task_state rescuing.
Jul 29 14:54:11 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:54:11 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:54:11 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Instance destroyed successfully.
Jul 29 14:54:11 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-3f700927-baa1-4e5d-a464-75b2590e9fe0 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Attempting rescue
Jul 29 14:54:11 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-3f700927-baa1-4e5d-a464-75b2590e9fe0 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=70924) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 29 14:54:11 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-3f700927-baa1-4e5d-a464-75b2590e9fe0 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Instance directory exists: not creating {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 29 14:54:11 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-3f700927-baa1-4e5d-a464-75b2590e9fe0 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Creating image(s)
Jul 29 14:54:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-3f700927-baa1-4e5d-a464-75b2590e9fe0 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Acquiring lock "/opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:54:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-3f700927-baa1-4e5d-a464-75b2590e9fe0 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "/opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:54:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-3f700927-baa1-4e5d-a464-75b2590e9fe0 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "/opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.018s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:54:11 user nova-compute[70924]: DEBUG nova.objects.instance [None req-3f700927-baa1-4e5d-a464-75b2590e9fe0 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9ec07c62-951b-4e3a-bffa-e01dfb4665ec {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:54:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-3f700927-baa1-4e5d-a464-75b2590e9fe0 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Acquiring lock "bd72453517468710f1de26b27fb0ea28688e9009" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:54:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-3f700927-baa1-4e5d-a464-75b2590e9fe0 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:54:11 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-3f700927-baa1-4e5d-a464-75b2590e9fe0 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:54:11 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-3f700927-baa1-4e5d-a464-75b2590e9fe0 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.136s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:54:11 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-3f700927-baa1-4e5d-a464-75b2590e9fe0 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk.rescue {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:54:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-3f700927-baa1-4e5d-a464-75b2590e9fe0 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk.rescue" returned: 0 in 0.049s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:54:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-3f700927-baa1-4e5d-a464-75b2590e9fe0 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:54:12 user nova-compute[70924]: DEBUG nova.objects.instance [None req-3f700927-baa1-4e5d-a464-75b2590e9fe0 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lazy-loading 'migration_context' on Instance uuid 9ec07c62-951b-4e3a-bffa-e01dfb4665ec {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:54:12 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-3f700927-baa1-4e5d-a464-75b2590e9fe0 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Created local disks {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 14:54:12 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-3f700927-baa1-4e5d-a464-75b2590e9fe0 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Start _get_guest_xml network_info=[{"id": "cb01658e-4dd9-426e-9b45-340ea19db056", "address": "fa:16:3e:75:a4:24", "network": {"id": "b2aee530-d195-47bb-b39d-c8bd15b81a08", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-421022738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-421022738-network", "vif_mac": "fa:16:3e:75:a4:24"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcf4644e7a24bf68b407be2e3d9732c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb01658e-4d", "ovs_interfaceid": "cb01658e-4dd9-426e-9b45-340ea19db056", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '3aba2e73-6832-404b-8bd0-d0503ce82b8c', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 14:54:12 user nova-compute[70924]: DEBUG nova.objects.instance [None req-3f700927-baa1-4e5d-a464-75b2590e9fe0 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lazy-loading 'resources' on Instance uuid 9ec07c62-951b-4e3a-bffa-e01dfb4665ec {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:54:12 user nova-compute[70924]: DEBUG nova.objects.instance [None req-3f700927-baa1-4e5d-a464-75b2590e9fe0 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lazy-loading 'numa_topology' on Instance uuid 9ec07c62-951b-4e3a-bffa-e01dfb4665ec {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:54:12 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-3f700927-baa1-4e5d-a464-75b2590e9fe0 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:54:12 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-3f700927-baa1-4e5d-a464-75b2590e9fe0 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:54:12 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-3f700927-baa1-4e5d-a464-75b2590e9fe0 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 14:54:12 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-3f700927-baa1-4e5d-a464-75b2590e9fe0 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] CPU controller missing on host. {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 14:54:12 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-3f700927-baa1-4e5d-a464-75b2590e9fe0 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 14:54:12 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-3f700927-baa1-4e5d-a464-75b2590e9fe0 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] CPU controller found on host. {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 14:54:12 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-3f700927-baa1-4e5d-a464-75b2590e9fe0 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70924) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 14:54:12 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-3f700927-baa1-4e5d-a464-75b2590e9fe0 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T14:36:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 14:54:12 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-3f700927-baa1-4e5d-a464-75b2590e9fe0 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Flavor limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 14:54:12 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-3f700927-baa1-4e5d-a464-75b2590e9fe0 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Image limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 14:54:12 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-3f700927-baa1-4e5d-a464-75b2590e9fe0 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Flavor pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 14:54:12 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-3f700927-baa1-4e5d-a464-75b2590e9fe0 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Image pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 14:54:12 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-3f700927-baa1-4e5d-a464-75b2590e9fe0 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 14:54:12 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-3f700927-baa1-4e5d-a464-75b2590e9fe0 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 14:54:12 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-3f700927-baa1-4e5d-a464-75b2590e9fe0 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 14:54:12 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-3f700927-baa1-4e5d-a464-75b2590e9fe0 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Got 1 possible topologies {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 14:54:12 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-3f700927-baa1-4e5d-a464-75b2590e9fe0 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 14:54:12 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-3f700927-baa1-4e5d-a464-75b2590e9fe0 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 14:54:12 user nova-compute[70924]: DEBUG nova.objects.instance [None req-3f700927-baa1-4e5d-a464-75b2590e9fe0 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9ec07c62-951b-4e3a-bffa-e01dfb4665ec {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:54:12 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-3f700927-baa1-4e5d-a464-75b2590e9fe0 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:49:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-399297785',display_name='tempest-ServerRescueNegativeTestJSON-server-399297785',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-399297785',id=24,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:49:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8fcf4644e7a24bf68b407be2e3d9732c',ramdisk_id='',reservation_id='r-nfbumwrt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1436708078',owner_user_name='tempest-ServerRescueNegativeTestJSON-1436708078-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:49:35Z,user_data=None,user_id='8ec7e735cfff48828e0c0c7618f50711',uuid=9ec07c62-951b-4e3a-bffa-e01dfb4665ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb01658e-4dd9-426e-9b45-340ea19db056", "address": "fa:16:3e:75:a4:24", "network": {"id": "b2aee530-d195-47bb-b39d-c8bd15b81a08", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-421022738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-421022738-network", "vif_mac": "fa:16:3e:75:a4:24"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcf4644e7a24bf68b407be2e3d9732c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb01658e-4d", "ovs_interfaceid": "cb01658e-4dd9-426e-9b45-340ea19db056", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:54:12 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-3f700927-baa1-4e5d-a464-75b2590e9fe0 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Converting VIF {"id": "cb01658e-4dd9-426e-9b45-340ea19db056", "address": "fa:16:3e:75:a4:24", "network": {"id": "b2aee530-d195-47bb-b39d-c8bd15b81a08", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-421022738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-421022738-network", "vif_mac": "fa:16:3e:75:a4:24"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcf4644e7a24bf68b407be2e3d9732c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb01658e-4d", "ovs_interfaceid": "cb01658e-4dd9-426e-9b45-340ea19db056", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:54:12 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-3f700927-baa1-4e5d-a464-75b2590e9fe0 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:75:a4:24,bridge_name='br-int',has_traffic_filtering=True,id=cb01658e-4dd9-426e-9b45-340ea19db056,network=Network(b2aee530-d195-47bb-b39d-c8bd15b81a08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb01658e-4d') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:54:12 user nova-compute[70924]: DEBUG nova.objects.instance [None req-3f700927-baa1-4e5d-a464-75b2590e9fe0 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lazy-loading 'pci_devices' on Instance uuid 9ec07c62-951b-4e3a-bffa-e01dfb4665ec {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:54:12 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-3f700927-baa1-4e5d-a464-75b2590e9fe0 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] End _get_guest_xml xml=<domain type="kvm">
Jul 29 14:54:12 user nova-compute[70924]:   <uuid>9ec07c62-951b-4e3a-bffa-e01dfb4665ec</uuid>
Jul 29 14:54:12 user nova-compute[70924]:   <name>instance-00000018</name>
Jul 29 14:54:12 user nova-compute[70924]:   <memory>524288</memory>
Jul 29 14:54:12 user nova-compute[70924]:   <vcpu>1</vcpu>
Jul 29 14:54:12 user nova-compute[70924]:   <metadata>
Jul 29 14:54:12 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 14:54:12 user nova-compute[70924]:       <nova:package version="0.0.0"/>
Jul 29 14:54:12 user nova-compute[70924]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-399297785</nova:name>
Jul 29 14:54:12 user nova-compute[70924]:       <nova:creationTime>2023-07-29 14:54:12</nova:creationTime>
Jul 29 14:54:12 user nova-compute[70924]:       <nova:flavor name="m1.tiny">
Jul 29 14:54:12 user nova-compute[70924]:         <nova:memory>512</nova:memory>
Jul 29 14:54:12 user nova-compute[70924]:         <nova:disk>1</nova:disk>
Jul 29 14:54:12 user nova-compute[70924]:         <nova:swap>0</nova:swap>
Jul 29 14:54:12 user nova-compute[70924]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 14:54:12 user nova-compute[70924]:         <nova:vcpus>1</nova:vcpus>
Jul 29 14:54:12 user nova-compute[70924]:       </nova:flavor>
Jul 29 14:54:12 user nova-compute[70924]:       <nova:owner>
Jul 29 14:54:12 user nova-compute[70924]:         <nova:user uuid="8ec7e735cfff48828e0c0c7618f50711">tempest-ServerRescueNegativeTestJSON-1436708078-project-member</nova:user>
Jul 29 14:54:12 user nova-compute[70924]:         <nova:project uuid="8fcf4644e7a24bf68b407be2e3d9732c">tempest-ServerRescueNegativeTestJSON-1436708078</nova:project>
Jul 29 14:54:12 user nova-compute[70924]:       </nova:owner>
Jul 29 14:54:12 user nova-compute[70924]:       <nova:root type="image" uuid="3aba2e73-6832-404b-8bd0-d0503ce82b8c"/>
Jul 29 14:54:12 user nova-compute[70924]:       <nova:ports>
Jul 29 14:54:12 user nova-compute[70924]:         <nova:port uuid="cb01658e-4dd9-426e-9b45-340ea19db056">
Jul 29 14:54:12 user nova-compute[70924]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 29 14:54:12 user nova-compute[70924]:         </nova:port>
Jul 29 14:54:12 user nova-compute[70924]:       </nova:ports>
Jul 29 14:54:12 user nova-compute[70924]:     </nova:instance>
Jul 29 14:54:12 user nova-compute[70924]:   </metadata>
Jul 29 14:54:12 user nova-compute[70924]:   <sysinfo type="smbios">
Jul 29 14:54:12 user nova-compute[70924]:     <system>
Jul 29 14:54:12 user nova-compute[70924]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 14:54:12 user nova-compute[70924]:       <entry name="product">OpenStack Nova</entry>
Jul 29 14:54:12 user nova-compute[70924]:       <entry name="version">0.0.0</entry>
Jul 29 14:54:12 user nova-compute[70924]:       <entry name="serial">9ec07c62-951b-4e3a-bffa-e01dfb4665ec</entry>
Jul 29 14:54:12 user nova-compute[70924]:       <entry name="uuid">9ec07c62-951b-4e3a-bffa-e01dfb4665ec</entry>
Jul 29 14:54:12 user nova-compute[70924]:       <entry name="family">Virtual Machine</entry>
Jul 29 14:54:12 user nova-compute[70924]:     </system>
Jul 29 14:54:12 user nova-compute[70924]:   </sysinfo>
Jul 29 14:54:12 user nova-compute[70924]:   <os>
Jul 29 14:54:12 user nova-compute[70924]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 14:54:12 user nova-compute[70924]:     <smbios mode="sysinfo"/>
Jul 29 14:54:12 user nova-compute[70924]:   </os>
Jul 29 14:54:12 user nova-compute[70924]:   <features>
Jul 29 14:54:12 user nova-compute[70924]:     <acpi/>
Jul 29 14:54:12 user nova-compute[70924]:     <apic/>
Jul 29 14:54:12 user nova-compute[70924]:     <vmcoreinfo/>
Jul 29 14:54:12 user nova-compute[70924]:   </features>
Jul 29 14:54:12 user nova-compute[70924]:   <clock offset="utc">
Jul 29 14:54:12 user nova-compute[70924]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 14:54:12 user nova-compute[70924]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 14:54:12 user nova-compute[70924]:     <timer name="hpet" present="no"/>
Jul 29 14:54:12 user nova-compute[70924]:   </clock>
Jul 29 14:54:12 user nova-compute[70924]:   <cpu mode="custom" match="exact">
Jul 29 14:54:12 user nova-compute[70924]:     <model>Nehalem</model>
Jul 29 14:54:12 user nova-compute[70924]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 14:54:12 user nova-compute[70924]:   </cpu>
Jul 29 14:54:12 user nova-compute[70924]:   <devices>
Jul 29 14:54:12 user nova-compute[70924]:     <disk type="file" device="disk">
Jul 29 14:54:12 user nova-compute[70924]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 14:54:12 user nova-compute[70924]:       <source file="/opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk.rescue"/>
Jul 29 14:54:12 user nova-compute[70924]:       <target dev="vda" bus="virtio"/>
Jul 29 14:54:12 user nova-compute[70924]:     </disk>
Jul 29 14:54:12 user nova-compute[70924]:     <disk type="file" device="disk">
Jul 29 14:54:12 user nova-compute[70924]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 14:54:12 user nova-compute[70924]:       <source file="/opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk"/>
Jul 29 14:54:12 user nova-compute[70924]:       <target dev="vdb" bus="virtio"/>
Jul 29 14:54:12 user nova-compute[70924]:     </disk>
Jul 29 14:54:12 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 14:54:12 user nova-compute[70924]:       <mac address="fa:16:3e:75:a4:24"/>
Jul 29 14:54:12 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:54:12 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 14:54:12 user nova-compute[70924]:       <target dev="tapcb01658e-4d"/>
Jul 29 14:54:12 user nova-compute[70924]:     </interface>
Jul 29 14:54:12 user nova-compute[70924]:     <serial type="pty">
Jul 29 14:54:12 user nova-compute[70924]:       <log file="/opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/console.log" append="off"/>
Jul 29 14:54:12 user nova-compute[70924]:     </serial>
Jul 29 14:54:12 user nova-compute[70924]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 14:54:12 user nova-compute[70924]:     <video>
Jul 29 14:54:12 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:54:12 user nova-compute[70924]:     </video>
Jul 29 14:54:12 user nova-compute[70924]:     <rng model="virtio">
Jul 29 14:54:12 user nova-compute[70924]:       <backend model="random">/dev/urandom</backend>
Jul 29 14:54:12 user nova-compute[70924]:     </rng>
Jul 29 14:54:12 user nova-compute[70924]:     <controller type="usb" index="0" model="none"/>
Jul 29 14:54:12 user nova-compute[70924]:     <memballoon model="virtio">
Jul 29 14:54:12 user nova-compute[70924]:       <stats period="10"/>
Jul 29 14:54:12 user nova-compute[70924]:     </memballoon>
Jul 29 14:54:12 user nova-compute[70924]:   </devices>
Jul 29 14:54:12 user nova-compute[70924]: </domain>
Jul 29 14:54:12 user nova-compute[70924]:  {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 14:54:12 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Instance destroyed successfully.
Jul 29 14:54:12 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-3f700927-baa1-4e5d-a464-75b2590e9fe0 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:54:12 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-3f700927-baa1-4e5d-a464-75b2590e9fe0 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:54:12 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-3f700927-baa1-4e5d-a464-75b2590e9fe0 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] No VIF found with MAC fa:16:3e:75:a4:24, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:54:13 user nova-compute[70924]: DEBUG nova.compute.manager [req-c9e31668-e118-44ff-9509-295dfd4655e6 req-0b5ddd22-21e8-436e-8a05-3f347ce1826b service nova] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Received event network-vif-plugged-cb01658e-4dd9-426e-9b45-340ea19db056 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:54:13 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c9e31668-e118-44ff-9509-295dfd4655e6 req-0b5ddd22-21e8-436e-8a05-3f347ce1826b service nova] Acquiring lock "9ec07c62-951b-4e3a-bffa-e01dfb4665ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:54:13 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c9e31668-e118-44ff-9509-295dfd4655e6 req-0b5ddd22-21e8-436e-8a05-3f347ce1826b service nova] Lock "9ec07c62-951b-4e3a-bffa-e01dfb4665ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:54:13 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c9e31668-e118-44ff-9509-295dfd4655e6 req-0b5ddd22-21e8-436e-8a05-3f347ce1826b service nova] Lock "9ec07c62-951b-4e3a-bffa-e01dfb4665ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:54:13 user nova-compute[70924]: DEBUG nova.compute.manager [req-c9e31668-e118-44ff-9509-295dfd4655e6 req-0b5ddd22-21e8-436e-8a05-3f347ce1826b service nova] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] No waiting events found dispatching network-vif-plugged-cb01658e-4dd9-426e-9b45-340ea19db056 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:54:13 user nova-compute[70924]: WARNING nova.compute.manager [req-c9e31668-e118-44ff-9509-295dfd4655e6 req-0b5ddd22-21e8-436e-8a05-3f347ce1826b service nova] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Received unexpected event network-vif-plugged-cb01658e-4dd9-426e-9b45-340ea19db056 for instance with vm_state active and task_state rescuing.
Jul 29 14:54:13 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:54:13 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:54:13 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:54:13 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:54:13 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:54:13 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:54:14 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:54:15 user nova-compute[70924]: DEBUG nova.compute.manager [req-9463249e-121b-4406-8c89-74befe0d13f9 req-6ffa6d5c-b635-4eca-8f0d-95c2adfb6c83 service nova] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Received event network-vif-plugged-cb01658e-4dd9-426e-9b45-340ea19db056 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:54:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-9463249e-121b-4406-8c89-74befe0d13f9 req-6ffa6d5c-b635-4eca-8f0d-95c2adfb6c83 service nova] Acquiring lock "9ec07c62-951b-4e3a-bffa-e01dfb4665ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:54:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-9463249e-121b-4406-8c89-74befe0d13f9 req-6ffa6d5c-b635-4eca-8f0d-95c2adfb6c83 service nova] Lock "9ec07c62-951b-4e3a-bffa-e01dfb4665ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:54:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-9463249e-121b-4406-8c89-74befe0d13f9 req-6ffa6d5c-b635-4eca-8f0d-95c2adfb6c83 service nova] Lock "9ec07c62-951b-4e3a-bffa-e01dfb4665ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:54:15 user nova-compute[70924]: DEBUG nova.compute.manager [req-9463249e-121b-4406-8c89-74befe0d13f9 req-6ffa6d5c-b635-4eca-8f0d-95c2adfb6c83 service nova] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] No waiting events found dispatching network-vif-plugged-cb01658e-4dd9-426e-9b45-340ea19db056 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:54:15 user nova-compute[70924]: WARNING nova.compute.manager [req-9463249e-121b-4406-8c89-74befe0d13f9 req-6ffa6d5c-b635-4eca-8f0d-95c2adfb6c83 service nova] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Received unexpected event network-vif-plugged-cb01658e-4dd9-426e-9b45-340ea19db056 for instance with vm_state active and task_state rescuing.
Jul 29 14:54:15 user nova-compute[70924]: DEBUG nova.compute.manager [req-9463249e-121b-4406-8c89-74befe0d13f9 req-6ffa6d5c-b635-4eca-8f0d-95c2adfb6c83 service nova] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Received event network-vif-plugged-cb01658e-4dd9-426e-9b45-340ea19db056 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:54:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-9463249e-121b-4406-8c89-74befe0d13f9 req-6ffa6d5c-b635-4eca-8f0d-95c2adfb6c83 service nova] Acquiring lock "9ec07c62-951b-4e3a-bffa-e01dfb4665ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:54:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-9463249e-121b-4406-8c89-74befe0d13f9 req-6ffa6d5c-b635-4eca-8f0d-95c2adfb6c83 service nova] Lock "9ec07c62-951b-4e3a-bffa-e01dfb4665ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:54:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-9463249e-121b-4406-8c89-74befe0d13f9 req-6ffa6d5c-b635-4eca-8f0d-95c2adfb6c83 service nova] Lock "9ec07c62-951b-4e3a-bffa-e01dfb4665ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:54:15 user nova-compute[70924]: DEBUG nova.compute.manager [req-9463249e-121b-4406-8c89-74befe0d13f9 req-6ffa6d5c-b635-4eca-8f0d-95c2adfb6c83 service nova] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] No waiting events found dispatching network-vif-plugged-cb01658e-4dd9-426e-9b45-340ea19db056 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:54:15 user nova-compute[70924]: WARNING nova.compute.manager [req-9463249e-121b-4406-8c89-74befe0d13f9 req-6ffa6d5c-b635-4eca-8f0d-95c2adfb6c83 service nova] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Received unexpected event network-vif-plugged-cb01658e-4dd9-426e-9b45-340ea19db056 for instance with vm_state active and task_state rescuing.
Jul 29 14:54:15 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Removed pending event for 9ec07c62-951b-4e3a-bffa-e01dfb4665ec due to event {{(pid=70924) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 29 14:54:15 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642455.7366734, 9ec07c62-951b-4e3a-bffa-e01dfb4665ec => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:54:15 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] VM Resumed (Lifecycle Event)
Jul 29 14:54:15 user nova-compute[70924]: DEBUG nova.compute.manager [None req-3f700927-baa1-4e5d-a464-75b2590e9fe0 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:54:15 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:54:15 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:54:15 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 29 14:54:15 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642455.737983, 9ec07c62-951b-4e3a-bffa-e01dfb4665ec => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:54:15 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] VM Started (Lifecycle Event)
Jul 29 14:54:15 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:54:15 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:54:16 user nova-compute[70924]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690642441.9879296, 7cb12b3e-de44-4887-ab74-2a68164b5f7d => Stopped> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:54:16 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] VM Stopped (Lifecycle Event)
Jul 29 14:54:17 user nova-compute[70924]: DEBUG nova.compute.manager [None req-3eac9ccf-ee97-4510-a01a-22644f40b3d6 None None] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:54:17 user nova-compute[70924]: DEBUG nova.compute.manager [None req-3eac9ccf-ee97-4510-a01a-22644f40b3d6 None None] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:54:18 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:54:19 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:54:23 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:54:24 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:54:27 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-8a9af4c7-b670-433a-81fa-e4288fc8d90d tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Acquiring lock "bdaf1714-27f9-47ee-808b-206ec78c6067" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:54:27 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-8a9af4c7-b670-433a-81fa-e4288fc8d90d tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "bdaf1714-27f9-47ee-808b-206ec78c6067" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:54:27 user nova-compute[70924]: INFO nova.compute.manager [None req-8a9af4c7-b670-433a-81fa-e4288fc8d90d tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Detaching volume f56651ac-e14a-456e-8195-3627842873e4
Jul 29 14:54:28 user nova-compute[70924]: INFO nova.virt.block_device [None req-8a9af4c7-b670-433a-81fa-e4288fc8d90d tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Attempting to driver detach volume f56651ac-e14a-456e-8195-3627842873e4 from mountpoint /dev/vdc
Jul 29 14:54:28 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-8a9af4c7-b670-433a-81fa-e4288fc8d90d tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Attempting to detach device vdc from instance bdaf1714-27f9-47ee-808b-206ec78c6067 from the persistent domain config. {{(pid=70924) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 29 14:54:28 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-8a9af4c7-b670-433a-81fa-e4288fc8d90d tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 14:54:28 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:54:28 user nova-compute[70924]:   <source dev="/dev/sdf"/>
Jul 29 14:54:28 user nova-compute[70924]:   <target dev="vdc" bus="virtio"/>
Jul 29 14:54:28 user nova-compute[70924]:   <serial>f56651ac-e14a-456e-8195-3627842873e4</serial>
Jul 29 14:54:28 user nova-compute[70924]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 29 14:54:28 user nova-compute[70924]: </disk>
Jul 29 14:54:28 user nova-compute[70924]:  {{(pid=70924) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 14:54:28 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-8a9af4c7-b670-433a-81fa-e4288fc8d90d tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Successfully detached device vdc from instance bdaf1714-27f9-47ee-808b-206ec78c6067 from the persistent domain config.
Jul 29 14:54:28 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-8a9af4c7-b670-433a-81fa-e4288fc8d90d tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance bdaf1714-27f9-47ee-808b-206ec78c6067 from the live domain config. {{(pid=70924) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 29 14:54:28 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-8a9af4c7-b670-433a-81fa-e4288fc8d90d tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 14:54:28 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:54:28 user nova-compute[70924]:   <source dev="/dev/sdf"/>
Jul 29 14:54:28 user nova-compute[70924]:   <target dev="vdc" bus="virtio"/>
Jul 29 14:54:28 user nova-compute[70924]:   <serial>f56651ac-e14a-456e-8195-3627842873e4</serial>
Jul 29 14:54:28 user nova-compute[70924]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 29 14:54:28 user nova-compute[70924]: </disk>
Jul 29 14:54:28 user nova-compute[70924]:  {{(pid=70924) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 14:54:28 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Received event <DeviceRemovedEvent: 1690642468.521169, bdaf1714-27f9-47ee-808b-206ec78c6067 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=70924) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 29 14:54:28 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-8a9af4c7-b670-433a-81fa-e4288fc8d90d tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance bdaf1714-27f9-47ee-808b-206ec78c6067 {{(pid=70924) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 29 14:54:28 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-8a9af4c7-b670-433a-81fa-e4288fc8d90d tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Successfully detached device vdc from instance bdaf1714-27f9-47ee-808b-206ec78c6067 from the live domain config.
Jul 29 14:54:28 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a9af4c7-b670-433a-81fa-e4288fc8d90d tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] calling os-brick to detach iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 14:54:28 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9af4c7-b670-433a-81fa-e4288fc8d90d tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, {'target_iqns': ['iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OonHpJYc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:54:28 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-8a9af4c7-b670-433a-81fa-e4288fc8d90d tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:54:28 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-8a9af4c7-b670-433a-81fa-e4288fc8d90d tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:54:28 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-8a9af4c7-b670-433a-81fa-e4288fc8d90d tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:54:28 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9af4c7-b670-433a-81fa-e4288fc8d90d tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4', 0)] {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 14:54:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:54:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:54:28 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9a6446-545a-45c5-8b20-335ed5122dc2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:54:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:54:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:54:28 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0468bfc8-bfb5-4f55-bee8-2a1fdd2731f9]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:54:28 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9af4c7-b670-433a-81fa-e4288fc8d90d tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:54:28 user nova-compute[70924]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:54:28 user nova-compute[70924]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)
Jul 29 14:54:28 user nova-compute[70924]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4 (non-flash)
Jul 29 14:54:28 user nova-compute[70924]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb (non-flash)
Jul 29 14:54:28 user nova-compute[70924]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)
Jul 29 14:54:28 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:54:28 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9af4c7-b670-433a-81fa-e4288fc8d90d tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:54:28 user nova-compute[70924]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:54:28 user nova-compute[70924]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)
Jul 29 14:54:28 user nova-compute[70924]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4 (non-flash)
Jul 29 14:54:28 user nova-compute[70924]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb (non-flash)
Jul 29 14:54:28 user nova-compute[70924]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)
Jul 29 14:54:28 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:54:28 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9af4c7-b670-433a-81fa-e4288fc8d90d tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feee9a89cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4'): ({'sdf'}, set())}) {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 14:54:28 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-8a9af4c7-b670-433a-81fa-e4288fc8d90d tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Removing single pathed devices sdf {{(pid=70924) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 14:54:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:54:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:54:28 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3470195-6cce-43f3-b8c3-120d32828a3e]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:54:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:54:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:54:28 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51e8ef3-065e-45f7-97d0-40040d5c0968]: (4, ('ok\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:54:28 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-8a9af4c7-b670-433a-81fa-e4288fc8d90d tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Flushing IO for device /dev/sdf {{(pid=70924) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 14:54:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:54:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:54:28 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[164ac9cd-e484-4002-bd83-520cc158a068]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:54:28 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-8a9af4c7-b670-433a-81fa-e4288fc8d90d tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=70924) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 14:54:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:54:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:54:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.051s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:54:28 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[71abbdb2-35b6-4316-a785-172f5dcdb71d]: (4, ('1', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:54:28 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-8a9af4c7-b670-433a-81fa-e4288fc8d90d tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 14:54:28 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-8a9af4c7-b670-433a-81fa-e4288fc8d90d tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] SCSI volumes sdf have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 14:54:28 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9af4c7-b670-433a-81fa-e4288fc8d90d tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4')] {{(pid=70924) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 14:54:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:54:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:54:28 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca232e24-d9f8-4baa-9174-1e6e377f0b32]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:54:28 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9af4c7-b670-433a-81fa-e4288fc8d90d tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:54:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4 -p 172.16.0.220:3260 --logout {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:54:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:54:28 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8129218-783b-48c9-bd3e-09c25869d237]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:54:28 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9af4c7-b670-433a-81fa-e4288fc8d90d tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4, portal: 172.16.0.220,3260]
Jul 29 14:54:28 user nova-compute[70924]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4, portal: 172.16.0.220,3260] successful.
Jul 29 14:54:28 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:54:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4 -p 172.16.0.220:3260 --op delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:54:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f56651ac-e14a-456e-8195-3627842873e4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:54:28 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[047f07b8-7cb0-4d6a-b1cf-bbc208972e0e]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:54:28 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9af4c7-b670-433a-81fa-e4288fc8d90d tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:54:28 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-8a9af4c7-b670-433a-81fa-e4288fc8d90d tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:54:28 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a9af4c7-b670-433a-81fa-e4288fc8d90d tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] <== disconnect_volume: return (322ms) None {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:54:28 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a9af4c7-b670-433a-81fa-e4288fc8d90d tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Disconnected iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 14:54:29 user nova-compute[70924]: DEBUG nova.objects.instance [None req-8a9af4c7-b670-433a-81fa-e4288fc8d90d tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lazy-loading 'flavor' on Instance uuid bdaf1714-27f9-47ee-808b-206ec78c6067 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:54:29 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-8a9af4c7-b670-433a-81fa-e4288fc8d90d tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "bdaf1714-27f9-47ee-808b-206ec78c6067" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.718s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:54:29 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:54:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ef8df106-128a-415b-9333-26cd0bf601f6 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Acquiring lock "1f7989ca-77e9-440f-bd2f-60e46e005557" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:54:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ef8df106-128a-415b-9333-26cd0bf601f6 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lock "1f7989ca-77e9-440f-bd2f-60e46e005557" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:54:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ef8df106-128a-415b-9333-26cd0bf601f6 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Acquiring lock "1f7989ca-77e9-440f-bd2f-60e46e005557-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:54:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ef8df106-128a-415b-9333-26cd0bf601f6 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lock "1f7989ca-77e9-440f-bd2f-60e46e005557-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:54:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ef8df106-128a-415b-9333-26cd0bf601f6 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lock "1f7989ca-77e9-440f-bd2f-60e46e005557-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:54:30 user nova-compute[70924]: INFO nova.compute.manager [None req-ef8df106-128a-415b-9333-26cd0bf601f6 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Terminating instance
Jul 29 14:54:30 user nova-compute[70924]: DEBUG nova.compute.manager [None req-ef8df106-128a-415b-9333-26cd0bf601f6 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Start destroying the instance on the hypervisor. {{(pid=70924) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 14:54:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:54:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:54:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:54:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:54:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:54:31 user nova-compute[70924]: DEBUG nova.compute.manager [req-2ff98258-50d3-43ce-83d0-acd74de39b42 req-c717bfdc-e45b-4a12-a473-75ef6a0f3c42 service nova] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Received event network-vif-unplugged-4fdb3c78-791e-4638-8def-ec63abfa254d {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:54:31 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-2ff98258-50d3-43ce-83d0-acd74de39b42 req-c717bfdc-e45b-4a12-a473-75ef6a0f3c42 service nova] Acquiring lock "1f7989ca-77e9-440f-bd2f-60e46e005557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:54:31 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-2ff98258-50d3-43ce-83d0-acd74de39b42 req-c717bfdc-e45b-4a12-a473-75ef6a0f3c42 service nova] Lock "1f7989ca-77e9-440f-bd2f-60e46e005557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:54:31 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-2ff98258-50d3-43ce-83d0-acd74de39b42 req-c717bfdc-e45b-4a12-a473-75ef6a0f3c42 service nova] Lock "1f7989ca-77e9-440f-bd2f-60e46e005557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:54:31 user nova-compute[70924]: DEBUG nova.compute.manager [req-2ff98258-50d3-43ce-83d0-acd74de39b42 req-c717bfdc-e45b-4a12-a473-75ef6a0f3c42 service nova] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] No waiting events found dispatching network-vif-unplugged-4fdb3c78-791e-4638-8def-ec63abfa254d {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:54:31 user nova-compute[70924]: DEBUG nova.compute.manager [req-2ff98258-50d3-43ce-83d0-acd74de39b42 req-c717bfdc-e45b-4a12-a473-75ef6a0f3c42 service nova] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Received event network-vif-unplugged-4fdb3c78-791e-4638-8def-ec63abfa254d for instance with task_state deleting. {{(pid=70924) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 14:54:31 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Instance destroyed successfully.
Jul 29 14:54:31 user nova-compute[70924]: DEBUG nova.objects.instance [None req-ef8df106-128a-415b-9333-26cd0bf601f6 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lazy-loading 'resources' on Instance uuid 1f7989ca-77e9-440f-bd2f-60e46e005557 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:54:31 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-ef8df106-128a-415b-9333-26cd0bf601f6 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:47:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1035627137',display_name='tempest-SnapshotDataIntegrityTests-server-1035627137',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1035627137',id=19,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOW4Vb7Fde2KN5KBYzR7NXCPI46n57IZiqdlNijlO8O55HSkwbteWcppPciLWtVPwInqoGDWxxTHZcydj+yeq8s17OmPiiCShvdNC6vFLWbM1xOkA0q6mHBPs+hZyb927g==',key_name='tempest-keypair-1948217579',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:47:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b4a2f0557d16467f8f1c7f8a2890e9e8',ramdisk_id='',reservation_id='r-tsdr4fhw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-444803474',owner_user_name='tempest-SnapshotDataIntegrityTests-444803474-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:47:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='474262573a7c4fee90b9f991d2ec9c01',uuid=1f7989ca-77e9-440f-bd2f-60e46e005557,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4fdb3c78-791e-4638-8def-ec63abfa254d", "address": "fa:16:3e:09:43:b7", "network": {"id": "14a35b1f-254b-4eae-8c5f-d18ab7e0cb3c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1329518083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4a2f0557d16467f8f1c7f8a2890e9e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fdb3c78-79", "ovs_interfaceid": "4fdb3c78-791e-4638-8def-ec63abfa254d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 14:54:31 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-ef8df106-128a-415b-9333-26cd0bf601f6 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Converting VIF {"id": "4fdb3c78-791e-4638-8def-ec63abfa254d", "address": "fa:16:3e:09:43:b7", "network": {"id": "14a35b1f-254b-4eae-8c5f-d18ab7e0cb3c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1329518083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4a2f0557d16467f8f1c7f8a2890e9e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fdb3c78-79", "ovs_interfaceid": "4fdb3c78-791e-4638-8def-ec63abfa254d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:54:31 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-ef8df106-128a-415b-9333-26cd0bf601f6 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:09:43:b7,bridge_name='br-int',has_traffic_filtering=True,id=4fdb3c78-791e-4638-8def-ec63abfa254d,network=Network(14a35b1f-254b-4eae-8c5f-d18ab7e0cb3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fdb3c78-79') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:54:31 user nova-compute[70924]: DEBUG os_vif [None req-ef8df106-128a-415b-9333-26cd0bf601f6 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:43:b7,bridge_name='br-int',has_traffic_filtering=True,id=4fdb3c78-791e-4638-8def-ec63abfa254d,network=Network(14a35b1f-254b-4eae-8c5f-d18ab7e0cb3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fdb3c78-79') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 14:54:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:54:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4fdb3c78-79, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:54:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:54:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:54:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:54:31 user nova-compute[70924]: INFO os_vif [None req-ef8df106-128a-415b-9333-26cd0bf601f6 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:43:b7,bridge_name='br-int',has_traffic_filtering=True,id=4fdb3c78-791e-4638-8def-ec63abfa254d,network=Network(14a35b1f-254b-4eae-8c5f-d18ab7e0cb3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fdb3c78-79')
Jul 29 14:54:31 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-ef8df106-128a-415b-9333-26cd0bf601f6 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Deleting instance files /opt/stack/data/nova/instances/1f7989ca-77e9-440f-bd2f-60e46e005557_del
Jul 29 14:54:31 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-ef8df106-128a-415b-9333-26cd0bf601f6 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Deletion of /opt/stack/data/nova/instances/1f7989ca-77e9-440f-bd2f-60e46e005557_del complete
Jul 29 14:54:31 user nova-compute[70924]: INFO nova.compute.manager [None req-ef8df106-128a-415b-9333-26cd0bf601f6 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Took 0.88 seconds to destroy the instance on the hypervisor.
Jul 29 14:54:31 user nova-compute[70924]: DEBUG oslo.service.loopingcall [None req-ef8df106-128a-415b-9333-26cd0bf601f6 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70924) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 14:54:31 user nova-compute[70924]: DEBUG nova.compute.manager [-] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Deallocating network for instance {{(pid=70924) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 14:54:31 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] deallocate_for_instance() {{(pid=70924) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 14:54:32 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:54:32 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:54:32 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Took 0.81 seconds to deallocate network for instance.
Jul 29 14:54:32 user nova-compute[70924]: DEBUG nova.compute.manager [req-f1024738-5bc9-472b-a616-2c98fec97a15 req-c7bc3203-d3dd-41c9-b3e0-feaa13207974 service nova] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Received event network-vif-deleted-4fdb3c78-791e-4638-8def-ec63abfa254d {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:54:32 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ef8df106-128a-415b-9333-26cd0bf601f6 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:54:32 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ef8df106-128a-415b-9333-26cd0bf601f6 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:54:33 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-ef8df106-128a-415b-9333-26cd0bf601f6 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:54:33 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-ef8df106-128a-415b-9333-26cd0bf601f6 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:54:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ef8df106-128a-415b-9333-26cd0bf601f6 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.460s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:54:33 user nova-compute[70924]: INFO nova.scheduler.client.report [None req-ef8df106-128a-415b-9333-26cd0bf601f6 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Deleted allocations for instance 1f7989ca-77e9-440f-bd2f-60e46e005557
Jul 29 14:54:33 user nova-compute[70924]: DEBUG nova.compute.manager [req-1e14c18d-8b14-4d9c-860f-949b287d70bf req-4bcab68d-913e-4195-948a-4d4f975fc3cc service nova] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Received event network-vif-plugged-4fdb3c78-791e-4638-8def-ec63abfa254d {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:54:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-1e14c18d-8b14-4d9c-860f-949b287d70bf req-4bcab68d-913e-4195-948a-4d4f975fc3cc service nova] Acquiring lock "1f7989ca-77e9-440f-bd2f-60e46e005557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:54:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-1e14c18d-8b14-4d9c-860f-949b287d70bf req-4bcab68d-913e-4195-948a-4d4f975fc3cc service nova] Lock "1f7989ca-77e9-440f-bd2f-60e46e005557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:54:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-1e14c18d-8b14-4d9c-860f-949b287d70bf req-4bcab68d-913e-4195-948a-4d4f975fc3cc service nova] Lock "1f7989ca-77e9-440f-bd2f-60e46e005557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:54:33 user nova-compute[70924]: DEBUG nova.compute.manager [req-1e14c18d-8b14-4d9c-860f-949b287d70bf req-4bcab68d-913e-4195-948a-4d4f975fc3cc service nova] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] No waiting events found dispatching network-vif-plugged-4fdb3c78-791e-4638-8def-ec63abfa254d {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:54:33 user nova-compute[70924]: WARNING nova.compute.manager [req-1e14c18d-8b14-4d9c-860f-949b287d70bf req-4bcab68d-913e-4195-948a-4d4f975fc3cc service nova] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Received unexpected event network-vif-plugged-4fdb3c78-791e-4638-8def-ec63abfa254d for instance with vm_state deleted and task_state None.
Jul 29 14:54:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ef8df106-128a-415b-9333-26cd0bf601f6 tempest-SnapshotDataIntegrityTests-444803474 tempest-SnapshotDataIntegrityTests-444803474-project-member] Lock "1f7989ca-77e9-440f-bd2f-60e46e005557" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.416s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:54:33 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:54:36 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:54:38 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:54:41 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:54:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:54:46 user nova-compute[70924]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690642471.5600092, 1f7989ca-77e9-440f-bd2f-60e46e005557 => Stopped> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:54:46 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] VM Stopped (Lifecycle Event)
Jul 29 14:54:46 user nova-compute[70924]: DEBUG nova.compute.manager [None req-62746f58-23fa-44dd-8ee5-5d9368612170 None None] [instance: 1f7989ca-77e9-440f-bd2f-60e46e005557] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:54:46 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:54:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:54:51 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:54:53 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:54:53 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:54:53 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:54:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:54:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:54:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:54:53 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Auditing locally available compute resources for user (node: user) {{(pid=70924) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 14:54:53 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk.rescue --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:54:53 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:54:53 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk.rescue --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:54:53 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:54:53 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:54:54 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:54:54 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:54:54 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:54:54 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:54:54 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:54:54 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:54:54 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:54:54 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 14:54:54 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:54:54 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:54:54 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:54:54 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:54:54 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c31a724f-3006-4e5d-a9b5-847fd6cd170a/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:54:54 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c31a724f-3006-4e5d-a9b5-847fd6cd170a/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:54:54 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c31a724f-3006-4e5d-a9b5-847fd6cd170a/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:54:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c31a724f-3006-4e5d-a9b5-847fd6cd170a/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:54:55 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 14:54:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cb12b3e-de44-4887-ab74-2a68164b5f7d/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:54:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cb12b3e-de44-4887-ab74-2a68164b5f7d/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:54:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cb12b3e-de44-4887-ab74-2a68164b5f7d/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:54:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cb12b3e-de44-4887-ab74-2a68164b5f7d/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:54:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:54:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:54:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:54:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:54:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7171083a-00aa-4faf-9732-88cab8a0d83d/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:54:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7171083a-00aa-4faf-9732-88cab8a0d83d/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:54:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7171083a-00aa-4faf-9732-88cab8a0d83d/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:54:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7171083a-00aa-4faf-9732-88cab8a0d83d/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:54:55 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 14:54:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710f0d5a-8420-49c4-bf70-27305dd85bd3/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:54:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710f0d5a-8420-49c4-bf70-27305dd85bd3/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:54:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710f0d5a-8420-49c4-bf70-27305dd85bd3/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:54:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710f0d5a-8420-49c4-bf70-27305dd85bd3/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:54:56 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 14:54:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdaf1714-27f9-47ee-808b-206ec78c6067/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:54:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdaf1714-27f9-47ee-808b-206ec78c6067/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:54:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdaf1714-27f9-47ee-808b-206ec78c6067/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:54:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdaf1714-27f9-47ee-808b-206ec78c6067/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:54:56 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 14:54:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk.rescue --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:54:56 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:54:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:54:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk.rescue --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:54:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk.rescue --force-share --output=json" returned: 0 in 0.149s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:54:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:54:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:54:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:54:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:54:57 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:54:57 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:54:57 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Hypervisor/Node resource view: name=user free_ram=6830MB free_disk=25.19487762451172GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70924) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 14:54:57 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:54:57 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:54:57 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance db656346-c4af-43da-9600-fd39f1b9e4dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:54:57 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 86ecc6cb-88a8-4572-8e41-d4c5859036a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:54:57 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 02c75b00-a1b4-4ef9-ae96-bc67d8038589 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:54:57 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 7cb12b3e-de44-4887-ab74-2a68164b5f7d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:54:57 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 7171083a-00aa-4faf-9732-88cab8a0d83d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:54:57 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 9ec07c62-951b-4e3a-bffa-e01dfb4665ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:54:57 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 091e384f-7851-4ac9-b566-990df0497fc5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:54:57 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance c31a724f-3006-4e5d-a9b5-847fd6cd170a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:54:57 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance f5350fb5-9460-490b-a47e-74f88c8eb51c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:54:57 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance fd57baf8-6306-4553-a058-e915fb543405 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:54:57 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance bdaf1714-27f9-47ee-808b-206ec78c6067 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:54:57 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 710f0d5a-8420-49c4-bf70-27305dd85bd3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:54:57 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance b001d812-892a-4756-9f37-fc0c5ef5f0a7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:54:57 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance fd91d5fc-857d-4d63-ad83-8028c1d3309f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:54:57 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 14:54:57 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 14:54:58 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:54:58 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:54:58 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Compute_service record updated for user:user {{(pid=70924) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 14:54:58 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.579s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:55:00 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:55:00 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:55:00 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Starting heal instance info cache {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 14:55:00 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "refresh_cache-7171083a-00aa-4faf-9732-88cab8a0d83d" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:55:00 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquired lock "refresh_cache-7171083a-00aa-4faf-9732-88cab8a0d83d" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:55:00 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] Forcefully refreshing network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 29 14:55:00 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] Updating instance_info_cache with network_info: [{"id": "67386daa-d99b-4cd2-aec9-5df2b4d957f0", "address": "fa:16:3e:04:89:76", "network": {"id": "cb1ab4d5-0cba-4628-bca8-015a7acce83b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-875103426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d5793d2e5b9451f9ef38fa61cb877d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67386daa-d9", "ovs_interfaceid": "67386daa-d99b-4cd2-aec9-5df2b4d957f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:55:00 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Releasing lock "refresh_cache-7171083a-00aa-4faf-9732-88cab8a0d83d" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:55:00 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] Updated the network info_cache for instance {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 29 14:55:00 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:55:00 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:55:00 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:55:00 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:55:00 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:55:00 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70924) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 14:55:01 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-3f408793-13fe-4859-bb13-940675e20edb tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Acquiring lock "710f0d5a-8420-49c4-bf70-27305dd85bd3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:55:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-3f408793-13fe-4859-bb13-940675e20edb tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lock "710f0d5a-8420-49c4-bf70-27305dd85bd3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:55:01 user nova-compute[70924]: DEBUG nova.objects.instance [None req-3f408793-13fe-4859-bb13-940675e20edb tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lazy-loading 'flavor' on Instance uuid 710f0d5a-8420-49c4-bf70-27305dd85bd3 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:55:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-3f408793-13fe-4859-bb13-940675e20edb tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lock "710f0d5a-8420-49c4-bf70-27305dd85bd3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:55:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-3f408793-13fe-4859-bb13-940675e20edb tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Acquiring lock "710f0d5a-8420-49c4-bf70-27305dd85bd3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:55:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-3f408793-13fe-4859-bb13-940675e20edb tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lock "710f0d5a-8420-49c4-bf70-27305dd85bd3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:55:02 user nova-compute[70924]: INFO nova.compute.manager [None req-3f408793-13fe-4859-bb13-940675e20edb tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Attaching volume 3ac35b93-78b7-4614-a0c6-aa80496897e2 to /dev/vdb
Jul 29 14:55:02 user nova-compute[70924]: DEBUG os_brick.utils [None req-3f408793-13fe-4859-bb13-940675e20edb tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:55:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:02 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a059b51-4c54-4d3e-9933-cc69f6aac744]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f2127c4a30d9\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:55:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:02 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[97385e45-610d-42b7-989d-0dde2b475d2b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:55:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:02 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a434f07-077c-4a69-be3e-02f6d3abf6c5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:55:02 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[16793b27-c603-4e0e-b797-29ae9bff9030]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:55:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-3f408793-13fe-4859-bb13-940675e20edb tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Running cmd (subprocess): nvme version {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-3f408793-13fe-4859-bb13-940675e20edb tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] 'nvme version' failed. Not Retrying. {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:55:02 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3f408793-13fe-4859-bb13-940675e20edb tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] nvme not present on system {{(pid=70924) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 14:55:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:55:02 user nova-compute[70924]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 14:55:02 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b0b24e-2577-4211-b9bd-a5eef9694691]: (4, '') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:55:02 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-3f408793-13fe-4859-bb13-940675e20edb tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70924) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 14:55:02 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-3f408793-13fe-4859-bb13-940675e20edb tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 14:55:02 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-3f408793-13fe-4859-bb13-940675e20edb tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] LIGHTOS: no hostnqn found. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 14:55:02 user nova-compute[70924]: DEBUG os_brick.utils [None req-3f408793-13fe-4859-bb13-940675e20edb tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f2127c4a30d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:55:02 user nova-compute[70924]: DEBUG nova.virt.block_device [None req-3f408793-13fe-4859-bb13-940675e20edb tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Updating existing volume attachment record: fbc6d190-6929-47be-ada5-f14d2d7c5b47 {{(pid=70924) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 14:55:06 user nova-compute[70924]: INFO nova.compute.manager [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Rescuing
Jul 29 14:55:06 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Acquiring lock "refresh_cache-b001d812-892a-4756-9f37-fc0c5ef5f0a7" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:55:06 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Acquired lock "refresh_cache-b001d812-892a-4756-9f37-fc0c5ef5f0a7" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:55:06 user nova-compute[70924]: DEBUG nova.network.neutron [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 14:55:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:55:07 user nova-compute[70924]: DEBUG nova.network.neutron [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Updating instance_info_cache with network_info: [{"id": "a17ada4e-69e7-42ef-b08d-f405a5da6368", "address": "fa:16:3e:62:06:29", "network": {"id": "d5876e18-e2af-45c2-aab5-2d0d552ebfe4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2035085552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9e5c78c1684c359cfab4e32b9c213f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa17ada4e-69", "ovs_interfaceid": "a17ada4e-69e7-42ef-b08d-f405a5da6368", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:55:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Releasing lock "refresh_cache-b001d812-892a-4756-9f37-fc0c5ef5f0a7" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:55:07 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:07 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:07 user nova-compute[70924]: DEBUG nova.compute.manager [req-1aa09661-7e13-4146-9489-b46b0397e80e req-49edf6e3-5476-4b22-8d0b-93faed5f0793 service nova] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Received event network-vif-unplugged-a17ada4e-69e7-42ef-b08d-f405a5da6368 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:55:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-1aa09661-7e13-4146-9489-b46b0397e80e req-49edf6e3-5476-4b22-8d0b-93faed5f0793 service nova] Acquiring lock "b001d812-892a-4756-9f37-fc0c5ef5f0a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:55:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-1aa09661-7e13-4146-9489-b46b0397e80e req-49edf6e3-5476-4b22-8d0b-93faed5f0793 service nova] Lock "b001d812-892a-4756-9f37-fc0c5ef5f0a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:55:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-1aa09661-7e13-4146-9489-b46b0397e80e req-49edf6e3-5476-4b22-8d0b-93faed5f0793 service nova] Lock "b001d812-892a-4756-9f37-fc0c5ef5f0a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:55:07 user nova-compute[70924]: DEBUG nova.compute.manager [req-1aa09661-7e13-4146-9489-b46b0397e80e req-49edf6e3-5476-4b22-8d0b-93faed5f0793 service nova] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] No waiting events found dispatching network-vif-unplugged-a17ada4e-69e7-42ef-b08d-f405a5da6368 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:55:07 user nova-compute[70924]: WARNING nova.compute.manager [req-1aa09661-7e13-4146-9489-b46b0397e80e req-49edf6e3-5476-4b22-8d0b-93faed5f0793 service nova] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Received unexpected event network-vif-unplugged-a17ada4e-69e7-42ef-b08d-f405a5da6368 for instance with vm_state active and task_state rescuing.
Jul 29 14:55:07 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:07 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:07 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Instance destroyed successfully.
Jul 29 14:55:07 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Attempting a stable device rescue
Jul 29 14:55:07 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=70924) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 29 14:55:07 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Instance directory exists: not creating {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 29 14:55:07 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Creating image(s)
Jul 29 14:55:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Acquiring lock "/opt/stack/data/nova/instances/b001d812-892a-4756-9f37-fc0c5ef5f0a7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:55:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "/opt/stack/data/nova/instances/b001d812-892a-4756-9f37-fc0c5ef5f0a7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:55:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "/opt/stack/data/nova/instances/b001d812-892a-4756-9f37-fc0c5ef5f0a7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:55:07 user nova-compute[70924]: DEBUG nova.objects.instance [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lazy-loading 'trusted_certs' on Instance uuid b001d812-892a-4756-9f37-fc0c5ef5f0a7 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:55:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Acquiring lock "437cd5e9c37eaf16a52af89493aa78388f349830" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:55:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "437cd5e9c37eaf16a52af89493aa78388f349830" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:55:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/437cd5e9c37eaf16a52af89493aa78388f349830.part --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/437cd5e9c37eaf16a52af89493aa78388f349830.part --force-share --output=json" returned: 0 in 0.136s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:09 user nova-compute[70924]: DEBUG nova.virt.images [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] 69893cdd-36aa-492c-92e7-b65df0ae77f7 was qcow2, converting to raw {{(pid=70924) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 29 14:55:09 user nova-compute[70924]: DEBUG nova.privsep.utils [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70924) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 29 14:55:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/437cd5e9c37eaf16a52af89493aa78388f349830.part /opt/stack/data/nova/instances/_base/437cd5e9c37eaf16a52af89493aa78388f349830.converted {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:09 user nova-compute[70924]: DEBUG nova.compute.manager [req-83aafe6d-8753-4843-acc7-64d232eb195c req-df44d426-2683-4459-8692-33820733ccff service nova] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Received event network-vif-plugged-a17ada4e-69e7-42ef-b08d-f405a5da6368 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:55:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-83aafe6d-8753-4843-acc7-64d232eb195c req-df44d426-2683-4459-8692-33820733ccff service nova] Acquiring lock "b001d812-892a-4756-9f37-fc0c5ef5f0a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:55:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-83aafe6d-8753-4843-acc7-64d232eb195c req-df44d426-2683-4459-8692-33820733ccff service nova] Lock "b001d812-892a-4756-9f37-fc0c5ef5f0a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:55:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-83aafe6d-8753-4843-acc7-64d232eb195c req-df44d426-2683-4459-8692-33820733ccff service nova] Lock "b001d812-892a-4756-9f37-fc0c5ef5f0a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:55:09 user nova-compute[70924]: DEBUG nova.compute.manager [req-83aafe6d-8753-4843-acc7-64d232eb195c req-df44d426-2683-4459-8692-33820733ccff service nova] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] No waiting events found dispatching network-vif-plugged-a17ada4e-69e7-42ef-b08d-f405a5da6368 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:55:09 user nova-compute[70924]: WARNING nova.compute.manager [req-83aafe6d-8753-4843-acc7-64d232eb195c req-df44d426-2683-4459-8692-33820733ccff service nova] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Received unexpected event network-vif-plugged-a17ada4e-69e7-42ef-b08d-f405a5da6368 for instance with vm_state active and task_state rescuing.
Jul 29 14:55:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/437cd5e9c37eaf16a52af89493aa78388f349830.part /opt/stack/data/nova/instances/_base/437cd5e9c37eaf16a52af89493aa78388f349830.converted" returned: 0 in 0.562s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/437cd5e9c37eaf16a52af89493aa78388f349830.converted --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/437cd5e9c37eaf16a52af89493aa78388f349830.converted --force-share --output=json" returned: 0 in 0.200s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "437cd5e9c37eaf16a52af89493aa78388f349830" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.879s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:55:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Acquiring lock "437cd5e9c37eaf16a52af89493aa78388f349830" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:55:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "437cd5e9c37eaf16a52af89493aa78388f349830" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:55:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/437cd5e9c37eaf16a52af89493aa78388f349830 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/437cd5e9c37eaf16a52af89493aa78388f349830 --force-share --output=json" returned: 0 in 0.137s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/437cd5e9c37eaf16a52af89493aa78388f349830,backing_fmt=raw /opt/stack/data/nova/instances/b001d812-892a-4756-9f37-fc0c5ef5f0a7/disk.rescue {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f408793-13fe-4859-bb13-940675e20edb tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Calling os-brick to attach iSCSI Volume {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f408793-13fe-4859-bb13-940675e20edb tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dCGqnbFN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:55:10 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-3f408793-13fe-4859-bb13-940675e20edb tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:55:10 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-3f408793-13fe-4859-bb13-940675e20edb tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-3f408793-13fe-4859-bb13-940675e20edb tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:55:10 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-3f408793-13fe-4859-bb13-940675e20edb tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:55:10 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-3f408793-13fe-4859-bb13-940675e20edb tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-3f408793-13fe-4859-bb13-940675e20edb tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:55:10 user nova-compute[70924]: INFO os_brick.initiator.connectors.iscsi [None req-3f408793-13fe-4859-bb13-940675e20edb tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 14:55:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/437cd5e9c37eaf16a52af89493aa78388f349830,backing_fmt=raw /opt/stack/data/nova/instances/b001d812-892a-4756-9f37-fc0c5ef5f0a7/disk.rescue" returned: 0 in 0.059s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "437cd5e9c37eaf16a52af89493aa78388f349830" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG nova.objects.instance [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lazy-loading 'migration_context' on Instance uuid b001d812-892a-4756-9f37-fc0c5ef5f0a7 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2 -p 172.16.0.220:3260 {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Created local disks {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Start _get_guest_xml network_info=[{"id": "a17ada4e-69e7-42ef-b08d-f405a5da6368", "address": "fa:16:3e:62:06:29", "network": {"id": "d5876e18-e2af-45c2-aab5-2d0d552ebfe4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2035085552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2035085552-network", "vif_mac": "fa:16:3e:62:06:29"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9e5c78c1684c359cfab4e32b9c213f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa17ada4e-69", "ovs_interfaceid": "a17ada4e-69e7-42ef-b08d-f405a5da6368", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '69893cdd-36aa-492c-92e7-b65df0ae77f7', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mDXsQUNA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': 'b001d812-892a-4756-9f37-fc0c5ef5f0a7', 'attached_at': '', 'detached_at': '', 'volume_id': 'cbf3a486-19b2-4b15-b277-e028bef200fb', 'serial': 'cbf3a486-19b2-4b15-b277-e028bef200fb'}, 'attachment_id': 'e9b7dad9-67b5-4df2-afc9-3c9514d9e0f4', 'volume_type': None} {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG nova.objects.instance [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lazy-loading 'resources' on Instance uuid b001d812-892a-4756-9f37-fc0c5ef5f0a7 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74f27b3-ea18-49a8-a6fa-c3cf28aea88c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f408793-13fe-4859-bb13-940675e20edb tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 14:55:10 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2 -p 172.16.0.220:3260 --interface default --op new {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG nova.objects.instance [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lazy-loading 'numa_topology' on Instance uuid b001d812-892a-4756-9f37-fc0c5ef5f0a7 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58dfb14-7149-4938-8c29-74cf5272fc3b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2] added\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f408793-13fe-4859-bb13-940675e20edb tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2] added
Jul 29 14:55:10 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:10 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:55:10 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:55:10 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] CPU controller missing on host. {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] CPU controller found on host. {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70924) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T14:36:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Flavor limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Image limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Flavor pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Image pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Got 1 possible topologies {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG nova.objects.instance [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lazy-loading 'vcpu_model' on Instance uuid b001d812-892a-4756-9f37-fc0c5ef5f0a7 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded7f156-45cf-4d18-9ebd-1f161b503526]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f408793-13fe-4859-bb13-940675e20edb tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Calling os-brick to attach iSCSI Volume {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mDXsQUNA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:55:10 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:55:10 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d0d38a-9dfa-4d1c-9779-f1d73eb7b85d]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f408793-13fe-4859-bb13-940675e20edb tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dCGqnbFN {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dCGqnbFN" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[06418461-5179-4bf8-af57-114b9f4564ed]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f408793-13fe-4859-bb13-940675e20edb tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dCGqnbFN'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ecc018-228c-4f7e-a4c4-339ebe1f2745]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f408793-13fe-4859-bb13-940675e20edb tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e8cb83-b944-4559-9257-c81500fb6337]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f408793-13fe-4859-bb13-940675e20edb tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:55:10 user nova-compute[70924]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:55:10 user nova-compute[70924]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)
Jul 29 14:55:10 user nova-compute[70924]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb (non-flash)
Jul 29 14:55:10 user nova-compute[70924]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)
Jul 29 14:55:10 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f408793-13fe-4859-bb13-940675e20edb tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:55:10 user nova-compute[70924]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:55:10 user nova-compute[70924]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)
Jul 29 14:55:10 user nova-compute[70924]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb (non-flash)
Jul 29 14:55:10 user nova-compute[70924]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)
Jul 29 14:55:10 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2 -p 172.16.0.220:3260 --login {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79f4e1c-7119-44d6-93e7-004db0614454]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f408793-13fe-4859-bb13-940675e20edb tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2, portal: 172.16.0.220,3260]
Jul 29 14:55:10 user nova-compute[70924]: Login to [iface: default, target: iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2, portal: 172.16.0.220,3260] successful.
Jul 29 14:55:10 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab43debe-4dc8-41ce-865b-f2fdf4831c21]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f408793-13fe-4859-bb13-940675e20edb tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c4c246-65f3-46a4-8373-ac9f0e30fbc6]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f408793-13fe-4859-bb13-940675e20edb tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:55:10 user nova-compute[70924]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:55:10 user nova-compute[70924]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)
Jul 29 14:55:10 user nova-compute[70924]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb (non-flash)
Jul 29 14:55:10 user nova-compute[70924]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)
Jul 29 14:55:10 user nova-compute[70924]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2 (non-flash)
Jul 29 14:55:10 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f408793-13fe-4859-bb13-940675e20edb tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:55:10 user nova-compute[70924]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:55:10 user nova-compute[70924]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)
Jul 29 14:55:10 user nova-compute[70924]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb (non-flash)
Jul 29 14:55:10 user nova-compute[70924]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)
Jul 29 14:55:10 user nova-compute[70924]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2 (non-flash)
Jul 29 14:55:10 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-3f408793-13fe-4859-bb13-940675e20edb tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f408793-13fe-4859-bb13-940675e20edb tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Connected to 172.16.0.220:3260 {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-3f408793-13fe-4859-bb13-940675e20edb tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] HCTL ('34', '-', '-', 0) found on session 38 with lun 0 {{(pid=70924) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-3f408793-13fe-4859-bb13-940675e20edb tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70924) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6c0fbc-8037-4001-9fbe-c6d7c5ca5350]: (4, ('- - 0', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:55:10 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-3f408793-13fe-4859-bb13-940675e20edb tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Searching for a device in session 38 and hctl ['34', '*', '*', 0] yield: None {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 14:55:11 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-3f408793-13fe-4859-bb13-940675e20edb tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Searching for a device in session 38 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 14:55:11 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f408793-13fe-4859-bb13-940675e20edb tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dCGqnbFN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 14:55:11 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-3f408793-13fe-4859-bb13-940675e20edb tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:55:11 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f408793-13fe-4859-bb13-940675e20edb tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '23831343961396432', 'path': '/dev/sdc'} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:55:11 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f408793-13fe-4859-bb13-940675e20edb tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831343961396432', 'path': '/dev/sdc'} {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 14:55:11 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.242s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:55:11 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:55:11 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:55:11 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:55:11 user nova-compute[70924]: INFO os_brick.initiator.connectors.iscsi [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 14:55:11 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb -p 172.16.0.220:3260 {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:11 user nova-compute[70924]: DEBUG nova.objects.instance [None req-3f408793-13fe-4859-bb13-940675e20edb tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lazy-loading 'flavor' on Instance uuid 710f0d5a-8420-49c4-bf70-27305dd85bd3 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:55:11 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:11 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0ed5aa-c30f-4283-94a9-e810eeaff555]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = mDXsQUNA\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:55:11 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Jul 29 14:55:11 user nova-compute[70924]: node.name = iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb
Jul 29 14:55:11 user nova-compute[70924]: node.tpgt = -1
Jul 29 14:55:11 user nova-compute[70924]: node.startup = automatic
Jul 29 14:55:11 user nova-compute[70924]: node.leading_login = No
Jul 29 14:55:11 user nova-compute[70924]: iface.iscsi_ifacename = default
Jul 29 14:55:11 user nova-compute[70924]: iface.net_ifacename = <empty>
Jul 29 14:55:11 user nova-compute[70924]: iface.ipaddress = <empty>
Jul 29 14:55:11 user nova-compute[70924]: iface.prefix_len = 0
Jul 29 14:55:11 user nova-compute[70924]: iface.hwaddress = <empty>
Jul 29 14:55:11 user nova-compute[70924]: iface.transport_name = tcp
Jul 29 14:55:11 user nova-compute[70924]: iface.initiatorname = <empty>
Jul 29 14:55:11 user nova-compute[70924]: iface.state = <empty>
Jul 29 14:55:11 user nova-compute[70924]: iface.vlan_id = 0
Jul 29 14:55:11 user nova-compute[70924]: iface.vlan_priority = 0
Jul 29 14:55:11 user nova-compute[70924]: iface.vlan_state = <empty>
Jul 29 14:55:11 user nova-compute[70924]: iface.iface_num = 0
Jul 29 14:55:11 user nova-compute[70924]: iface.mtu = 0
Jul 29 14:55:11 user nova-compute[70924]: iface.port = 0
Jul 29 14:55:11 user nova-compute[70924]: iface.bootproto = <empty>
Jul 29 14:55:11 user nova-compute[70924]: iface.subnet_mask = <empty>
Jul 29 14:55:11 user nova-compute[70924]: iface.gateway = <empty>
Jul 29 14:55:11 user nova-compute[70924]: iface.dhcp_alt_client_id_state = <empty>
Jul 29 14:55:11 user nova-compute[70924]: iface.dhcp_alt_client_id = <empty>
Jul 29 14:55:11 user nova-compute[70924]: iface.dhcp_dns = <empty>
Jul 29 14:55:11 user nova-compute[70924]: iface.dhcp_learn_iqn = <empty>
Jul 29 14:55:11 user nova-compute[70924]: iface.dhcp_req_vendor_id_state = <empty>
Jul 29 14:55:11 user nova-compute[70924]: iface.dhcp_vendor_id_state = <empty>
Jul 29 14:55:11 user nova-compute[70924]: iface.dhcp_vendor_id = <empty>
Jul 29 14:55:11 user nova-compute[70924]: iface.dhcp_slp_da = <empty>
Jul 29 14:55:11 user nova-compute[70924]: iface.fragmentation = <empty>
Jul 29 14:55:11 user nova-compute[70924]: iface.gratuitous_arp = <empty>
Jul 29 14:55:11 user nova-compute[70924]: iface.incoming_forwarding = <empty>
Jul 29 14:55:11 user nova-compute[70924]: iface.tos_state = <empty>
Jul 29 14:55:11 user nova-compute[70924]: iface.tos = 0
Jul 29 14:55:11 user nova-compute[70924]: iface.ttl = 0
Jul 29 14:55:11 user nova-compute[70924]: iface.delayed_ack = <empty>
Jul 29 14:55:11 user nova-compute[70924]: iface.tcp_nagle = <empty>
Jul 29 14:55:11 user nova-compute[70924]: iface.tcp_wsf_state = <empty>
Jul 29 14:55:11 user nova-compute[70924]: iface.tcp_wsf = 0
Jul 29 14:55:11 user nova-compute[70924]: iface.tcp_timer_scale = 0
Jul 29 14:55:11 user nova-compute[70924]: iface.tcp_timestamp = <empty>
Jul 29 14:55:11 user nova-compute[70924]: iface.redirect = <empty>
Jul 29 14:55:11 user nova-compute[70924]: iface.def_task_mgmt_timeout = 0
Jul 29 14:55:11 user nova-compute[70924]: iface.header_digest = <empty>
Jul 29 14:55:11 user nova-compute[70924]: iface.data_digest = <empty>
Jul 29 14:55:11 user nova-compute[70924]: iface.immediate_data = <empty>
Jul 29 14:55:11 user nova-compute[70924]: iface.initial_r2t = <empty>
Jul 29 14:55:11 user nova-compute[70924]: iface.data_seq_inorder = <empty>
Jul 29 14:55:11 user nova-compute[70924]: iface.data_pdu_inorder = <empty>
Jul 29 14:55:11 user nova-compute[70924]: iface.erl = 0
Jul 29 14:55:11 user nova-compute[70924]: iface.max_receive_data_len = 0
Jul 29 14:55:11 user nova-compute[70924]: iface.first_burst_len = 0
Jul 29 14:55:11 user nova-compute[70924]: iface.max_outstanding_r2t = 0
Jul 29 14:55:11 user nova-compute[70924]: iface.max_burst_len = 0
Jul 29 14:55:11 user nova-compute[70924]: iface.chap_auth = <empty>
Jul 29 14:55:11 user nova-compute[70924]: iface.bidi_chap = <empty>
Jul 29 14:55:11 user nova-compute[70924]: iface.strict_login_compliance = <empty>
Jul 29 14:55:11 user nova-compute[70924]: iface.discovery_auth = <empty>
Jul 29 14:55:11 user nova-compute[70924]: iface.discovery_logout = <empty>
Jul 29 14:55:11 user nova-compute[70924]: node.discovery_address = <empty>
Jul 29 14:55:11 user nova-compute[70924]: node.discovery_port = 0
Jul 29 14:55:11 user nova-compute[70924]: node.discovery_type = static
Jul 29 14:55:11 user nova-compute[70924]: node.session.initial_cmdsn = 0
Jul 29 14:55:11 user nova-compute[70924]: node.session.initial_login_retry_max = 8
Jul 29 14:55:11 user nova-compute[70924]: node.session.xmit_thread_priority = -20
Jul 29 14:55:11 user nova-compute[70924]: node.session.cmds_max = 128
Jul 29 14:55:11 user nova-compute[70924]: node.session.queue_depth = 32
Jul 29 14:55:11 user nova-compute[70924]: node.session.nr_sessions = 1
Jul 29 14:55:11 user nova-compute[70924]: node.session.auth.authmethod = CHAP
Jul 29 14:55:11 user nova-compute[70924]: node.session.auth.username = mDXsQUNA
Jul 29 14:55:11 user nova-compute[70924]: node.session.auth.password = ***
Jul 29 14:55:11 user nova-compute[70924]: node.session.auth.username_in = <empty>
Jul 29 14:55:11 user nova-compute[70924]: node.session.auth.password_in = <empty>
Jul 29 14:55:11 user nova-compute[70924]: node.session.auth.chap_algs = MD5
Jul 29 14:55:11 user nova-compute[70924]: node.session.timeo.replacement_timeout = 120
Jul 29 14:55:11 user nova-compute[70924]: node.session.err_timeo.abort_timeout = 15
Jul 29 14:55:11 user nova-compute[70924]: node.session.err_timeo.lu_reset_timeout = 30
Jul 29 14:55:11 user nova-compute[70924]: node.session.err_timeo.tgt_reset_timeout = 30
Jul 29 14:55:11 user nova-compute[70924]: node.session.err_timeo.host_reset_timeout = 60
Jul 29 14:55:11 user nova-compute[70924]: node.session.iscsi.FastAbort = Yes
Jul 29 14:55:11 user nova-compute[70924]: node.session.iscsi.InitialR2T = No
Jul 29 14:55:11 user nova-compute[70924]: node.session.iscsi.ImmediateData = Yes
Jul 29 14:55:11 user nova-compute[70924]: node.session.iscsi.FirstBurstLength = 262144
Jul 29 14:55:11 user nova-compute[70924]: node.session.iscsi.MaxBurstLength = 16776192
Jul 29 14:55:11 user nova-compute[70924]: node.session.iscsi.DefaultTime2Retain = 0
Jul 29 14:55:11 user nova-compute[70924]: node.session.iscsi.DefaultTime2Wait = 2
Jul 29 14:55:11 user nova-compute[70924]: node.session.iscsi.MaxConnections = 1
Jul 29 14:55:11 user nova-compute[70924]: node.session.iscsi.MaxOutstandingR2T = 1
Jul 29 14:55:11 user nova-compute[70924]: node.session.iscsi.ERL = 0
Jul 29 14:55:11 user nova-compute[70924]: node.session.scan = manual
Jul 29 14:55:11 user nova-compute[70924]: node.session.reopen_max = 0
Jul 29 14:55:11 user nova-compute[70924]: node.conn[0].address = 172.16.0.220
Jul 29 14:55:11 user nova-compute[70924]: node.conn[0].port = 3260
Jul 29 14:55:11 user nova-compute[70924]: node.conn[0].startup = manual
Jul 29 14:55:11 user nova-compute[70924]: node.conn[0].tcp.window_size = 524288
Jul 29 14:55:11 user nova-compute[70924]: node.conn[0].tcp.type_of_service = 0
Jul 29 14:55:11 user nova-compute[70924]: node.conn[0].timeo.logout_timeout = 15
Jul 29 14:55:11 user nova-compute[70924]: node.conn[0].timeo.login_timeout = 15
Jul 29 14:55:11 user nova-compute[70924]: node.conn[0].timeo.auth_timeout = 45
Jul 29 14:55:11 user nova-compute[70924]: node.conn[0].timeo.noop_out_interval = 5
Jul 29 14:55:11 user nova-compute[70924]: node.conn[0].timeo.noop_out_timeout = 5
Jul 29 14:55:11 user nova-compute[70924]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jul 29 14:55:11 user nova-compute[70924]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jul 29 14:55:11 user nova-compute[70924]: node.conn[0].iscsi.HeaderDigest = None
Jul 29 14:55:11 user nova-compute[70924]: node.conn[0].iscsi.DataDigest = None
Jul 29 14:55:11 user nova-compute[70924]: node.conn[0].iscsi.IFMarker = No
Jul 29 14:55:11 user nova-compute[70924]: node.conn[0].iscsi.OFMarker = No
Jul 29 14:55:11 user nova-compute[70924]: # END RECORD
Jul 29 14:55:11 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:55:11 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:11 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-3f408793-13fe-4859-bb13-940675e20edb tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] attach device xml: <disk type="block" device="disk">
Jul 29 14:55:11 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:55:11 user nova-compute[70924]:   <source dev="/dev/sdc"/>
Jul 29 14:55:11 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 14:55:11 user nova-compute[70924]:   <serial>3ac35b93-78b7-4614-a0c6-aa80496897e2</serial>
Jul 29 14:55:11 user nova-compute[70924]: </disk>
Jul 29 14:55:11 user nova-compute[70924]:  {{(pid=70924) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 29 14:55:11 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:11 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[428f74cf-71d2-4b1f-a247-1fdf2d50917b]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:55:11 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:55:11 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:11 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.073s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:11 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf405013-1556-42b5-892e-98553df782b2]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:55:11 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:55:11 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mDXsQUNA {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:11 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mDXsQUNA" returned: 0 in 0.024s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:11 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b404c27e-e4a1-4420-bac6-60d8c18409eb]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:55:11 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mDXsQUNA'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:55:11 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:11 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:11 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7b6f38-fb4a-4278-aa16-d26fbe20e861]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:55:11 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:55:11 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:11 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:11 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:11 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5b8a18-ef9a-4602-8dad-6f42d2b1a88b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:55:11 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:55:11 user nova-compute[70924]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:55:11 user nova-compute[70924]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)
Jul 29 14:55:11 user nova-compute[70924]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb (non-flash)
Jul 29 14:55:11 user nova-compute[70924]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)
Jul 29 14:55:11 user nova-compute[70924]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2 (non-flash)
Jul 29 14:55:11 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:55:11 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:55:11 user nova-compute[70924]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:55:11 user nova-compute[70924]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)
Jul 29 14:55:11 user nova-compute[70924]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb (non-flash)
Jul 29 14:55:11 user nova-compute[70924]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)
Jul 29 14:55:11 user nova-compute[70924]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2 (non-flash)
Jul 29 14:55:11 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:55:11 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.219s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:55:11 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Connected to 172.16.0.220:3260 {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 14:55:11 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] HCTL ('38', '0', '0', 0) found on session 36 with lun 0 {{(pid=70924) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 14:55:11 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Scanning host 38 c: 0, t: 0, l: 0) {{(pid=70924) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 14:55:11 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:11 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.013s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:11 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d34a76-ed60-42a5-8eac-2258e1f498ea]: (4, ('0 0 0', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:55:11 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Searching for a device in session 36 and hctl ('38', '0', '0', 0) yield: sdg {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 14:55:11 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mDXsQUNA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 14:55:11 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.241s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:55:11 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] <== connect_volume: return (1483ms) {'type': 'block', 'scsi_wwn': '26264376561306238', 'path': '/dev/sdg'} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:55:11 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26264376561306238', 'path': '/dev/sdg'} {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 14:55:11 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:53:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-987712595',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-987712595',id=31,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:53:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5a9e5c78c1684c359cfab4e32b9c213f',ramdisk_id='',reservation_id='r-r6j2fqy4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2089253815',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:53:35Z,user_data=None,user_id='43582a8a85c54b5e9d16d11b12bf50d4',uuid=b001d812-892a-4756-9f37-fc0c5ef5f0a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a17ada4e-69e7-42ef-b08d-f405a5da6368", "address": "fa:16:3e:62:06:29", "network": {"id": "d5876e18-e2af-45c2-aab5-2d0d552ebfe4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2035085552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2035085552-network", "vif_mac": "fa:16:3e:62:06:29"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9e5c78c1684c359cfab4e32b9c213f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa17ada4e-69", "ovs_interfaceid": "a17ada4e-69e7-42ef-b08d-f405a5da6368", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:55:11 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Converting VIF {"id": "a17ada4e-69e7-42ef-b08d-f405a5da6368", "address": "fa:16:3e:62:06:29", "network": {"id": "d5876e18-e2af-45c2-aab5-2d0d552ebfe4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2035085552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2035085552-network", "vif_mac": "fa:16:3e:62:06:29"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9e5c78c1684c359cfab4e32b9c213f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa17ada4e-69", "ovs_interfaceid": "a17ada4e-69e7-42ef-b08d-f405a5da6368", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:55:11 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:62:06:29,bridge_name='br-int',has_traffic_filtering=True,id=a17ada4e-69e7-42ef-b08d-f405a5da6368,network=Network(d5876e18-e2af-45c2-aab5-2d0d552ebfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa17ada4e-69') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:55:11 user nova-compute[70924]: DEBUG nova.objects.instance [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lazy-loading 'pci_devices' on Instance uuid b001d812-892a-4756-9f37-fc0c5ef5f0a7 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:55:11 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] End _get_guest_xml xml=<domain type="kvm">
Jul 29 14:55:11 user nova-compute[70924]:   <uuid>b001d812-892a-4756-9f37-fc0c5ef5f0a7</uuid>
Jul 29 14:55:11 user nova-compute[70924]:   <name>instance-0000001f</name>
Jul 29 14:55:11 user nova-compute[70924]:   <memory>524288</memory>
Jul 29 14:55:11 user nova-compute[70924]:   <vcpu>1</vcpu>
Jul 29 14:55:11 user nova-compute[70924]:   <metadata>
Jul 29 14:55:11 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 14:55:11 user nova-compute[70924]:       <nova:package version="0.0.0"/>
Jul 29 14:55:11 user nova-compute[70924]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-987712595</nova:name>
Jul 29 14:55:11 user nova-compute[70924]:       <nova:creationTime>2023-07-29 14:55:10</nova:creationTime>
Jul 29 14:55:11 user nova-compute[70924]:       <nova:flavor name="m1.tiny">
Jul 29 14:55:11 user nova-compute[70924]:         <nova:memory>512</nova:memory>
Jul 29 14:55:11 user nova-compute[70924]:         <nova:disk>1</nova:disk>
Jul 29 14:55:11 user nova-compute[70924]:         <nova:swap>0</nova:swap>
Jul 29 14:55:11 user nova-compute[70924]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 14:55:11 user nova-compute[70924]:         <nova:vcpus>1</nova:vcpus>
Jul 29 14:55:11 user nova-compute[70924]:       </nova:flavor>
Jul 29 14:55:11 user nova-compute[70924]:       <nova:owner>
Jul 29 14:55:11 user nova-compute[70924]:         <nova:user uuid="43582a8a85c54b5e9d16d11b12bf50d4">tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member</nova:user>
Jul 29 14:55:11 user nova-compute[70924]:         <nova:project uuid="5a9e5c78c1684c359cfab4e32b9c213f">tempest-ServerBootFromVolumeStableRescueTest-2089253815</nova:project>
Jul 29 14:55:11 user nova-compute[70924]:       </nova:owner>
Jul 29 14:55:11 user nova-compute[70924]:       <nova:root type="image" uuid="3aba2e73-6832-404b-8bd0-d0503ce82b8c"/>
Jul 29 14:55:11 user nova-compute[70924]:       <nova:ports>
Jul 29 14:55:11 user nova-compute[70924]:         <nova:port uuid="a17ada4e-69e7-42ef-b08d-f405a5da6368">
Jul 29 14:55:11 user nova-compute[70924]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 29 14:55:11 user nova-compute[70924]:         </nova:port>
Jul 29 14:55:11 user nova-compute[70924]:       </nova:ports>
Jul 29 14:55:11 user nova-compute[70924]:     </nova:instance>
Jul 29 14:55:11 user nova-compute[70924]:   </metadata>
Jul 29 14:55:11 user nova-compute[70924]:   <sysinfo type="smbios">
Jul 29 14:55:11 user nova-compute[70924]:     <system>
Jul 29 14:55:11 user nova-compute[70924]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 14:55:11 user nova-compute[70924]:       <entry name="product">OpenStack Nova</entry>
Jul 29 14:55:11 user nova-compute[70924]:       <entry name="version">0.0.0</entry>
Jul 29 14:55:11 user nova-compute[70924]:       <entry name="serial">b001d812-892a-4756-9f37-fc0c5ef5f0a7</entry>
Jul 29 14:55:11 user nova-compute[70924]:       <entry name="uuid">b001d812-892a-4756-9f37-fc0c5ef5f0a7</entry>
Jul 29 14:55:11 user nova-compute[70924]:       <entry name="family">Virtual Machine</entry>
Jul 29 14:55:11 user nova-compute[70924]:     </system>
Jul 29 14:55:11 user nova-compute[70924]:   </sysinfo>
Jul 29 14:55:11 user nova-compute[70924]:   <os>
Jul 29 14:55:11 user nova-compute[70924]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 14:55:11 user nova-compute[70924]:     <smbios mode="sysinfo"/>
Jul 29 14:55:11 user nova-compute[70924]:   </os>
Jul 29 14:55:11 user nova-compute[70924]:   <features>
Jul 29 14:55:11 user nova-compute[70924]:     <acpi/>
Jul 29 14:55:11 user nova-compute[70924]:     <apic/>
Jul 29 14:55:11 user nova-compute[70924]:     <vmcoreinfo/>
Jul 29 14:55:11 user nova-compute[70924]:   </features>
Jul 29 14:55:11 user nova-compute[70924]:   <clock offset="utc">
Jul 29 14:55:11 user nova-compute[70924]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 14:55:11 user nova-compute[70924]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 14:55:11 user nova-compute[70924]:     <timer name="hpet" present="no"/>
Jul 29 14:55:11 user nova-compute[70924]:   </clock>
Jul 29 14:55:11 user nova-compute[70924]:   <cpu mode="custom" match="exact">
Jul 29 14:55:11 user nova-compute[70924]:     <model>Nehalem</model>
Jul 29 14:55:11 user nova-compute[70924]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 14:55:11 user nova-compute[70924]:   </cpu>
Jul 29 14:55:11 user nova-compute[70924]:   <devices>
Jul 29 14:55:11 user nova-compute[70924]:     <disk type="block" device="disk">
Jul 29 14:55:11 user nova-compute[70924]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:55:11 user nova-compute[70924]:       <source dev="/dev/sdg"/>
Jul 29 14:55:11 user nova-compute[70924]:       <target dev="vda" bus="virtio"/>
Jul 29 14:55:11 user nova-compute[70924]:       <serial>cbf3a486-19b2-4b15-b277-e028bef200fb</serial>
Jul 29 14:55:11 user nova-compute[70924]:     </disk>
Jul 29 14:55:11 user nova-compute[70924]:     <disk type="file" device="disk">
Jul 29 14:55:11 user nova-compute[70924]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 14:55:11 user nova-compute[70924]:       <source file="/opt/stack/data/nova/instances/b001d812-892a-4756-9f37-fc0c5ef5f0a7/disk.rescue"/>
Jul 29 14:55:11 user nova-compute[70924]:       <target dev="vdb" bus="virtio"/>
Jul 29 14:55:11 user nova-compute[70924]:       <boot order="1"/>
Jul 29 14:55:11 user nova-compute[70924]:     </disk>
Jul 29 14:55:11 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 14:55:11 user nova-compute[70924]:       <mac address="fa:16:3e:62:06:29"/>
Jul 29 14:55:11 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:55:11 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 14:55:11 user nova-compute[70924]:       <target dev="tapa17ada4e-69"/>
Jul 29 14:55:11 user nova-compute[70924]:     </interface>
Jul 29 14:55:11 user nova-compute[70924]:     <serial type="pty">
Jul 29 14:55:11 user nova-compute[70924]:       <log file="/opt/stack/data/nova/instances/b001d812-892a-4756-9f37-fc0c5ef5f0a7/console.log" append="off"/>
Jul 29 14:55:11 user nova-compute[70924]:     </serial>
Jul 29 14:55:11 user nova-compute[70924]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 14:55:11 user nova-compute[70924]:     <video>
Jul 29 14:55:11 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:55:11 user nova-compute[70924]:     </video>
Jul 29 14:55:11 user nova-compute[70924]:     <rng model="virtio">
Jul 29 14:55:11 user nova-compute[70924]:       <backend model="random">/dev/urandom</backend>
Jul 29 14:55:11 user nova-compute[70924]:     </rng>
Jul 29 14:55:11 user nova-compute[70924]:     <controller type="usb" index="0" model="none"/>
Jul 29 14:55:11 user nova-compute[70924]:     <memballoon model="virtio">
Jul 29 14:55:11 user nova-compute[70924]:       <stats period="10"/>
Jul 29 14:55:11 user nova-compute[70924]:     </memballoon>
Jul 29 14:55:11 user nova-compute[70924]:   </devices>
Jul 29 14:55:11 user nova-compute[70924]: </domain>
Jul 29 14:55:11 user nova-compute[70924]:  {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 14:55:11 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Instance destroyed successfully.
Jul 29 14:55:11 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:55:11 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:55:11 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] No VIF found with MAC fa:16:3e:62:06:29, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:55:11 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-3f408793-13fe-4859-bb13-940675e20edb tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:55:11 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-3f408793-13fe-4859-bb13-940675e20edb tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:55:11 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-3f408793-13fe-4859-bb13-940675e20edb tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] No VIF found with MAC fa:16:3e:67:60:2e, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:55:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-3f408793-13fe-4859-bb13-940675e20edb tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lock "710f0d5a-8420-49c4-bf70-27305dd85bd3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.958s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:55:13 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:13 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:13 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:13 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:13 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:13 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:13 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:13 user nova-compute[70924]: DEBUG nova.compute.manager [req-7583803e-d83c-46d5-a128-839da5ddbed3 req-8351e29a-3aad-42c8-a5e0-4b6823e009af service nova] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Received event network-vif-plugged-a17ada4e-69e7-42ef-b08d-f405a5da6368 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:55:13 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-7583803e-d83c-46d5-a128-839da5ddbed3 req-8351e29a-3aad-42c8-a5e0-4b6823e009af service nova] Acquiring lock "b001d812-892a-4756-9f37-fc0c5ef5f0a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:55:13 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-7583803e-d83c-46d5-a128-839da5ddbed3 req-8351e29a-3aad-42c8-a5e0-4b6823e009af service nova] Lock "b001d812-892a-4756-9f37-fc0c5ef5f0a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:55:13 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-7583803e-d83c-46d5-a128-839da5ddbed3 req-8351e29a-3aad-42c8-a5e0-4b6823e009af service nova] Lock "b001d812-892a-4756-9f37-fc0c5ef5f0a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:55:13 user nova-compute[70924]: DEBUG nova.compute.manager [req-7583803e-d83c-46d5-a128-839da5ddbed3 req-8351e29a-3aad-42c8-a5e0-4b6823e009af service nova] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] No waiting events found dispatching network-vif-plugged-a17ada4e-69e7-42ef-b08d-f405a5da6368 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:55:13 user nova-compute[70924]: WARNING nova.compute.manager [req-7583803e-d83c-46d5-a128-839da5ddbed3 req-8351e29a-3aad-42c8-a5e0-4b6823e009af service nova] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Received unexpected event network-vif-plugged-a17ada4e-69e7-42ef-b08d-f405a5da6368 for instance with vm_state active and task_state rescuing.
Jul 29 14:55:14 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-7e6eef84-3d71-4774-91b4-7a176274364d tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Acquiring lock "f5350fb5-9460-490b-a47e-74f88c8eb51c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:55:14 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-7e6eef84-3d71-4774-91b4-7a176274364d tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Lock "f5350fb5-9460-490b-a47e-74f88c8eb51c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:55:14 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-7e6eef84-3d71-4774-91b4-7a176274364d tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Acquiring lock "f5350fb5-9460-490b-a47e-74f88c8eb51c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:55:14 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-7e6eef84-3d71-4774-91b4-7a176274364d tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Lock "f5350fb5-9460-490b-a47e-74f88c8eb51c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:55:14 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-7e6eef84-3d71-4774-91b4-7a176274364d tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Lock "f5350fb5-9460-490b-a47e-74f88c8eb51c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:55:14 user nova-compute[70924]: INFO nova.compute.manager [None req-7e6eef84-3d71-4774-91b4-7a176274364d tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Terminating instance
Jul 29 14:55:14 user nova-compute[70924]: DEBUG nova.compute.manager [None req-7e6eef84-3d71-4774-91b4-7a176274364d tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Start destroying the instance on the hypervisor. {{(pid=70924) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 14:55:14 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:14 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:14 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:14 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:15 user nova-compute[70924]: DEBUG nova.compute.manager [req-824e8c33-9065-416f-991c-2caad1c21450 req-222d2061-9837-4404-a79d-1abdabfceec1 service nova] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Received event network-vif-unplugged-c4a5a7c9-34d6-4040-87a3-78c4fd26b170 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:55:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-824e8c33-9065-416f-991c-2caad1c21450 req-222d2061-9837-4404-a79d-1abdabfceec1 service nova] Acquiring lock "f5350fb5-9460-490b-a47e-74f88c8eb51c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:55:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-824e8c33-9065-416f-991c-2caad1c21450 req-222d2061-9837-4404-a79d-1abdabfceec1 service nova] Lock "f5350fb5-9460-490b-a47e-74f88c8eb51c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:55:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-824e8c33-9065-416f-991c-2caad1c21450 req-222d2061-9837-4404-a79d-1abdabfceec1 service nova] Lock "f5350fb5-9460-490b-a47e-74f88c8eb51c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:55:15 user nova-compute[70924]: DEBUG nova.compute.manager [req-824e8c33-9065-416f-991c-2caad1c21450 req-222d2061-9837-4404-a79d-1abdabfceec1 service nova] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] No waiting events found dispatching network-vif-unplugged-c4a5a7c9-34d6-4040-87a3-78c4fd26b170 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:55:15 user nova-compute[70924]: DEBUG nova.compute.manager [req-824e8c33-9065-416f-991c-2caad1c21450 req-222d2061-9837-4404-a79d-1abdabfceec1 service nova] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Received event network-vif-unplugged-c4a5a7c9-34d6-4040-87a3-78c4fd26b170 for instance with task_state deleting. {{(pid=70924) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 14:55:15 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:15 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Instance destroyed successfully.
Jul 29 14:55:15 user nova-compute[70924]: DEBUG nova.objects.instance [None req-7e6eef84-3d71-4774-91b4-7a176274364d tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Lazy-loading 'resources' on Instance uuid f5350fb5-9460-490b-a47e-74f88c8eb51c {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:55:15 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-7e6eef84-3d71-4774-91b4-7a176274364d tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:46:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1255761132',display_name='tempest-ServerActionsTestOtherB-server-1255761132',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1255761132',id=18,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIBMm7U7DNUnZfHvCCwqmdK01H/F7FPPtGEiHdQU/UfZbvDiHS9WyDAl4KpLKXM2BWrjymDoAA5PpeT/LkSZzEFYL6ZRKv5TsemED0bunybXK/h2EPtICo6kFvAJz1A93g==',key_name='tempest-keypair-566023039',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:52:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fd007df2b3e04ab784369809178e4240',ramdisk_id='',reservation_id='r-z4t1omey',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-298005467',owner_user_name='tempest-ServerActionsTestOtherB-298005467-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:52:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6e2628064a66492e9f85e99332ac3ceb',uuid=f5350fb5-9460-490b-a47e-74f88c8eb51c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c4a5a7c9-34d6-4040-87a3-78c4fd26b170", "address": "fa:16:3e:90:f1:53", "network": {"id": "d87dd51f-8870-4dfa-b608-7c4b662219ca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1964327887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd007df2b3e04ab784369809178e4240", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a5a7c9-34", "ovs_interfaceid": "c4a5a7c9-34d6-4040-87a3-78c4fd26b170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 14:55:15 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-7e6eef84-3d71-4774-91b4-7a176274364d tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Converting VIF {"id": "c4a5a7c9-34d6-4040-87a3-78c4fd26b170", "address": "fa:16:3e:90:f1:53", "network": {"id": "d87dd51f-8870-4dfa-b608-7c4b662219ca", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1964327887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd007df2b3e04ab784369809178e4240", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a5a7c9-34", "ovs_interfaceid": "c4a5a7c9-34d6-4040-87a3-78c4fd26b170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:55:15 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-7e6eef84-3d71-4774-91b4-7a176274364d tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:f1:53,bridge_name='br-int',has_traffic_filtering=True,id=c4a5a7c9-34d6-4040-87a3-78c4fd26b170,network=Network(d87dd51f-8870-4dfa-b608-7c4b662219ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4a5a7c9-34') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:55:15 user nova-compute[70924]: DEBUG os_vif [None req-7e6eef84-3d71-4774-91b4-7a176274364d tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:f1:53,bridge_name='br-int',has_traffic_filtering=True,id=c4a5a7c9-34d6-4040-87a3-78c4fd26b170,network=Network(d87dd51f-8870-4dfa-b608-7c4b662219ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4a5a7c9-34') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 14:55:15 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:15 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc4a5a7c9-34, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:55:15 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:15 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:55:15 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:15 user nova-compute[70924]: INFO os_vif [None req-7e6eef84-3d71-4774-91b4-7a176274364d tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:f1:53,bridge_name='br-int',has_traffic_filtering=True,id=c4a5a7c9-34d6-4040-87a3-78c4fd26b170,network=Network(d87dd51f-8870-4dfa-b608-7c4b662219ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4a5a7c9-34')
Jul 29 14:55:15 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e6eef84-3d71-4774-91b4-7a176274364d tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] calling os-brick to detach iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 14:55:15 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6eef84-3d71-4774-91b4-7a176274364d tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, {'target_iqns': ['iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xWibJIcX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:55:15 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-7e6eef84-3d71-4774-91b4-7a176274364d tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:55:15 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-7e6eef84-3d71-4774-91b4-7a176274364d tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:55:15 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-7e6eef84-3d71-4774-91b4-7a176274364d tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:55:15 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6eef84-3d71-4774-91b4-7a176274364d tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef', 0)] {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 14:55:15 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:15 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:15 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[81738e76-75af-4f9c-b910-56111348b277]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:55:15 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:15 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Removed pending event for b001d812-892a-4756-9f37-fc0c5ef5f0a7 due to event {{(pid=70924) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 29 14:55:15 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642515.6709547, b001d812-892a-4756-9f37-fc0c5ef5f0a7 => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:55:15 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] VM Resumed (Lifecycle Event)
Jul 29 14:55:15 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:15 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[227f4c35-aaa7-4c21-8cdf-1116d3cdd325]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:55:15 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6eef84-3d71-4774-91b4-7a176274364d tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:55:15 user nova-compute[70924]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:55:15 user nova-compute[70924]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)
Jul 29 14:55:15 user nova-compute[70924]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb (non-flash)
Jul 29 14:55:15 user nova-compute[70924]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)
Jul 29 14:55:15 user nova-compute[70924]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2 (non-flash)
Jul 29 14:55:15 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:55:15 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6eef84-3d71-4774-91b4-7a176274364d tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:55:15 user nova-compute[70924]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:55:15 user nova-compute[70924]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef (non-flash)
Jul 29 14:55:15 user nova-compute[70924]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb (non-flash)
Jul 29 14:55:15 user nova-compute[70924]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)
Jul 29 14:55:15 user nova-compute[70924]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2 (non-flash)
Jul 29 14:55:15 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:55:15 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6eef84-3d71-4774-91b4-7a176274364d tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feecc68f370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef'): ({'sde'}, set())}) {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 14:55:15 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-7e6eef84-3d71-4774-91b4-7a176274364d tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Removing single pathed devices sde {{(pid=70924) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 14:55:15 user nova-compute[70924]: DEBUG nova.compute.manager [None req-9b0a9e8c-194d-4e5d-9d1e-e284de15363b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:55:15 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:15 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:55:15 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:55:15 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:15 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[294a027d-4f8b-44ce-ac7d-cab225637b24]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:55:15 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:15 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 29 14:55:15 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642515.6726818, b001d812-892a-4756-9f37-fc0c5ef5f0a7 => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:55:15 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] VM Started (Lifecycle Event)
Jul 29 14:55:15 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:15 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9347a892-d7a3-4d54-a790-a4467e0e00ae]: (4, ('ok\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:55:15 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-7e6eef84-3d71-4774-91b4-7a176274364d tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Flushing IO for device /dev/sde {{(pid=70924) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 14:55:15 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:15 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:55:15 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:15 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b02d21-4623-4d9a-8d04-958004a970e6]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:55:15 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-7e6eef84-3d71-4774-91b4-7a176274364d tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70924) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 14:55:15 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:15 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:55:15 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.051s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:15 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6630ba43-4771-4e92-bdcc-dc4e62243902]: (4, ('1', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:55:15 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-7e6eef84-3d71-4774-91b4-7a176274364d tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 14:55:15 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-7e6eef84-3d71-4774-91b4-7a176274364d tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] SCSI volumes sde have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 14:55:15 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6eef84-3d71-4774-91b4-7a176274364d tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef')] {{(pid=70924) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 14:55:15 user nova-compute[70924]: DEBUG nova.compute.manager [req-08be9d2c-feaf-4482-9a5f-0b955650e92c req-7c2882e7-5fee-49ae-8922-06e094b03d47 service nova] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Received event network-vif-plugged-a17ada4e-69e7-42ef-b08d-f405a5da6368 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:55:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-08be9d2c-feaf-4482-9a5f-0b955650e92c req-7c2882e7-5fee-49ae-8922-06e094b03d47 service nova] Acquiring lock "b001d812-892a-4756-9f37-fc0c5ef5f0a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:55:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-08be9d2c-feaf-4482-9a5f-0b955650e92c req-7c2882e7-5fee-49ae-8922-06e094b03d47 service nova] Lock "b001d812-892a-4756-9f37-fc0c5ef5f0a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:55:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-08be9d2c-feaf-4482-9a5f-0b955650e92c req-7c2882e7-5fee-49ae-8922-06e094b03d47 service nova] Lock "b001d812-892a-4756-9f37-fc0c5ef5f0a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:55:15 user nova-compute[70924]: DEBUG nova.compute.manager [req-08be9d2c-feaf-4482-9a5f-0b955650e92c req-7c2882e7-5fee-49ae-8922-06e094b03d47 service nova] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] No waiting events found dispatching network-vif-plugged-a17ada4e-69e7-42ef-b08d-f405a5da6368 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:55:15 user nova-compute[70924]: WARNING nova.compute.manager [req-08be9d2c-feaf-4482-9a5f-0b955650e92c req-7c2882e7-5fee-49ae-8922-06e094b03d47 service nova] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Received unexpected event network-vif-plugged-a17ada4e-69e7-42ef-b08d-f405a5da6368 for instance with vm_state rescued and task_state None.
Jul 29 14:55:15 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:15 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:15 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3cd33d5-4225-49b0-82fe-5b702ccdeb83]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:55:15 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6eef84-3d71-4774-91b4-7a176274364d tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:55:15 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef -p 172.16.0.220:3260 --logout {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:15 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:15 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[4081f5df-32a2-4bd8-ab14-3fb072f989ab]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:55:15 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6eef84-3d71-4774-91b4-7a176274364d tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef, portal: 172.16.0.220,3260]
Jul 29 14:55:15 user nova-compute[70924]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef, portal: 172.16.0.220,3260] successful.
Jul 29 14:55:15 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:55:15 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef -p 172.16.0.220:3260 --op delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:15 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40240a39-c2db-4b14-bc97-0fb20849bdef -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:15 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee26d21-cbcb-48ad-882d-901d330ee3a3]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:55:15 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6eef84-3d71-4774-91b4-7a176274364d tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:55:15 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-7e6eef84-3d71-4774-91b4-7a176274364d tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:55:15 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6eef84-3d71-4774-91b4-7a176274364d tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] <== disconnect_volume: return (348ms) None {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:55:15 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e6eef84-3d71-4774-91b4-7a176274364d tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Disconnected iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 14:55:15 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-7e6eef84-3d71-4774-91b4-7a176274364d tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Deleting instance files /opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c_del
Jul 29 14:55:15 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-7e6eef84-3d71-4774-91b4-7a176274364d tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Deletion of /opt/stack/data/nova/instances/f5350fb5-9460-490b-a47e-74f88c8eb51c_del complete
Jul 29 14:55:16 user nova-compute[70924]: INFO nova.compute.manager [None req-7e6eef84-3d71-4774-91b4-7a176274364d tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Took 1.27 seconds to destroy the instance on the hypervisor.
Jul 29 14:55:16 user nova-compute[70924]: DEBUG oslo.service.loopingcall [None req-7e6eef84-3d71-4774-91b4-7a176274364d tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70924) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 14:55:16 user nova-compute[70924]: DEBUG nova.compute.manager [-] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Deallocating network for instance {{(pid=70924) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 14:55:16 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] deallocate_for_instance() {{(pid=70924) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 14:55:16 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:55:16 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Took 0.90 seconds to deallocate network for instance.
Jul 29 14:55:17 user nova-compute[70924]: DEBUG nova.compute.manager [req-f4b398fb-7082-470a-afbf-342358be8d96 req-ec76b758-4fe5-46bb-bbf6-ce01065da590 service nova] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Received event network-vif-plugged-c4a5a7c9-34d6-4040-87a3-78c4fd26b170 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:55:17 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-f4b398fb-7082-470a-afbf-342358be8d96 req-ec76b758-4fe5-46bb-bbf6-ce01065da590 service nova] Acquiring lock "f5350fb5-9460-490b-a47e-74f88c8eb51c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:55:17 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-f4b398fb-7082-470a-afbf-342358be8d96 req-ec76b758-4fe5-46bb-bbf6-ce01065da590 service nova] Lock "f5350fb5-9460-490b-a47e-74f88c8eb51c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:55:17 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-f4b398fb-7082-470a-afbf-342358be8d96 req-ec76b758-4fe5-46bb-bbf6-ce01065da590 service nova] Lock "f5350fb5-9460-490b-a47e-74f88c8eb51c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:55:17 user nova-compute[70924]: DEBUG nova.compute.manager [req-f4b398fb-7082-470a-afbf-342358be8d96 req-ec76b758-4fe5-46bb-bbf6-ce01065da590 service nova] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] No waiting events found dispatching network-vif-plugged-c4a5a7c9-34d6-4040-87a3-78c4fd26b170 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:55:17 user nova-compute[70924]: WARNING nova.compute.manager [req-f4b398fb-7082-470a-afbf-342358be8d96 req-ec76b758-4fe5-46bb-bbf6-ce01065da590 service nova] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Received unexpected event network-vif-plugged-c4a5a7c9-34d6-4040-87a3-78c4fd26b170 for instance with vm_state active and task_state deleting.
Jul 29 14:55:17 user nova-compute[70924]: INFO nova.compute.manager [None req-7e6eef84-3d71-4774-91b4-7a176274364d tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Took 0.77 seconds to detach 1 volumes for instance.
Jul 29 14:55:17 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-7e6eef84-3d71-4774-91b4-7a176274364d tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:55:17 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-7e6eef84-3d71-4774-91b4-7a176274364d tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:55:17 user nova-compute[70924]: DEBUG nova.compute.manager [req-cf6bb88b-62d4-401c-b813-ec887d98b8b8 req-77960531-c3ee-483a-87fb-a08a951c13be service nova] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Received event network-vif-deleted-c4a5a7c9-34d6-4040-87a3-78c4fd26b170 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:55:18 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-7e6eef84-3d71-4774-91b4-7a176274364d tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:55:18 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-7e6eef84-3d71-4774-91b4-7a176274364d tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:55:18 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-7e6eef84-3d71-4774-91b4-7a176274364d tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.486s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:55:18 user nova-compute[70924]: INFO nova.scheduler.client.report [None req-7e6eef84-3d71-4774-91b4-7a176274364d tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Deleted allocations for instance f5350fb5-9460-490b-a47e-74f88c8eb51c
Jul 29 14:55:18 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9eaf2a3c-642d-4a4e-8370-2407fcc47ffc tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Acquiring lock "bdaf1714-27f9-47ee-808b-206ec78c6067" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:55:18 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9eaf2a3c-642d-4a4e-8370-2407fcc47ffc tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "bdaf1714-27f9-47ee-808b-206ec78c6067" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:55:18 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9eaf2a3c-642d-4a4e-8370-2407fcc47ffc tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Acquiring lock "bdaf1714-27f9-47ee-808b-206ec78c6067-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:55:18 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9eaf2a3c-642d-4a4e-8370-2407fcc47ffc tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "bdaf1714-27f9-47ee-808b-206ec78c6067-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:55:18 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9eaf2a3c-642d-4a4e-8370-2407fcc47ffc tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "bdaf1714-27f9-47ee-808b-206ec78c6067-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:55:18 user nova-compute[70924]: INFO nova.compute.manager [None req-9eaf2a3c-642d-4a4e-8370-2407fcc47ffc tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Terminating instance
Jul 29 14:55:18 user nova-compute[70924]: DEBUG nova.compute.manager [None req-9eaf2a3c-642d-4a4e-8370-2407fcc47ffc tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Start destroying the instance on the hypervisor. {{(pid=70924) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 14:55:18 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:18 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-7e6eef84-3d71-4774-91b4-7a176274364d tempest-ServerActionsTestOtherB-298005467 tempest-ServerActionsTestOtherB-298005467-project-member] Lock "f5350fb5-9460-490b-a47e-74f88c8eb51c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.693s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:55:18 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:18 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:18 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:18 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:19 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Instance destroyed successfully.
Jul 29 14:55:19 user nova-compute[70924]: DEBUG nova.objects.instance [None req-9eaf2a3c-642d-4a4e-8370-2407fcc47ffc tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lazy-loading 'resources' on Instance uuid bdaf1714-27f9-47ee-808b-206ec78c6067 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:55:19 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-9eaf2a3c-642d-4a4e-8370-2407fcc47ffc tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-29T14:48:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-54166973',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-54166973',id=22,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4138Bk00KQqmdfErUxFcQgiDYdWqeBsVhjPxaQRe+n75igQpnWmMVo4wZ/3rzplwKKaH6Hx7du1dBe18tcOE6kgd7gQe+rlVaexoX2OrP2lfJM85qo3Gho73g735rkUA==',key_name='tempest-keypair-1998502930',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:52:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6f5f9f30926f47afad3cb4c9e89d55c5',ramdisk_id='',reservation_id='r-zgo1dppv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-130200384',owner_user_name='tempest-AttachVolumeShelveTestJSON-130200384-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:52:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c9562451ffa45b2aad975335d83fa8c',uuid=bdaf1714-27f9-47ee-808b-206ec78c6067,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d95eba18-cd83-40e6-847a-c36b2e084f89", "address": "fa:16:3e:45:15:fc", "network": {"id": "ff833b6e-b3ce-44ac-88ec-775f193cdfe4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-546934977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f5f9f30926f47afad3cb4c9e89d55c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd95eba18-cd", "ovs_interfaceid": "d95eba18-cd83-40e6-847a-c36b2e084f89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 14:55:19 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-9eaf2a3c-642d-4a4e-8370-2407fcc47ffc tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Converting VIF {"id": "d95eba18-cd83-40e6-847a-c36b2e084f89", "address": "fa:16:3e:45:15:fc", "network": {"id": "ff833b6e-b3ce-44ac-88ec-775f193cdfe4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-546934977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f5f9f30926f47afad3cb4c9e89d55c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd95eba18-cd", "ovs_interfaceid": "d95eba18-cd83-40e6-847a-c36b2e084f89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:55:19 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-9eaf2a3c-642d-4a4e-8370-2407fcc47ffc tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:15:fc,bridge_name='br-int',has_traffic_filtering=True,id=d95eba18-cd83-40e6-847a-c36b2e084f89,network=Network(ff833b6e-b3ce-44ac-88ec-775f193cdfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd95eba18-cd') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:55:19 user nova-compute[70924]: DEBUG os_vif [None req-9eaf2a3c-642d-4a4e-8370-2407fcc47ffc tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:15:fc,bridge_name='br-int',has_traffic_filtering=True,id=d95eba18-cd83-40e6-847a-c36b2e084f89,network=Network(ff833b6e-b3ce-44ac-88ec-775f193cdfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd95eba18-cd') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 14:55:19 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:19 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd95eba18-cd, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:55:19 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:55:19 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:19 user nova-compute[70924]: INFO os_vif [None req-9eaf2a3c-642d-4a4e-8370-2407fcc47ffc tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:15:fc,bridge_name='br-int',has_traffic_filtering=True,id=d95eba18-cd83-40e6-847a-c36b2e084f89,network=Network(ff833b6e-b3ce-44ac-88ec-775f193cdfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd95eba18-cd')
Jul 29 14:55:19 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-9eaf2a3c-642d-4a4e-8370-2407fcc47ffc tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Deleting instance files /opt/stack/data/nova/instances/bdaf1714-27f9-47ee-808b-206ec78c6067_del
Jul 29 14:55:19 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-9eaf2a3c-642d-4a4e-8370-2407fcc47ffc tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Deletion of /opt/stack/data/nova/instances/bdaf1714-27f9-47ee-808b-206ec78c6067_del complete
Jul 29 14:55:19 user nova-compute[70924]: INFO nova.compute.manager [None req-9eaf2a3c-642d-4a4e-8370-2407fcc47ffc tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Took 0.92 seconds to destroy the instance on the hypervisor.
Jul 29 14:55:19 user nova-compute[70924]: DEBUG oslo.service.loopingcall [None req-9eaf2a3c-642d-4a4e-8370-2407fcc47ffc tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70924) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 14:55:19 user nova-compute[70924]: DEBUG nova.compute.manager [-] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Deallocating network for instance {{(pid=70924) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 14:55:19 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] deallocate_for_instance() {{(pid=70924) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 14:55:19 user nova-compute[70924]: DEBUG nova.compute.manager [req-d5557c7a-078d-4b41-906f-9bd7023154e8 req-068fc807-483e-4991-b84e-e8bbc3001337 service nova] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Received event network-vif-unplugged-d95eba18-cd83-40e6-847a-c36b2e084f89 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:55:19 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-d5557c7a-078d-4b41-906f-9bd7023154e8 req-068fc807-483e-4991-b84e-e8bbc3001337 service nova] Acquiring lock "bdaf1714-27f9-47ee-808b-206ec78c6067-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:55:19 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-d5557c7a-078d-4b41-906f-9bd7023154e8 req-068fc807-483e-4991-b84e-e8bbc3001337 service nova] Lock "bdaf1714-27f9-47ee-808b-206ec78c6067-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:55:19 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-d5557c7a-078d-4b41-906f-9bd7023154e8 req-068fc807-483e-4991-b84e-e8bbc3001337 service nova] Lock "bdaf1714-27f9-47ee-808b-206ec78c6067-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:55:19 user nova-compute[70924]: DEBUG nova.compute.manager [req-d5557c7a-078d-4b41-906f-9bd7023154e8 req-068fc807-483e-4991-b84e-e8bbc3001337 service nova] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] No waiting events found dispatching network-vif-unplugged-d95eba18-cd83-40e6-847a-c36b2e084f89 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:55:19 user nova-compute[70924]: DEBUG nova.compute.manager [req-d5557c7a-078d-4b41-906f-9bd7023154e8 req-068fc807-483e-4991-b84e-e8bbc3001337 service nova] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Received event network-vif-unplugged-d95eba18-cd83-40e6-847a-c36b2e084f89 for instance with task_state deleting. {{(pid=70924) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 14:55:19 user nova-compute[70924]: DEBUG nova.compute.manager [req-d5557c7a-078d-4b41-906f-9bd7023154e8 req-068fc807-483e-4991-b84e-e8bbc3001337 service nova] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Received event network-vif-plugged-d95eba18-cd83-40e6-847a-c36b2e084f89 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:55:19 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-d5557c7a-078d-4b41-906f-9bd7023154e8 req-068fc807-483e-4991-b84e-e8bbc3001337 service nova] Acquiring lock "bdaf1714-27f9-47ee-808b-206ec78c6067-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:55:19 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-d5557c7a-078d-4b41-906f-9bd7023154e8 req-068fc807-483e-4991-b84e-e8bbc3001337 service nova] Lock "bdaf1714-27f9-47ee-808b-206ec78c6067-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:55:19 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-d5557c7a-078d-4b41-906f-9bd7023154e8 req-068fc807-483e-4991-b84e-e8bbc3001337 service nova] Lock "bdaf1714-27f9-47ee-808b-206ec78c6067-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:55:19 user nova-compute[70924]: DEBUG nova.compute.manager [req-d5557c7a-078d-4b41-906f-9bd7023154e8 req-068fc807-483e-4991-b84e-e8bbc3001337 service nova] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] No waiting events found dispatching network-vif-plugged-d95eba18-cd83-40e6-847a-c36b2e084f89 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:55:19 user nova-compute[70924]: WARNING nova.compute.manager [req-d5557c7a-078d-4b41-906f-9bd7023154e8 req-068fc807-483e-4991-b84e-e8bbc3001337 service nova] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Received unexpected event network-vif-plugged-d95eba18-cd83-40e6-847a-c36b2e084f89 for instance with vm_state active and task_state deleting.
Jul 29 14:55:20 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:55:20 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Took 1.58 seconds to deallocate network for instance.
Jul 29 14:55:20 user nova-compute[70924]: DEBUG nova.compute.manager [req-e42ecfe2-4424-4746-a390-b2661b0fa3d6 req-0e4c37d0-dedb-4fb6-9b1c-224cba86ba81 service nova] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Received event network-vif-deleted-d95eba18-cd83-40e6-847a-c36b2e084f89 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:55:20 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9eaf2a3c-642d-4a4e-8370-2407fcc47ffc tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:55:20 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9eaf2a3c-642d-4a4e-8370-2407fcc47ffc tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:55:21 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-9eaf2a3c-642d-4a4e-8370-2407fcc47ffc tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:55:21 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-9eaf2a3c-642d-4a4e-8370-2407fcc47ffc tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:55:21 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9eaf2a3c-642d-4a4e-8370-2407fcc47ffc tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.523s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:55:21 user nova-compute[70924]: INFO nova.scheduler.client.report [None req-9eaf2a3c-642d-4a4e-8370-2407fcc47ffc tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Deleted allocations for instance bdaf1714-27f9-47ee-808b-206ec78c6067
Jul 29 14:55:21 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9eaf2a3c-642d-4a4e-8370-2407fcc47ffc tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "bdaf1714-27f9-47ee-808b-206ec78c6067" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.310s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:55:22 user nova-compute[70924]: DEBUG nova.compute.manager [req-a599fb65-d57e-43d6-9c1f-7dab385d570a req-85073d06-4149-42f1-9430-624736b9a8b5 service nova] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Received event network-changed-fa798159-0d64-40e0-8418-5889396f6a5f {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:55:22 user nova-compute[70924]: DEBUG nova.compute.manager [req-a599fb65-d57e-43d6-9c1f-7dab385d570a req-85073d06-4149-42f1-9430-624736b9a8b5 service nova] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Refreshing instance network info cache due to event network-changed-fa798159-0d64-40e0-8418-5889396f6a5f. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:55:22 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a599fb65-d57e-43d6-9c1f-7dab385d570a req-85073d06-4149-42f1-9430-624736b9a8b5 service nova] Acquiring lock "refresh_cache-710f0d5a-8420-49c4-bf70-27305dd85bd3" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:55:22 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a599fb65-d57e-43d6-9c1f-7dab385d570a req-85073d06-4149-42f1-9430-624736b9a8b5 service nova] Acquired lock "refresh_cache-710f0d5a-8420-49c4-bf70-27305dd85bd3" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:55:22 user nova-compute[70924]: DEBUG nova.network.neutron [req-a599fb65-d57e-43d6-9c1f-7dab385d570a req-85073d06-4149-42f1-9430-624736b9a8b5 service nova] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Refreshing network info cache for port fa798159-0d64-40e0-8418-5889396f6a5f {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:55:23 user nova-compute[70924]: DEBUG nova.network.neutron [req-a599fb65-d57e-43d6-9c1f-7dab385d570a req-85073d06-4149-42f1-9430-624736b9a8b5 service nova] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Updated VIF entry in instance network info cache for port fa798159-0d64-40e0-8418-5889396f6a5f. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:55:23 user nova-compute[70924]: DEBUG nova.network.neutron [req-a599fb65-d57e-43d6-9c1f-7dab385d570a req-85073d06-4149-42f1-9430-624736b9a8b5 service nova] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Updating instance_info_cache with network_info: [{"id": "fa798159-0d64-40e0-8418-5889396f6a5f", "address": "fa:16:3e:67:60:2e", "network": {"id": "21a19801-8526-40a2-9bcb-dda6cfb435fe", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-761511746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a03844d646454b6ea55e1b5625f7909a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa798159-0d", "ovs_interfaceid": "fa798159-0d64-40e0-8418-5889396f6a5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:55:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a599fb65-d57e-43d6-9c1f-7dab385d570a req-85073d06-4149-42f1-9430-624736b9a8b5 service nova] Releasing lock "refresh_cache-710f0d5a-8420-49c4-bf70-27305dd85bd3" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:55:23 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:24 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:24 user nova-compute[70924]: DEBUG nova.compute.manager [req-cfde02ed-9ca2-4570-baf0-9365a0d453e4 req-f1ff007f-48de-43b3-a3e5-a215c9434b18 service nova] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Received event network-changed-fa798159-0d64-40e0-8418-5889396f6a5f {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:55:24 user nova-compute[70924]: DEBUG nova.compute.manager [req-cfde02ed-9ca2-4570-baf0-9365a0d453e4 req-f1ff007f-48de-43b3-a3e5-a215c9434b18 service nova] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Refreshing instance network info cache due to event network-changed-fa798159-0d64-40e0-8418-5889396f6a5f. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:55:24 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-cfde02ed-9ca2-4570-baf0-9365a0d453e4 req-f1ff007f-48de-43b3-a3e5-a215c9434b18 service nova] Acquiring lock "refresh_cache-710f0d5a-8420-49c4-bf70-27305dd85bd3" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:55:24 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-cfde02ed-9ca2-4570-baf0-9365a0d453e4 req-f1ff007f-48de-43b3-a3e5-a215c9434b18 service nova] Acquired lock "refresh_cache-710f0d5a-8420-49c4-bf70-27305dd85bd3" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:55:24 user nova-compute[70924]: DEBUG nova.network.neutron [req-cfde02ed-9ca2-4570-baf0-9365a0d453e4 req-f1ff007f-48de-43b3-a3e5-a215c9434b18 service nova] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Refreshing network info cache for port fa798159-0d64-40e0-8418-5889396f6a5f {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:55:25 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:25 user nova-compute[70924]: DEBUG nova.network.neutron [req-cfde02ed-9ca2-4570-baf0-9365a0d453e4 req-f1ff007f-48de-43b3-a3e5-a215c9434b18 service nova] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Updated VIF entry in instance network info cache for port fa798159-0d64-40e0-8418-5889396f6a5f. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:55:25 user nova-compute[70924]: DEBUG nova.network.neutron [req-cfde02ed-9ca2-4570-baf0-9365a0d453e4 req-f1ff007f-48de-43b3-a3e5-a215c9434b18 service nova] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Updating instance_info_cache with network_info: [{"id": "fa798159-0d64-40e0-8418-5889396f6a5f", "address": "fa:16:3e:67:60:2e", "network": {"id": "21a19801-8526-40a2-9bcb-dda6cfb435fe", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-761511746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a03844d646454b6ea55e1b5625f7909a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa798159-0d", "ovs_interfaceid": "fa798159-0d64-40e0-8418-5889396f6a5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:55:25 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-cfde02ed-9ca2-4570-baf0-9365a0d453e4 req-f1ff007f-48de-43b3-a3e5-a215c9434b18 service nova] Releasing lock "refresh_cache-710f0d5a-8420-49c4-bf70-27305dd85bd3" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:55:27 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Acquiring lock "710f0d5a-8420-49c4-bf70-27305dd85bd3" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:55:27 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lock "710f0d5a-8420-49c4-bf70-27305dd85bd3" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:55:27 user nova-compute[70924]: INFO nova.compute.manager [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Rebooting instance
Jul 29 14:55:27 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Acquiring lock "refresh_cache-710f0d5a-8420-49c4-bf70-27305dd85bd3" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:55:27 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Acquired lock "refresh_cache-710f0d5a-8420-49c4-bf70-27305dd85bd3" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:55:27 user nova-compute[70924]: DEBUG nova.network.neutron [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 14:55:27 user nova-compute[70924]: DEBUG nova.network.neutron [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Updating instance_info_cache with network_info: [{"id": "fa798159-0d64-40e0-8418-5889396f6a5f", "address": "fa:16:3e:67:60:2e", "network": {"id": "21a19801-8526-40a2-9bcb-dda6cfb435fe", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-761511746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a03844d646454b6ea55e1b5625f7909a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa798159-0d", "ovs_interfaceid": "fa798159-0d64-40e0-8418-5889396f6a5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:55:27 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Releasing lock "refresh_cache-710f0d5a-8420-49c4-bf70-27305dd85bd3" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:55:27 user nova-compute[70924]: DEBUG nova.compute.manager [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:55:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:28 user nova-compute[70924]: DEBUG nova.compute.manager [req-ef268fb9-9662-4ab4-adb9-f118f563a4f2 req-2515d3a3-ac09-41ff-a51d-8752ad3e9098 service nova] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Received event network-vif-unplugged-fa798159-0d64-40e0-8418-5889396f6a5f {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:55:28 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-ef268fb9-9662-4ab4-adb9-f118f563a4f2 req-2515d3a3-ac09-41ff-a51d-8752ad3e9098 service nova] Acquiring lock "710f0d5a-8420-49c4-bf70-27305dd85bd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:55:28 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-ef268fb9-9662-4ab4-adb9-f118f563a4f2 req-2515d3a3-ac09-41ff-a51d-8752ad3e9098 service nova] Lock "710f0d5a-8420-49c4-bf70-27305dd85bd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:55:28 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-ef268fb9-9662-4ab4-adb9-f118f563a4f2 req-2515d3a3-ac09-41ff-a51d-8752ad3e9098 service nova] Lock "710f0d5a-8420-49c4-bf70-27305dd85bd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:55:28 user nova-compute[70924]: DEBUG nova.compute.manager [req-ef268fb9-9662-4ab4-adb9-f118f563a4f2 req-2515d3a3-ac09-41ff-a51d-8752ad3e9098 service nova] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] No waiting events found dispatching network-vif-unplugged-fa798159-0d64-40e0-8418-5889396f6a5f {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:55:28 user nova-compute[70924]: WARNING nova.compute.manager [req-ef268fb9-9662-4ab4-adb9-f118f563a4f2 req-2515d3a3-ac09-41ff-a51d-8752ad3e9098 service nova] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Received unexpected event network-vif-unplugged-fa798159-0d64-40e0-8418-5889396f6a5f for instance with vm_state active and task_state reboot_started_hard.
Jul 29 14:55:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:28 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Instance destroyed successfully.
Jul 29 14:55:28 user nova-compute[70924]: DEBUG nova.objects.instance [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lazy-loading 'resources' on Instance uuid 710f0d5a-8420-49c4-bf70-27305dd85bd3 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:55:28 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:53:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-813512746',display_name='tempest-TestMinimumBasicScenario-server-813512746',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-813512746',id=30,image_ref='8f3dcf97-8b65-45cb-b52e-bff81d80db70',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA76T/51PTdIphAR5vmKjW5tUtLn/sQuimAbsDwwFMd+B+5p2qZFOwSM1z2S0WxRqwOdkFbLSkcByFgSatE660bvOjkxrQaY0j/lDrcZkHXhqDCNe3n8ezCtGkqt/N+vPw==',key_name='tempest-TestMinimumBasicScenario-2130533388',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:53:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a03844d646454b6ea55e1b5625f7909a',ramdisk_id='',reservation_id='r-idexnh0b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8f3dcf97-8b65-45cb-b52e-bff81d80db70',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-944069199',owner_user_name='tempest-TestMinimumBasicScenario-944069199-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:55:28Z,user_data=None,user_id='7aa9677ce659431db31a0e513277d692',uuid=710f0d5a-8420-49c4-bf70-27305dd85bd3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fa798159-0d64-40e0-8418-5889396f6a5f", "address": "fa:16:3e:67:60:2e", "network": {"id": "21a19801-8526-40a2-9bcb-dda6cfb435fe", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-761511746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a03844d646454b6ea55e1b5625f7909a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa798159-0d", "ovs_interfaceid": "fa798159-0d64-40e0-8418-5889396f6a5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 14:55:28 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Converting VIF {"id": "fa798159-0d64-40e0-8418-5889396f6a5f", "address": "fa:16:3e:67:60:2e", "network": {"id": "21a19801-8526-40a2-9bcb-dda6cfb435fe", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-761511746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a03844d646454b6ea55e1b5625f7909a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa798159-0d", "ovs_interfaceid": "fa798159-0d64-40e0-8418-5889396f6a5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:55:28 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:67:60:2e,bridge_name='br-int',has_traffic_filtering=True,id=fa798159-0d64-40e0-8418-5889396f6a5f,network=Network(21a19801-8526-40a2-9bcb-dda6cfb435fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa798159-0d') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:55:28 user nova-compute[70924]: DEBUG os_vif [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:60:2e,bridge_name='br-int',has_traffic_filtering=True,id=fa798159-0d64-40e0-8418-5889396f6a5f,network=Network(21a19801-8526-40a2-9bcb-dda6cfb435fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa798159-0d') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 14:55:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfa798159-0d, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:55:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:55:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:28 user nova-compute[70924]: INFO os_vif [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:60:2e,bridge_name='br-int',has_traffic_filtering=True,id=fa798159-0d64-40e0-8418-5889396f6a5f,network=Network(21a19801-8526-40a2-9bcb-dda6cfb435fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa798159-0d')
Jul 29 14:55:28 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] calling os-brick to detach iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 14:55:28 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, {'target_iqns': ['iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dCGqnbFN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:55:28 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:55:28 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:55:28 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:55:28 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2', 0)] {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0ae953-f12b-4b6c-af2a-b53e3b095e28]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[a397fac6-7743-4035-88d1-79c652ac2240]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:55:29 user nova-compute[70924]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:55:29 user nova-compute[70924]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb (non-flash)
Jul 29 14:55:29 user nova-compute[70924]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)
Jul 29 14:55:29 user nova-compute[70924]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2 (non-flash)
Jul 29 14:55:29 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:55:29 user nova-compute[70924]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:55:29 user nova-compute[70924]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb (non-flash)
Jul 29 14:55:29 user nova-compute[70924]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)
Jul 29 14:55:29 user nova-compute[70924]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2 (non-flash)
Jul 29 14:55:29 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feedc57ef80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2'): ({'sdc'}, set())}) {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Removing single pathed devices sdc {{(pid=70924) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39136df-e55a-422e-925e-1a14be0bf752]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da31557-457f-4e9a-baa9-5eeafdb5556a]: (4, ('ok\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Flushing IO for device /dev/sdc {{(pid=70924) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 14:55:29 user nova-compute[70924]: INFO nova.compute.manager [None req-51a6f2b5-3941-4020-bf4a-1b12af423118 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] Get console output
Jul 29 14:55:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f780199d-d814-45ab-95c8-ab7f0108d80a]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70924) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.060s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d260f66e-4055-4242-a7e3-5d5fe402010f]: (4, ('1', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] SCSI volumes sdc have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2')] {{(pid=70924) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG nova.compute.manager [req-956e94d3-5556-4689-a2ea-960ead3f51c9 req-15aafd80-ff65-49d4-8774-1ad24c650421 service nova] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Received event network-changed-a9e045fe-1480-4254-ad3d-ce7a12c1b293 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG nova.compute.manager [req-956e94d3-5556-4689-a2ea-960ead3f51c9 req-15aafd80-ff65-49d4-8774-1ad24c650421 service nova] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Refreshing instance network info cache due to event network-changed-a9e045fe-1480-4254-ad3d-ce7a12c1b293. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-956e94d3-5556-4689-a2ea-960ead3f51c9 req-15aafd80-ff65-49d4-8774-1ad24c650421 service nova] Acquiring lock "refresh_cache-fd91d5fc-857d-4d63-ad83-8028c1d3309f" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-956e94d3-5556-4689-a2ea-960ead3f51c9 req-15aafd80-ff65-49d4-8774-1ad24c650421 service nova] Acquired lock "refresh_cache-fd91d5fc-857d-4d63-ad83-8028c1d3309f" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG nova.network.neutron [req-956e94d3-5556-4689-a2ea-960ead3f51c9 req-15aafd80-ff65-49d4-8774-1ad24c650421 service nova] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Refreshing network info cache for port a9e045fe-1480-4254-ad3d-ce7a12c1b293 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.038s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd3748a-47d9-4ca6-a12c-d0993f7cefd5]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2 -p 172.16.0.220:3260 --logout {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:29 user nova-compute[70924]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Jul 29 14:55:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b460852c-263e-48a5-9705-67964013270a]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2, portal: 172.16.0.220,3260]
Jul 29 14:55:29 user nova-compute[70924]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2, portal: 172.16.0.220,3260] successful.
Jul 29 14:55:29 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-647c82e2-0114-4356-94f4-0df3d6cc8c11 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Acquiring lock "fd91d5fc-857d-4d63-ad83-8028c1d3309f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-647c82e2-0114-4356-94f4-0df3d6cc8c11 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Lock "fd91d5fc-857d-4d63-ad83-8028c1d3309f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-647c82e2-0114-4356-94f4-0df3d6cc8c11 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Acquiring lock "fd91d5fc-857d-4d63-ad83-8028c1d3309f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-647c82e2-0114-4356-94f4-0df3d6cc8c11 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Lock "fd91d5fc-857d-4d63-ad83-8028c1d3309f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-647c82e2-0114-4356-94f4-0df3d6cc8c11 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Lock "fd91d5fc-857d-4d63-ad83-8028c1d3309f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2 -p 172.16.0.220:3260 --op delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:29 user nova-compute[70924]: INFO nova.compute.manager [None req-647c82e2-0114-4356-94f4-0df3d6cc8c11 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Terminating instance
Jul 29 14:55:29 user nova-compute[70924]: DEBUG nova.compute.manager [None req-647c82e2-0114-4356-94f4-0df3d6cc8c11 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Start destroying the instance on the hypervisor. {{(pid=70924) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[035beba6-e795-4426-856f-046b93c225ed]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.394s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] <== disconnect_volume: return (395ms) None {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Disconnected iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Start _get_guest_xml network_info=[{"id": "fa798159-0d64-40e0-8418-5889396f6a5f", "address": "fa:16:3e:67:60:2e", "network": {"id": "21a19801-8526-40a2-9bcb-dda6cfb435fe", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-761511746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a03844d646454b6ea55e1b5625f7909a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa798159-0d", "ovs_interfaceid": "fa798159-0d64-40e0-8418-5889396f6a5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8f3dcf97-8b65-45cb-b52e-bff81d80db70,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '8f3dcf97-8b65-45cb-b52e-bff81d80db70'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'boot_index': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dCGqnbFN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '710f0d5a-8420-49c4-bf70-27305dd85bd3', 'attached_at': '', 'detached_at': '', 'volume_id': '3ac35b93-78b7-4614-a0c6-aa80496897e2', 'serial': '3ac35b93-78b7-4614-a0c6-aa80496897e2'}, 'attachment_id': 'fbc6d190-6929-47be-ada5-f14d2d7c5b47', 'volume_type': None} {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 14:55:29 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:55:29 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:55:29 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] CPU controller missing on host. {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] CPU controller found on host. {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70924) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T14:36:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8f3dcf97-8b65-45cb-b52e-bff81d80db70,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Flavor limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Image limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Flavor pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Image pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Got 1 possible topologies {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG nova.objects.instance [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lazy-loading 'vcpu_model' on Instance uuid 710f0d5a-8420-49c4-bf70-27305dd85bd3 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Calling os-brick to attach iSCSI Volume {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dCGqnbFN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:55:29 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:55:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:55:29 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:55:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:55:29 user nova-compute[70924]: INFO os_brick.initiator.connectors.iscsi [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 14:55:29 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2 -p 172.16.0.220:3260 {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[56180110-17e2-41df-99af-fd29799a4bc6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 14:55:29 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2 -p 172.16.0.220:3260 --interface default --op new {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc564567-236a-488f-a302-88606f8a748d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2] added\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2] added
Jul 29 14:55:29 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f34356-6a94-4d38-88c8-22dfcb490c3e]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54ce627-37da-4f0e-b77f-02a873a4a239]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dCGqnbFN {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dCGqnbFN" returned: 0 in 0.026s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[23187a30-8a73-48b8-a138-eb83d6148922]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dCGqnbFN'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c210eb64-45b7-40a1-9a8a-912de44a77e6]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[989bfd5a-0d3e-4dcd-8fcc-a3e5c46442f6]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:55:29 user nova-compute[70924]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:55:29 user nova-compute[70924]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb (non-flash)
Jul 29 14:55:29 user nova-compute[70924]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)
Jul 29 14:55:29 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:55:29 user nova-compute[70924]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:55:29 user nova-compute[70924]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb (non-flash)
Jul 29 14:55:29 user nova-compute[70924]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)
Jul 29 14:55:29 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2 -p 172.16.0.220:3260 --login {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[39160cf0-3109-4a6f-b394-f921a51f5364]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2, portal: 172.16.0.220,3260]
Jul 29 14:55:29 user nova-compute[70924]: Login to [iface: default, target: iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2, portal: 172.16.0.220,3260] successful.
Jul 29 14:55:29 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1841d7bb-a867-4fe4-9a59-46bd1ab60d0b]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[02742038-e256-4883-b1ce-806edb3d5aaf]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:55:29 user nova-compute[70924]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:55:29 user nova-compute[70924]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb (non-flash)
Jul 29 14:55:29 user nova-compute[70924]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)
Jul 29 14:55:29 user nova-compute[70924]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2 (non-flash)
Jul 29 14:55:29 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:55:29 user nova-compute[70924]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:55:29 user nova-compute[70924]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb (non-flash)
Jul 29 14:55:29 user nova-compute[70924]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)
Jul 29 14:55:29 user nova-compute[70924]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2 (non-flash)
Jul 29 14:55:29 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.357s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Connected to 172.16.0.220:3260 {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] HCTL ('34', '-', '-', 0) found on session 39 with lun 0 {{(pid=70924) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70924) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c2d1ed-4746-46f3-be34-347c1f96ba02]: (4, ('- - 0', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 14:55:29 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dCGqnbFN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 14:55:30 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Instance destroyed successfully.
Jul 29 14:55:30 user nova-compute[70924]: DEBUG nova.objects.instance [None req-647c82e2-0114-4356-94f4-0df3d6cc8c11 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Lazy-loading 'resources' on Instance uuid fd91d5fc-857d-4d63-ad83-8028c1d3309f {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:55:30 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-647c82e2-0114-4356-94f4-0df3d6cc8c11 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-29T14:49:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-101620479',display_name='tempest-TestShelveInstance-server-101620479',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-101620479',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJl9SeKBDEFUdZXIRYxtj3V1LFrnLzpBI1BTadh9TNsH8fkqnHg5Fw+RxTHhcTZ72iicnrnvmeL33OTqSqXpIduQnNb3GyKNIEhQtAMHUQIlw02/VIbczFOLlqv70OZPgQ==',key_name='tempest-TestShelveInstance-614764253',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:53:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='85e92f662b024b8a86d5fd646f169169',ramdisk_id='',reservation_id='r-npw3a429',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1828854384',owner_user_name='tempest-TestShelveInstance-1828854384-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:53:54Z,user_data=None,user_id='53f2f7de42a74fb997661c7d579f508d',uuid=fd91d5fc-857d-4d63-ad83-8028c1d3309f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a9e045fe-1480-4254-ad3d-ce7a12c1b293", "address": "fa:16:3e:a4:a5:1c", "network": {"id": "fe4e60fb-1489-4a58-989a-1d81e33eddbc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1273087888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85e92f662b024b8a86d5fd646f169169", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9e045fe-14", "ovs_interfaceid": "a9e045fe-1480-4254-ad3d-ce7a12c1b293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 14:55:30 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-647c82e2-0114-4356-94f4-0df3d6cc8c11 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Converting VIF {"id": "a9e045fe-1480-4254-ad3d-ce7a12c1b293", "address": "fa:16:3e:a4:a5:1c", "network": {"id": "fe4e60fb-1489-4a58-989a-1d81e33eddbc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1273087888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85e92f662b024b8a86d5fd646f169169", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9e045fe-14", "ovs_interfaceid": "a9e045fe-1480-4254-ad3d-ce7a12c1b293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:55:30 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-647c82e2-0114-4356-94f4-0df3d6cc8c11 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:a5:1c,bridge_name='br-int',has_traffic_filtering=True,id=a9e045fe-1480-4254-ad3d-ce7a12c1b293,network=Network(fe4e60fb-1489-4a58-989a-1d81e33eddbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9e045fe-14') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:55:30 user nova-compute[70924]: DEBUG os_vif [None req-647c82e2-0114-4356-94f4-0df3d6cc8c11 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:a5:1c,bridge_name='br-int',has_traffic_filtering=True,id=a9e045fe-1480-4254-ad3d-ce7a12c1b293,network=Network(fe4e60fb-1489-4a58-989a-1d81e33eddbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9e045fe-14') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 14:55:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa9e045fe-14, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:55:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:55:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:30 user nova-compute[70924]: INFO os_vif [None req-647c82e2-0114-4356-94f4-0df3d6cc8c11 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:a5:1c,bridge_name='br-int',has_traffic_filtering=True,id=a9e045fe-1480-4254-ad3d-ce7a12c1b293,network=Network(fe4e60fb-1489-4a58-989a-1d81e33eddbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9e045fe-14')
Jul 29 14:55:30 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-647c82e2-0114-4356-94f4-0df3d6cc8c11 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] calling os-brick to detach iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 14:55:30 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-647c82e2-0114-4356-94f4-0df3d6cc8c11 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, {'target_iqns': ['iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tvIfOzwR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:55:30 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-647c82e2-0114-4356-94f4-0df3d6cc8c11 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:55:30 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-647c82e2-0114-4356-94f4-0df3d6cc8c11 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:55:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:30 user nova-compute[70924]: DEBUG nova.network.neutron [req-956e94d3-5556-4689-a2ea-960ead3f51c9 req-15aafd80-ff65-49d4-8774-1ad24c650421 service nova] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Updated VIF entry in instance network info cache for port a9e045fe-1480-4254-ad3d-ce7a12c1b293. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:55:30 user nova-compute[70924]: DEBUG nova.network.neutron [req-956e94d3-5556-4689-a2ea-960ead3f51c9 req-15aafd80-ff65-49d4-8774-1ad24c650421 service nova] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Updating instance_info_cache with network_info: [{"id": "a9e045fe-1480-4254-ad3d-ce7a12c1b293", "address": "fa:16:3e:a4:a5:1c", "network": {"id": "fe4e60fb-1489-4a58-989a-1d81e33eddbc", "bridge": "br-int", "label": "tempest-TestShelveInstance-1273087888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85e92f662b024b8a86d5fd646f169169", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9e045fe-14", "ovs_interfaceid": "a9e045fe-1480-4254-ad3d-ce7a12c1b293", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:55:30 user nova-compute[70924]: DEBUG nova.compute.manager [req-101bda62-092e-4025-92b5-2b37076aa7f1 req-0a44b27c-2ae0-4b81-a3f9-14f999929ece service nova] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Received event network-vif-plugged-fa798159-0d64-40e0-8418-5889396f6a5f {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:55:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-101bda62-092e-4025-92b5-2b37076aa7f1 req-0a44b27c-2ae0-4b81-a3f9-14f999929ece service nova] Acquiring lock "710f0d5a-8420-49c4-bf70-27305dd85bd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:55:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-101bda62-092e-4025-92b5-2b37076aa7f1 req-0a44b27c-2ae0-4b81-a3f9-14f999929ece service nova] Lock "710f0d5a-8420-49c4-bf70-27305dd85bd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:55:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-101bda62-092e-4025-92b5-2b37076aa7f1 req-0a44b27c-2ae0-4b81-a3f9-14f999929ece service nova] Lock "710f0d5a-8420-49c4-bf70-27305dd85bd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:55:30 user nova-compute[70924]: DEBUG nova.compute.manager [req-101bda62-092e-4025-92b5-2b37076aa7f1 req-0a44b27c-2ae0-4b81-a3f9-14f999929ece service nova] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] No waiting events found dispatching network-vif-plugged-fa798159-0d64-40e0-8418-5889396f6a5f {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:55:30 user nova-compute[70924]: WARNING nova.compute.manager [req-101bda62-092e-4025-92b5-2b37076aa7f1 req-0a44b27c-2ae0-4b81-a3f9-14f999929ece service nova] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Received unexpected event network-vif-plugged-fa798159-0d64-40e0-8418-5889396f6a5f for instance with vm_state active and task_state reboot_started_hard.
Jul 29 14:55:30 user nova-compute[70924]: DEBUG nova.compute.manager [req-101bda62-092e-4025-92b5-2b37076aa7f1 req-0a44b27c-2ae0-4b81-a3f9-14f999929ece service nova] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Received event network-vif-unplugged-a9e045fe-1480-4254-ad3d-ce7a12c1b293 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:55:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-101bda62-092e-4025-92b5-2b37076aa7f1 req-0a44b27c-2ae0-4b81-a3f9-14f999929ece service nova] Acquiring lock "fd91d5fc-857d-4d63-ad83-8028c1d3309f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:55:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-101bda62-092e-4025-92b5-2b37076aa7f1 req-0a44b27c-2ae0-4b81-a3f9-14f999929ece service nova] Lock "fd91d5fc-857d-4d63-ad83-8028c1d3309f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:55:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-101bda62-092e-4025-92b5-2b37076aa7f1 req-0a44b27c-2ae0-4b81-a3f9-14f999929ece service nova] Lock "fd91d5fc-857d-4d63-ad83-8028c1d3309f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:55:30 user nova-compute[70924]: DEBUG nova.compute.manager [req-101bda62-092e-4025-92b5-2b37076aa7f1 req-0a44b27c-2ae0-4b81-a3f9-14f999929ece service nova] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] No waiting events found dispatching network-vif-unplugged-a9e045fe-1480-4254-ad3d-ce7a12c1b293 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:55:30 user nova-compute[70924]: DEBUG nova.compute.manager [req-101bda62-092e-4025-92b5-2b37076aa7f1 req-0a44b27c-2ae0-4b81-a3f9-14f999929ece service nova] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Received event network-vif-unplugged-a9e045fe-1480-4254-ad3d-ce7a12c1b293 for instance with task_state deleting. {{(pid=70924) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 14:55:30 user nova-compute[70924]: DEBUG nova.compute.manager [req-101bda62-092e-4025-92b5-2b37076aa7f1 req-0a44b27c-2ae0-4b81-a3f9-14f999929ece service nova] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Received event network-vif-plugged-a9e045fe-1480-4254-ad3d-ce7a12c1b293 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:55:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-101bda62-092e-4025-92b5-2b37076aa7f1 req-0a44b27c-2ae0-4b81-a3f9-14f999929ece service nova] Acquiring lock "fd91d5fc-857d-4d63-ad83-8028c1d3309f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:55:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-101bda62-092e-4025-92b5-2b37076aa7f1 req-0a44b27c-2ae0-4b81-a3f9-14f999929ece service nova] Lock "fd91d5fc-857d-4d63-ad83-8028c1d3309f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:55:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-101bda62-092e-4025-92b5-2b37076aa7f1 req-0a44b27c-2ae0-4b81-a3f9-14f999929ece service nova] Lock "fd91d5fc-857d-4d63-ad83-8028c1d3309f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:55:30 user nova-compute[70924]: DEBUG nova.compute.manager [req-101bda62-092e-4025-92b5-2b37076aa7f1 req-0a44b27c-2ae0-4b81-a3f9-14f999929ece service nova] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] No waiting events found dispatching network-vif-plugged-a9e045fe-1480-4254-ad3d-ce7a12c1b293 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:55:30 user nova-compute[70924]: WARNING nova.compute.manager [req-101bda62-092e-4025-92b5-2b37076aa7f1 req-0a44b27c-2ae0-4b81-a3f9-14f999929ece service nova] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Received unexpected event network-vif-plugged-a9e045fe-1480-4254-ad3d-ce7a12c1b293 for instance with vm_state active and task_state deleting.
Jul 29 14:55:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-956e94d3-5556-4689-a2ea-960ead3f51c9 req-15aafd80-ff65-49d4-8774-1ad24c650421 service nova] Releasing lock "refresh_cache-fd91d5fc-857d-4d63-ad83-8028c1d3309f" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:55:30 user nova-compute[70924]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690642515.5555234, f5350fb5-9460-490b-a47e-74f88c8eb51c => Stopped> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:55:30 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] VM Stopped (Lifecycle Event)
Jul 29 14:55:30 user nova-compute[70924]: DEBUG nova.compute.manager [None req-bc44e7bf-6e8c-49bc-afc3-f8cd5f106c92 None None] [instance: f5350fb5-9460-490b-a47e-74f88c8eb51c] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:55:30 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.391s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:55:30 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] <== connect_volume: return (1392ms) {'type': 'block', 'scsi_wwn': '23831343961396432', 'path': '/dev/sdc'} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:55:30 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831343961396432', 'path': '/dev/sdc'} {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 14:55:30 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-647c82e2-0114-4356-94f4-0df3d6cc8c11 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.695s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:55:30 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-647c82e2-0114-4356-94f4-0df3d6cc8c11 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495', 0)] {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 14:55:30 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:30 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:30 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51d9ba8-545a-4721-ad74-e6a2c11d0187]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:55:30 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:30 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:53:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-813512746',display_name='tempest-TestMinimumBasicScenario-server-813512746',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-813512746',id=30,image_ref='8f3dcf97-8b65-45cb-b52e-bff81d80db70',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA76T/51PTdIphAR5vmKjW5tUtLn/sQuimAbsDwwFMd+B+5p2qZFOwSM1z2S0WxRqwOdkFbLSkcByFgSatE660bvOjkxrQaY0j/lDrcZkHXhqDCNe3n8ezCtGkqt/N+vPw==',key_name='tempest-TestMinimumBasicScenario-2130533388',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:53:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a03844d646454b6ea55e1b5625f7909a',ramdisk_id='',reservation_id='r-idexnh0b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8f3dcf97-8b65-45cb-b52e-bff81d80db70',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-944069199',owner_user_name='tempest-TestMinimumBasicScenario-944069199-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:55:28Z,user_data=None,user_id='7aa9677ce659431db31a0e513277d692',uuid=710f0d5a-8420-49c4-bf70-27305dd85bd3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fa798159-0d64-40e0-8418-5889396f6a5f", "address": "fa:16:3e:67:60:2e", "network": {"id": "21a19801-8526-40a2-9bcb-dda6cfb435fe", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-761511746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a03844d646454b6ea55e1b5625f7909a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa798159-0d", "ovs_interfaceid": "fa798159-0d64-40e0-8418-5889396f6a5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:55:30 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Converting VIF {"id": "fa798159-0d64-40e0-8418-5889396f6a5f", "address": "fa:16:3e:67:60:2e", "network": {"id": "21a19801-8526-40a2-9bcb-dda6cfb435fe", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-761511746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a03844d646454b6ea55e1b5625f7909a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa798159-0d", "ovs_interfaceid": "fa798159-0d64-40e0-8418-5889396f6a5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:55:30 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:67:60:2e,bridge_name='br-int',has_traffic_filtering=True,id=fa798159-0d64-40e0-8418-5889396f6a5f,network=Network(21a19801-8526-40a2-9bcb-dda6cfb435fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa798159-0d') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:55:30 user nova-compute[70924]: DEBUG nova.objects.instance [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lazy-loading 'pci_devices' on Instance uuid 710f0d5a-8420-49c4-bf70-27305dd85bd3 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:55:30 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] End _get_guest_xml xml=<domain type="kvm">
Jul 29 14:55:30 user nova-compute[70924]:   <uuid>710f0d5a-8420-49c4-bf70-27305dd85bd3</uuid>
Jul 29 14:55:30 user nova-compute[70924]:   <name>instance-0000001e</name>
Jul 29 14:55:30 user nova-compute[70924]:   <memory>524288</memory>
Jul 29 14:55:30 user nova-compute[70924]:   <vcpu>1</vcpu>
Jul 29 14:55:30 user nova-compute[70924]:   <metadata>
Jul 29 14:55:30 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 14:55:30 user nova-compute[70924]:       <nova:package version="0.0.0"/>
Jul 29 14:55:30 user nova-compute[70924]:       <nova:name>tempest-TestMinimumBasicScenario-server-813512746</nova:name>
Jul 29 14:55:30 user nova-compute[70924]:       <nova:creationTime>2023-07-29 14:55:29</nova:creationTime>
Jul 29 14:55:30 user nova-compute[70924]:       <nova:flavor name="m1.tiny">
Jul 29 14:55:30 user nova-compute[70924]:         <nova:memory>512</nova:memory>
Jul 29 14:55:30 user nova-compute[70924]:         <nova:disk>1</nova:disk>
Jul 29 14:55:30 user nova-compute[70924]:         <nova:swap>0</nova:swap>
Jul 29 14:55:30 user nova-compute[70924]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 14:55:30 user nova-compute[70924]:         <nova:vcpus>1</nova:vcpus>
Jul 29 14:55:30 user nova-compute[70924]:       </nova:flavor>
Jul 29 14:55:30 user nova-compute[70924]:       <nova:owner>
Jul 29 14:55:30 user nova-compute[70924]:         <nova:user uuid="7aa9677ce659431db31a0e513277d692">tempest-TestMinimumBasicScenario-944069199-project-member</nova:user>
Jul 29 14:55:30 user nova-compute[70924]:         <nova:project uuid="a03844d646454b6ea55e1b5625f7909a">tempest-TestMinimumBasicScenario-944069199</nova:project>
Jul 29 14:55:30 user nova-compute[70924]:       </nova:owner>
Jul 29 14:55:30 user nova-compute[70924]:       <nova:root type="image" uuid="8f3dcf97-8b65-45cb-b52e-bff81d80db70"/>
Jul 29 14:55:30 user nova-compute[70924]:       <nova:ports>
Jul 29 14:55:30 user nova-compute[70924]:         <nova:port uuid="fa798159-0d64-40e0-8418-5889396f6a5f">
Jul 29 14:55:30 user nova-compute[70924]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 29 14:55:30 user nova-compute[70924]:         </nova:port>
Jul 29 14:55:30 user nova-compute[70924]:       </nova:ports>
Jul 29 14:55:30 user nova-compute[70924]:     </nova:instance>
Jul 29 14:55:30 user nova-compute[70924]:   </metadata>
Jul 29 14:55:30 user nova-compute[70924]:   <sysinfo type="smbios">
Jul 29 14:55:30 user nova-compute[70924]:     <system>
Jul 29 14:55:30 user nova-compute[70924]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 14:55:30 user nova-compute[70924]:       <entry name="product">OpenStack Nova</entry>
Jul 29 14:55:30 user nova-compute[70924]:       <entry name="version">0.0.0</entry>
Jul 29 14:55:30 user nova-compute[70924]:       <entry name="serial">710f0d5a-8420-49c4-bf70-27305dd85bd3</entry>
Jul 29 14:55:30 user nova-compute[70924]:       <entry name="uuid">710f0d5a-8420-49c4-bf70-27305dd85bd3</entry>
Jul 29 14:55:30 user nova-compute[70924]:       <entry name="family">Virtual Machine</entry>
Jul 29 14:55:30 user nova-compute[70924]:     </system>
Jul 29 14:55:30 user nova-compute[70924]:   </sysinfo>
Jul 29 14:55:30 user nova-compute[70924]:   <os>
Jul 29 14:55:30 user nova-compute[70924]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 14:55:30 user nova-compute[70924]:     <boot dev="hd"/>
Jul 29 14:55:30 user nova-compute[70924]:     <smbios mode="sysinfo"/>
Jul 29 14:55:30 user nova-compute[70924]:   </os>
Jul 29 14:55:30 user nova-compute[70924]:   <features>
Jul 29 14:55:30 user nova-compute[70924]:     <acpi/>
Jul 29 14:55:30 user nova-compute[70924]:     <apic/>
Jul 29 14:55:30 user nova-compute[70924]:     <vmcoreinfo/>
Jul 29 14:55:30 user nova-compute[70924]:   </features>
Jul 29 14:55:30 user nova-compute[70924]:   <clock offset="utc">
Jul 29 14:55:30 user nova-compute[70924]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 14:55:30 user nova-compute[70924]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 14:55:30 user nova-compute[70924]:     <timer name="hpet" present="no"/>
Jul 29 14:55:30 user nova-compute[70924]:   </clock>
Jul 29 14:55:30 user nova-compute[70924]:   <cpu mode="custom" match="exact">
Jul 29 14:55:30 user nova-compute[70924]:     <model>Nehalem</model>
Jul 29 14:55:30 user nova-compute[70924]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 14:55:30 user nova-compute[70924]:   </cpu>
Jul 29 14:55:30 user nova-compute[70924]:   <devices>
Jul 29 14:55:30 user nova-compute[70924]:     <disk type="file" device="disk">
Jul 29 14:55:30 user nova-compute[70924]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 14:55:30 user nova-compute[70924]:       <source file="/opt/stack/data/nova/instances/710f0d5a-8420-49c4-bf70-27305dd85bd3/disk"/>
Jul 29 14:55:30 user nova-compute[70924]:       <target dev="vda" bus="virtio"/>
Jul 29 14:55:30 user nova-compute[70924]:     </disk>
Jul 29 14:55:30 user nova-compute[70924]:     <disk type="block" device="disk">
Jul 29 14:55:30 user nova-compute[70924]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:55:30 user nova-compute[70924]:       <source dev="/dev/sdc"/>
Jul 29 14:55:30 user nova-compute[70924]:       <target dev="vdb" bus="virtio"/>
Jul 29 14:55:30 user nova-compute[70924]:       <serial>3ac35b93-78b7-4614-a0c6-aa80496897e2</serial>
Jul 29 14:55:30 user nova-compute[70924]:     </disk>
Jul 29 14:55:30 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 14:55:30 user nova-compute[70924]:       <mac address="fa:16:3e:67:60:2e"/>
Jul 29 14:55:30 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:55:30 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 14:55:30 user nova-compute[70924]:       <target dev="tapfa798159-0d"/>
Jul 29 14:55:30 user nova-compute[70924]:     </interface>
Jul 29 14:55:30 user nova-compute[70924]:     <serial type="pty">
Jul 29 14:55:30 user nova-compute[70924]:       <log file="/opt/stack/data/nova/instances/710f0d5a-8420-49c4-bf70-27305dd85bd3/console.log" append="off"/>
Jul 29 14:55:30 user nova-compute[70924]:     </serial>
Jul 29 14:55:30 user nova-compute[70924]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 14:55:30 user nova-compute[70924]:     <video>
Jul 29 14:55:30 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:55:30 user nova-compute[70924]:     </video>
Jul 29 14:55:30 user nova-compute[70924]:     <rng model="virtio">
Jul 29 14:55:30 user nova-compute[70924]:       <backend model="random">/dev/urandom</backend>
Jul 29 14:55:30 user nova-compute[70924]:     </rng>
Jul 29 14:55:30 user nova-compute[70924]:     <controller type="usb" index="0" model="none"/>
Jul 29 14:55:30 user nova-compute[70924]:     <memballoon model="virtio">
Jul 29 14:55:30 user nova-compute[70924]:       <stats period="10"/>
Jul 29 14:55:30 user nova-compute[70924]:     </memballoon>
Jul 29 14:55:30 user nova-compute[70924]:   </devices>
Jul 29 14:55:30 user nova-compute[70924]: </domain>
Jul 29 14:55:30 user nova-compute[70924]:  {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 14:55:30 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710f0d5a-8420-49c4-bf70-27305dd85bd3/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:30 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:30 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7e93e7-a3b1-4a56-af23-108d56e2c5d1]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:55:30 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-647c82e2-0114-4356-94f4-0df3d6cc8c11 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:55:30 user nova-compute[70924]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:55:30 user nova-compute[70924]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb (non-flash)
Jul 29 14:55:30 user nova-compute[70924]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)
Jul 29 14:55:30 user nova-compute[70924]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2 (non-flash)
Jul 29 14:55:30 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:55:30 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-647c82e2-0114-4356-94f4-0df3d6cc8c11 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:55:30 user nova-compute[70924]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:55:30 user nova-compute[70924]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb (non-flash)
Jul 29 14:55:30 user nova-compute[70924]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 (non-flash)
Jul 29 14:55:30 user nova-compute[70924]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2 (non-flash)
Jul 29 14:55:30 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:55:30 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-647c82e2-0114-4356-94f4-0df3d6cc8c11 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feedc3a2dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495'): ({'sdh'}, set())}) {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 14:55:30 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-647c82e2-0114-4356-94f4-0df3d6cc8c11 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Removing single pathed devices sdh {{(pid=70924) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 14:55:30 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:30 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:30 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a12264-3bd0-4135-bba5-855e1826ebae]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:55:30 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:31 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8145a9a-f0a7-46d2-b0db-c10a7d102c8c]: (4, ('ok\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:55:31 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-647c82e2-0114-4356-94f4-0df3d6cc8c11 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Flushing IO for device /dev/sdh {{(pid=70924) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 14:55:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:31 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68bf4da-27fe-4286-aa4c-81098edf6a83]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:55:31 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-647c82e2-0114-4356-94f4-0df3d6cc8c11 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=70924) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 14:55:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710f0d5a-8420-49c4-bf70-27305dd85bd3/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710f0d5a-8420-49c4-bf70-27305dd85bd3/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.046s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:31 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[62386fe3-f79f-4bdf-ab9e-12c933faf446]: (4, ('1', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:55:31 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-647c82e2-0114-4356-94f4-0df3d6cc8c11 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 14:55:31 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-647c82e2-0114-4356-94f4-0df3d6cc8c11 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] SCSI volumes sdh have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 14:55:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-647c82e2-0114-4356-94f4-0df3d6cc8c11 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495')] {{(pid=70924) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 14:55:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.035s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:31 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[157be02a-1411-48ba-baee-96178a191ff3]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:55:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-647c82e2-0114-4356-94f4-0df3d6cc8c11 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:55:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 -p 172.16.0.220:3260 --logout {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710f0d5a-8420-49c4-bf70-27305dd85bd3/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:31 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 14:55:31 user nova-compute[70924]: DEBUG nova.objects.instance [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lazy-loading 'trusted_certs' on Instance uuid 710f0d5a-8420-49c4-bf70-27305dd85bd3 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:55:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:31 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c30baf6-a5ba-4810-b420-1308055f312f]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:55:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-647c82e2-0114-4356-94f4-0df3d6cc8c11 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495, portal: 172.16.0.220,3260]
Jul 29 14:55:31 user nova-compute[70924]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495, portal: 172.16.0.220,3260] successful.
Jul 29 14:55:31 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:55:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 -p 172.16.0.220:3260 --op delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4ae6046779fbcd27dd45012e98584ad882af3a --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:229cbfa1-ea7a-4400-b9c6-9df461306495 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:31 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa69bc1-5b75-4c3f-9755-a4123b2e0be7]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:55:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-647c82e2-0114-4356-94f4-0df3d6cc8c11 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:55:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-647c82e2-0114-4356-94f4-0df3d6cc8c11 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.416s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:55:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-647c82e2-0114-4356-94f4-0df3d6cc8c11 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] <== disconnect_volume: return (1110ms) None {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:55:31 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-647c82e2-0114-4356-94f4-0df3d6cc8c11 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Disconnected iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 14:55:31 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-647c82e2-0114-4356-94f4-0df3d6cc8c11 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Deleting instance files /opt/stack/data/nova/instances/fd91d5fc-857d-4d63-ad83-8028c1d3309f_del
Jul 29 14:55:31 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-647c82e2-0114-4356-94f4-0df3d6cc8c11 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Deletion of /opt/stack/data/nova/instances/fd91d5fc-857d-4d63-ad83-8028c1d3309f_del complete
Jul 29 14:55:31 user nova-compute[70924]: INFO nova.compute.manager [None req-647c82e2-0114-4356-94f4-0df3d6cc8c11 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Took 2.00 seconds to destroy the instance on the hypervisor.
Jul 29 14:55:31 user nova-compute[70924]: DEBUG oslo.service.loopingcall [None req-647c82e2-0114-4356-94f4-0df3d6cc8c11 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70924) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 14:55:31 user nova-compute[70924]: DEBUG nova.compute.manager [-] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Deallocating network for instance {{(pid=70924) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 14:55:31 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] deallocate_for_instance() {{(pid=70924) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 14:55:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5a4ae6046779fbcd27dd45012e98584ad882af3a --force-share --output=json" returned: 0 in 0.142s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:31 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Checking if we can resize image /opt/stack/data/nova/instances/710f0d5a-8420-49c4-bf70-27305dd85bd3/disk. size=1073741824 {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 14:55:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710f0d5a-8420-49c4-bf70-27305dd85bd3/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710f0d5a-8420-49c4-bf70-27305dd85bd3/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:31 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Cannot resize image /opt/stack/data/nova/instances/710f0d5a-8420-49c4-bf70-27305dd85bd3/disk to a smaller size. {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 14:55:31 user nova-compute[70924]: DEBUG nova.objects.instance [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lazy-loading 'migration_context' on Instance uuid 710f0d5a-8420-49c4-bf70-27305dd85bd3 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:55:31 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:53:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-813512746',display_name='tempest-TestMinimumBasicScenario-server-813512746',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-813512746',id=30,image_ref='8f3dcf97-8b65-45cb-b52e-bff81d80db70',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA76T/51PTdIphAR5vmKjW5tUtLn/sQuimAbsDwwFMd+B+5p2qZFOwSM1z2S0WxRqwOdkFbLSkcByFgSatE660bvOjkxrQaY0j/lDrcZkHXhqDCNe3n8ezCtGkqt/N+vPw==',key_name='tempest-TestMinimumBasicScenario-2130533388',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:53:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='a03844d646454b6ea55e1b5625f7909a',ramdisk_id='',reservation_id='r-idexnh0b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8f3dcf97-8b65-45cb-b52e-bff81d80db70',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-944069199',owner_user_name='tempest-TestMinimumBasicScenario-944069199-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:55:28Z,user_data=None,user_id='7aa9677ce659431db31a0e513277d692',uuid=710f0d5a-8420-49c4-bf70-27305dd85bd3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fa798159-0d64-40e0-8418-5889396f6a5f", "address": "fa:16:3e:67:60:2e", "network": {"id": "21a19801-8526-40a2-9bcb-dda6cfb435fe", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-761511746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a03844d646454b6ea55e1b5625f7909a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa798159-0d", "ovs_interfaceid": "fa798159-0d64-40e0-8418-5889396f6a5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 14:55:31 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Converting VIF {"id": "fa798159-0d64-40e0-8418-5889396f6a5f", "address": "fa:16:3e:67:60:2e", "network": {"id": "21a19801-8526-40a2-9bcb-dda6cfb435fe", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-761511746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a03844d646454b6ea55e1b5625f7909a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa798159-0d", "ovs_interfaceid": "fa798159-0d64-40e0-8418-5889396f6a5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:55:31 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:67:60:2e,bridge_name='br-int',has_traffic_filtering=True,id=fa798159-0d64-40e0-8418-5889396f6a5f,network=Network(21a19801-8526-40a2-9bcb-dda6cfb435fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa798159-0d') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:55:31 user nova-compute[70924]: DEBUG os_vif [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:60:2e,bridge_name='br-int',has_traffic_filtering=True,id=fa798159-0d64-40e0-8418-5889396f6a5f,network=Network(21a19801-8526-40a2-9bcb-dda6cfb435fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa798159-0d') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 14:55:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:55:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 14:55:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfa798159-0d, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:55:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfa798159-0d, col_values=(('external_ids', {'iface-id': 'fa798159-0d64-40e0-8418-5889396f6a5f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:60:2e', 'vm-uuid': '710f0d5a-8420-49c4-bf70-27305dd85bd3'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:55:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:55:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:31 user nova-compute[70924]: INFO os_vif [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:60:2e,bridge_name='br-int',has_traffic_filtering=True,id=fa798159-0d64-40e0-8418-5889396f6a5f,network=Network(21a19801-8526-40a2-9bcb-dda6cfb435fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa798159-0d')
Jul 29 14:55:31 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:55:31 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Took 0.50 seconds to deallocate network for instance.
Jul 29 14:55:31 user nova-compute[70924]: DEBUG nova.compute.manager [req-0f058564-7cbd-469e-b38e-e5c26a81522b req-71162594-b756-4254-bd02-a5d471feab9a service nova] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Received event network-vif-deleted-a9e045fe-1480-4254-ad3d-ce7a12c1b293 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:55:31 user nova-compute[70924]: INFO nova.compute.manager [req-0f058564-7cbd-469e-b38e-e5c26a81522b req-71162594-b756-4254-bd02-a5d471feab9a service nova] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Neutron deleted interface a9e045fe-1480-4254-ad3d-ce7a12c1b293; detaching it from the instance and deleting it from the info cache
Jul 29 14:55:31 user nova-compute[70924]: DEBUG nova.network.neutron [req-0f058564-7cbd-469e-b38e-e5c26a81522b req-71162594-b756-4254-bd02-a5d471feab9a service nova] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:55:31 user nova-compute[70924]: DEBUG nova.compute.manager [req-0f058564-7cbd-469e-b38e-e5c26a81522b req-71162594-b756-4254-bd02-a5d471feab9a service nova] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Detach interface failed, port_id=a9e045fe-1480-4254-ad3d-ce7a12c1b293, reason: Instance fd91d5fc-857d-4d63-ad83-8028c1d3309f could not be found. {{(pid=70924) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 29 14:55:32 user nova-compute[70924]: INFO nova.compute.manager [None req-647c82e2-0114-4356-94f4-0df3d6cc8c11 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Took 0.79 seconds to detach 1 volumes for instance.
Jul 29 14:55:32 user nova-compute[70924]: DEBUG nova.compute.manager [None req-647c82e2-0114-4356-94f4-0df3d6cc8c11 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Deleting volume: 229cbfa1-ea7a-4400-b9c6-9df461306495 {{(pid=70924) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Jul 29 14:55:32 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-647c82e2-0114-4356-94f4-0df3d6cc8c11 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:55:32 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-647c82e2-0114-4356-94f4-0df3d6cc8c11 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:55:32 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:32 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:32 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:33 user nova-compute[70924]: DEBUG nova.compute.manager [req-4518aa82-8a64-44ea-a70e-21c9774f35b6 req-7385fa6f-7c07-4d9e-afda-e967d8a566aa service nova] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Received event network-vif-plugged-fa798159-0d64-40e0-8418-5889396f6a5f {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:55:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-4518aa82-8a64-44ea-a70e-21c9774f35b6 req-7385fa6f-7c07-4d9e-afda-e967d8a566aa service nova] Acquiring lock "710f0d5a-8420-49c4-bf70-27305dd85bd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:55:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-4518aa82-8a64-44ea-a70e-21c9774f35b6 req-7385fa6f-7c07-4d9e-afda-e967d8a566aa service nova] Lock "710f0d5a-8420-49c4-bf70-27305dd85bd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:55:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-4518aa82-8a64-44ea-a70e-21c9774f35b6 req-7385fa6f-7c07-4d9e-afda-e967d8a566aa service nova] Lock "710f0d5a-8420-49c4-bf70-27305dd85bd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:55:33 user nova-compute[70924]: DEBUG nova.compute.manager [req-4518aa82-8a64-44ea-a70e-21c9774f35b6 req-7385fa6f-7c07-4d9e-afda-e967d8a566aa service nova] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] No waiting events found dispatching network-vif-plugged-fa798159-0d64-40e0-8418-5889396f6a5f {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:55:33 user nova-compute[70924]: WARNING nova.compute.manager [req-4518aa82-8a64-44ea-a70e-21c9774f35b6 req-7385fa6f-7c07-4d9e-afda-e967d8a566aa service nova] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Received unexpected event network-vif-plugged-fa798159-0d64-40e0-8418-5889396f6a5f for instance with vm_state active and task_state reboot_started_hard.
Jul 29 14:55:33 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-647c82e2-0114-4356-94f4-0df3d6cc8c11 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:55:33 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-647c82e2-0114-4356-94f4-0df3d6cc8c11 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:55:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-647c82e2-0114-4356-94f4-0df3d6cc8c11 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.463s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:55:33 user nova-compute[70924]: INFO nova.scheduler.client.report [None req-647c82e2-0114-4356-94f4-0df3d6cc8c11 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Deleted allocations for instance fd91d5fc-857d-4d63-ad83-8028c1d3309f
Jul 29 14:55:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-647c82e2-0114-4356-94f4-0df3d6cc8c11 tempest-TestShelveInstance-1828854384 tempest-TestShelveInstance-1828854384-project-member] Lock "fd91d5fc-857d-4d63-ad83-8028c1d3309f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.080s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:55:33 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:33 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:33 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:33 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:33 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:34 user nova-compute[70924]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690642519.1245856, bdaf1714-27f9-47ee-808b-206ec78c6067 => Stopped> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:55:34 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] VM Stopped (Lifecycle Event)
Jul 29 14:55:34 user nova-compute[70924]: DEBUG nova.compute.manager [None req-12622848-1f4c-4300-a60e-24a31076787f None None] [instance: bdaf1714-27f9-47ee-808b-206ec78c6067] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:55:35 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Removed pending event for 710f0d5a-8420-49c4-bf70-27305dd85bd3 due to event {{(pid=70924) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 29 14:55:35 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642535.0869846, 710f0d5a-8420-49c4-bf70-27305dd85bd3 => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:55:35 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] VM Resumed (Lifecycle Event)
Jul 29 14:55:35 user nova-compute[70924]: DEBUG nova.compute.manager [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Instance event wait completed in 0 seconds for  {{(pid=70924) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 14:55:35 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Instance rebooted successfully.
Jul 29 14:55:35 user nova-compute[70924]: DEBUG nova.compute.manager [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:55:35 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:55:35 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:55:35 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Jul 29 14:55:35 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642535.0884693, 710f0d5a-8420-49c4-bf70-27305dd85bd3 => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:55:35 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] VM Started (Lifecycle Event)
Jul 29 14:55:35 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:55:35 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:55:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-8dc52666-c8ae-4928-80f4-f57a818bb2c2 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lock "710f0d5a-8420-49c4-bf70-27305dd85bd3" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.955s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:55:35 user nova-compute[70924]: DEBUG nova.compute.manager [req-e7ed7141-a125-4368-ae38-f5f17ea8ee73 req-321d8580-cba9-460e-a842-ee91703c803c service nova] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Received event network-vif-plugged-fa798159-0d64-40e0-8418-5889396f6a5f {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:55:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-e7ed7141-a125-4368-ae38-f5f17ea8ee73 req-321d8580-cba9-460e-a842-ee91703c803c service nova] Acquiring lock "710f0d5a-8420-49c4-bf70-27305dd85bd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:55:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-e7ed7141-a125-4368-ae38-f5f17ea8ee73 req-321d8580-cba9-460e-a842-ee91703c803c service nova] Lock "710f0d5a-8420-49c4-bf70-27305dd85bd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:55:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-e7ed7141-a125-4368-ae38-f5f17ea8ee73 req-321d8580-cba9-460e-a842-ee91703c803c service nova] Lock "710f0d5a-8420-49c4-bf70-27305dd85bd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:55:35 user nova-compute[70924]: DEBUG nova.compute.manager [req-e7ed7141-a125-4368-ae38-f5f17ea8ee73 req-321d8580-cba9-460e-a842-ee91703c803c service nova] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] No waiting events found dispatching network-vif-plugged-fa798159-0d64-40e0-8418-5889396f6a5f {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:55:35 user nova-compute[70924]: WARNING nova.compute.manager [req-e7ed7141-a125-4368-ae38-f5f17ea8ee73 req-321d8580-cba9-460e-a842-ee91703c803c service nova] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Received unexpected event network-vif-plugged-fa798159-0d64-40e0-8418-5889396f6a5f for instance with vm_state active and task_state None.
Jul 29 14:55:36 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:38 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:41 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:45 user nova-compute[70924]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690642530.1235173, fd91d5fc-857d-4d63-ad83-8028c1d3309f => Stopped> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:55:45 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] VM Stopped (Lifecycle Event)
Jul 29 14:55:45 user nova-compute[70924]: DEBUG nova.compute.manager [None req-4ce6de2b-6852-4428-8ce2-5b05e21155a2 None None] [instance: fd91d5fc-857d-4d63-ad83-8028c1d3309f] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:55:46 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:51 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:51 user nova-compute[70924]: DEBUG nova.objects.instance [None req-50b2609a-e71b-4491-9615-11404acc7457 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lazy-loading 'flavor' on Instance uuid 7cb12b3e-de44-4887-ab74-2a68164b5f7d {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:55:51 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-50b2609a-e71b-4491-9615-11404acc7457 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Acquiring lock "refresh_cache-7cb12b3e-de44-4887-ab74-2a68164b5f7d" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:55:51 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-50b2609a-e71b-4491-9615-11404acc7457 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Acquired lock "refresh_cache-7cb12b3e-de44-4887-ab74-2a68164b5f7d" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:55:51 user nova-compute[70924]: DEBUG nova.network.neutron [None req-50b2609a-e71b-4491-9615-11404acc7457 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 14:55:51 user nova-compute[70924]: DEBUG nova.objects.instance [None req-50b2609a-e71b-4491-9615-11404acc7457 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lazy-loading 'info_cache' on Instance uuid 7cb12b3e-de44-4887-ab74-2a68164b5f7d {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:55:52 user nova-compute[70924]: DEBUG nova.network.neutron [None req-50b2609a-e71b-4491-9615-11404acc7457 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Updating instance_info_cache with network_info: [{"id": "e41d642f-f559-4294-b5ff-5ec478fb3438", "address": "fa:16:3e:f7:ee:73", "network": {"id": "46d2cfde-13db-4cf3-af0e-4d6742f37044", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1642265305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0388bcf487e492082e85b183f38765c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape41d642f-f5", "ovs_interfaceid": "e41d642f-f559-4294-b5ff-5ec478fb3438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:55:52 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-50b2609a-e71b-4491-9615-11404acc7457 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Releasing lock "refresh_cache-7cb12b3e-de44-4887-ab74-2a68164b5f7d" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:55:52 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Instance destroyed successfully.
Jul 29 14:55:52 user nova-compute[70924]: DEBUG nova.objects.instance [None req-50b2609a-e71b-4491-9615-11404acc7457 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lazy-loading 'resources' on Instance uuid 7cb12b3e-de44-4887-ab74-2a68164b5f7d {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:55:52 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-50b2609a-e71b-4491-9615-11404acc7457 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:48:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1090583774',display_name='tempest-AttachVolumeTestJSON-server-1090583774',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1090583774',id=20,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxYeAuUdgBDENKjW9KGfUkDITpquweWjsClM8apGgMwschv+svyuQ0OvGCeunIrF1Cf2sPzGMDx0GWfQ+3b5oeX2ZZAH8S+9X0B99z5roSd+MxfrhgBDxbU7z4pZrnyqA==',key_name='tempest-keypair-571943859',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:48:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a0388bcf487e492082e85b183f38765c',ramdisk_id='',reservation_id='r-4dtac58j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-651630277',owner_user_name='tempest-AttachVolumeTestJSON-651630277-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:54:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='761e4287afb94bf4ad93c09a43bada1f',uuid=7cb12b3e-de44-4887-ab74-2a68164b5f7d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e41d642f-f559-4294-b5ff-5ec478fb3438", "address": "fa:16:3e:f7:ee:73", "network": {"id": "46d2cfde-13db-4cf3-af0e-4d6742f37044", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1642265305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0388bcf487e492082e85b183f38765c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape41d642f-f5", "ovs_interfaceid": "e41d642f-f559-4294-b5ff-5ec478fb3438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 14:55:52 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-50b2609a-e71b-4491-9615-11404acc7457 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Converting VIF {"id": "e41d642f-f559-4294-b5ff-5ec478fb3438", "address": "fa:16:3e:f7:ee:73", "network": {"id": "46d2cfde-13db-4cf3-af0e-4d6742f37044", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1642265305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0388bcf487e492082e85b183f38765c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape41d642f-f5", "ovs_interfaceid": "e41d642f-f559-4294-b5ff-5ec478fb3438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:55:52 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-50b2609a-e71b-4491-9615-11404acc7457 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:ee:73,bridge_name='br-int',has_traffic_filtering=True,id=e41d642f-f559-4294-b5ff-5ec478fb3438,network=Network(46d2cfde-13db-4cf3-af0e-4d6742f37044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape41d642f-f5') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:55:52 user nova-compute[70924]: DEBUG os_vif [None req-50b2609a-e71b-4491-9615-11404acc7457 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:ee:73,bridge_name='br-int',has_traffic_filtering=True,id=e41d642f-f559-4294-b5ff-5ec478fb3438,network=Network(46d2cfde-13db-4cf3-af0e-4d6742f37044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape41d642f-f5') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 14:55:52 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:52 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape41d642f-f5, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:55:52 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:52 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:55:52 user nova-compute[70924]: INFO os_vif [None req-50b2609a-e71b-4491-9615-11404acc7457 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:ee:73,bridge_name='br-int',has_traffic_filtering=True,id=e41d642f-f559-4294-b5ff-5ec478fb3438,network=Network(46d2cfde-13db-4cf3-af0e-4d6742f37044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape41d642f-f5')
Jul 29 14:55:52 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-50b2609a-e71b-4491-9615-11404acc7457 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Start _get_guest_xml network_info=[{"id": "e41d642f-f559-4294-b5ff-5ec478fb3438", "address": "fa:16:3e:f7:ee:73", "network": {"id": "46d2cfde-13db-4cf3-af0e-4d6742f37044", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1642265305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0388bcf487e492082e85b183f38765c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape41d642f-f5", "ovs_interfaceid": "e41d642f-f559-4294-b5ff-5ec478fb3438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '3aba2e73-6832-404b-8bd0-d0503ce82b8c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 14:55:52 user nova-compute[70924]: DEBUG nova.objects.instance [None req-50b2609a-e71b-4491-9615-11404acc7457 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lazy-loading 'numa_topology' on Instance uuid 7cb12b3e-de44-4887-ab74-2a68164b5f7d {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:55:52 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-50b2609a-e71b-4491-9615-11404acc7457 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:55:52 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-50b2609a-e71b-4491-9615-11404acc7457 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:55:52 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-50b2609a-e71b-4491-9615-11404acc7457 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 14:55:52 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-50b2609a-e71b-4491-9615-11404acc7457 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] CPU controller missing on host. {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 14:55:52 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-50b2609a-e71b-4491-9615-11404acc7457 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 14:55:52 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-50b2609a-e71b-4491-9615-11404acc7457 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] CPU controller found on host. {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 14:55:52 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-50b2609a-e71b-4491-9615-11404acc7457 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70924) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 14:55:52 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-50b2609a-e71b-4491-9615-11404acc7457 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T14:36:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 14:55:52 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-50b2609a-e71b-4491-9615-11404acc7457 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Flavor limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 14:55:52 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-50b2609a-e71b-4491-9615-11404acc7457 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Image limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 14:55:52 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-50b2609a-e71b-4491-9615-11404acc7457 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Flavor pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 14:55:52 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-50b2609a-e71b-4491-9615-11404acc7457 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Image pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 14:55:52 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-50b2609a-e71b-4491-9615-11404acc7457 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 14:55:52 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-50b2609a-e71b-4491-9615-11404acc7457 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 14:55:52 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-50b2609a-e71b-4491-9615-11404acc7457 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 14:55:52 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-50b2609a-e71b-4491-9615-11404acc7457 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Got 1 possible topologies {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 14:55:52 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-50b2609a-e71b-4491-9615-11404acc7457 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 14:55:52 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-50b2609a-e71b-4491-9615-11404acc7457 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 14:55:52 user nova-compute[70924]: DEBUG nova.objects.instance [None req-50b2609a-e71b-4491-9615-11404acc7457 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7cb12b3e-de44-4887-ab74-2a68164b5f7d {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:55:53 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-50b2609a-e71b-4491-9615-11404acc7457 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:48:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1090583774',display_name='tempest-AttachVolumeTestJSON-server-1090583774',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1090583774',id=20,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxYeAuUdgBDENKjW9KGfUkDITpquweWjsClM8apGgMwschv+svyuQ0OvGCeunIrF1Cf2sPzGMDx0GWfQ+3b5oeX2ZZAH8S+9X0B99z5roSd+MxfrhgBDxbU7z4pZrnyqA==',key_name='tempest-keypair-571943859',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:48:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a0388bcf487e492082e85b183f38765c',ramdisk_id='',reservation_id='r-4dtac58j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-651630277',owner_user_name='tempest-AttachVolumeTestJSON-651630277-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:54:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='761e4287afb94bf4ad93c09a43bada1f',uuid=7cb12b3e-de44-4887-ab74-2a68164b5f7d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e41d642f-f559-4294-b5ff-5ec478fb3438", "address": "fa:16:3e:f7:ee:73", "network": {"id": "46d2cfde-13db-4cf3-af0e-4d6742f37044", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1642265305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0388bcf487e492082e85b183f38765c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape41d642f-f5", "ovs_interfaceid": "e41d642f-f559-4294-b5ff-5ec478fb3438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:55:53 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-50b2609a-e71b-4491-9615-11404acc7457 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Converting VIF {"id": "e41d642f-f559-4294-b5ff-5ec478fb3438", "address": "fa:16:3e:f7:ee:73", "network": {"id": "46d2cfde-13db-4cf3-af0e-4d6742f37044", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1642265305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0388bcf487e492082e85b183f38765c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape41d642f-f5", "ovs_interfaceid": "e41d642f-f559-4294-b5ff-5ec478fb3438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:55:53 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-50b2609a-e71b-4491-9615-11404acc7457 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:ee:73,bridge_name='br-int',has_traffic_filtering=True,id=e41d642f-f559-4294-b5ff-5ec478fb3438,network=Network(46d2cfde-13db-4cf3-af0e-4d6742f37044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape41d642f-f5') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:55:53 user nova-compute[70924]: DEBUG nova.objects.instance [None req-50b2609a-e71b-4491-9615-11404acc7457 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lazy-loading 'pci_devices' on Instance uuid 7cb12b3e-de44-4887-ab74-2a68164b5f7d {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:55:53 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-50b2609a-e71b-4491-9615-11404acc7457 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] End _get_guest_xml xml=<domain type="kvm">
Jul 29 14:55:53 user nova-compute[70924]:   <uuid>7cb12b3e-de44-4887-ab74-2a68164b5f7d</uuid>
Jul 29 14:55:53 user nova-compute[70924]:   <name>instance-00000014</name>
Jul 29 14:55:53 user nova-compute[70924]:   <memory>524288</memory>
Jul 29 14:55:53 user nova-compute[70924]:   <vcpu>1</vcpu>
Jul 29 14:55:53 user nova-compute[70924]:   <metadata>
Jul 29 14:55:53 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 14:55:53 user nova-compute[70924]:       <nova:package version="0.0.0"/>
Jul 29 14:55:53 user nova-compute[70924]:       <nova:name>tempest-AttachVolumeTestJSON-server-1090583774</nova:name>
Jul 29 14:55:53 user nova-compute[70924]:       <nova:creationTime>2023-07-29 14:55:52</nova:creationTime>
Jul 29 14:55:53 user nova-compute[70924]:       <nova:flavor name="m1.tiny">
Jul 29 14:55:53 user nova-compute[70924]:         <nova:memory>512</nova:memory>
Jul 29 14:55:53 user nova-compute[70924]:         <nova:disk>1</nova:disk>
Jul 29 14:55:53 user nova-compute[70924]:         <nova:swap>0</nova:swap>
Jul 29 14:55:53 user nova-compute[70924]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 14:55:53 user nova-compute[70924]:         <nova:vcpus>1</nova:vcpus>
Jul 29 14:55:53 user nova-compute[70924]:       </nova:flavor>
Jul 29 14:55:53 user nova-compute[70924]:       <nova:owner>
Jul 29 14:55:53 user nova-compute[70924]:         <nova:user uuid="761e4287afb94bf4ad93c09a43bada1f">tempest-AttachVolumeTestJSON-651630277-project-member</nova:user>
Jul 29 14:55:53 user nova-compute[70924]:         <nova:project uuid="a0388bcf487e492082e85b183f38765c">tempest-AttachVolumeTestJSON-651630277</nova:project>
Jul 29 14:55:53 user nova-compute[70924]:       </nova:owner>
Jul 29 14:55:53 user nova-compute[70924]:       <nova:root type="image" uuid="3aba2e73-6832-404b-8bd0-d0503ce82b8c"/>
Jul 29 14:55:53 user nova-compute[70924]:       <nova:ports>
Jul 29 14:55:53 user nova-compute[70924]:         <nova:port uuid="e41d642f-f559-4294-b5ff-5ec478fb3438">
Jul 29 14:55:53 user nova-compute[70924]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 29 14:55:53 user nova-compute[70924]:         </nova:port>
Jul 29 14:55:53 user nova-compute[70924]:       </nova:ports>
Jul 29 14:55:53 user nova-compute[70924]:     </nova:instance>
Jul 29 14:55:53 user nova-compute[70924]:   </metadata>
Jul 29 14:55:53 user nova-compute[70924]:   <sysinfo type="smbios">
Jul 29 14:55:53 user nova-compute[70924]:     <system>
Jul 29 14:55:53 user nova-compute[70924]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 14:55:53 user nova-compute[70924]:       <entry name="product">OpenStack Nova</entry>
Jul 29 14:55:53 user nova-compute[70924]:       <entry name="version">0.0.0</entry>
Jul 29 14:55:53 user nova-compute[70924]:       <entry name="serial">7cb12b3e-de44-4887-ab74-2a68164b5f7d</entry>
Jul 29 14:55:53 user nova-compute[70924]:       <entry name="uuid">7cb12b3e-de44-4887-ab74-2a68164b5f7d</entry>
Jul 29 14:55:53 user nova-compute[70924]:       <entry name="family">Virtual Machine</entry>
Jul 29 14:55:53 user nova-compute[70924]:     </system>
Jul 29 14:55:53 user nova-compute[70924]:   </sysinfo>
Jul 29 14:55:53 user nova-compute[70924]:   <os>
Jul 29 14:55:53 user nova-compute[70924]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 14:55:53 user nova-compute[70924]:     <boot dev="hd"/>
Jul 29 14:55:53 user nova-compute[70924]:     <smbios mode="sysinfo"/>
Jul 29 14:55:53 user nova-compute[70924]:   </os>
Jul 29 14:55:53 user nova-compute[70924]:   <features>
Jul 29 14:55:53 user nova-compute[70924]:     <acpi/>
Jul 29 14:55:53 user nova-compute[70924]:     <apic/>
Jul 29 14:55:53 user nova-compute[70924]:     <vmcoreinfo/>
Jul 29 14:55:53 user nova-compute[70924]:   </features>
Jul 29 14:55:53 user nova-compute[70924]:   <clock offset="utc">
Jul 29 14:55:53 user nova-compute[70924]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 14:55:53 user nova-compute[70924]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 14:55:53 user nova-compute[70924]:     <timer name="hpet" present="no"/>
Jul 29 14:55:53 user nova-compute[70924]:   </clock>
Jul 29 14:55:53 user nova-compute[70924]:   <cpu mode="custom" match="exact">
Jul 29 14:55:53 user nova-compute[70924]:     <model>Nehalem</model>
Jul 29 14:55:53 user nova-compute[70924]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 14:55:53 user nova-compute[70924]:   </cpu>
Jul 29 14:55:53 user nova-compute[70924]:   <devices>
Jul 29 14:55:53 user nova-compute[70924]:     <disk type="file" device="disk">
Jul 29 14:55:53 user nova-compute[70924]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 14:55:53 user nova-compute[70924]:       <source file="/opt/stack/data/nova/instances/7cb12b3e-de44-4887-ab74-2a68164b5f7d/disk"/>
Jul 29 14:55:53 user nova-compute[70924]:       <target dev="vda" bus="virtio"/>
Jul 29 14:55:53 user nova-compute[70924]:     </disk>
Jul 29 14:55:53 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 14:55:53 user nova-compute[70924]:       <mac address="fa:16:3e:f7:ee:73"/>
Jul 29 14:55:53 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:55:53 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 14:55:53 user nova-compute[70924]:       <target dev="tape41d642f-f5"/>
Jul 29 14:55:53 user nova-compute[70924]:     </interface>
Jul 29 14:55:53 user nova-compute[70924]:     <serial type="pty">
Jul 29 14:55:53 user nova-compute[70924]:       <log file="/opt/stack/data/nova/instances/7cb12b3e-de44-4887-ab74-2a68164b5f7d/console.log" append="off"/>
Jul 29 14:55:53 user nova-compute[70924]:     </serial>
Jul 29 14:55:53 user nova-compute[70924]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 14:55:53 user nova-compute[70924]:     <video>
Jul 29 14:55:53 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:55:53 user nova-compute[70924]:     </video>
Jul 29 14:55:53 user nova-compute[70924]:     <rng model="virtio">
Jul 29 14:55:53 user nova-compute[70924]:       <backend model="random">/dev/urandom</backend>
Jul 29 14:55:53 user nova-compute[70924]:     </rng>
Jul 29 14:55:53 user nova-compute[70924]:     <controller type="usb" index="0" model="none"/>
Jul 29 14:55:53 user nova-compute[70924]:     <memballoon model="virtio">
Jul 29 14:55:53 user nova-compute[70924]:       <stats period="10"/>
Jul 29 14:55:53 user nova-compute[70924]:     </memballoon>
Jul 29 14:55:53 user nova-compute[70924]:   </devices>
Jul 29 14:55:53 user nova-compute[70924]: </domain>
Jul 29 14:55:53 user nova-compute[70924]:  {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 14:55:53 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-50b2609a-e71b-4491-9615-11404acc7457 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cb12b3e-de44-4887-ab74-2a68164b5f7d/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:53 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-50b2609a-e71b-4491-9615-11404acc7457 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cb12b3e-de44-4887-ab74-2a68164b5f7d/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:53 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-50b2609a-e71b-4491-9615-11404acc7457 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cb12b3e-de44-4887-ab74-2a68164b5f7d/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:53 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-50b2609a-e71b-4491-9615-11404acc7457 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cb12b3e-de44-4887-ab74-2a68164b5f7d/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:53 user nova-compute[70924]: DEBUG nova.objects.instance [None req-50b2609a-e71b-4491-9615-11404acc7457 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7cb12b3e-de44-4887-ab74-2a68164b5f7d {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:55:53 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-50b2609a-e71b-4491-9615-11404acc7457 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:53 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-50b2609a-e71b-4491-9615-11404acc7457 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.136s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:53 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-50b2609a-e71b-4491-9615-11404acc7457 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7cb12b3e-de44-4887-ab74-2a68164b5f7d/disk. size=1073741824 {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 14:55:53 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-50b2609a-e71b-4491-9615-11404acc7457 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cb12b3e-de44-4887-ab74-2a68164b5f7d/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:53 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-50b2609a-e71b-4491-9615-11404acc7457 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cb12b3e-de44-4887-ab74-2a68164b5f7d/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:53 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-50b2609a-e71b-4491-9615-11404acc7457 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Cannot resize image /opt/stack/data/nova/instances/7cb12b3e-de44-4887-ab74-2a68164b5f7d/disk to a smaller size. {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 14:55:53 user nova-compute[70924]: DEBUG nova.objects.instance [None req-50b2609a-e71b-4491-9615-11404acc7457 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lazy-loading 'migration_context' on Instance uuid 7cb12b3e-de44-4887-ab74-2a68164b5f7d {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:55:53 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-50b2609a-e71b-4491-9615-11404acc7457 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:48:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1090583774',display_name='tempest-AttachVolumeTestJSON-server-1090583774',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1090583774',id=20,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxYeAuUdgBDENKjW9KGfUkDITpquweWjsClM8apGgMwschv+svyuQ0OvGCeunIrF1Cf2sPzGMDx0GWfQ+3b5oeX2ZZAH8S+9X0B99z5roSd+MxfrhgBDxbU7z4pZrnyqA==',key_name='tempest-keypair-571943859',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:48:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='a0388bcf487e492082e85b183f38765c',ramdisk_id='',reservation_id='r-4dtac58j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-651630277',owner_user_name='tempest-AttachVolumeTestJSON-651630277-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:54:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='761e4287afb94bf4ad93c09a43bada1f',uuid=7cb12b3e-de44-4887-ab74-2a68164b5f7d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e41d642f-f559-4294-b5ff-5ec478fb3438", "address": "fa:16:3e:f7:ee:73", "network": {"id": "46d2cfde-13db-4cf3-af0e-4d6742f37044", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1642265305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0388bcf487e492082e85b183f38765c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape41d642f-f5", "ovs_interfaceid": "e41d642f-f559-4294-b5ff-5ec478fb3438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 14:55:53 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-50b2609a-e71b-4491-9615-11404acc7457 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Converting VIF {"id": "e41d642f-f559-4294-b5ff-5ec478fb3438", "address": "fa:16:3e:f7:ee:73", "network": {"id": "46d2cfde-13db-4cf3-af0e-4d6742f37044", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1642265305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0388bcf487e492082e85b183f38765c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape41d642f-f5", "ovs_interfaceid": "e41d642f-f559-4294-b5ff-5ec478fb3438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:55:53 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-50b2609a-e71b-4491-9615-11404acc7457 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:ee:73,bridge_name='br-int',has_traffic_filtering=True,id=e41d642f-f559-4294-b5ff-5ec478fb3438,network=Network(46d2cfde-13db-4cf3-af0e-4d6742f37044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape41d642f-f5') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:55:53 user nova-compute[70924]: DEBUG os_vif [None req-50b2609a-e71b-4491-9615-11404acc7457 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:ee:73,bridge_name='br-int',has_traffic_filtering=True,id=e41d642f-f559-4294-b5ff-5ec478fb3438,network=Network(46d2cfde-13db-4cf3-af0e-4d6742f37044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape41d642f-f5') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 14:55:53 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:53 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:55:53 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 14:55:53 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:53 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape41d642f-f5, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:55:53 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape41d642f-f5, col_values=(('external_ids', {'iface-id': 'e41d642f-f559-4294-b5ff-5ec478fb3438', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:ee:73', 'vm-uuid': '7cb12b3e-de44-4887-ab74-2a68164b5f7d'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:55:53 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:53 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:55:53 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:53 user nova-compute[70924]: INFO os_vif [None req-50b2609a-e71b-4491-9615-11404acc7457 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:ee:73,bridge_name='br-int',has_traffic_filtering=True,id=e41d642f-f559-4294-b5ff-5ec478fb3438,network=Network(46d2cfde-13db-4cf3-af0e-4d6742f37044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape41d642f-f5')
Jul 29 14:55:53 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:54 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:55:54 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:55:54 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:55:54 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:55:54 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:55:54 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:55:54 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Auditing locally available compute resources for user (node: user) {{(pid=70924) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 14:55:54 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:55 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:55 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:55 user nova-compute[70924]: DEBUG nova.compute.manager [req-ff5a77bd-a1d3-42aa-b7fc-da6a77869f62 req-a21e9ab6-4c4b-4eb2-b8da-2eeea6f8f13b service nova] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Received event network-vif-plugged-e41d642f-f559-4294-b5ff-5ec478fb3438 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:55:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-ff5a77bd-a1d3-42aa-b7fc-da6a77869f62 req-a21e9ab6-4c4b-4eb2-b8da-2eeea6f8f13b service nova] Acquiring lock "7cb12b3e-de44-4887-ab74-2a68164b5f7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:55:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-ff5a77bd-a1d3-42aa-b7fc-da6a77869f62 req-a21e9ab6-4c4b-4eb2-b8da-2eeea6f8f13b service nova] Lock "7cb12b3e-de44-4887-ab74-2a68164b5f7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:55:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-ff5a77bd-a1d3-42aa-b7fc-da6a77869f62 req-a21e9ab6-4c4b-4eb2-b8da-2eeea6f8f13b service nova] Lock "7cb12b3e-de44-4887-ab74-2a68164b5f7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:55:55 user nova-compute[70924]: DEBUG nova.compute.manager [req-ff5a77bd-a1d3-42aa-b7fc-da6a77869f62 req-a21e9ab6-4c4b-4eb2-b8da-2eeea6f8f13b service nova] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] No waiting events found dispatching network-vif-plugged-e41d642f-f559-4294-b5ff-5ec478fb3438 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:55:55 user nova-compute[70924]: WARNING nova.compute.manager [req-ff5a77bd-a1d3-42aa-b7fc-da6a77869f62 req-a21e9ab6-4c4b-4eb2-b8da-2eeea6f8f13b service nova] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Received unexpected event network-vif-plugged-e41d642f-f559-4294-b5ff-5ec478fb3438 for instance with vm_state stopped and task_state powering-on.
Jul 29 14:55:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk.rescue --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:55 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:55 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:55 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk.rescue --force-share --output=json" returned: 0 in 0.162s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk.rescue --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c31a724f-3006-4e5d-a9b5-847fd6cd170a/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c31a724f-3006-4e5d-a9b5-847fd6cd170a/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c31a724f-3006-4e5d-a9b5-847fd6cd170a/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c31a724f-3006-4e5d-a9b5-847fd6cd170a/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:56 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 14:55:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cb12b3e-de44-4887-ab74-2a68164b5f7d/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cb12b3e-de44-4887-ab74-2a68164b5f7d/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cb12b3e-de44-4887-ab74-2a68164b5f7d/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cb12b3e-de44-4887-ab74-2a68164b5f7d/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:57 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642557.0636098, 7cb12b3e-de44-4887-ab74-2a68164b5f7d => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:55:57 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] VM Resumed (Lifecycle Event)
Jul 29 14:55:57 user nova-compute[70924]: DEBUG nova.compute.manager [None req-50b2609a-e71b-4491-9615-11404acc7457 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Instance event wait completed in 0 seconds for  {{(pid=70924) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 14:55:57 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Instance rebooted successfully.
Jul 29 14:55:57 user nova-compute[70924]: DEBUG nova.compute.manager [None req-50b2609a-e71b-4491-9615-11404acc7457 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:55:57 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:55:57 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:55:57 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] During sync_power_state the instance has a pending task (powering-on). Skip.
Jul 29 14:55:57 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642557.0753021, 7cb12b3e-de44-4887-ab74-2a68164b5f7d => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:55:57 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] VM Started (Lifecycle Event)
Jul 29 14:55:57 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:55:57 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:55:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7171083a-00aa-4faf-9732-88cab8a0d83d/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:57 user nova-compute[70924]: DEBUG nova.compute.manager [req-a48e361f-1692-4e48-bcd4-4320901bfdb5 req-a7416083-43d9-48c3-ac7a-a4bf2f281bb5 service nova] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Received event network-vif-plugged-e41d642f-f559-4294-b5ff-5ec478fb3438 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:55:57 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a48e361f-1692-4e48-bcd4-4320901bfdb5 req-a7416083-43d9-48c3-ac7a-a4bf2f281bb5 service nova] Acquiring lock "7cb12b3e-de44-4887-ab74-2a68164b5f7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:55:57 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a48e361f-1692-4e48-bcd4-4320901bfdb5 req-a7416083-43d9-48c3-ac7a-a4bf2f281bb5 service nova] Lock "7cb12b3e-de44-4887-ab74-2a68164b5f7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:55:57 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a48e361f-1692-4e48-bcd4-4320901bfdb5 req-a7416083-43d9-48c3-ac7a-a4bf2f281bb5 service nova] Lock "7cb12b3e-de44-4887-ab74-2a68164b5f7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:55:57 user nova-compute[70924]: DEBUG nova.compute.manager [req-a48e361f-1692-4e48-bcd4-4320901bfdb5 req-a7416083-43d9-48c3-ac7a-a4bf2f281bb5 service nova] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] No waiting events found dispatching network-vif-plugged-e41d642f-f559-4294-b5ff-5ec478fb3438 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:55:57 user nova-compute[70924]: WARNING nova.compute.manager [req-a48e361f-1692-4e48-bcd4-4320901bfdb5 req-a7416083-43d9-48c3-ac7a-a4bf2f281bb5 service nova] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Received unexpected event network-vif-plugged-e41d642f-f559-4294-b5ff-5ec478fb3438 for instance with vm_state active and task_state None.
Jul 29 14:55:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7171083a-00aa-4faf-9732-88cab8a0d83d/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7171083a-00aa-4faf-9732-88cab8a0d83d/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7171083a-00aa-4faf-9732-88cab8a0d83d/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:57 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 14:55:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710f0d5a-8420-49c4-bf70-27305dd85bd3/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710f0d5a-8420-49c4-bf70-27305dd85bd3/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710f0d5a-8420-49c4-bf70-27305dd85bd3/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710f0d5a-8420-49c4-bf70-27305dd85bd3/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:57 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 14:55:57 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 14:55:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b001d812-892a-4756-9f37-fc0c5ef5f0a7/disk.rescue --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b001d812-892a-4756-9f37-fc0c5ef5f0a7/disk.rescue --force-share --output=json" returned: 0 in 0.146s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b001d812-892a-4756-9f37-fc0c5ef5f0a7/disk.rescue --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b001d812-892a-4756-9f37-fc0c5ef5f0a7/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk.rescue --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk.rescue --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:55:58 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:58 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:55:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:55:59 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:55:59 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:55:59 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Hypervisor/Node resource view: name=user free_ram=7446MB free_disk=25.142925262451172GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70924) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 14:55:59 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:55:59 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:55:59 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance db656346-c4af-43da-9600-fd39f1b9e4dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:55:59 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 86ecc6cb-88a8-4572-8e41-d4c5859036a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:55:59 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 02c75b00-a1b4-4ef9-ae96-bc67d8038589 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:55:59 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 7cb12b3e-de44-4887-ab74-2a68164b5f7d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:55:59 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 7171083a-00aa-4faf-9732-88cab8a0d83d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:55:59 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 9ec07c62-951b-4e3a-bffa-e01dfb4665ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:55:59 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 091e384f-7851-4ac9-b566-990df0497fc5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:55:59 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance c31a724f-3006-4e5d-a9b5-847fd6cd170a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:55:59 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance fd57baf8-6306-4553-a058-e915fb543405 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:55:59 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 710f0d5a-8420-49c4-bf70-27305dd85bd3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:55:59 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance b001d812-892a-4756-9f37-fc0c5ef5f0a7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:55:59 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 14:55:59 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 14:55:59 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:55:59 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:55:59 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Compute_service record updated for user:user {{(pid=70924) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 14:55:59 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.477s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:56:00 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:56:00 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Starting heal instance info cache {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 14:56:00 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Rebuilding the list of instances to heal {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 29 14:56:00 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "refresh_cache-db656346-c4af-43da-9600-fd39f1b9e4dc" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:56:00 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquired lock "refresh_cache-db656346-c4af-43da-9600-fd39f1b9e4dc" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:56:00 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Forcefully refreshing network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 29 14:56:00 user nova-compute[70924]: DEBUG nova.objects.instance [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lazy-loading 'info_cache' on Instance uuid db656346-c4af-43da-9600-fd39f1b9e4dc {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:56:01 user nova-compute[70924]: INFO nova.compute.manager [None req-a50b4475-6aef-4fc8-9931-0cb59b647dea tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Unrescuing
Jul 29 14:56:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a50b4475-6aef-4fc8-9931-0cb59b647dea tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Acquiring lock "refresh_cache-9ec07c62-951b-4e3a-bffa-e01dfb4665ec" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:56:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a50b4475-6aef-4fc8-9931-0cb59b647dea tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Acquired lock "refresh_cache-9ec07c62-951b-4e3a-bffa-e01dfb4665ec" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:56:01 user nova-compute[70924]: DEBUG nova.network.neutron [None req-a50b4475-6aef-4fc8-9931-0cb59b647dea tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 14:56:01 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Updating instance_info_cache with network_info: [{"id": "bd091ea0-8c42-4140-aad1-617f27d2a469", "address": "fa:16:3e:53:1d:70", "network": {"id": "d5876e18-e2af-45c2-aab5-2d0d552ebfe4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2035085552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9e5c78c1684c359cfab4e32b9c213f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd091ea0-8c", "ovs_interfaceid": "bd091ea0-8c42-4140-aad1-617f27d2a469", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:56:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Releasing lock "refresh_cache-db656346-c4af-43da-9600-fd39f1b9e4dc" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:56:01 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Updated the network info_cache for instance {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 29 14:56:01 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:56:01 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:56:01 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:56:01 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:56:01 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:56:01 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70924) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 14:56:01 user nova-compute[70924]: DEBUG nova.network.neutron [None req-a50b4475-6aef-4fc8-9931-0cb59b647dea tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Updating instance_info_cache with network_info: [{"id": "cb01658e-4dd9-426e-9b45-340ea19db056", "address": "fa:16:3e:75:a4:24", "network": {"id": "b2aee530-d195-47bb-b39d-c8bd15b81a08", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-421022738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcf4644e7a24bf68b407be2e3d9732c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb01658e-4d", "ovs_interfaceid": "cb01658e-4dd9-426e-9b45-340ea19db056", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:56:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a50b4475-6aef-4fc8-9931-0cb59b647dea tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Releasing lock "refresh_cache-9ec07c62-951b-4e3a-bffa-e01dfb4665ec" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:56:01 user nova-compute[70924]: DEBUG nova.objects.instance [None req-a50b4475-6aef-4fc8-9931-0cb59b647dea tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lazy-loading 'flavor' on Instance uuid 9ec07c62-951b-4e3a-bffa-e01dfb4665ec {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:56:02 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:56:02 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:56:02 user nova-compute[70924]: DEBUG nova.compute.manager [req-45a76d26-7220-48f6-b808-c362a503b2b6 req-d41f5768-8615-4766-bedb-32b7e1306de4 service nova] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Received event network-vif-unplugged-cb01658e-4dd9-426e-9b45-340ea19db056 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:56:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-45a76d26-7220-48f6-b808-c362a503b2b6 req-d41f5768-8615-4766-bedb-32b7e1306de4 service nova] Acquiring lock "9ec07c62-951b-4e3a-bffa-e01dfb4665ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:56:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-45a76d26-7220-48f6-b808-c362a503b2b6 req-d41f5768-8615-4766-bedb-32b7e1306de4 service nova] Lock "9ec07c62-951b-4e3a-bffa-e01dfb4665ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:56:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-45a76d26-7220-48f6-b808-c362a503b2b6 req-d41f5768-8615-4766-bedb-32b7e1306de4 service nova] Lock "9ec07c62-951b-4e3a-bffa-e01dfb4665ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:56:02 user nova-compute[70924]: DEBUG nova.compute.manager [req-45a76d26-7220-48f6-b808-c362a503b2b6 req-d41f5768-8615-4766-bedb-32b7e1306de4 service nova] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] No waiting events found dispatching network-vif-unplugged-cb01658e-4dd9-426e-9b45-340ea19db056 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:56:02 user nova-compute[70924]: WARNING nova.compute.manager [req-45a76d26-7220-48f6-b808-c362a503b2b6 req-d41f5768-8615-4766-bedb-32b7e1306de4 service nova] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Received unexpected event network-vif-unplugged-cb01658e-4dd9-426e-9b45-340ea19db056 for instance with vm_state rescued and task_state unrescuing.
Jul 29 14:56:02 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:56:02 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:56:02 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Instance destroyed successfully.
Jul 29 14:56:03 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:56:03 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:56:04 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:56:04 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:56:04 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:56:04 user nova-compute[70924]: DEBUG nova.compute.manager [req-ab9799ba-b632-434c-9aca-937643f934b0 req-49f24a6f-3e5e-4c22-877f-424999ac7f1b service nova] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Received event network-vif-plugged-cb01658e-4dd9-426e-9b45-340ea19db056 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:56:04 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-ab9799ba-b632-434c-9aca-937643f934b0 req-49f24a6f-3e5e-4c22-877f-424999ac7f1b service nova] Acquiring lock "9ec07c62-951b-4e3a-bffa-e01dfb4665ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:56:04 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-ab9799ba-b632-434c-9aca-937643f934b0 req-49f24a6f-3e5e-4c22-877f-424999ac7f1b service nova] Lock "9ec07c62-951b-4e3a-bffa-e01dfb4665ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:56:04 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-ab9799ba-b632-434c-9aca-937643f934b0 req-49f24a6f-3e5e-4c22-877f-424999ac7f1b service nova] Lock "9ec07c62-951b-4e3a-bffa-e01dfb4665ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:56:04 user nova-compute[70924]: DEBUG nova.compute.manager [req-ab9799ba-b632-434c-9aca-937643f934b0 req-49f24a6f-3e5e-4c22-877f-424999ac7f1b service nova] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] No waiting events found dispatching network-vif-plugged-cb01658e-4dd9-426e-9b45-340ea19db056 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:56:04 user nova-compute[70924]: WARNING nova.compute.manager [req-ab9799ba-b632-434c-9aca-937643f934b0 req-49f24a6f-3e5e-4c22-877f-424999ac7f1b service nova] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Received unexpected event network-vif-plugged-cb01658e-4dd9-426e-9b45-340ea19db056 for instance with vm_state rescued and task_state unrescuing.
Jul 29 14:56:04 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:56:04 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:56:06 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Removed pending event for 9ec07c62-951b-4e3a-bffa-e01dfb4665ec due to event {{(pid=70924) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 29 14:56:06 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642566.2413502, 9ec07c62-951b-4e3a-bffa-e01dfb4665ec => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:56:06 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] VM Resumed (Lifecycle Event)
Jul 29 14:56:06 user nova-compute[70924]: DEBUG nova.compute.manager [None req-a50b4475-6aef-4fc8-9931-0cb59b647dea tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:56:06 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:56:06 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:56:06 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 29 14:56:06 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642566.2428534, 9ec07c62-951b-4e3a-bffa-e01dfb4665ec => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:56:06 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] VM Started (Lifecycle Event)
Jul 29 14:56:06 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:56:06 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:56:06 user nova-compute[70924]: DEBUG nova.compute.manager [req-b05a8248-4dec-434a-b081-554e0f69485f req-6c4b4d02-980f-4637-95cf-5810c54a63b6 service nova] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Received event network-vif-plugged-cb01658e-4dd9-426e-9b45-340ea19db056 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:56:06 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b05a8248-4dec-434a-b081-554e0f69485f req-6c4b4d02-980f-4637-95cf-5810c54a63b6 service nova] Acquiring lock "9ec07c62-951b-4e3a-bffa-e01dfb4665ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:56:06 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b05a8248-4dec-434a-b081-554e0f69485f req-6c4b4d02-980f-4637-95cf-5810c54a63b6 service nova] Lock "9ec07c62-951b-4e3a-bffa-e01dfb4665ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:56:06 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b05a8248-4dec-434a-b081-554e0f69485f req-6c4b4d02-980f-4637-95cf-5810c54a63b6 service nova] Lock "9ec07c62-951b-4e3a-bffa-e01dfb4665ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:56:06 user nova-compute[70924]: DEBUG nova.compute.manager [req-b05a8248-4dec-434a-b081-554e0f69485f req-6c4b4d02-980f-4637-95cf-5810c54a63b6 service nova] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] No waiting events found dispatching network-vif-plugged-cb01658e-4dd9-426e-9b45-340ea19db056 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:56:06 user nova-compute[70924]: WARNING nova.compute.manager [req-b05a8248-4dec-434a-b081-554e0f69485f req-6c4b4d02-980f-4637-95cf-5810c54a63b6 service nova] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Received unexpected event network-vif-plugged-cb01658e-4dd9-426e-9b45-340ea19db056 for instance with vm_state active and task_state None.
Jul 29 14:56:06 user nova-compute[70924]: DEBUG nova.compute.manager [req-b05a8248-4dec-434a-b081-554e0f69485f req-6c4b4d02-980f-4637-95cf-5810c54a63b6 service nova] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Received event network-vif-plugged-cb01658e-4dd9-426e-9b45-340ea19db056 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:56:06 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b05a8248-4dec-434a-b081-554e0f69485f req-6c4b4d02-980f-4637-95cf-5810c54a63b6 service nova] Acquiring lock "9ec07c62-951b-4e3a-bffa-e01dfb4665ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:56:06 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b05a8248-4dec-434a-b081-554e0f69485f req-6c4b4d02-980f-4637-95cf-5810c54a63b6 service nova] Lock "9ec07c62-951b-4e3a-bffa-e01dfb4665ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:56:06 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b05a8248-4dec-434a-b081-554e0f69485f req-6c4b4d02-980f-4637-95cf-5810c54a63b6 service nova] Lock "9ec07c62-951b-4e3a-bffa-e01dfb4665ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:56:06 user nova-compute[70924]: DEBUG nova.compute.manager [req-b05a8248-4dec-434a-b081-554e0f69485f req-6c4b4d02-980f-4637-95cf-5810c54a63b6 service nova] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] No waiting events found dispatching network-vif-plugged-cb01658e-4dd9-426e-9b45-340ea19db056 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:56:06 user nova-compute[70924]: WARNING nova.compute.manager [req-b05a8248-4dec-434a-b081-554e0f69485f req-6c4b4d02-980f-4637-95cf-5810c54a63b6 service nova] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Received unexpected event network-vif-plugged-cb01658e-4dd9-426e-9b45-340ea19db056 for instance with vm_state active and task_state None.
Jul 29 14:56:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:56:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:56:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:56:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Acquiring lock "1555ef29-8abe-43ca-ad2b-ac2f86180202" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:56:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "1555ef29-8abe-43ca-ad2b-ac2f86180202" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:56:12 user nova-compute[70924]: DEBUG nova.compute.manager [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Starting instance... {{(pid=70924) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 14:56:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:56:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:56:12 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70924) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 14:56:12 user nova-compute[70924]: INFO nova.compute.claims [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Claim successful on node user
Jul 29 14:56:13 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:56:13 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:56:13 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.465s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:56:13 user nova-compute[70924]: DEBUG nova.compute.manager [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Start building networks asynchronously for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 14:56:13 user nova-compute[70924]: DEBUG nova.compute.manager [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Allocating IP information in the background. {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 14:56:13 user nova-compute[70924]: DEBUG nova.network.neutron [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] allocate_for_instance() {{(pid=70924) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 14:56:13 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 14:56:13 user nova-compute[70924]: DEBUG nova.compute.manager [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Start building block device mappings for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 14:56:13 user nova-compute[70924]: DEBUG nova.compute.manager [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Start spawning the instance on the hypervisor. {{(pid=70924) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 14:56:13 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Creating instance directory {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 14:56:13 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Creating image(s)
Jul 29 14:56:13 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Acquiring lock "/opt/stack/data/nova/instances/1555ef29-8abe-43ca-ad2b-ac2f86180202/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:56:13 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "/opt/stack/data/nova/instances/1555ef29-8abe-43ca-ad2b-ac2f86180202/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:56:13 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "/opt/stack/data/nova/instances/1555ef29-8abe-43ca-ad2b-ac2f86180202/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:56:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:56:13 user nova-compute[70924]: DEBUG nova.policy [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7c9562451ffa45b2aad975335d83fa8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5f9f30926f47afad3cb4c9e89d55c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70924) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 14:56:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.147s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:56:13 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Acquiring lock "bd72453517468710f1de26b27fb0ea28688e9009" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:56:13 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:56:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:56:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.137s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:56:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/1555ef29-8abe-43ca-ad2b-ac2f86180202/disk 1073741824 {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:56:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/1555ef29-8abe-43ca-ad2b-ac2f86180202/disk 1073741824" returned: 0 in 0.059s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:56:13 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:56:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:56:13 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:56:13 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:56:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.182s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:56:13 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1555ef29-8abe-43ca-ad2b-ac2f86180202/disk. size=1073741824 {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 14:56:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1555ef29-8abe-43ca-ad2b-ac2f86180202/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:56:14 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1555ef29-8abe-43ca-ad2b-ac2f86180202/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:56:14 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Cannot resize image /opt/stack/data/nova/instances/1555ef29-8abe-43ca-ad2b-ac2f86180202/disk to a smaller size. {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 14:56:14 user nova-compute[70924]: DEBUG nova.objects.instance [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lazy-loading 'migration_context' on Instance uuid 1555ef29-8abe-43ca-ad2b-ac2f86180202 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:56:14 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Created local disks {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 14:56:14 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Ensure instance console log exists: /opt/stack/data/nova/instances/1555ef29-8abe-43ca-ad2b-ac2f86180202/console.log {{(pid=70924) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 14:56:14 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:56:14 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:56:14 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:56:14 user nova-compute[70924]: DEBUG nova.network.neutron [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Successfully created port: f34f8730-445d-4711-8db4-3c6455cbd24e {{(pid=70924) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 14:56:15 user nova-compute[70924]: DEBUG nova.network.neutron [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Successfully updated port: f34f8730-445d-4711-8db4-3c6455cbd24e {{(pid=70924) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 14:56:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Acquiring lock "refresh_cache-1555ef29-8abe-43ca-ad2b-ac2f86180202" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:56:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Acquired lock "refresh_cache-1555ef29-8abe-43ca-ad2b-ac2f86180202" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:56:15 user nova-compute[70924]: DEBUG nova.network.neutron [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 14:56:15 user nova-compute[70924]: DEBUG nova.compute.manager [req-b100daad-091d-4704-aed3-940865ba4a86 req-35625285-c590-433b-a1fc-b84192ae26e3 service nova] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Received event network-changed-f34f8730-445d-4711-8db4-3c6455cbd24e {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:56:15 user nova-compute[70924]: DEBUG nova.compute.manager [req-b100daad-091d-4704-aed3-940865ba4a86 req-35625285-c590-433b-a1fc-b84192ae26e3 service nova] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Refreshing instance network info cache due to event network-changed-f34f8730-445d-4711-8db4-3c6455cbd24e. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:56:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b100daad-091d-4704-aed3-940865ba4a86 req-35625285-c590-433b-a1fc-b84192ae26e3 service nova] Acquiring lock "refresh_cache-1555ef29-8abe-43ca-ad2b-ac2f86180202" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:56:15 user nova-compute[70924]: DEBUG nova.network.neutron [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Instance cache missing network info. {{(pid=70924) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 14:56:15 user nova-compute[70924]: DEBUG nova.network.neutron [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Updating instance_info_cache with network_info: [{"id": "f34f8730-445d-4711-8db4-3c6455cbd24e", "address": "fa:16:3e:c0:c2:af", "network": {"id": "ff833b6e-b3ce-44ac-88ec-775f193cdfe4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-546934977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f5f9f30926f47afad3cb4c9e89d55c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34f8730-44", "ovs_interfaceid": "f34f8730-445d-4711-8db4-3c6455cbd24e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:56:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Releasing lock "refresh_cache-1555ef29-8abe-43ca-ad2b-ac2f86180202" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:56:15 user nova-compute[70924]: DEBUG nova.compute.manager [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Instance network_info: |[{"id": "f34f8730-445d-4711-8db4-3c6455cbd24e", "address": "fa:16:3e:c0:c2:af", "network": {"id": "ff833b6e-b3ce-44ac-88ec-775f193cdfe4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-546934977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f5f9f30926f47afad3cb4c9e89d55c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34f8730-44", "ovs_interfaceid": "f34f8730-445d-4711-8db4-3c6455cbd24e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 14:56:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b100daad-091d-4704-aed3-940865ba4a86 req-35625285-c590-433b-a1fc-b84192ae26e3 service nova] Acquired lock "refresh_cache-1555ef29-8abe-43ca-ad2b-ac2f86180202" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:56:15 user nova-compute[70924]: DEBUG nova.network.neutron [req-b100daad-091d-4704-aed3-940865ba4a86 req-35625285-c590-433b-a1fc-b84192ae26e3 service nova] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Refreshing network info cache for port f34f8730-445d-4711-8db4-3c6455cbd24e {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:56:15 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Start _get_guest_xml network_info=[{"id": "f34f8730-445d-4711-8db4-3c6455cbd24e", "address": "fa:16:3e:c0:c2:af", "network": {"id": "ff833b6e-b3ce-44ac-88ec-775f193cdfe4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-546934977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f5f9f30926f47afad3cb4c9e89d55c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34f8730-44", "ovs_interfaceid": "f34f8730-445d-4711-8db4-3c6455cbd24e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '3aba2e73-6832-404b-8bd0-d0503ce82b8c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 14:56:15 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:56:15 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:56:15 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 14:56:15 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] CPU controller missing on host. {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 14:56:15 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 14:56:15 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] CPU controller found on host. {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 14:56:15 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70924) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 14:56:15 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T14:36:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 14:56:15 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Flavor limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 14:56:15 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Image limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 14:56:15 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Flavor pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 14:56:15 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Image pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 14:56:15 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 14:56:15 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 14:56:15 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 14:56:15 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Got 1 possible topologies {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 14:56:15 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 14:56:15 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 14:56:15 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:56:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-294782032',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-294782032',id=32,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7k8yfFGWAhiv9WTAEC+6fczleFZHosFBEhgzN65FlDOxe0bzyOCT08gSIHyZ/TQjIC3xWZ7z6zR+yTrFH/0d4DbX2ns5rROljHoWjhL3MWWhXMwDOcgatQXM+nTcx+Rg==',key_name='tempest-keypair-391897607',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f5f9f30926f47afad3cb4c9e89d55c5',ramdisk_id='',reservation_id='r-daxoh0gf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-130200384',owner_user_name='tempest-AttachVolumeShelveTestJSON-130200384-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:56:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c9562451ffa45b2aad975335d83fa8c',uuid=1555ef29-8abe-43ca-ad2b-ac2f86180202,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f34f8730-445d-4711-8db4-3c6455cbd24e", "address": "fa:16:3e:c0:c2:af", "network": {"id": "ff833b6e-b3ce-44ac-88ec-775f193cdfe4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-546934977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f5f9f30926f47afad3cb4c9e89d55c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34f8730-44", "ovs_interfaceid": "f34f8730-445d-4711-8db4-3c6455cbd24e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:56:15 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Converting VIF {"id": "f34f8730-445d-4711-8db4-3c6455cbd24e", "address": "fa:16:3e:c0:c2:af", "network": {"id": "ff833b6e-b3ce-44ac-88ec-775f193cdfe4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-546934977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f5f9f30926f47afad3cb4c9e89d55c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34f8730-44", "ovs_interfaceid": "f34f8730-445d-4711-8db4-3c6455cbd24e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:56:15 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:c2:af,bridge_name='br-int',has_traffic_filtering=True,id=f34f8730-445d-4711-8db4-3c6455cbd24e,network=Network(ff833b6e-b3ce-44ac-88ec-775f193cdfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf34f8730-44') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:56:15 user nova-compute[70924]: DEBUG nova.objects.instance [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lazy-loading 'pci_devices' on Instance uuid 1555ef29-8abe-43ca-ad2b-ac2f86180202 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:56:15 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] End _get_guest_xml xml=<domain type="kvm">
Jul 29 14:56:15 user nova-compute[70924]:   <uuid>1555ef29-8abe-43ca-ad2b-ac2f86180202</uuid>
Jul 29 14:56:15 user nova-compute[70924]:   <name>instance-00000020</name>
Jul 29 14:56:15 user nova-compute[70924]:   <memory>524288</memory>
Jul 29 14:56:15 user nova-compute[70924]:   <vcpu>1</vcpu>
Jul 29 14:56:15 user nova-compute[70924]:   <metadata>
Jul 29 14:56:15 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 14:56:15 user nova-compute[70924]:       <nova:package version="0.0.0"/>
Jul 29 14:56:15 user nova-compute[70924]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-294782032</nova:name>
Jul 29 14:56:15 user nova-compute[70924]:       <nova:creationTime>2023-07-29 14:56:15</nova:creationTime>
Jul 29 14:56:15 user nova-compute[70924]:       <nova:flavor name="m1.tiny">
Jul 29 14:56:15 user nova-compute[70924]:         <nova:memory>512</nova:memory>
Jul 29 14:56:15 user nova-compute[70924]:         <nova:disk>1</nova:disk>
Jul 29 14:56:15 user nova-compute[70924]:         <nova:swap>0</nova:swap>
Jul 29 14:56:15 user nova-compute[70924]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 14:56:15 user nova-compute[70924]:         <nova:vcpus>1</nova:vcpus>
Jul 29 14:56:15 user nova-compute[70924]:       </nova:flavor>
Jul 29 14:56:15 user nova-compute[70924]:       <nova:owner>
Jul 29 14:56:15 user nova-compute[70924]:         <nova:user uuid="7c9562451ffa45b2aad975335d83fa8c">tempest-AttachVolumeShelveTestJSON-130200384-project-member</nova:user>
Jul 29 14:56:15 user nova-compute[70924]:         <nova:project uuid="6f5f9f30926f47afad3cb4c9e89d55c5">tempest-AttachVolumeShelveTestJSON-130200384</nova:project>
Jul 29 14:56:15 user nova-compute[70924]:       </nova:owner>
Jul 29 14:56:15 user nova-compute[70924]:       <nova:root type="image" uuid="3aba2e73-6832-404b-8bd0-d0503ce82b8c"/>
Jul 29 14:56:15 user nova-compute[70924]:       <nova:ports>
Jul 29 14:56:15 user nova-compute[70924]:         <nova:port uuid="f34f8730-445d-4711-8db4-3c6455cbd24e">
Jul 29 14:56:15 user nova-compute[70924]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 29 14:56:15 user nova-compute[70924]:         </nova:port>
Jul 29 14:56:15 user nova-compute[70924]:       </nova:ports>
Jul 29 14:56:15 user nova-compute[70924]:     </nova:instance>
Jul 29 14:56:15 user nova-compute[70924]:   </metadata>
Jul 29 14:56:15 user nova-compute[70924]:   <sysinfo type="smbios">
Jul 29 14:56:15 user nova-compute[70924]:     <system>
Jul 29 14:56:15 user nova-compute[70924]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 14:56:15 user nova-compute[70924]:       <entry name="product">OpenStack Nova</entry>
Jul 29 14:56:15 user nova-compute[70924]:       <entry name="version">0.0.0</entry>
Jul 29 14:56:15 user nova-compute[70924]:       <entry name="serial">1555ef29-8abe-43ca-ad2b-ac2f86180202</entry>
Jul 29 14:56:15 user nova-compute[70924]:       <entry name="uuid">1555ef29-8abe-43ca-ad2b-ac2f86180202</entry>
Jul 29 14:56:15 user nova-compute[70924]:       <entry name="family">Virtual Machine</entry>
Jul 29 14:56:15 user nova-compute[70924]:     </system>
Jul 29 14:56:15 user nova-compute[70924]:   </sysinfo>
Jul 29 14:56:15 user nova-compute[70924]:   <os>
Jul 29 14:56:15 user nova-compute[70924]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 14:56:15 user nova-compute[70924]:     <boot dev="hd"/>
Jul 29 14:56:15 user nova-compute[70924]:     <smbios mode="sysinfo"/>
Jul 29 14:56:15 user nova-compute[70924]:   </os>
Jul 29 14:56:15 user nova-compute[70924]:   <features>
Jul 29 14:56:15 user nova-compute[70924]:     <acpi/>
Jul 29 14:56:15 user nova-compute[70924]:     <apic/>
Jul 29 14:56:15 user nova-compute[70924]:     <vmcoreinfo/>
Jul 29 14:56:15 user nova-compute[70924]:   </features>
Jul 29 14:56:15 user nova-compute[70924]:   <clock offset="utc">
Jul 29 14:56:15 user nova-compute[70924]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 14:56:15 user nova-compute[70924]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 14:56:15 user nova-compute[70924]:     <timer name="hpet" present="no"/>
Jul 29 14:56:15 user nova-compute[70924]:   </clock>
Jul 29 14:56:15 user nova-compute[70924]:   <cpu mode="custom" match="exact">
Jul 29 14:56:15 user nova-compute[70924]:     <model>Nehalem</model>
Jul 29 14:56:15 user nova-compute[70924]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 14:56:15 user nova-compute[70924]:   </cpu>
Jul 29 14:56:15 user nova-compute[70924]:   <devices>
Jul 29 14:56:15 user nova-compute[70924]:     <disk type="file" device="disk">
Jul 29 14:56:15 user nova-compute[70924]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 14:56:15 user nova-compute[70924]:       <source file="/opt/stack/data/nova/instances/1555ef29-8abe-43ca-ad2b-ac2f86180202/disk"/>
Jul 29 14:56:15 user nova-compute[70924]:       <target dev="vda" bus="virtio"/>
Jul 29 14:56:15 user nova-compute[70924]:     </disk>
Jul 29 14:56:15 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 14:56:15 user nova-compute[70924]:       <mac address="fa:16:3e:c0:c2:af"/>
Jul 29 14:56:15 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:56:15 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 14:56:15 user nova-compute[70924]:       <target dev="tapf34f8730-44"/>
Jul 29 14:56:15 user nova-compute[70924]:     </interface>
Jul 29 14:56:15 user nova-compute[70924]:     <serial type="pty">
Jul 29 14:56:15 user nova-compute[70924]:       <log file="/opt/stack/data/nova/instances/1555ef29-8abe-43ca-ad2b-ac2f86180202/console.log" append="off"/>
Jul 29 14:56:15 user nova-compute[70924]:     </serial>
Jul 29 14:56:15 user nova-compute[70924]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 14:56:15 user nova-compute[70924]:     <video>
Jul 29 14:56:15 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:56:15 user nova-compute[70924]:     </video>
Jul 29 14:56:15 user nova-compute[70924]:     <rng model="virtio">
Jul 29 14:56:15 user nova-compute[70924]:       <backend model="random">/dev/urandom</backend>
Jul 29 14:56:15 user nova-compute[70924]:     </rng>
Jul 29 14:56:15 user nova-compute[70924]:     <controller type="usb" index="0" model="none"/>
Jul 29 14:56:15 user nova-compute[70924]:     <memballoon model="virtio">
Jul 29 14:56:15 user nova-compute[70924]:       <stats period="10"/>
Jul 29 14:56:15 user nova-compute[70924]:     </memballoon>
Jul 29 14:56:15 user nova-compute[70924]:   </devices>
Jul 29 14:56:15 user nova-compute[70924]: </domain>
Jul 29 14:56:15 user nova-compute[70924]:  {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 14:56:15 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:56:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-294782032',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-294782032',id=32,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7k8yfFGWAhiv9WTAEC+6fczleFZHosFBEhgzN65FlDOxe0bzyOCT08gSIHyZ/TQjIC3xWZ7z6zR+yTrFH/0d4DbX2ns5rROljHoWjhL3MWWhXMwDOcgatQXM+nTcx+Rg==',key_name='tempest-keypair-391897607',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f5f9f30926f47afad3cb4c9e89d55c5',ramdisk_id='',reservation_id='r-daxoh0gf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-130200384',owner_user_name='tempest-AttachVolumeShelveTestJSON-130200384-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:56:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c9562451ffa45b2aad975335d83fa8c',uuid=1555ef29-8abe-43ca-ad2b-ac2f86180202,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f34f8730-445d-4711-8db4-3c6455cbd24e", "address": "fa:16:3e:c0:c2:af", "network": {"id": "ff833b6e-b3ce-44ac-88ec-775f193cdfe4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-546934977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f5f9f30926f47afad3cb4c9e89d55c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34f8730-44", "ovs_interfaceid": "f34f8730-445d-4711-8db4-3c6455cbd24e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 14:56:15 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Converting VIF {"id": "f34f8730-445d-4711-8db4-3c6455cbd24e", "address": "fa:16:3e:c0:c2:af", "network": {"id": "ff833b6e-b3ce-44ac-88ec-775f193cdfe4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-546934977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f5f9f30926f47afad3cb4c9e89d55c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34f8730-44", "ovs_interfaceid": "f34f8730-445d-4711-8db4-3c6455cbd24e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:56:15 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:c2:af,bridge_name='br-int',has_traffic_filtering=True,id=f34f8730-445d-4711-8db4-3c6455cbd24e,network=Network(ff833b6e-b3ce-44ac-88ec-775f193cdfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf34f8730-44') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:56:15 user nova-compute[70924]: DEBUG os_vif [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:c2:af,bridge_name='br-int',has_traffic_filtering=True,id=f34f8730-445d-4711-8db4-3c6455cbd24e,network=Network(ff833b6e-b3ce-44ac-88ec-775f193cdfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf34f8730-44') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 14:56:15 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:56:15 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:56:15 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 14:56:15 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:56:15 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf34f8730-44, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:56:15 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf34f8730-44, col_values=(('external_ids', {'iface-id': 'f34f8730-445d-4711-8db4-3c6455cbd24e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:c2:af', 'vm-uuid': '1555ef29-8abe-43ca-ad2b-ac2f86180202'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:56:15 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:56:15 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:56:15 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:56:15 user nova-compute[70924]: INFO os_vif [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:c2:af,bridge_name='br-int',has_traffic_filtering=True,id=f34f8730-445d-4711-8db4-3c6455cbd24e,network=Network(ff833b6e-b3ce-44ac-88ec-775f193cdfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf34f8730-44')
Jul 29 14:56:15 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:56:15 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] No VIF found with MAC fa:16:3e:c0:c2:af, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:56:16 user nova-compute[70924]: DEBUG nova.network.neutron [req-b100daad-091d-4704-aed3-940865ba4a86 req-35625285-c590-433b-a1fc-b84192ae26e3 service nova] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Updated VIF entry in instance network info cache for port f34f8730-445d-4711-8db4-3c6455cbd24e. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:56:16 user nova-compute[70924]: DEBUG nova.network.neutron [req-b100daad-091d-4704-aed3-940865ba4a86 req-35625285-c590-433b-a1fc-b84192ae26e3 service nova] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Updating instance_info_cache with network_info: [{"id": "f34f8730-445d-4711-8db4-3c6455cbd24e", "address": "fa:16:3e:c0:c2:af", "network": {"id": "ff833b6e-b3ce-44ac-88ec-775f193cdfe4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-546934977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f5f9f30926f47afad3cb4c9e89d55c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34f8730-44", "ovs_interfaceid": "f34f8730-445d-4711-8db4-3c6455cbd24e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:56:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b100daad-091d-4704-aed3-940865ba4a86 req-35625285-c590-433b-a1fc-b84192ae26e3 service nova] Releasing lock "refresh_cache-1555ef29-8abe-43ca-ad2b-ac2f86180202" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:56:17 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:56:17 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:56:17 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:56:17 user nova-compute[70924]: DEBUG nova.compute.manager [req-46b15646-e6b3-4ae1-9b45-bd6ab2421efe req-71ac3587-d54d-4e1d-9377-571b54c40a9f service nova] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Received event network-vif-plugged-f34f8730-445d-4711-8db4-3c6455cbd24e {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:56:17 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-46b15646-e6b3-4ae1-9b45-bd6ab2421efe req-71ac3587-d54d-4e1d-9377-571b54c40a9f service nova] Acquiring lock "1555ef29-8abe-43ca-ad2b-ac2f86180202-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:56:17 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-46b15646-e6b3-4ae1-9b45-bd6ab2421efe req-71ac3587-d54d-4e1d-9377-571b54c40a9f service nova] Lock "1555ef29-8abe-43ca-ad2b-ac2f86180202-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:56:17 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-46b15646-e6b3-4ae1-9b45-bd6ab2421efe req-71ac3587-d54d-4e1d-9377-571b54c40a9f service nova] Lock "1555ef29-8abe-43ca-ad2b-ac2f86180202-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:56:17 user nova-compute[70924]: DEBUG nova.compute.manager [req-46b15646-e6b3-4ae1-9b45-bd6ab2421efe req-71ac3587-d54d-4e1d-9377-571b54c40a9f service nova] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] No waiting events found dispatching network-vif-plugged-f34f8730-445d-4711-8db4-3c6455cbd24e {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:56:17 user nova-compute[70924]: WARNING nova.compute.manager [req-46b15646-e6b3-4ae1-9b45-bd6ab2421efe req-71ac3587-d54d-4e1d-9377-571b54c40a9f service nova] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Received unexpected event network-vif-plugged-f34f8730-445d-4711-8db4-3c6455cbd24e for instance with vm_state building and task_state spawning.
Jul 29 14:56:17 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:56:17 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:56:17 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:56:17 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:56:18 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:56:18 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:56:19 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642579.4676516, 1555ef29-8abe-43ca-ad2b-ac2f86180202 => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:56:19 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] VM Resumed (Lifecycle Event)
Jul 29 14:56:19 user nova-compute[70924]: DEBUG nova.compute.manager [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Instance event wait completed in 0 seconds for  {{(pid=70924) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 14:56:19 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Guest created on hypervisor {{(pid=70924) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 14:56:19 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Instance spawned successfully.
Jul 29 14:56:19 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 14:56:19 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:56:19 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:56:19 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Found default for hw_cdrom_bus of ide {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:56:19 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Found default for hw_disk_bus of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:56:19 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Found default for hw_input_bus of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:56:19 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Found default for hw_pointer_model of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:56:19 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Found default for hw_video_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:56:19 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Found default for hw_vif_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:56:19 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:56:19 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642579.47012, 1555ef29-8abe-43ca-ad2b-ac2f86180202 => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:56:19 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] VM Started (Lifecycle Event)
Jul 29 14:56:19 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:56:19 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:56:19 user nova-compute[70924]: DEBUG nova.compute.manager [req-4cd4811a-dcc8-4c26-93e5-da45a542d749 req-907f855e-a19b-44a3-bf56-02d99b69c3bb service nova] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Received event network-vif-plugged-f34f8730-445d-4711-8db4-3c6455cbd24e {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:56:19 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-4cd4811a-dcc8-4c26-93e5-da45a542d749 req-907f855e-a19b-44a3-bf56-02d99b69c3bb service nova] Acquiring lock "1555ef29-8abe-43ca-ad2b-ac2f86180202-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:56:19 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-4cd4811a-dcc8-4c26-93e5-da45a542d749 req-907f855e-a19b-44a3-bf56-02d99b69c3bb service nova] Lock "1555ef29-8abe-43ca-ad2b-ac2f86180202-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:56:19 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-4cd4811a-dcc8-4c26-93e5-da45a542d749 req-907f855e-a19b-44a3-bf56-02d99b69c3bb service nova] Lock "1555ef29-8abe-43ca-ad2b-ac2f86180202-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:56:19 user nova-compute[70924]: DEBUG nova.compute.manager [req-4cd4811a-dcc8-4c26-93e5-da45a542d749 req-907f855e-a19b-44a3-bf56-02d99b69c3bb service nova] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] No waiting events found dispatching network-vif-plugged-f34f8730-445d-4711-8db4-3c6455cbd24e {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:56:19 user nova-compute[70924]: WARNING nova.compute.manager [req-4cd4811a-dcc8-4c26-93e5-da45a542d749 req-907f855e-a19b-44a3-bf56-02d99b69c3bb service nova] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Received unexpected event network-vif-plugged-f34f8730-445d-4711-8db4-3c6455cbd24e for instance with vm_state building and task_state spawning.
Jul 29 14:56:19 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:56:19 user nova-compute[70924]: INFO nova.compute.manager [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Took 6.36 seconds to spawn the instance on the hypervisor.
Jul 29 14:56:19 user nova-compute[70924]: DEBUG nova.compute.manager [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:56:19 user nova-compute[70924]: INFO nova.compute.manager [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Took 7.18 seconds to build instance.
Jul 29 14:56:19 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-384e31e8-d620-47e3-9e91-d42fe5535934 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "1555ef29-8abe-43ca-ad2b-ac2f86180202" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.310s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:56:20 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:56:23 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:56:23 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:56:25 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:56:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:56:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:56:29 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:56:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ed1b58bb-1292-452c-80ec-38ffbfbd41f7 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Acquiring lock "fd57baf8-6306-4553-a058-e915fb543405" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:56:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ed1b58bb-1292-452c-80ec-38ffbfbd41f7 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "fd57baf8-6306-4553-a058-e915fb543405" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:56:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ed1b58bb-1292-452c-80ec-38ffbfbd41f7 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Acquiring lock "fd57baf8-6306-4553-a058-e915fb543405-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:56:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ed1b58bb-1292-452c-80ec-38ffbfbd41f7 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "fd57baf8-6306-4553-a058-e915fb543405-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:56:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ed1b58bb-1292-452c-80ec-38ffbfbd41f7 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "fd57baf8-6306-4553-a058-e915fb543405-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:56:30 user nova-compute[70924]: INFO nova.compute.manager [None req-ed1b58bb-1292-452c-80ec-38ffbfbd41f7 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] Terminating instance
Jul 29 14:56:30 user nova-compute[70924]: DEBUG nova.compute.manager [None req-ed1b58bb-1292-452c-80ec-38ffbfbd41f7 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] Start destroying the instance on the hypervisor. {{(pid=70924) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 14:56:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:56:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:56:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:56:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:56:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:56:30 user nova-compute[70924]: DEBUG nova.compute.manager [req-51ace0ce-ce15-47dc-9002-05fd755cbd61 req-3a9ff122-b607-49b9-a274-4767fbe9becc service nova] [instance: fd57baf8-6306-4553-a058-e915fb543405] Received event network-vif-unplugged-c8f2eadb-705f-4b8b-9f67-c5280cf1f025 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:56:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-51ace0ce-ce15-47dc-9002-05fd755cbd61 req-3a9ff122-b607-49b9-a274-4767fbe9becc service nova] Acquiring lock "fd57baf8-6306-4553-a058-e915fb543405-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:56:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-51ace0ce-ce15-47dc-9002-05fd755cbd61 req-3a9ff122-b607-49b9-a274-4767fbe9becc service nova] Lock "fd57baf8-6306-4553-a058-e915fb543405-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:56:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-51ace0ce-ce15-47dc-9002-05fd755cbd61 req-3a9ff122-b607-49b9-a274-4767fbe9becc service nova] Lock "fd57baf8-6306-4553-a058-e915fb543405-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:56:30 user nova-compute[70924]: DEBUG nova.compute.manager [req-51ace0ce-ce15-47dc-9002-05fd755cbd61 req-3a9ff122-b607-49b9-a274-4767fbe9becc service nova] [instance: fd57baf8-6306-4553-a058-e915fb543405] No waiting events found dispatching network-vif-unplugged-c8f2eadb-705f-4b8b-9f67-c5280cf1f025 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:56:30 user nova-compute[70924]: DEBUG nova.compute.manager [req-51ace0ce-ce15-47dc-9002-05fd755cbd61 req-3a9ff122-b607-49b9-a274-4767fbe9becc service nova] [instance: fd57baf8-6306-4553-a058-e915fb543405] Received event network-vif-unplugged-c8f2eadb-705f-4b8b-9f67-c5280cf1f025 for instance with task_state deleting. {{(pid=70924) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 14:56:31 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: fd57baf8-6306-4553-a058-e915fb543405] Instance destroyed successfully.
Jul 29 14:56:31 user nova-compute[70924]: DEBUG nova.objects.instance [None req-ed1b58bb-1292-452c-80ec-38ffbfbd41f7 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lazy-loading 'resources' on Instance uuid fd57baf8-6306-4553-a058-e915fb543405 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:56:31 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-ed1b58bb-1292-452c-80ec-38ffbfbd41f7 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:49:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1631866093',display_name='tempest-ServerActionsTestOtherA-server-1631866093',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1631866093',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfg71Q+cjedfRarcbIler9POuKvX/jsQII2ANgknh6qTEvuHJAE8T34RCDfGUcAvd9SbwZCzhWP8ikNDBjVZKRBIySMsLhBLIX0hKsMOAV+S3aIT6/Yawicov1EmjAkDw==',key_name='tempest-keypair-1866871140',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:52:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b33d01ba458f466b99b6bc5bba88d8c0',ramdisk_id='',reservation_id='r-gzlw9uxq',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-166265056',owner_user_name='tempest-ServerActionsTestOtherA-166265056-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:53:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55b9032bef2d4d3586dc5d18cdc1ee55',uuid=fd57baf8-6306-4553-a058-e915fb543405,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c8f2eadb-705f-4b8b-9f67-c5280cf1f025", "address": "fa:16:3e:15:d2:44", "network": {"id": "55c18d07-a341-4678-9d1c-2dff057a9b1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1092921088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b33d01ba458f466b99b6bc5bba88d8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8f2eadb-70", "ovs_interfaceid": "c8f2eadb-705f-4b8b-9f67-c5280cf1f025", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 14:56:31 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-ed1b58bb-1292-452c-80ec-38ffbfbd41f7 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Converting VIF {"id": "c8f2eadb-705f-4b8b-9f67-c5280cf1f025", "address": "fa:16:3e:15:d2:44", "network": {"id": "55c18d07-a341-4678-9d1c-2dff057a9b1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1092921088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b33d01ba458f466b99b6bc5bba88d8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8f2eadb-70", "ovs_interfaceid": "c8f2eadb-705f-4b8b-9f67-c5280cf1f025", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:56:31 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-ed1b58bb-1292-452c-80ec-38ffbfbd41f7 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:d2:44,bridge_name='br-int',has_traffic_filtering=True,id=c8f2eadb-705f-4b8b-9f67-c5280cf1f025,network=Network(55c18d07-a341-4678-9d1c-2dff057a9b1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8f2eadb-70') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:56:31 user nova-compute[70924]: DEBUG os_vif [None req-ed1b58bb-1292-452c-80ec-38ffbfbd41f7 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:d2:44,bridge_name='br-int',has_traffic_filtering=True,id=c8f2eadb-705f-4b8b-9f67-c5280cf1f025,network=Network(55c18d07-a341-4678-9d1c-2dff057a9b1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8f2eadb-70') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 14:56:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:56:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc8f2eadb-70, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:56:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:56:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:56:31 user nova-compute[70924]: INFO os_vif [None req-ed1b58bb-1292-452c-80ec-38ffbfbd41f7 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:d2:44,bridge_name='br-int',has_traffic_filtering=True,id=c8f2eadb-705f-4b8b-9f67-c5280cf1f025,network=Network(55c18d07-a341-4678-9d1c-2dff057a9b1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8f2eadb-70')
Jul 29 14:56:31 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed1b58bb-1292-452c-80ec-38ffbfbd41f7 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] calling os-brick to detach iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 14:56:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed1b58bb-1292-452c-80ec-38ffbfbd41f7 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, {'target_iqns': ['iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zKwhpaCm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:56:31 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-ed1b58bb-1292-452c-80ec-38ffbfbd41f7 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:56:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-ed1b58bb-1292-452c-80ec-38ffbfbd41f7 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:56:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-ed1b58bb-1292-452c-80ec-38ffbfbd41f7 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:56:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed1b58bb-1292-452c-80ec-38ffbfbd41f7 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464', 0)] {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 14:56:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:56:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:56:31 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43c1e8d-6cd6-421d-bbb8-148e89a2079a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:56:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:56:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:56:31 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fefb7d4-9ee8-4df8-b1fc-ce2b3cfa3740]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:56:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed1b58bb-1292-452c-80ec-38ffbfbd41f7 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:56:31 user nova-compute[70924]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:56:31 user nova-compute[70924]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb (non-flash)
Jul 29 14:56:31 user nova-compute[70924]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2 (non-flash)
Jul 29 14:56:31 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:56:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed1b58bb-1292-452c-80ec-38ffbfbd41f7 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:56:31 user nova-compute[70924]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 (non-flash)
Jul 29 14:56:31 user nova-compute[70924]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb (non-flash)
Jul 29 14:56:31 user nova-compute[70924]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2 (non-flash)
Jul 29 14:56:31 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:56:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed1b58bb-1292-452c-80ec-38ffbfbd41f7 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feee9914430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464'): ({'sdd'}, set())}) {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 14:56:31 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-ed1b58bb-1292-452c-80ec-38ffbfbd41f7 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Removing single pathed devices sdd {{(pid=70924) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 14:56:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:56:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:56:31 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c691a8-378f-4d8d-93b8-3ac290dff237]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:56:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:56:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:56:31 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0723ef-d19e-4c33-bec8-ed411bb3fa53]: (4, ('ok\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:56:31 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-ed1b58bb-1292-452c-80ec-38ffbfbd41f7 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Flushing IO for device /dev/sdd {{(pid=70924) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 14:56:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:56:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:56:31 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c014911-c4a9-4ca7-a0c3-d084edc24b15]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:56:31 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-ed1b58bb-1292-452c-80ec-38ffbfbd41f7 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70924) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 14:56:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:56:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:56:31 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8b7eb7-586d-4711-8a2e-2f21bccbe149]: (4, ('1', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:56:31 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-ed1b58bb-1292-452c-80ec-38ffbfbd41f7 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 14:56:31 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-ed1b58bb-1292-452c-80ec-38ffbfbd41f7 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] SCSI volumes sdd have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 14:56:31 user nova-compute[70924]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_2b6c7414',) {{(pid=81998) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 29 14:56:31 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a8a124-8904-4602-80b4-2fdc448e9e60]: (4, None) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:56:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed1b58bb-1292-452c-80ec-38ffbfbd41f7 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464')] {{(pid=70924) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 14:56:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:56:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:56:31 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[127ea274-7e6d-4bf2-b1c4-7b168b5b5b59]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:56:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed1b58bb-1292-452c-80ec-38ffbfbd41f7 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:56:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 -p 172.16.0.220:3260 --logout {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:56:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:56:31 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ab9507-5bcf-4d48-9a75-84a65b575648]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:56:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed1b58bb-1292-452c-80ec-38ffbfbd41f7 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464, portal: 172.16.0.220,3260]
Jul 29 14:56:31 user nova-compute[70924]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464, portal: 172.16.0.220,3260] successful.
Jul 29 14:56:31 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:56:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 -p 172.16.0.220:3260 --op delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:56:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60c129c4-a916-49f7-86b6-ff1a2339a464 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:56:31 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2905e3a-4242-4ac5-9af6-b41af6bf0f2c]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:56:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed1b58bb-1292-452c-80ec-38ffbfbd41f7 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:56:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-ed1b58bb-1292-452c-80ec-38ffbfbd41f7 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:56:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed1b58bb-1292-452c-80ec-38ffbfbd41f7 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] <== disconnect_volume: return (324ms) None {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:56:31 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed1b58bb-1292-452c-80ec-38ffbfbd41f7 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] Disconnected iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 14:56:31 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-ed1b58bb-1292-452c-80ec-38ffbfbd41f7 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] Deleting instance files /opt/stack/data/nova/instances/fd57baf8-6306-4553-a058-e915fb543405_del
Jul 29 14:56:31 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-ed1b58bb-1292-452c-80ec-38ffbfbd41f7 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] Deletion of /opt/stack/data/nova/instances/fd57baf8-6306-4553-a058-e915fb543405_del complete
Jul 29 14:56:31 user nova-compute[70924]: INFO nova.compute.manager [None req-ed1b58bb-1292-452c-80ec-38ffbfbd41f7 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] Took 1.22 seconds to destroy the instance on the hypervisor.
Jul 29 14:56:31 user nova-compute[70924]: DEBUG oslo.service.loopingcall [None req-ed1b58bb-1292-452c-80ec-38ffbfbd41f7 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70924) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 14:56:31 user nova-compute[70924]: DEBUG nova.compute.manager [-] [instance: fd57baf8-6306-4553-a058-e915fb543405] Deallocating network for instance {{(pid=70924) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 14:56:31 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: fd57baf8-6306-4553-a058-e915fb543405] deallocate_for_instance() {{(pid=70924) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 14:56:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:56:32 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: fd57baf8-6306-4553-a058-e915fb543405] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:56:32 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: fd57baf8-6306-4553-a058-e915fb543405] Took 1.11 seconds to deallocate network for instance.
Jul 29 14:56:32 user nova-compute[70924]: DEBUG nova.compute.manager [req-5a2e8121-e19d-4331-9547-cfeca5346528 req-768c0293-2117-4f61-97ce-e92151d08050 service nova] [instance: fd57baf8-6306-4553-a058-e915fb543405] Received event network-vif-plugged-c8f2eadb-705f-4b8b-9f67-c5280cf1f025 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:56:32 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-5a2e8121-e19d-4331-9547-cfeca5346528 req-768c0293-2117-4f61-97ce-e92151d08050 service nova] Acquiring lock "fd57baf8-6306-4553-a058-e915fb543405-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:56:32 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-5a2e8121-e19d-4331-9547-cfeca5346528 req-768c0293-2117-4f61-97ce-e92151d08050 service nova] Lock "fd57baf8-6306-4553-a058-e915fb543405-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:56:32 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-5a2e8121-e19d-4331-9547-cfeca5346528 req-768c0293-2117-4f61-97ce-e92151d08050 service nova] Lock "fd57baf8-6306-4553-a058-e915fb543405-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:56:32 user nova-compute[70924]: DEBUG nova.compute.manager [req-5a2e8121-e19d-4331-9547-cfeca5346528 req-768c0293-2117-4f61-97ce-e92151d08050 service nova] [instance: fd57baf8-6306-4553-a058-e915fb543405] No waiting events found dispatching network-vif-plugged-c8f2eadb-705f-4b8b-9f67-c5280cf1f025 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:56:32 user nova-compute[70924]: WARNING nova.compute.manager [req-5a2e8121-e19d-4331-9547-cfeca5346528 req-768c0293-2117-4f61-97ce-e92151d08050 service nova] [instance: fd57baf8-6306-4553-a058-e915fb543405] Received unexpected event network-vif-plugged-c8f2eadb-705f-4b8b-9f67-c5280cf1f025 for instance with vm_state active and task_state deleting.
Jul 29 14:56:32 user nova-compute[70924]: DEBUG nova.compute.manager [req-5a2e8121-e19d-4331-9547-cfeca5346528 req-768c0293-2117-4f61-97ce-e92151d08050 service nova] [instance: fd57baf8-6306-4553-a058-e915fb543405] Received event network-vif-deleted-c8f2eadb-705f-4b8b-9f67-c5280cf1f025 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:56:33 user nova-compute[70924]: INFO nova.compute.manager [None req-ed1b58bb-1292-452c-80ec-38ffbfbd41f7 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] Took 0.76 seconds to detach 1 volumes for instance.
Jul 29 14:56:33 user nova-compute[70924]: DEBUG nova.compute.manager [None req-ed1b58bb-1292-452c-80ec-38ffbfbd41f7 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: fd57baf8-6306-4553-a058-e915fb543405] Deleting volume: 60c129c4-a916-49f7-86b6-ff1a2339a464 {{(pid=70924) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Jul 29 14:56:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ed1b58bb-1292-452c-80ec-38ffbfbd41f7 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:56:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ed1b58bb-1292-452c-80ec-38ffbfbd41f7 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:56:33 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:56:34 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-ed1b58bb-1292-452c-80ec-38ffbfbd41f7 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:56:34 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-ed1b58bb-1292-452c-80ec-38ffbfbd41f7 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:56:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ed1b58bb-1292-452c-80ec-38ffbfbd41f7 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.427s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:56:34 user nova-compute[70924]: INFO nova.scheduler.client.report [None req-ed1b58bb-1292-452c-80ec-38ffbfbd41f7 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Deleted allocations for instance fd57baf8-6306-4553-a058-e915fb543405
Jul 29 14:56:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ed1b58bb-1292-452c-80ec-38ffbfbd41f7 tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "fd57baf8-6306-4553-a058-e915fb543405" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.991s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:56:36 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:56:36 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:56:38 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:56:39 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:56:41 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:56:42 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:56:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:56:45 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:56:46 user nova-compute[70924]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690642591.1297138, fd57baf8-6306-4553-a058-e915fb543405 => Stopped> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:56:46 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: fd57baf8-6306-4553-a058-e915fb543405] VM Stopped (Lifecycle Event)
Jul 29 14:56:46 user nova-compute[70924]: DEBUG nova.compute.manager [None req-9288f178-0923-462f-afa7-31070e18e2cb None None] [instance: fd57baf8-6306-4553-a058-e915fb543405] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:56:46 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:56:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:56:51 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:56:52 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:56:54 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:56:54 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:56:54 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:56:54 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Cleaning up deleted instances {{(pid=70924) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 29 14:56:54 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] There are 0 instances to clean {{(pid=70924) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 29 14:56:55 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:56:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:56:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:56:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:56:55 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Auditing locally available compute resources for user (node: user) {{(pid=70924) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 14:56:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk.rescue --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:56:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:56:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk.rescue --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:56:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:56:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:56:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:56:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:56:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:56:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:56:56 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:56:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:56:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:56:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:56:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c31a724f-3006-4e5d-a9b5-847fd6cd170a/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:56:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c31a724f-3006-4e5d-a9b5-847fd6cd170a/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:56:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c31a724f-3006-4e5d-a9b5-847fd6cd170a/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:56:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c31a724f-3006-4e5d-a9b5-847fd6cd170a/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:56:56 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 14:56:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cb12b3e-de44-4887-ab74-2a68164b5f7d/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:56:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cb12b3e-de44-4887-ab74-2a68164b5f7d/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:56:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cb12b3e-de44-4887-ab74-2a68164b5f7d/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:56:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cb12b3e-de44-4887-ab74-2a68164b5f7d/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:56:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:56:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:56:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:56:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:56:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7171083a-00aa-4faf-9732-88cab8a0d83d/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:56:57 user nova-compute[70924]: INFO nova.compute.manager [None req-1dc5c255-b6f5-459f-9d56-8ae803c98106 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Unrescuing
Jul 29 14:56:57 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1dc5c255-b6f5-459f-9d56-8ae803c98106 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Acquiring lock "refresh_cache-b001d812-892a-4756-9f37-fc0c5ef5f0a7" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:56:57 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1dc5c255-b6f5-459f-9d56-8ae803c98106 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Acquired lock "refresh_cache-b001d812-892a-4756-9f37-fc0c5ef5f0a7" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:56:57 user nova-compute[70924]: DEBUG nova.network.neutron [None req-1dc5c255-b6f5-459f-9d56-8ae803c98106 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 14:56:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7171083a-00aa-4faf-9732-88cab8a0d83d/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:56:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7171083a-00aa-4faf-9732-88cab8a0d83d/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:56:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7171083a-00aa-4faf-9732-88cab8a0d83d/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:56:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710f0d5a-8420-49c4-bf70-27305dd85bd3/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:56:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710f0d5a-8420-49c4-bf70-27305dd85bd3/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:56:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710f0d5a-8420-49c4-bf70-27305dd85bd3/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:56:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710f0d5a-8420-49c4-bf70-27305dd85bd3/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:56:57 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 14:56:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1555ef29-8abe-43ca-ad2b-ac2f86180202/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:56:58 user nova-compute[70924]: DEBUG nova.network.neutron [None req-1dc5c255-b6f5-459f-9d56-8ae803c98106 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Updating instance_info_cache with network_info: [{"id": "a17ada4e-69e7-42ef-b08d-f405a5da6368", "address": "fa:16:3e:62:06:29", "network": {"id": "d5876e18-e2af-45c2-aab5-2d0d552ebfe4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2035085552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9e5c78c1684c359cfab4e32b9c213f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa17ada4e-69", "ovs_interfaceid": "a17ada4e-69e7-42ef-b08d-f405a5da6368", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:56:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1555ef29-8abe-43ca-ad2b-ac2f86180202/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:56:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1555ef29-8abe-43ca-ad2b-ac2f86180202/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:56:58 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1dc5c255-b6f5-459f-9d56-8ae803c98106 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Releasing lock "refresh_cache-b001d812-892a-4756-9f37-fc0c5ef5f0a7" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:56:58 user nova-compute[70924]: DEBUG nova.objects.instance [None req-1dc5c255-b6f5-459f-9d56-8ae803c98106 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lazy-loading 'flavor' on Instance uuid b001d812-892a-4756-9f37-fc0c5ef5f0a7 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:56:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1555ef29-8abe-43ca-ad2b-ac2f86180202/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:56:58 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:56:58 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:56:58 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:56:58 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:56:58 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 14:56:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b001d812-892a-4756-9f37-fc0c5ef5f0a7/disk.rescue --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:56:58 user nova-compute[70924]: DEBUG nova.compute.manager [req-af562149-d27f-4857-aaa1-429e5700ced1 req-74e0f2b4-2696-4df6-933c-79c6d5130477 service nova] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Received event network-vif-unplugged-a17ada4e-69e7-42ef-b08d-f405a5da6368 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:56:58 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-af562149-d27f-4857-aaa1-429e5700ced1 req-74e0f2b4-2696-4df6-933c-79c6d5130477 service nova] Acquiring lock "b001d812-892a-4756-9f37-fc0c5ef5f0a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:56:58 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-af562149-d27f-4857-aaa1-429e5700ced1 req-74e0f2b4-2696-4df6-933c-79c6d5130477 service nova] Lock "b001d812-892a-4756-9f37-fc0c5ef5f0a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:56:58 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-af562149-d27f-4857-aaa1-429e5700ced1 req-74e0f2b4-2696-4df6-933c-79c6d5130477 service nova] Lock "b001d812-892a-4756-9f37-fc0c5ef5f0a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:56:58 user nova-compute[70924]: DEBUG nova.compute.manager [req-af562149-d27f-4857-aaa1-429e5700ced1 req-74e0f2b4-2696-4df6-933c-79c6d5130477 service nova] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] No waiting events found dispatching network-vif-unplugged-a17ada4e-69e7-42ef-b08d-f405a5da6368 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:56:58 user nova-compute[70924]: WARNING nova.compute.manager [req-af562149-d27f-4857-aaa1-429e5700ced1 req-74e0f2b4-2696-4df6-933c-79c6d5130477 service nova] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Received unexpected event network-vif-unplugged-a17ada4e-69e7-42ef-b08d-f405a5da6368 for instance with vm_state rescued and task_state unrescuing.
Jul 29 14:56:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b001d812-892a-4756-9f37-fc0c5ef5f0a7/disk.rescue --force-share --output=json" returned: 0 in 0.157s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:56:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b001d812-892a-4756-9f37-fc0c5ef5f0a7/disk.rescue --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:56:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b001d812-892a-4756-9f37-fc0c5ef5f0a7/disk.rescue --force-share --output=json" returned: 0 in 0.149s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:56:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:56:58 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Instance destroyed successfully.
Jul 29 14:56:59 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:56:59 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:56:59 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:57:02 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:57:02 user nova-compute[70924]: DEBUG nova.compute.manager [None req-1dc5c255-b6f5-459f-9d56-8ae803c98106 tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:57:02 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Removed pending event for b001d812-892a-4756-9f37-fc0c5ef5f0a7 due to event {{(pid=70924) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 29 14:57:02 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642622.4251263, b001d812-892a-4756-9f37-fc0c5ef5f0a7 => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:57:02 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] VM Resumed (Lifecycle Event)
Jul 29 14:57:02 user nova-compute[70924]: DEBUG nova.compute.manager [req-437db8df-3de5-462f-96af-3b649ffd23ec req-1d2705b9-c70f-46c1-a17a-62584404fb0c service nova] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Received event network-vif-plugged-a17ada4e-69e7-42ef-b08d-f405a5da6368 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:57:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-437db8df-3de5-462f-96af-3b649ffd23ec req-1d2705b9-c70f-46c1-a17a-62584404fb0c service nova] Acquiring lock "b001d812-892a-4756-9f37-fc0c5ef5f0a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:57:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-437db8df-3de5-462f-96af-3b649ffd23ec req-1d2705b9-c70f-46c1-a17a-62584404fb0c service nova] Lock "b001d812-892a-4756-9f37-fc0c5ef5f0a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:57:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-437db8df-3de5-462f-96af-3b649ffd23ec req-1d2705b9-c70f-46c1-a17a-62584404fb0c service nova] Lock "b001d812-892a-4756-9f37-fc0c5ef5f0a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:57:02 user nova-compute[70924]: DEBUG nova.compute.manager [req-437db8df-3de5-462f-96af-3b649ffd23ec req-1d2705b9-c70f-46c1-a17a-62584404fb0c service nova] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] No waiting events found dispatching network-vif-plugged-a17ada4e-69e7-42ef-b08d-f405a5da6368 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:57:02 user nova-compute[70924]: WARNING nova.compute.manager [req-437db8df-3de5-462f-96af-3b649ffd23ec req-1d2705b9-c70f-46c1-a17a-62584404fb0c service nova] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Received unexpected event network-vif-plugged-a17ada4e-69e7-42ef-b08d-f405a5da6368 for instance with vm_state rescued and task_state unrescuing.
Jul 29 14:57:02 user nova-compute[70924]: DEBUG nova.compute.manager [req-437db8df-3de5-462f-96af-3b649ffd23ec req-1d2705b9-c70f-46c1-a17a-62584404fb0c service nova] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Received event network-vif-plugged-a17ada4e-69e7-42ef-b08d-f405a5da6368 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:57:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-437db8df-3de5-462f-96af-3b649ffd23ec req-1d2705b9-c70f-46c1-a17a-62584404fb0c service nova] Acquiring lock "b001d812-892a-4756-9f37-fc0c5ef5f0a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:57:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-437db8df-3de5-462f-96af-3b649ffd23ec req-1d2705b9-c70f-46c1-a17a-62584404fb0c service nova] Lock "b001d812-892a-4756-9f37-fc0c5ef5f0a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:57:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-437db8df-3de5-462f-96af-3b649ffd23ec req-1d2705b9-c70f-46c1-a17a-62584404fb0c service nova] Lock "b001d812-892a-4756-9f37-fc0c5ef5f0a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:57:02 user nova-compute[70924]: DEBUG nova.compute.manager [req-437db8df-3de5-462f-96af-3b649ffd23ec req-1d2705b9-c70f-46c1-a17a-62584404fb0c service nova] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] No waiting events found dispatching network-vif-plugged-a17ada4e-69e7-42ef-b08d-f405a5da6368 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:57:02 user nova-compute[70924]: WARNING nova.compute.manager [req-437db8df-3de5-462f-96af-3b649ffd23ec req-1d2705b9-c70f-46c1-a17a-62584404fb0c service nova] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Received unexpected event network-vif-plugged-a17ada4e-69e7-42ef-b08d-f405a5da6368 for instance with vm_state rescued and task_state unrescuing.
Jul 29 14:57:02 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:57:02 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:57:02 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Hypervisor/Node resource view: name=user free_ram=7294MB free_disk=25.100540161132812GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70924) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 14:57:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:57:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:57:02 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:57:02 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:57:02 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 29 14:57:02 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642622.425528, b001d812-892a-4756-9f37-fc0c5ef5f0a7 => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:57:02 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] VM Started (Lifecycle Event)
Jul 29 14:57:02 user nova-compute[70924]: DEBUG nova.compute.manager [req-907a9e5d-4a48-4d02-a8ac-594d4d8b4fe9 req-4a6a6d37-c92c-4779-889b-eede111ee46d service nova] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Received event network-vif-plugged-a17ada4e-69e7-42ef-b08d-f405a5da6368 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:57:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-907a9e5d-4a48-4d02-a8ac-594d4d8b4fe9 req-4a6a6d37-c92c-4779-889b-eede111ee46d service nova] Acquiring lock "b001d812-892a-4756-9f37-fc0c5ef5f0a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:57:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-907a9e5d-4a48-4d02-a8ac-594d4d8b4fe9 req-4a6a6d37-c92c-4779-889b-eede111ee46d service nova] Lock "b001d812-892a-4756-9f37-fc0c5ef5f0a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:57:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-907a9e5d-4a48-4d02-a8ac-594d4d8b4fe9 req-4a6a6d37-c92c-4779-889b-eede111ee46d service nova] Lock "b001d812-892a-4756-9f37-fc0c5ef5f0a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:57:02 user nova-compute[70924]: DEBUG nova.compute.manager [req-907a9e5d-4a48-4d02-a8ac-594d4d8b4fe9 req-4a6a6d37-c92c-4779-889b-eede111ee46d service nova] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] No waiting events found dispatching network-vif-plugged-a17ada4e-69e7-42ef-b08d-f405a5da6368 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:57:02 user nova-compute[70924]: WARNING nova.compute.manager [req-907a9e5d-4a48-4d02-a8ac-594d4d8b4fe9 req-4a6a6d37-c92c-4779-889b-eede111ee46d service nova] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Received unexpected event network-vif-plugged-a17ada4e-69e7-42ef-b08d-f405a5da6368 for instance with vm_state rescued and task_state unrescuing.
Jul 29 14:57:02 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:57:02 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:57:02 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance db656346-c4af-43da-9600-fd39f1b9e4dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:57:02 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 86ecc6cb-88a8-4572-8e41-d4c5859036a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:57:02 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 02c75b00-a1b4-4ef9-ae96-bc67d8038589 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:57:02 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 7cb12b3e-de44-4887-ab74-2a68164b5f7d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:57:02 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 7171083a-00aa-4faf-9732-88cab8a0d83d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:57:02 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 9ec07c62-951b-4e3a-bffa-e01dfb4665ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:57:02 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 091e384f-7851-4ac9-b566-990df0497fc5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:57:02 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance c31a724f-3006-4e5d-a9b5-847fd6cd170a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:57:02 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 710f0d5a-8420-49c4-bf70-27305dd85bd3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:57:02 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance b001d812-892a-4756-9f37-fc0c5ef5f0a7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:57:02 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 1555ef29-8abe-43ca-ad2b-ac2f86180202 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:57:02 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 14:57:02 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 14:57:03 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:57:03 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:57:03 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Compute_service record updated for user:user {{(pid=70924) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 14:57:03 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.559s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:57:03 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:57:03 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Cleaning up deleted instances with incomplete migration  {{(pid=70924) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 29 14:57:03 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:57:05 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:57:05 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:57:05 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Starting heal instance info cache {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 14:57:05 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "refresh_cache-86ecc6cb-88a8-4572-8e41-d4c5859036a6" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:57:05 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquired lock "refresh_cache-86ecc6cb-88a8-4572-8e41-d4c5859036a6" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:57:05 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Forcefully refreshing network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 29 14:57:05 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Updating instance_info_cache with network_info: [{"id": "4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3", "address": "fa:16:3e:d6:b6:d3", "network": {"id": "55c18d07-a341-4678-9d1c-2dff057a9b1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1092921088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b33d01ba458f466b99b6bc5bba88d8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cd05bcc-ca", "ovs_interfaceid": "4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:57:05 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Releasing lock "refresh_cache-86ecc6cb-88a8-4572-8e41-d4c5859036a6" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:57:05 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Updated the network info_cache for instance {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 29 14:57:05 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:57:05 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:57:05 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:57:05 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:57:05 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:57:05 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70924) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 14:57:07 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:57:12 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._sync_power_states {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:57:12 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Triggering sync for uuid db656346-c4af-43da-9600-fd39f1b9e4dc {{(pid=70924) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 29 14:57:12 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Triggering sync for uuid 86ecc6cb-88a8-4572-8e41-d4c5859036a6 {{(pid=70924) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 29 14:57:12 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Triggering sync for uuid 02c75b00-a1b4-4ef9-ae96-bc67d8038589 {{(pid=70924) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 29 14:57:12 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Triggering sync for uuid 7cb12b3e-de44-4887-ab74-2a68164b5f7d {{(pid=70924) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 29 14:57:12 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Triggering sync for uuid 7171083a-00aa-4faf-9732-88cab8a0d83d {{(pid=70924) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 29 14:57:12 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Triggering sync for uuid 9ec07c62-951b-4e3a-bffa-e01dfb4665ec {{(pid=70924) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 29 14:57:12 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Triggering sync for uuid 091e384f-7851-4ac9-b566-990df0497fc5 {{(pid=70924) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 29 14:57:12 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Triggering sync for uuid c31a724f-3006-4e5d-a9b5-847fd6cd170a {{(pid=70924) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 29 14:57:12 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Triggering sync for uuid 710f0d5a-8420-49c4-bf70-27305dd85bd3 {{(pid=70924) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 29 14:57:12 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Triggering sync for uuid b001d812-892a-4756-9f37-fc0c5ef5f0a7 {{(pid=70924) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 29 14:57:12 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Triggering sync for uuid 1555ef29-8abe-43ca-ad2b-ac2f86180202 {{(pid=70924) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 29 14:57:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "db656346-c4af-43da-9600-fd39f1b9e4dc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:57:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "db656346-c4af-43da-9600-fd39f1b9e4dc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:57:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "86ecc6cb-88a8-4572-8e41-d4c5859036a6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:57:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "86ecc6cb-88a8-4572-8e41-d4c5859036a6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:57:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "02c75b00-a1b4-4ef9-ae96-bc67d8038589" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:57:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "02c75b00-a1b4-4ef9-ae96-bc67d8038589" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:57:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "7cb12b3e-de44-4887-ab74-2a68164b5f7d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:57:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "7cb12b3e-de44-4887-ab74-2a68164b5f7d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:57:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "7171083a-00aa-4faf-9732-88cab8a0d83d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:57:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "7171083a-00aa-4faf-9732-88cab8a0d83d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:57:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "9ec07c62-951b-4e3a-bffa-e01dfb4665ec" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:57:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "9ec07c62-951b-4e3a-bffa-e01dfb4665ec" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:57:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "091e384f-7851-4ac9-b566-990df0497fc5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:57:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "091e384f-7851-4ac9-b566-990df0497fc5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:57:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "c31a724f-3006-4e5d-a9b5-847fd6cd170a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:57:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "c31a724f-3006-4e5d-a9b5-847fd6cd170a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:57:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "710f0d5a-8420-49c4-bf70-27305dd85bd3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:57:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "710f0d5a-8420-49c4-bf70-27305dd85bd3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:57:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "b001d812-892a-4756-9f37-fc0c5ef5f0a7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:57:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "b001d812-892a-4756-9f37-fc0c5ef5f0a7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:57:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "1555ef29-8abe-43ca-ad2b-ac2f86180202" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:57:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "1555ef29-8abe-43ca-ad2b-ac2f86180202" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:57:12 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:57:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "02c75b00-a1b4-4ef9-ae96-bc67d8038589" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:57:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "db656346-c4af-43da-9600-fd39f1b9e4dc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:57:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "86ecc6cb-88a8-4572-8e41-d4c5859036a6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.051s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:57:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "7cb12b3e-de44-4887-ab74-2a68164b5f7d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:57:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "9ec07c62-951b-4e3a-bffa-e01dfb4665ec" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:57:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "7171083a-00aa-4faf-9732-88cab8a0d83d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:57:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "091e384f-7851-4ac9-b566-990df0497fc5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.065s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:57:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "c31a724f-3006-4e5d-a9b5-847fd6cd170a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.074s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:57:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "710f0d5a-8420-49c4-bf70-27305dd85bd3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.086s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:57:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "b001d812-892a-4756-9f37-fc0c5ef5f0a7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.086s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:57:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "1555ef29-8abe-43ca-ad2b-ac2f86180202" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.095s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:57:17 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:57:18 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:57:20 user nova-compute[70924]: DEBUG nova.compute.manager [req-9ff49bd3-5fb4-46a4-9aac-b832fd0a863f req-79b03d0b-3edf-4f62-9594-c160b9667987 service nova] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Received event network-changed-fa798159-0d64-40e0-8418-5889396f6a5f {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:57:20 user nova-compute[70924]: DEBUG nova.compute.manager [req-9ff49bd3-5fb4-46a4-9aac-b832fd0a863f req-79b03d0b-3edf-4f62-9594-c160b9667987 service nova] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Refreshing instance network info cache due to event network-changed-fa798159-0d64-40e0-8418-5889396f6a5f. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:57:20 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-9ff49bd3-5fb4-46a4-9aac-b832fd0a863f req-79b03d0b-3edf-4f62-9594-c160b9667987 service nova] Acquiring lock "refresh_cache-710f0d5a-8420-49c4-bf70-27305dd85bd3" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:57:20 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-9ff49bd3-5fb4-46a4-9aac-b832fd0a863f req-79b03d0b-3edf-4f62-9594-c160b9667987 service nova] Acquired lock "refresh_cache-710f0d5a-8420-49c4-bf70-27305dd85bd3" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:57:20 user nova-compute[70924]: DEBUG nova.network.neutron [req-9ff49bd3-5fb4-46a4-9aac-b832fd0a863f req-79b03d0b-3edf-4f62-9594-c160b9667987 service nova] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Refreshing network info cache for port fa798159-0d64-40e0-8418-5889396f6a5f {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:57:20 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:57:20 user nova-compute[70924]: DEBUG nova.network.neutron [req-9ff49bd3-5fb4-46a4-9aac-b832fd0a863f req-79b03d0b-3edf-4f62-9594-c160b9667987 service nova] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Updated VIF entry in instance network info cache for port fa798159-0d64-40e0-8418-5889396f6a5f. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:57:20 user nova-compute[70924]: DEBUG nova.network.neutron [req-9ff49bd3-5fb4-46a4-9aac-b832fd0a863f req-79b03d0b-3edf-4f62-9594-c160b9667987 service nova] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Updating instance_info_cache with network_info: [{"id": "fa798159-0d64-40e0-8418-5889396f6a5f", "address": "fa:16:3e:67:60:2e", "network": {"id": "21a19801-8526-40a2-9bcb-dda6cfb435fe", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-761511746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a03844d646454b6ea55e1b5625f7909a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa798159-0d", "ovs_interfaceid": "fa798159-0d64-40e0-8418-5889396f6a5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:57:20 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-9ff49bd3-5fb4-46a4-9aac-b832fd0a863f req-79b03d0b-3edf-4f62-9594-c160b9667987 service nova] Releasing lock "refresh_cache-710f0d5a-8420-49c4-bf70-27305dd85bd3" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:57:21 user nova-compute[70924]: DEBUG nova.compute.manager [req-8e444a96-e904-4425-afab-83bbede1cfbf req-1753f9f3-dd97-40c7-942c-bd7d2cd6b9f6 service nova] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Received event network-changed-fa798159-0d64-40e0-8418-5889396f6a5f {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:57:21 user nova-compute[70924]: DEBUG nova.compute.manager [req-8e444a96-e904-4425-afab-83bbede1cfbf req-1753f9f3-dd97-40c7-942c-bd7d2cd6b9f6 service nova] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Refreshing instance network info cache due to event network-changed-fa798159-0d64-40e0-8418-5889396f6a5f. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:57:21 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-8e444a96-e904-4425-afab-83bbede1cfbf req-1753f9f3-dd97-40c7-942c-bd7d2cd6b9f6 service nova] Acquiring lock "refresh_cache-710f0d5a-8420-49c4-bf70-27305dd85bd3" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:57:21 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-8e444a96-e904-4425-afab-83bbede1cfbf req-1753f9f3-dd97-40c7-942c-bd7d2cd6b9f6 service nova] Acquired lock "refresh_cache-710f0d5a-8420-49c4-bf70-27305dd85bd3" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:57:21 user nova-compute[70924]: DEBUG nova.network.neutron [req-8e444a96-e904-4425-afab-83bbede1cfbf req-1753f9f3-dd97-40c7-942c-bd7d2cd6b9f6 service nova] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Refreshing network info cache for port fa798159-0d64-40e0-8418-5889396f6a5f {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:57:21 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-51c785ce-bf3e-4306-9fd2-5385c97c5f85 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Acquiring lock "7171083a-00aa-4faf-9732-88cab8a0d83d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:57:21 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-51c785ce-bf3e-4306-9fd2-5385c97c5f85 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Lock "7171083a-00aa-4faf-9732-88cab8a0d83d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:57:21 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-51c785ce-bf3e-4306-9fd2-5385c97c5f85 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Acquiring lock "7171083a-00aa-4faf-9732-88cab8a0d83d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:57:21 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-51c785ce-bf3e-4306-9fd2-5385c97c5f85 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Lock "7171083a-00aa-4faf-9732-88cab8a0d83d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:57:21 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-51c785ce-bf3e-4306-9fd2-5385c97c5f85 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Lock "7171083a-00aa-4faf-9732-88cab8a0d83d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:57:21 user nova-compute[70924]: INFO nova.compute.manager [None req-51c785ce-bf3e-4306-9fd2-5385c97c5f85 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] Terminating instance
Jul 29 14:57:21 user nova-compute[70924]: DEBUG nova.compute.manager [None req-51c785ce-bf3e-4306-9fd2-5385c97c5f85 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] Start destroying the instance on the hypervisor. {{(pid=70924) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 14:57:21 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:57:21 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:57:21 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:57:21 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:57:21 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-e4335d51-6057-4dae-9844-3af303bc69b4 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Acquiring lock "710f0d5a-8420-49c4-bf70-27305dd85bd3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:57:21 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-e4335d51-6057-4dae-9844-3af303bc69b4 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lock "710f0d5a-8420-49c4-bf70-27305dd85bd3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:57:21 user nova-compute[70924]: INFO nova.compute.manager [None req-e4335d51-6057-4dae-9844-3af303bc69b4 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Detaching volume 3ac35b93-78b7-4614-a0c6-aa80496897e2
Jul 29 14:57:21 user nova-compute[70924]: INFO nova.virt.block_device [None req-e4335d51-6057-4dae-9844-3af303bc69b4 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Attempting to driver detach volume 3ac35b93-78b7-4614-a0c6-aa80496897e2 from mountpoint /dev/vdb
Jul 29 14:57:21 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-e4335d51-6057-4dae-9844-3af303bc69b4 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Attempting to detach device vdb from instance 710f0d5a-8420-49c4-bf70-27305dd85bd3 from the persistent domain config. {{(pid=70924) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 29 14:57:21 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-e4335d51-6057-4dae-9844-3af303bc69b4 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 14:57:21 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:57:21 user nova-compute[70924]:   <source dev="/dev/sdc"/>
Jul 29 14:57:21 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 14:57:21 user nova-compute[70924]:   <serial>3ac35b93-78b7-4614-a0c6-aa80496897e2</serial>
Jul 29 14:57:21 user nova-compute[70924]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 29 14:57:21 user nova-compute[70924]: </disk>
Jul 29 14:57:21 user nova-compute[70924]:  {{(pid=70924) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 14:57:21 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-e4335d51-6057-4dae-9844-3af303bc69b4 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Successfully detached device vdb from instance 710f0d5a-8420-49c4-bf70-27305dd85bd3 from the persistent domain config.
Jul 29 14:57:21 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-e4335d51-6057-4dae-9844-3af303bc69b4 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 710f0d5a-8420-49c4-bf70-27305dd85bd3 from the live domain config. {{(pid=70924) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 29 14:57:21 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-e4335d51-6057-4dae-9844-3af303bc69b4 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 14:57:21 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:57:21 user nova-compute[70924]:   <source dev="/dev/sdc"/>
Jul 29 14:57:21 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 14:57:21 user nova-compute[70924]:   <serial>3ac35b93-78b7-4614-a0c6-aa80496897e2</serial>
Jul 29 14:57:21 user nova-compute[70924]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 29 14:57:21 user nova-compute[70924]: </disk>
Jul 29 14:57:21 user nova-compute[70924]:  {{(pid=70924) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 14:57:21 user nova-compute[70924]: DEBUG nova.compute.manager [req-ccba745d-8aeb-4dae-b893-832716c79cda req-ec0bbebd-95d4-4a1c-9e2d-ed62f7d91416 service nova] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] Received event network-vif-unplugged-67386daa-d99b-4cd2-aec9-5df2b4d957f0 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:57:21 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-ccba745d-8aeb-4dae-b893-832716c79cda req-ec0bbebd-95d4-4a1c-9e2d-ed62f7d91416 service nova] Acquiring lock "7171083a-00aa-4faf-9732-88cab8a0d83d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:57:21 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-ccba745d-8aeb-4dae-b893-832716c79cda req-ec0bbebd-95d4-4a1c-9e2d-ed62f7d91416 service nova] Lock "7171083a-00aa-4faf-9732-88cab8a0d83d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:57:21 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-ccba745d-8aeb-4dae-b893-832716c79cda req-ec0bbebd-95d4-4a1c-9e2d-ed62f7d91416 service nova] Lock "7171083a-00aa-4faf-9732-88cab8a0d83d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:57:21 user nova-compute[70924]: DEBUG nova.compute.manager [req-ccba745d-8aeb-4dae-b893-832716c79cda req-ec0bbebd-95d4-4a1c-9e2d-ed62f7d91416 service nova] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] No waiting events found dispatching network-vif-unplugged-67386daa-d99b-4cd2-aec9-5df2b4d957f0 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:57:21 user nova-compute[70924]: DEBUG nova.compute.manager [req-ccba745d-8aeb-4dae-b893-832716c79cda req-ec0bbebd-95d4-4a1c-9e2d-ed62f7d91416 service nova] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] Received event network-vif-unplugged-67386daa-d99b-4cd2-aec9-5df2b4d957f0 for instance with task_state deleting. {{(pid=70924) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 14:57:21 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:57:21 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:57:21 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:57:21 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:57:22 user nova-compute[70924]: DEBUG nova.network.neutron [req-8e444a96-e904-4425-afab-83bbede1cfbf req-1753f9f3-dd97-40c7-942c-bd7d2cd6b9f6 service nova] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Updated VIF entry in instance network info cache for port fa798159-0d64-40e0-8418-5889396f6a5f. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:57:22 user nova-compute[70924]: DEBUG nova.network.neutron [req-8e444a96-e904-4425-afab-83bbede1cfbf req-1753f9f3-dd97-40c7-942c-bd7d2cd6b9f6 service nova] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Updating instance_info_cache with network_info: [{"id": "fa798159-0d64-40e0-8418-5889396f6a5f", "address": "fa:16:3e:67:60:2e", "network": {"id": "21a19801-8526-40a2-9bcb-dda6cfb435fe", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-761511746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a03844d646454b6ea55e1b5625f7909a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa798159-0d", "ovs_interfaceid": "fa798159-0d64-40e0-8418-5889396f6a5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:57:22 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-8e444a96-e904-4425-afab-83bbede1cfbf req-1753f9f3-dd97-40c7-942c-bd7d2cd6b9f6 service nova] Releasing lock "refresh_cache-710f0d5a-8420-49c4-bf70-27305dd85bd3" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:57:22 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Received event <DeviceRemovedEvent: 1690642642.2349322, 710f0d5a-8420-49c4-bf70-27305dd85bd3 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70924) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 29 14:57:22 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-e4335d51-6057-4dae-9844-3af303bc69b4 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 710f0d5a-8420-49c4-bf70-27305dd85bd3 {{(pid=70924) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 29 14:57:22 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-e4335d51-6057-4dae-9844-3af303bc69b4 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Successfully detached device vdb from instance 710f0d5a-8420-49c4-bf70-27305dd85bd3 from the live domain config.
Jul 29 14:57:22 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4335d51-6057-4dae-9844-3af303bc69b4 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] calling os-brick to detach iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 14:57:22 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4335d51-6057-4dae-9844-3af303bc69b4 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, {'target_iqns': ['iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dCGqnbFN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:57:22 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-e4335d51-6057-4dae-9844-3af303bc69b4 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:57:22 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-e4335d51-6057-4dae-9844-3af303bc69b4 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:57:22 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-e4335d51-6057-4dae-9844-3af303bc69b4 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:57:22 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4335d51-6057-4dae-9844-3af303bc69b4 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2', 0)] {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 14:57:22 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:57:22 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] Instance destroyed successfully.
Jul 29 14:57:22 user nova-compute[70924]: DEBUG nova.objects.instance [None req-51c785ce-bf3e-4306-9fd2-5385c97c5f85 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Lazy-loading 'resources' on Instance uuid 7171083a-00aa-4faf-9732-88cab8a0d83d {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:57:22 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:57:22 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0411dbe8-381b-46d0-91da-412477bc109b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:57:22 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:57:22 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-51c785ce-bf3e-4306-9fd2-5385c97c5f85 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:48:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1159256951',display_name='tempest-ServersNegativeTestJSON-server-1159256951',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1159256951',id=21,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:48:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8d5793d2e5b9451f9ef38fa61cb877d5',ramdisk_id='',reservation_id='r-7vcr36ib',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1209083119',owner_user_name='tempest-ServersNegativeTestJSON-1209083119-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:48:33Z,user_data=None,user_id='0fe49a3ddecb49d78f668df836df4ce8',uuid=7171083a-00aa-4faf-9732-88cab8a0d83d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "67386daa-d99b-4cd2-aec9-5df2b4d957f0", "address": "fa:16:3e:04:89:76", "network": {"id": "cb1ab4d5-0cba-4628-bca8-015a7acce83b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-875103426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d5793d2e5b9451f9ef38fa61cb877d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67386daa-d9", "ovs_interfaceid": "67386daa-d99b-4cd2-aec9-5df2b4d957f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 14:57:22 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-51c785ce-bf3e-4306-9fd2-5385c97c5f85 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Converting VIF {"id": "67386daa-d99b-4cd2-aec9-5df2b4d957f0", "address": "fa:16:3e:04:89:76", "network": {"id": "cb1ab4d5-0cba-4628-bca8-015a7acce83b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-875103426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d5793d2e5b9451f9ef38fa61cb877d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67386daa-d9", "ovs_interfaceid": "67386daa-d99b-4cd2-aec9-5df2b4d957f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:57:22 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-51c785ce-bf3e-4306-9fd2-5385c97c5f85 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:89:76,bridge_name='br-int',has_traffic_filtering=True,id=67386daa-d99b-4cd2-aec9-5df2b4d957f0,network=Network(cb1ab4d5-0cba-4628-bca8-015a7acce83b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67386daa-d9') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:57:22 user nova-compute[70924]: DEBUG os_vif [None req-51c785ce-bf3e-4306-9fd2-5385c97c5f85 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:89:76,bridge_name='br-int',has_traffic_filtering=True,id=67386daa-d99b-4cd2-aec9-5df2b4d957f0,network=Network(cb1ab4d5-0cba-4628-bca8-015a7acce83b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67386daa-d9') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 14:57:22 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:57:22 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap67386daa-d9, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:57:22 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:57:22 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:57:22 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[379d7c5d-7cf0-4a2c-a370-b23ffee3dd20]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:57:22 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4335d51-6057-4dae-9844-3af303bc69b4 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:57:22 user nova-compute[70924]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb (non-flash)
Jul 29 14:57:22 user nova-compute[70924]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2 (non-flash)
Jul 29 14:57:22 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:57:22 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4335d51-6057-4dae-9844-3af303bc69b4 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:57:22 user nova-compute[70924]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb (non-flash)
Jul 29 14:57:22 user nova-compute[70924]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2 (non-flash)
Jul 29 14:57:22 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:57:22 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4335d51-6057-4dae-9844-3af303bc69b4 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feee9a88d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2'): ({'sdc'}, set())}) {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 14:57:22 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-e4335d51-6057-4dae-9844-3af303bc69b4 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Removing single pathed devices sdc {{(pid=70924) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 14:57:22 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:57:22 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:57:22 user nova-compute[70924]: INFO os_vif [None req-51c785ce-bf3e-4306-9fd2-5385c97c5f85 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:89:76,bridge_name='br-int',has_traffic_filtering=True,id=67386daa-d99b-4cd2-aec9-5df2b4d957f0,network=Network(cb1ab4d5-0cba-4628-bca8-015a7acce83b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67386daa-d9')
Jul 29 14:57:22 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-51c785ce-bf3e-4306-9fd2-5385c97c5f85 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] Deleting instance files /opt/stack/data/nova/instances/7171083a-00aa-4faf-9732-88cab8a0d83d_del
Jul 29 14:57:22 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-51c785ce-bf3e-4306-9fd2-5385c97c5f85 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] Deletion of /opt/stack/data/nova/instances/7171083a-00aa-4faf-9732-88cab8a0d83d_del complete
Jul 29 14:57:22 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:57:22 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[22017e5e-1b94-4011-b60a-e7544ce566c7]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:57:22 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:57:22 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:57:22 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f00773-b010-41cf-9d75-e77e3c4dcb58]: (4, ('ok\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:57:22 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-e4335d51-6057-4dae-9844-3af303bc69b4 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Flushing IO for device /dev/sdc {{(pid=70924) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 14:57:22 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:57:22 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:57:22 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[512c7ae0-3796-4a66-b9e1-3a92f92a4498]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:57:22 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-e4335d51-6057-4dae-9844-3af303bc69b4 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70924) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 14:57:22 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:57:22 user nova-compute[70924]: INFO nova.compute.manager [None req-51c785ce-bf3e-4306-9fd2-5385c97c5f85 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] Took 1.37 seconds to destroy the instance on the hypervisor.
Jul 29 14:57:22 user nova-compute[70924]: DEBUG oslo.service.loopingcall [None req-51c785ce-bf3e-4306-9fd2-5385c97c5f85 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70924) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 14:57:22 user nova-compute[70924]: DEBUG nova.compute.manager [-] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] Deallocating network for instance {{(pid=70924) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 14:57:22 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] deallocate_for_instance() {{(pid=70924) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 14:57:22 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.055s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:57:22 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e23344-4183-441b-8164-a78525be0248]: (4, ('1', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:57:22 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-e4335d51-6057-4dae-9844-3af303bc69b4 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 14:57:22 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-e4335d51-6057-4dae-9844-3af303bc69b4 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] SCSI volumes sdc have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 14:57:22 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4335d51-6057-4dae-9844-3af303bc69b4 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2')] {{(pid=70924) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 14:57:22 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:57:22 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:57:22 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b1dbbf-9644-4b34-b693-40df2568e777]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:57:22 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4335d51-6057-4dae-9844-3af303bc69b4 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:57:22 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2 -p 172.16.0.220:3260 --logout {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:57:22 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:57:22 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3125b76-2c27-42f4-96f9-8731009218a3]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:57:22 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4335d51-6057-4dae-9844-3af303bc69b4 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2, portal: 172.16.0.220,3260]
Jul 29 14:57:22 user nova-compute[70924]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2, portal: 172.16.0.220,3260] successful.
Jul 29 14:57:22 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:57:22 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2 -p 172.16.0.220:3260 --op delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:57:22 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ac35b93-78b7-4614-a0c6-aa80496897e2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:57:22 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[59889f87-3888-4c17-a607-5261cd398ea6]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:57:22 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4335d51-6057-4dae-9844-3af303bc69b4 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:57:22 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-e4335d51-6057-4dae-9844-3af303bc69b4 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:57:22 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4335d51-6057-4dae-9844-3af303bc69b4 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] <== disconnect_volume: return (374ms) None {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:57:22 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4335d51-6057-4dae-9844-3af303bc69b4 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Disconnected iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 14:57:22 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:57:22 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:57:22 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:57:22 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:57:22 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:57:22 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:57:23 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:57:23 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] Took 1.08 seconds to deallocate network for instance.
Jul 29 14:57:23 user nova-compute[70924]: DEBUG nova.compute.manager [req-76f4aabb-a8bc-4aa1-ba22-b4c5c06beb96 req-006dfbb6-8fb3-4322-88b1-e9d9dca7b6ef service nova] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] Received event network-vif-plugged-67386daa-d99b-4cd2-aec9-5df2b4d957f0 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:57:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-76f4aabb-a8bc-4aa1-ba22-b4c5c06beb96 req-006dfbb6-8fb3-4322-88b1-e9d9dca7b6ef service nova] Acquiring lock "7171083a-00aa-4faf-9732-88cab8a0d83d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:57:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-76f4aabb-a8bc-4aa1-ba22-b4c5c06beb96 req-006dfbb6-8fb3-4322-88b1-e9d9dca7b6ef service nova] Lock "7171083a-00aa-4faf-9732-88cab8a0d83d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:57:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-76f4aabb-a8bc-4aa1-ba22-b4c5c06beb96 req-006dfbb6-8fb3-4322-88b1-e9d9dca7b6ef service nova] Lock "7171083a-00aa-4faf-9732-88cab8a0d83d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:57:23 user nova-compute[70924]: DEBUG nova.compute.manager [req-76f4aabb-a8bc-4aa1-ba22-b4c5c06beb96 req-006dfbb6-8fb3-4322-88b1-e9d9dca7b6ef service nova] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] No waiting events found dispatching network-vif-plugged-67386daa-d99b-4cd2-aec9-5df2b4d957f0 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:57:23 user nova-compute[70924]: WARNING nova.compute.manager [req-76f4aabb-a8bc-4aa1-ba22-b4c5c06beb96 req-006dfbb6-8fb3-4322-88b1-e9d9dca7b6ef service nova] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] Received unexpected event network-vif-plugged-67386daa-d99b-4cd2-aec9-5df2b4d957f0 for instance with vm_state active and task_state deleting.
Jul 29 14:57:23 user nova-compute[70924]: DEBUG nova.compute.manager [req-76f4aabb-a8bc-4aa1-ba22-b4c5c06beb96 req-006dfbb6-8fb3-4322-88b1-e9d9dca7b6ef service nova] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] Received event network-vif-plugged-67386daa-d99b-4cd2-aec9-5df2b4d957f0 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:57:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-76f4aabb-a8bc-4aa1-ba22-b4c5c06beb96 req-006dfbb6-8fb3-4322-88b1-e9d9dca7b6ef service nova] Acquiring lock "7171083a-00aa-4faf-9732-88cab8a0d83d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:57:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-76f4aabb-a8bc-4aa1-ba22-b4c5c06beb96 req-006dfbb6-8fb3-4322-88b1-e9d9dca7b6ef service nova] Lock "7171083a-00aa-4faf-9732-88cab8a0d83d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:57:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-76f4aabb-a8bc-4aa1-ba22-b4c5c06beb96 req-006dfbb6-8fb3-4322-88b1-e9d9dca7b6ef service nova] Lock "7171083a-00aa-4faf-9732-88cab8a0d83d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:57:23 user nova-compute[70924]: DEBUG nova.compute.manager [req-76f4aabb-a8bc-4aa1-ba22-b4c5c06beb96 req-006dfbb6-8fb3-4322-88b1-e9d9dca7b6ef service nova] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] No waiting events found dispatching network-vif-plugged-67386daa-d99b-4cd2-aec9-5df2b4d957f0 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:57:23 user nova-compute[70924]: WARNING nova.compute.manager [req-76f4aabb-a8bc-4aa1-ba22-b4c5c06beb96 req-006dfbb6-8fb3-4322-88b1-e9d9dca7b6ef service nova] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] Received unexpected event network-vif-plugged-67386daa-d99b-4cd2-aec9-5df2b4d957f0 for instance with vm_state active and task_state deleting.
Jul 29 14:57:23 user nova-compute[70924]: DEBUG nova.compute.manager [req-76f4aabb-a8bc-4aa1-ba22-b4c5c06beb96 req-006dfbb6-8fb3-4322-88b1-e9d9dca7b6ef service nova] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] Received event network-vif-plugged-67386daa-d99b-4cd2-aec9-5df2b4d957f0 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:57:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-76f4aabb-a8bc-4aa1-ba22-b4c5c06beb96 req-006dfbb6-8fb3-4322-88b1-e9d9dca7b6ef service nova] Acquiring lock "7171083a-00aa-4faf-9732-88cab8a0d83d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:57:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-76f4aabb-a8bc-4aa1-ba22-b4c5c06beb96 req-006dfbb6-8fb3-4322-88b1-e9d9dca7b6ef service nova] Lock "7171083a-00aa-4faf-9732-88cab8a0d83d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:57:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-76f4aabb-a8bc-4aa1-ba22-b4c5c06beb96 req-006dfbb6-8fb3-4322-88b1-e9d9dca7b6ef service nova] Lock "7171083a-00aa-4faf-9732-88cab8a0d83d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:57:23 user nova-compute[70924]: DEBUG nova.compute.manager [req-76f4aabb-a8bc-4aa1-ba22-b4c5c06beb96 req-006dfbb6-8fb3-4322-88b1-e9d9dca7b6ef service nova] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] No waiting events found dispatching network-vif-plugged-67386daa-d99b-4cd2-aec9-5df2b4d957f0 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:57:23 user nova-compute[70924]: WARNING nova.compute.manager [req-76f4aabb-a8bc-4aa1-ba22-b4c5c06beb96 req-006dfbb6-8fb3-4322-88b1-e9d9dca7b6ef service nova] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] Received unexpected event network-vif-plugged-67386daa-d99b-4cd2-aec9-5df2b4d957f0 for instance with vm_state active and task_state deleting.
Jul 29 14:57:23 user nova-compute[70924]: DEBUG nova.compute.manager [req-76f4aabb-a8bc-4aa1-ba22-b4c5c06beb96 req-006dfbb6-8fb3-4322-88b1-e9d9dca7b6ef service nova] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] Received event network-vif-unplugged-67386daa-d99b-4cd2-aec9-5df2b4d957f0 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:57:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-76f4aabb-a8bc-4aa1-ba22-b4c5c06beb96 req-006dfbb6-8fb3-4322-88b1-e9d9dca7b6ef service nova] Acquiring lock "7171083a-00aa-4faf-9732-88cab8a0d83d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:57:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-76f4aabb-a8bc-4aa1-ba22-b4c5c06beb96 req-006dfbb6-8fb3-4322-88b1-e9d9dca7b6ef service nova] Lock "7171083a-00aa-4faf-9732-88cab8a0d83d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:57:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-76f4aabb-a8bc-4aa1-ba22-b4c5c06beb96 req-006dfbb6-8fb3-4322-88b1-e9d9dca7b6ef service nova] Lock "7171083a-00aa-4faf-9732-88cab8a0d83d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:57:23 user nova-compute[70924]: DEBUG nova.compute.manager [req-76f4aabb-a8bc-4aa1-ba22-b4c5c06beb96 req-006dfbb6-8fb3-4322-88b1-e9d9dca7b6ef service nova] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] No waiting events found dispatching network-vif-unplugged-67386daa-d99b-4cd2-aec9-5df2b4d957f0 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:57:23 user nova-compute[70924]: DEBUG nova.compute.manager [req-76f4aabb-a8bc-4aa1-ba22-b4c5c06beb96 req-006dfbb6-8fb3-4322-88b1-e9d9dca7b6ef service nova] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] Received event network-vif-unplugged-67386daa-d99b-4cd2-aec9-5df2b4d957f0 for instance with task_state deleting. {{(pid=70924) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 14:57:23 user nova-compute[70924]: DEBUG nova.compute.manager [req-76f4aabb-a8bc-4aa1-ba22-b4c5c06beb96 req-006dfbb6-8fb3-4322-88b1-e9d9dca7b6ef service nova] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] Received event network-vif-deleted-67386daa-d99b-4cd2-aec9-5df2b4d957f0 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:57:23 user nova-compute[70924]: DEBUG nova.compute.manager [req-76f4aabb-a8bc-4aa1-ba22-b4c5c06beb96 req-006dfbb6-8fb3-4322-88b1-e9d9dca7b6ef service nova] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] Received event network-vif-plugged-67386daa-d99b-4cd2-aec9-5df2b4d957f0 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:57:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-76f4aabb-a8bc-4aa1-ba22-b4c5c06beb96 req-006dfbb6-8fb3-4322-88b1-e9d9dca7b6ef service nova] Acquiring lock "7171083a-00aa-4faf-9732-88cab8a0d83d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:57:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-76f4aabb-a8bc-4aa1-ba22-b4c5c06beb96 req-006dfbb6-8fb3-4322-88b1-e9d9dca7b6ef service nova] Lock "7171083a-00aa-4faf-9732-88cab8a0d83d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:57:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-76f4aabb-a8bc-4aa1-ba22-b4c5c06beb96 req-006dfbb6-8fb3-4322-88b1-e9d9dca7b6ef service nova] Lock "7171083a-00aa-4faf-9732-88cab8a0d83d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:57:23 user nova-compute[70924]: DEBUG nova.compute.manager [req-76f4aabb-a8bc-4aa1-ba22-b4c5c06beb96 req-006dfbb6-8fb3-4322-88b1-e9d9dca7b6ef service nova] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] No waiting events found dispatching network-vif-plugged-67386daa-d99b-4cd2-aec9-5df2b4d957f0 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:57:23 user nova-compute[70924]: WARNING nova.compute.manager [req-76f4aabb-a8bc-4aa1-ba22-b4c5c06beb96 req-006dfbb6-8fb3-4322-88b1-e9d9dca7b6ef service nova] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] Received unexpected event network-vif-plugged-67386daa-d99b-4cd2-aec9-5df2b4d957f0 for instance with vm_state active and task_state deleting.
Jul 29 14:57:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-51c785ce-bf3e-4306-9fd2-5385c97c5f85 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:57:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-51c785ce-bf3e-4306-9fd2-5385c97c5f85 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:57:23 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:57:23 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-51c785ce-bf3e-4306-9fd2-5385c97c5f85 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:57:23 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-51c785ce-bf3e-4306-9fd2-5385c97c5f85 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:57:24 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-51c785ce-bf3e-4306-9fd2-5385c97c5f85 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.385s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:57:24 user nova-compute[70924]: INFO nova.scheduler.client.report [None req-51c785ce-bf3e-4306-9fd2-5385c97c5f85 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Deleted allocations for instance 7171083a-00aa-4faf-9732-88cab8a0d83d
Jul 29 14:57:24 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-51c785ce-bf3e-4306-9fd2-5385c97c5f85 tempest-ServersNegativeTestJSON-1209083119 tempest-ServersNegativeTestJSON-1209083119-project-member] Lock "7171083a-00aa-4faf-9732-88cab8a0d83d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.052s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:57:25 user nova-compute[70924]: DEBUG nova.objects.instance [None req-e4335d51-6057-4dae-9844-3af303bc69b4 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lazy-loading 'flavor' on Instance uuid 710f0d5a-8420-49c4-bf70-27305dd85bd3 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:57:25 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-e4335d51-6057-4dae-9844-3af303bc69b4 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lock "710f0d5a-8420-49c4-bf70-27305dd85bd3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.974s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:57:26 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2fe6255e-3341-4ecd-9907-a6b362f0b37a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Acquiring lock "86ecc6cb-88a8-4572-8e41-d4c5859036a6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:57:26 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2fe6255e-3341-4ecd-9907-a6b362f0b37a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "86ecc6cb-88a8-4572-8e41-d4c5859036a6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:57:26 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2fe6255e-3341-4ecd-9907-a6b362f0b37a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Acquiring lock "86ecc6cb-88a8-4572-8e41-d4c5859036a6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:57:26 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2fe6255e-3341-4ecd-9907-a6b362f0b37a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "86ecc6cb-88a8-4572-8e41-d4c5859036a6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:57:26 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2fe6255e-3341-4ecd-9907-a6b362f0b37a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "86ecc6cb-88a8-4572-8e41-d4c5859036a6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:57:26 user nova-compute[70924]: INFO nova.compute.manager [None req-2fe6255e-3341-4ecd-9907-a6b362f0b37a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Terminating instance
Jul 29 14:57:26 user nova-compute[70924]: DEBUG nova.compute.manager [None req-2fe6255e-3341-4ecd-9907-a6b362f0b37a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Start destroying the instance on the hypervisor. {{(pid=70924) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 14:57:26 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:57:26 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:57:26 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:57:26 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:57:27 user nova-compute[70924]: DEBUG nova.compute.manager [req-1ff9f266-da92-4125-8356-0ecbb6f1f356 req-56e11c7c-dce5-4e2a-bd53-8cc5fda0769a service nova] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Received event network-vif-unplugged-4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:57:27 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-1ff9f266-da92-4125-8356-0ecbb6f1f356 req-56e11c7c-dce5-4e2a-bd53-8cc5fda0769a service nova] Acquiring lock "86ecc6cb-88a8-4572-8e41-d4c5859036a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:57:27 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-1ff9f266-da92-4125-8356-0ecbb6f1f356 req-56e11c7c-dce5-4e2a-bd53-8cc5fda0769a service nova] Lock "86ecc6cb-88a8-4572-8e41-d4c5859036a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:57:27 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-1ff9f266-da92-4125-8356-0ecbb6f1f356 req-56e11c7c-dce5-4e2a-bd53-8cc5fda0769a service nova] Lock "86ecc6cb-88a8-4572-8e41-d4c5859036a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:57:27 user nova-compute[70924]: DEBUG nova.compute.manager [req-1ff9f266-da92-4125-8356-0ecbb6f1f356 req-56e11c7c-dce5-4e2a-bd53-8cc5fda0769a service nova] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] No waiting events found dispatching network-vif-unplugged-4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:57:27 user nova-compute[70924]: DEBUG nova.compute.manager [req-1ff9f266-da92-4125-8356-0ecbb6f1f356 req-56e11c7c-dce5-4e2a-bd53-8cc5fda0769a service nova] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Received event network-vif-unplugged-4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3 for instance with task_state deleting. {{(pid=70924) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 14:57:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:57:27 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Instance destroyed successfully.
Jul 29 14:57:27 user nova-compute[70924]: DEBUG nova.objects.instance [None req-2fe6255e-3341-4ecd-9907-a6b362f0b37a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lazy-loading 'resources' on Instance uuid 86ecc6cb-88a8-4572-8e41-d4c5859036a6 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:57:27 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-2fe6255e-3341-4ecd-9907-a6b362f0b37a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-29T14:41:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2046651584',display_name='tempest-ServerActionsTestOtherA-server-413431300',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2046651584',id=5,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfg71Q+cjedfRarcbIler9POuKvX/jsQII2ANgknh6qTEvuHJAE8T34RCDfGUcAvd9SbwZCzhWP8ikNDBjVZKRBIySMsLhBLIX0hKsMOAV+S3aIT6/Yawicov1EmjAkDw==',key_name='tempest-keypair-1866871140',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:45:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b33d01ba458f466b99b6bc5bba88d8c0',ramdisk_id='',reservation_id='r-uso70bui',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-166265056',owner_user_name='tempest-ServerActionsTestOtherA-166265056-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:45:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55b9032bef2d4d3586dc5d18cdc1ee55',uuid=86ecc6cb-88a8-4572-8e41-d4c5859036a6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3", "address": "fa:16:3e:d6:b6:d3", "network": {"id": "55c18d07-a341-4678-9d1c-2dff057a9b1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1092921088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b33d01ba458f466b99b6bc5bba88d8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cd05bcc-ca", "ovs_interfaceid": "4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 14:57:27 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-2fe6255e-3341-4ecd-9907-a6b362f0b37a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Converting VIF {"id": "4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3", "address": "fa:16:3e:d6:b6:d3", "network": {"id": "55c18d07-a341-4678-9d1c-2dff057a9b1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1092921088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b33d01ba458f466b99b6bc5bba88d8c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cd05bcc-ca", "ovs_interfaceid": "4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:57:27 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-2fe6255e-3341-4ecd-9907-a6b362f0b37a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d6:b6:d3,bridge_name='br-int',has_traffic_filtering=True,id=4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3,network=Network(55c18d07-a341-4678-9d1c-2dff057a9b1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cd05bcc-ca') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:57:27 user nova-compute[70924]: DEBUG os_vif [None req-2fe6255e-3341-4ecd-9907-a6b362f0b37a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:b6:d3,bridge_name='br-int',has_traffic_filtering=True,id=4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3,network=Network(55c18d07-a341-4678-9d1c-2dff057a9b1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cd05bcc-ca') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 14:57:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:57:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4cd05bcc-ca, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:57:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:57:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:57:27 user nova-compute[70924]: INFO os_vif [None req-2fe6255e-3341-4ecd-9907-a6b362f0b37a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:b6:d3,bridge_name='br-int',has_traffic_filtering=True,id=4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3,network=Network(55c18d07-a341-4678-9d1c-2dff057a9b1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cd05bcc-ca')
Jul 29 14:57:27 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-2fe6255e-3341-4ecd-9907-a6b362f0b37a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Deleting instance files /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6_del
Jul 29 14:57:27 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-2fe6255e-3341-4ecd-9907-a6b362f0b37a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Deletion of /opt/stack/data/nova/instances/86ecc6cb-88a8-4572-8e41-d4c5859036a6_del complete
Jul 29 14:57:27 user nova-compute[70924]: INFO nova.compute.manager [None req-2fe6255e-3341-4ecd-9907-a6b362f0b37a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Took 0.89 seconds to destroy the instance on the hypervisor.
Jul 29 14:57:27 user nova-compute[70924]: DEBUG oslo.service.loopingcall [None req-2fe6255e-3341-4ecd-9907-a6b362f0b37a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70924) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 14:57:27 user nova-compute[70924]: DEBUG nova.compute.manager [-] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Deallocating network for instance {{(pid=70924) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 14:57:27 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] deallocate_for_instance() {{(pid=70924) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 14:57:28 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:57:28 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Took 0.74 seconds to deallocate network for instance.
Jul 29 14:57:28 user nova-compute[70924]: DEBUG nova.compute.manager [req-c19cc0c3-0867-4dc1-ad0a-88efa55eb7df req-f82dc4b7-0e0b-444d-a835-9dcf71d83f6b service nova] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Received event network-vif-deleted-4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:57:28 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2fe6255e-3341-4ecd-9907-a6b362f0b37a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:57:28 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2fe6255e-3341-4ecd-9907-a6b362f0b37a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:57:28 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-2fe6255e-3341-4ecd-9907-a6b362f0b37a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Refreshing inventories for resource provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 29 14:57:28 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-2fe6255e-3341-4ecd-9907-a6b362f0b37a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Updating ProviderTree inventory for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 29 14:57:28 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-2fe6255e-3341-4ecd-9907-a6b362f0b37a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Updating inventory in ProviderTree for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 29 14:57:28 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-2fe6255e-3341-4ecd-9907-a6b362f0b37a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Refreshing aggregate associations for resource provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832, aggregates: None {{(pid=70924) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 29 14:57:28 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-2fe6255e-3341-4ecd-9907-a6b362f0b37a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Refreshing trait associations for resource provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832, traits: COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=70924) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 29 14:57:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:57:28 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-2fe6255e-3341-4ecd-9907-a6b362f0b37a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:57:28 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-2fe6255e-3341-4ecd-9907-a6b362f0b37a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:57:29 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2fe6255e-3341-4ecd-9907-a6b362f0b37a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.603s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:57:29 user nova-compute[70924]: INFO nova.scheduler.client.report [None req-2fe6255e-3341-4ecd-9907-a6b362f0b37a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Deleted allocations for instance 86ecc6cb-88a8-4572-8e41-d4c5859036a6
Jul 29 14:57:29 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2fe6255e-3341-4ecd-9907-a6b362f0b37a tempest-ServerActionsTestOtherA-166265056 tempest-ServerActionsTestOtherA-166265056-project-member] Lock "86ecc6cb-88a8-4572-8e41-d4c5859036a6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.406s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:57:29 user nova-compute[70924]: DEBUG nova.compute.manager [req-8d9487db-7d2a-4321-ba58-bf4189738ff2 req-3bf9825f-0716-4827-a6a3-65fdd336959b service nova] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Received event network-vif-plugged-4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:57:29 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-8d9487db-7d2a-4321-ba58-bf4189738ff2 req-3bf9825f-0716-4827-a6a3-65fdd336959b service nova] Acquiring lock "86ecc6cb-88a8-4572-8e41-d4c5859036a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:57:29 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-8d9487db-7d2a-4321-ba58-bf4189738ff2 req-3bf9825f-0716-4827-a6a3-65fdd336959b service nova] Lock "86ecc6cb-88a8-4572-8e41-d4c5859036a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:57:29 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-8d9487db-7d2a-4321-ba58-bf4189738ff2 req-3bf9825f-0716-4827-a6a3-65fdd336959b service nova] Lock "86ecc6cb-88a8-4572-8e41-d4c5859036a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:57:29 user nova-compute[70924]: DEBUG nova.compute.manager [req-8d9487db-7d2a-4321-ba58-bf4189738ff2 req-3bf9825f-0716-4827-a6a3-65fdd336959b service nova] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] No waiting events found dispatching network-vif-plugged-4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:57:29 user nova-compute[70924]: WARNING nova.compute.manager [req-8d9487db-7d2a-4321-ba58-bf4189738ff2 req-3bf9825f-0716-4827-a6a3-65fdd336959b service nova] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Received unexpected event network-vif-plugged-4cd05bcc-ca9f-44ac-b798-c0b1e0adf9e3 for instance with vm_state deleted and task_state None.
Jul 29 14:57:32 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:57:33 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:57:37 user nova-compute[70924]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690642642.2544787, 7171083a-00aa-4faf-9732-88cab8a0d83d => Stopped> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:57:37 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] VM Stopped (Lifecycle Event)
Jul 29 14:57:37 user nova-compute[70924]: DEBUG nova.compute.manager [None req-2eb4fe20-e8c0-40e7-ad8b-b2470b448526 None None] [instance: 7171083a-00aa-4faf-9732-88cab8a0d83d] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:57:37 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:57:42 user nova-compute[70924]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690642647.467601, 86ecc6cb-88a8-4572-8e41-d4c5859036a6 => Stopped> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:57:42 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] VM Stopped (Lifecycle Event)
Jul 29 14:57:42 user nova-compute[70924]: DEBUG nova.compute.manager [None req-2d21e484-8846-464b-8b2b-76b80478b871 None None] [instance: 86ecc6cb-88a8-4572-8e41-d4c5859036a6] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:57:42 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:57:43 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-629dbec5-437f-47e3-806c-e41fcdf1b08c tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Acquiring lock "7cb12b3e-de44-4887-ab74-2a68164b5f7d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:57:43 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-629dbec5-437f-47e3-806c-e41fcdf1b08c tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "7cb12b3e-de44-4887-ab74-2a68164b5f7d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:57:43 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-629dbec5-437f-47e3-806c-e41fcdf1b08c tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Acquiring lock "7cb12b3e-de44-4887-ab74-2a68164b5f7d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:57:43 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-629dbec5-437f-47e3-806c-e41fcdf1b08c tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "7cb12b3e-de44-4887-ab74-2a68164b5f7d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:57:43 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-629dbec5-437f-47e3-806c-e41fcdf1b08c tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "7cb12b3e-de44-4887-ab74-2a68164b5f7d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:57:43 user nova-compute[70924]: INFO nova.compute.manager [None req-629dbec5-437f-47e3-806c-e41fcdf1b08c tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Terminating instance
Jul 29 14:57:43 user nova-compute[70924]: DEBUG nova.compute.manager [None req-629dbec5-437f-47e3-806c-e41fcdf1b08c tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Start destroying the instance on the hypervisor. {{(pid=70924) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 14:57:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:57:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:57:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:57:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:57:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:57:44 user nova-compute[70924]: DEBUG nova.compute.manager [req-8643edbe-4595-4104-ac67-a4c32a58704a req-47c8ae4d-77a7-4a23-a233-077c3e2c74e9 service nova] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Received event network-vif-unplugged-e41d642f-f559-4294-b5ff-5ec478fb3438 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:57:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-8643edbe-4595-4104-ac67-a4c32a58704a req-47c8ae4d-77a7-4a23-a233-077c3e2c74e9 service nova] Acquiring lock "7cb12b3e-de44-4887-ab74-2a68164b5f7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:57:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-8643edbe-4595-4104-ac67-a4c32a58704a req-47c8ae4d-77a7-4a23-a233-077c3e2c74e9 service nova] Lock "7cb12b3e-de44-4887-ab74-2a68164b5f7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:57:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-8643edbe-4595-4104-ac67-a4c32a58704a req-47c8ae4d-77a7-4a23-a233-077c3e2c74e9 service nova] Lock "7cb12b3e-de44-4887-ab74-2a68164b5f7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:57:44 user nova-compute[70924]: DEBUG nova.compute.manager [req-8643edbe-4595-4104-ac67-a4c32a58704a req-47c8ae4d-77a7-4a23-a233-077c3e2c74e9 service nova] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] No waiting events found dispatching network-vif-unplugged-e41d642f-f559-4294-b5ff-5ec478fb3438 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:57:44 user nova-compute[70924]: DEBUG nova.compute.manager [req-8643edbe-4595-4104-ac67-a4c32a58704a req-47c8ae4d-77a7-4a23-a233-077c3e2c74e9 service nova] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Received event network-vif-unplugged-e41d642f-f559-4294-b5ff-5ec478fb3438 for instance with task_state deleting. {{(pid=70924) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 14:57:44 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Instance destroyed successfully.
Jul 29 14:57:44 user nova-compute[70924]: DEBUG nova.objects.instance [None req-629dbec5-437f-47e3-806c-e41fcdf1b08c tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lazy-loading 'resources' on Instance uuid 7cb12b3e-de44-4887-ab74-2a68164b5f7d {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:57:44 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-629dbec5-437f-47e3-806c-e41fcdf1b08c tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:48:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1090583774',display_name='tempest-AttachVolumeTestJSON-server-1090583774',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1090583774',id=20,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxYeAuUdgBDENKjW9KGfUkDITpquweWjsClM8apGgMwschv+svyuQ0OvGCeunIrF1Cf2sPzGMDx0GWfQ+3b5oeX2ZZAH8S+9X0B99z5roSd+MxfrhgBDxbU7z4pZrnyqA==',key_name='tempest-keypair-571943859',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:48:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a0388bcf487e492082e85b183f38765c',ramdisk_id='',reservation_id='r-4dtac58j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-651630277',owner_user_name='tempest-AttachVolumeTestJSON-651630277-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:55:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='761e4287afb94bf4ad93c09a43bada1f',uuid=7cb12b3e-de44-4887-ab74-2a68164b5f7d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e41d642f-f559-4294-b5ff-5ec478fb3438", "address": "fa:16:3e:f7:ee:73", "network": {"id": "46d2cfde-13db-4cf3-af0e-4d6742f37044", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1642265305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0388bcf487e492082e85b183f38765c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape41d642f-f5", "ovs_interfaceid": "e41d642f-f559-4294-b5ff-5ec478fb3438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 14:57:44 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-629dbec5-437f-47e3-806c-e41fcdf1b08c tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Converting VIF {"id": "e41d642f-f559-4294-b5ff-5ec478fb3438", "address": "fa:16:3e:f7:ee:73", "network": {"id": "46d2cfde-13db-4cf3-af0e-4d6742f37044", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1642265305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0388bcf487e492082e85b183f38765c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape41d642f-f5", "ovs_interfaceid": "e41d642f-f559-4294-b5ff-5ec478fb3438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:57:44 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-629dbec5-437f-47e3-806c-e41fcdf1b08c tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:ee:73,bridge_name='br-int',has_traffic_filtering=True,id=e41d642f-f559-4294-b5ff-5ec478fb3438,network=Network(46d2cfde-13db-4cf3-af0e-4d6742f37044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape41d642f-f5') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:57:44 user nova-compute[70924]: DEBUG os_vif [None req-629dbec5-437f-47e3-806c-e41fcdf1b08c tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:ee:73,bridge_name='br-int',has_traffic_filtering=True,id=e41d642f-f559-4294-b5ff-5ec478fb3438,network=Network(46d2cfde-13db-4cf3-af0e-4d6742f37044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape41d642f-f5') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 14:57:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:57:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape41d642f-f5, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:57:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:57:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:57:44 user nova-compute[70924]: INFO os_vif [None req-629dbec5-437f-47e3-806c-e41fcdf1b08c tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:ee:73,bridge_name='br-int',has_traffic_filtering=True,id=e41d642f-f559-4294-b5ff-5ec478fb3438,network=Network(46d2cfde-13db-4cf3-af0e-4d6742f37044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape41d642f-f5')
Jul 29 14:57:44 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-629dbec5-437f-47e3-806c-e41fcdf1b08c tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Deleting instance files /opt/stack/data/nova/instances/7cb12b3e-de44-4887-ab74-2a68164b5f7d_del
Jul 29 14:57:44 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-629dbec5-437f-47e3-806c-e41fcdf1b08c tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Deletion of /opt/stack/data/nova/instances/7cb12b3e-de44-4887-ab74-2a68164b5f7d_del complete
Jul 29 14:57:44 user nova-compute[70924]: INFO nova.compute.manager [None req-629dbec5-437f-47e3-806c-e41fcdf1b08c tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Took 0.88 seconds to destroy the instance on the hypervisor.
Jul 29 14:57:44 user nova-compute[70924]: DEBUG oslo.service.loopingcall [None req-629dbec5-437f-47e3-806c-e41fcdf1b08c tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70924) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 14:57:44 user nova-compute[70924]: DEBUG nova.compute.manager [-] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Deallocating network for instance {{(pid=70924) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 14:57:44 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] deallocate_for_instance() {{(pid=70924) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 14:57:45 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:57:45 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Took 0.82 seconds to deallocate network for instance.
Jul 29 14:57:45 user nova-compute[70924]: DEBUG nova.compute.manager [req-eaf1f308-6225-4203-833e-834fcbf288c2 req-4345f381-7bbc-48e0-8a9d-81591617fa76 service nova] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Received event network-vif-deleted-e41d642f-f559-4294-b5ff-5ec478fb3438 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:57:45 user nova-compute[70924]: INFO nova.compute.manager [req-eaf1f308-6225-4203-833e-834fcbf288c2 req-4345f381-7bbc-48e0-8a9d-81591617fa76 service nova] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Neutron deleted interface e41d642f-f559-4294-b5ff-5ec478fb3438; detaching it from the instance and deleting it from the info cache
Jul 29 14:57:45 user nova-compute[70924]: DEBUG nova.network.neutron [req-eaf1f308-6225-4203-833e-834fcbf288c2 req-4345f381-7bbc-48e0-8a9d-81591617fa76 service nova] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:57:45 user nova-compute[70924]: DEBUG nova.compute.manager [req-eaf1f308-6225-4203-833e-834fcbf288c2 req-4345f381-7bbc-48e0-8a9d-81591617fa76 service nova] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Detach interface failed, port_id=e41d642f-f559-4294-b5ff-5ec478fb3438, reason: Instance 7cb12b3e-de44-4887-ab74-2a68164b5f7d could not be found. {{(pid=70924) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 29 14:57:45 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-629dbec5-437f-47e3-806c-e41fcdf1b08c tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:57:45 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-629dbec5-437f-47e3-806c-e41fcdf1b08c tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:57:45 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-629dbec5-437f-47e3-806c-e41fcdf1b08c tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:57:45 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-629dbec5-437f-47e3-806c-e41fcdf1b08c tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:57:45 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-629dbec5-437f-47e3-806c-e41fcdf1b08c tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.413s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:57:45 user nova-compute[70924]: INFO nova.scheduler.client.report [None req-629dbec5-437f-47e3-806c-e41fcdf1b08c tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Deleted allocations for instance 7cb12b3e-de44-4887-ab74-2a68164b5f7d
Jul 29 14:57:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-629dbec5-437f-47e3-806c-e41fcdf1b08c tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "7cb12b3e-de44-4887-ab74-2a68164b5f7d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.295s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:57:46 user nova-compute[70924]: DEBUG nova.compute.manager [req-b5c9fbdb-d480-4970-9ff6-1bed58c24700 req-d1180575-0626-4d43-b8f4-c05f6d249ee8 service nova] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Received event network-vif-plugged-e41d642f-f559-4294-b5ff-5ec478fb3438 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:57:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b5c9fbdb-d480-4970-9ff6-1bed58c24700 req-d1180575-0626-4d43-b8f4-c05f6d249ee8 service nova] Acquiring lock "7cb12b3e-de44-4887-ab74-2a68164b5f7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:57:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b5c9fbdb-d480-4970-9ff6-1bed58c24700 req-d1180575-0626-4d43-b8f4-c05f6d249ee8 service nova] Lock "7cb12b3e-de44-4887-ab74-2a68164b5f7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:57:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b5c9fbdb-d480-4970-9ff6-1bed58c24700 req-d1180575-0626-4d43-b8f4-c05f6d249ee8 service nova] Lock "7cb12b3e-de44-4887-ab74-2a68164b5f7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:57:46 user nova-compute[70924]: DEBUG nova.compute.manager [req-b5c9fbdb-d480-4970-9ff6-1bed58c24700 req-d1180575-0626-4d43-b8f4-c05f6d249ee8 service nova] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] No waiting events found dispatching network-vif-plugged-e41d642f-f559-4294-b5ff-5ec478fb3438 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:57:46 user nova-compute[70924]: WARNING nova.compute.manager [req-b5c9fbdb-d480-4970-9ff6-1bed58c24700 req-d1180575-0626-4d43-b8f4-c05f6d249ee8 service nova] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Received unexpected event network-vif-plugged-e41d642f-f559-4294-b5ff-5ec478fb3438 for instance with vm_state deleted and task_state None.
Jul 29 14:57:49 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:57:54 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:57:54 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:57:56 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:57:56 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:57:56 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:57:56 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:57:56 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:57:56 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Auditing locally available compute resources for user (node: user) {{(pid=70924) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 14:57:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk.rescue --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:57:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:57:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk.rescue --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:57:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:57:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:57:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:57:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:57:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:57:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c31a724f-3006-4e5d-a9b5-847fd6cd170a/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:57:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c31a724f-3006-4e5d-a9b5-847fd6cd170a/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:57:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c31a724f-3006-4e5d-a9b5-847fd6cd170a/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:57:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c31a724f-3006-4e5d-a9b5-847fd6cd170a/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:57:57 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 14:57:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:57:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:57:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:57:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:57:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710f0d5a-8420-49c4-bf70-27305dd85bd3/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:57:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710f0d5a-8420-49c4-bf70-27305dd85bd3/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:57:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710f0d5a-8420-49c4-bf70-27305dd85bd3/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:57:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710f0d5a-8420-49c4-bf70-27305dd85bd3/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:57:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1555ef29-8abe-43ca-ad2b-ac2f86180202/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:57:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1555ef29-8abe-43ca-ad2b-ac2f86180202/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:57:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1555ef29-8abe-43ca-ad2b-ac2f86180202/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:57:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1555ef29-8abe-43ca-ad2b-ac2f86180202/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:57:58 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 14:57:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:57:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:57:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:57:58 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Acquiring lock "f3f7eeda-a001-4c35-abeb-e459d701bd93" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:57:58 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "f3f7eeda-a001-4c35-abeb-e459d701bd93" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:57:58 user nova-compute[70924]: DEBUG nova.compute.manager [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Starting instance... {{(pid=70924) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 14:57:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:57:58 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:57:58 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:57:59 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70924) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 14:57:59 user nova-compute[70924]: INFO nova.compute.claims [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Claim successful on node user
Jul 29 14:57:59 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:57:59 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:57:59 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Hypervisor/Node resource view: name=user free_ram=7730MB free_disk=25.18207550048828GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70924) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 14:57:59 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:57:59 user nova-compute[70924]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690642664.4839993, 7cb12b3e-de44-4887-ab74-2a68164b5f7d => Stopped> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:57:59 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] VM Stopped (Lifecycle Event)
Jul 29 14:57:59 user nova-compute[70924]: DEBUG nova.compute.manager [None req-37a2d21a-d40a-447e-bbbd-47fc390063e0 None None] [instance: 7cb12b3e-de44-4887-ab74-2a68164b5f7d] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:57:59 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:57:59 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:57:59 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:57:59 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.843s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:57:59 user nova-compute[70924]: DEBUG nova.compute.manager [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Start building networks asynchronously for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 14:57:59 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.424s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:57:59 user nova-compute[70924]: DEBUG nova.compute.manager [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Allocating IP information in the background. {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 14:57:59 user nova-compute[70924]: DEBUG nova.network.neutron [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] allocate_for_instance() {{(pid=70924) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 14:57:59 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 14:57:59 user nova-compute[70924]: DEBUG nova.compute.manager [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Start building block device mappings for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 14:57:59 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance db656346-c4af-43da-9600-fd39f1b9e4dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:57:59 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 02c75b00-a1b4-4ef9-ae96-bc67d8038589 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:57:59 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 9ec07c62-951b-4e3a-bffa-e01dfb4665ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:57:59 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 091e384f-7851-4ac9-b566-990df0497fc5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:57:59 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance c31a724f-3006-4e5d-a9b5-847fd6cd170a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:57:59 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 710f0d5a-8420-49c4-bf70-27305dd85bd3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:57:59 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance b001d812-892a-4756-9f37-fc0c5ef5f0a7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:57:59 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 1555ef29-8abe-43ca-ad2b-ac2f86180202 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:57:59 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance f3f7eeda-a001-4c35-abeb-e459d701bd93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:57:59 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 14:57:59 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 14:57:59 user nova-compute[70924]: DEBUG nova.policy [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8ec7e735cfff48828e0c0c7618f50711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fcf4644e7a24bf68b407be2e3d9732c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70924) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 14:57:59 user nova-compute[70924]: DEBUG nova.compute.manager [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Start spawning the instance on the hypervisor. {{(pid=70924) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 14:57:59 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Creating instance directory {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 14:57:59 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Creating image(s)
Jul 29 14:57:59 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Acquiring lock "/opt/stack/data/nova/instances/f3f7eeda-a001-4c35-abeb-e459d701bd93/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:57:59 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "/opt/stack/data/nova/instances/f3f7eeda-a001-4c35-abeb-e459d701bd93/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:57:59 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "/opt/stack/data/nova/instances/f3f7eeda-a001-4c35-abeb-e459d701bd93/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:57:59 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:58:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.168s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:58:00 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Acquiring lock "bd72453517468710f1de26b27fb0ea28688e9009" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:58:00 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:58:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:58:00 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:58:00 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:58:00 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Compute_service record updated for user:user {{(pid=70924) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 14:58:00 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.605s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:58:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.170s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:58:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/f3f7eeda-a001-4c35-abeb-e459d701bd93/disk 1073741824 {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:58:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/f3f7eeda-a001-4c35-abeb-e459d701bd93/disk 1073741824" returned: 0 in 0.055s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:58:00 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:58:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:58:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.144s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:58:00 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f3f7eeda-a001-4c35-abeb-e459d701bd93/disk. size=1073741824 {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 14:58:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f7eeda-a001-4c35-abeb-e459d701bd93/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:58:00 user nova-compute[70924]: DEBUG nova.network.neutron [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Successfully created port: eafccd28-f902-4bc2-805e-4d2f8bbd4e82 {{(pid=70924) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 14:58:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f7eeda-a001-4c35-abeb-e459d701bd93/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:58:00 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Cannot resize image /opt/stack/data/nova/instances/f3f7eeda-a001-4c35-abeb-e459d701bd93/disk to a smaller size. {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 14:58:00 user nova-compute[70924]: DEBUG nova.objects.instance [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lazy-loading 'migration_context' on Instance uuid f3f7eeda-a001-4c35-abeb-e459d701bd93 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:58:00 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Created local disks {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 14:58:00 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Ensure instance console log exists: /opt/stack/data/nova/instances/f3f7eeda-a001-4c35-abeb-e459d701bd93/console.log {{(pid=70924) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 14:58:00 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:58:00 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:58:00 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:58:01 user nova-compute[70924]: DEBUG nova.network.neutron [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Successfully updated port: eafccd28-f902-4bc2-805e-4d2f8bbd4e82 {{(pid=70924) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 14:58:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Acquiring lock "refresh_cache-f3f7eeda-a001-4c35-abeb-e459d701bd93" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:58:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Acquired lock "refresh_cache-f3f7eeda-a001-4c35-abeb-e459d701bd93" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:58:01 user nova-compute[70924]: DEBUG nova.network.neutron [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 14:58:01 user nova-compute[70924]: DEBUG nova.compute.manager [req-559ec474-b530-4600-91fa-3796b37ad0ce req-d97e6619-13a1-4069-91c8-7a4673c196b2 service nova] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Received event network-changed-eafccd28-f902-4bc2-805e-4d2f8bbd4e82 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:58:01 user nova-compute[70924]: DEBUG nova.compute.manager [req-559ec474-b530-4600-91fa-3796b37ad0ce req-d97e6619-13a1-4069-91c8-7a4673c196b2 service nova] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Refreshing instance network info cache due to event network-changed-eafccd28-f902-4bc2-805e-4d2f8bbd4e82. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:58:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-559ec474-b530-4600-91fa-3796b37ad0ce req-d97e6619-13a1-4069-91c8-7a4673c196b2 service nova] Acquiring lock "refresh_cache-f3f7eeda-a001-4c35-abeb-e459d701bd93" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:58:01 user nova-compute[70924]: DEBUG nova.network.neutron [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Instance cache missing network info. {{(pid=70924) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 14:58:01 user nova-compute[70924]: DEBUG nova.network.neutron [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Updating instance_info_cache with network_info: [{"id": "eafccd28-f902-4bc2-805e-4d2f8bbd4e82", "address": "fa:16:3e:9f:ec:06", "network": {"id": "b2aee530-d195-47bb-b39d-c8bd15b81a08", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-421022738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcf4644e7a24bf68b407be2e3d9732c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeafccd28-f9", "ovs_interfaceid": "eafccd28-f902-4bc2-805e-4d2f8bbd4e82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:58:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Releasing lock "refresh_cache-f3f7eeda-a001-4c35-abeb-e459d701bd93" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:58:01 user nova-compute[70924]: DEBUG nova.compute.manager [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Instance network_info: |[{"id": "eafccd28-f902-4bc2-805e-4d2f8bbd4e82", "address": "fa:16:3e:9f:ec:06", "network": {"id": "b2aee530-d195-47bb-b39d-c8bd15b81a08", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-421022738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcf4644e7a24bf68b407be2e3d9732c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeafccd28-f9", "ovs_interfaceid": "eafccd28-f902-4bc2-805e-4d2f8bbd4e82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 14:58:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-559ec474-b530-4600-91fa-3796b37ad0ce req-d97e6619-13a1-4069-91c8-7a4673c196b2 service nova] Acquired lock "refresh_cache-f3f7eeda-a001-4c35-abeb-e459d701bd93" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:58:01 user nova-compute[70924]: DEBUG nova.network.neutron [req-559ec474-b530-4600-91fa-3796b37ad0ce req-d97e6619-13a1-4069-91c8-7a4673c196b2 service nova] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Refreshing network info cache for port eafccd28-f902-4bc2-805e-4d2f8bbd4e82 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:58:01 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Start _get_guest_xml network_info=[{"id": "eafccd28-f902-4bc2-805e-4d2f8bbd4e82", "address": "fa:16:3e:9f:ec:06", "network": {"id": "b2aee530-d195-47bb-b39d-c8bd15b81a08", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-421022738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcf4644e7a24bf68b407be2e3d9732c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeafccd28-f9", "ovs_interfaceid": "eafccd28-f902-4bc2-805e-4d2f8bbd4e82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '3aba2e73-6832-404b-8bd0-d0503ce82b8c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 14:58:01 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:58:01 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:58:01 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 14:58:01 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] CPU controller missing on host. {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 14:58:01 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 14:58:01 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] CPU controller found on host. {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 14:58:01 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70924) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 14:58:01 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T14:36:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 14:58:01 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Flavor limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 14:58:01 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Image limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 14:58:01 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Flavor pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 14:58:01 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Image pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 14:58:01 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 14:58:01 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 14:58:01 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 14:58:01 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Got 1 possible topologies {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 14:58:01 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 14:58:01 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 14:58:01 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:57:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-860009977',display_name='tempest-ServerRescueNegativeTestJSON-server-860009977',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-860009977',id=33,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYYUTKa/Li7BbPVzmg4ve1vgvH0FEhtwS0gOMqeRhUXC/Ag9zhCHxbsh4O9uwMJ9PeS5iqh/+F1q/DOCjXtppVcKojs97MuEkw+mKkCC6PAntsB1yiqhawyIRrJr7Iulg==',key_name='tempest-keypair-1342138702',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8fcf4644e7a24bf68b407be2e3d9732c',ramdisk_id='',reservation_id='r-mz1wzk08',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1436708078',owner_user_name='tempest-ServerRescueNegativeTestJSON-1436708078-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:58:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ec7e735cfff48828e0c0c7618f50711',uuid=f3f7eeda-a001-4c35-abeb-e459d701bd93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eafccd28-f902-4bc2-805e-4d2f8bbd4e82", "address": "fa:16:3e:9f:ec:06", "network": {"id": "b2aee530-d195-47bb-b39d-c8bd15b81a08", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-421022738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcf4644e7a24bf68b407be2e3d9732c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeafccd28-f9", "ovs_interfaceid": "eafccd28-f902-4bc2-805e-4d2f8bbd4e82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:58:01 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Converting VIF {"id": "eafccd28-f902-4bc2-805e-4d2f8bbd4e82", "address": "fa:16:3e:9f:ec:06", "network": {"id": "b2aee530-d195-47bb-b39d-c8bd15b81a08", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-421022738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcf4644e7a24bf68b407be2e3d9732c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeafccd28-f9", "ovs_interfaceid": "eafccd28-f902-4bc2-805e-4d2f8bbd4e82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:58:01 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:ec:06,bridge_name='br-int',has_traffic_filtering=True,id=eafccd28-f902-4bc2-805e-4d2f8bbd4e82,network=Network(b2aee530-d195-47bb-b39d-c8bd15b81a08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeafccd28-f9') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:58:01 user nova-compute[70924]: DEBUG nova.objects.instance [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lazy-loading 'pci_devices' on Instance uuid f3f7eeda-a001-4c35-abeb-e459d701bd93 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:58:01 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] End _get_guest_xml xml=<domain type="kvm">
Jul 29 14:58:01 user nova-compute[70924]:   <uuid>f3f7eeda-a001-4c35-abeb-e459d701bd93</uuid>
Jul 29 14:58:01 user nova-compute[70924]:   <name>instance-00000021</name>
Jul 29 14:58:01 user nova-compute[70924]:   <memory>524288</memory>
Jul 29 14:58:01 user nova-compute[70924]:   <vcpu>1</vcpu>
Jul 29 14:58:01 user nova-compute[70924]:   <metadata>
Jul 29 14:58:01 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 14:58:01 user nova-compute[70924]:       <nova:package version="0.0.0"/>
Jul 29 14:58:01 user nova-compute[70924]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-860009977</nova:name>
Jul 29 14:58:01 user nova-compute[70924]:       <nova:creationTime>2023-07-29 14:58:01</nova:creationTime>
Jul 29 14:58:01 user nova-compute[70924]:       <nova:flavor name="m1.tiny">
Jul 29 14:58:01 user nova-compute[70924]:         <nova:memory>512</nova:memory>
Jul 29 14:58:01 user nova-compute[70924]:         <nova:disk>1</nova:disk>
Jul 29 14:58:01 user nova-compute[70924]:         <nova:swap>0</nova:swap>
Jul 29 14:58:01 user nova-compute[70924]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 14:58:01 user nova-compute[70924]:         <nova:vcpus>1</nova:vcpus>
Jul 29 14:58:01 user nova-compute[70924]:       </nova:flavor>
Jul 29 14:58:01 user nova-compute[70924]:       <nova:owner>
Jul 29 14:58:01 user nova-compute[70924]:         <nova:user uuid="8ec7e735cfff48828e0c0c7618f50711">tempest-ServerRescueNegativeTestJSON-1436708078-project-member</nova:user>
Jul 29 14:58:01 user nova-compute[70924]:         <nova:project uuid="8fcf4644e7a24bf68b407be2e3d9732c">tempest-ServerRescueNegativeTestJSON-1436708078</nova:project>
Jul 29 14:58:01 user nova-compute[70924]:       </nova:owner>
Jul 29 14:58:01 user nova-compute[70924]:       <nova:root type="image" uuid="3aba2e73-6832-404b-8bd0-d0503ce82b8c"/>
Jul 29 14:58:01 user nova-compute[70924]:       <nova:ports>
Jul 29 14:58:01 user nova-compute[70924]:         <nova:port uuid="eafccd28-f902-4bc2-805e-4d2f8bbd4e82">
Jul 29 14:58:01 user nova-compute[70924]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 29 14:58:01 user nova-compute[70924]:         </nova:port>
Jul 29 14:58:01 user nova-compute[70924]:       </nova:ports>
Jul 29 14:58:01 user nova-compute[70924]:     </nova:instance>
Jul 29 14:58:01 user nova-compute[70924]:   </metadata>
Jul 29 14:58:01 user nova-compute[70924]:   <sysinfo type="smbios">
Jul 29 14:58:01 user nova-compute[70924]:     <system>
Jul 29 14:58:01 user nova-compute[70924]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 14:58:01 user nova-compute[70924]:       <entry name="product">OpenStack Nova</entry>
Jul 29 14:58:01 user nova-compute[70924]:       <entry name="version">0.0.0</entry>
Jul 29 14:58:01 user nova-compute[70924]:       <entry name="serial">f3f7eeda-a001-4c35-abeb-e459d701bd93</entry>
Jul 29 14:58:01 user nova-compute[70924]:       <entry name="uuid">f3f7eeda-a001-4c35-abeb-e459d701bd93</entry>
Jul 29 14:58:01 user nova-compute[70924]:       <entry name="family">Virtual Machine</entry>
Jul 29 14:58:01 user nova-compute[70924]:     </system>
Jul 29 14:58:01 user nova-compute[70924]:   </sysinfo>
Jul 29 14:58:01 user nova-compute[70924]:   <os>
Jul 29 14:58:01 user nova-compute[70924]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 14:58:01 user nova-compute[70924]:     <boot dev="hd"/>
Jul 29 14:58:01 user nova-compute[70924]:     <smbios mode="sysinfo"/>
Jul 29 14:58:01 user nova-compute[70924]:   </os>
Jul 29 14:58:01 user nova-compute[70924]:   <features>
Jul 29 14:58:01 user nova-compute[70924]:     <acpi/>
Jul 29 14:58:01 user nova-compute[70924]:     <apic/>
Jul 29 14:58:01 user nova-compute[70924]:     <vmcoreinfo/>
Jul 29 14:58:01 user nova-compute[70924]:   </features>
Jul 29 14:58:01 user nova-compute[70924]:   <clock offset="utc">
Jul 29 14:58:01 user nova-compute[70924]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 14:58:01 user nova-compute[70924]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 14:58:01 user nova-compute[70924]:     <timer name="hpet" present="no"/>
Jul 29 14:58:01 user nova-compute[70924]:   </clock>
Jul 29 14:58:01 user nova-compute[70924]:   <cpu mode="custom" match="exact">
Jul 29 14:58:01 user nova-compute[70924]:     <model>Nehalem</model>
Jul 29 14:58:01 user nova-compute[70924]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 14:58:01 user nova-compute[70924]:   </cpu>
Jul 29 14:58:01 user nova-compute[70924]:   <devices>
Jul 29 14:58:01 user nova-compute[70924]:     <disk type="file" device="disk">
Jul 29 14:58:01 user nova-compute[70924]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 14:58:01 user nova-compute[70924]:       <source file="/opt/stack/data/nova/instances/f3f7eeda-a001-4c35-abeb-e459d701bd93/disk"/>
Jul 29 14:58:01 user nova-compute[70924]:       <target dev="vda" bus="virtio"/>
Jul 29 14:58:01 user nova-compute[70924]:     </disk>
Jul 29 14:58:01 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 14:58:01 user nova-compute[70924]:       <mac address="fa:16:3e:9f:ec:06"/>
Jul 29 14:58:01 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:58:01 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 14:58:01 user nova-compute[70924]:       <target dev="tapeafccd28-f9"/>
Jul 29 14:58:01 user nova-compute[70924]:     </interface>
Jul 29 14:58:01 user nova-compute[70924]:     <serial type="pty">
Jul 29 14:58:01 user nova-compute[70924]:       <log file="/opt/stack/data/nova/instances/f3f7eeda-a001-4c35-abeb-e459d701bd93/console.log" append="off"/>
Jul 29 14:58:01 user nova-compute[70924]:     </serial>
Jul 29 14:58:01 user nova-compute[70924]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 14:58:01 user nova-compute[70924]:     <video>
Jul 29 14:58:01 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:58:01 user nova-compute[70924]:     </video>
Jul 29 14:58:01 user nova-compute[70924]:     <rng model="virtio">
Jul 29 14:58:01 user nova-compute[70924]:       <backend model="random">/dev/urandom</backend>
Jul 29 14:58:01 user nova-compute[70924]:     </rng>
Jul 29 14:58:01 user nova-compute[70924]:     <controller type="usb" index="0" model="none"/>
Jul 29 14:58:01 user nova-compute[70924]:     <memballoon model="virtio">
Jul 29 14:58:01 user nova-compute[70924]:       <stats period="10"/>
Jul 29 14:58:01 user nova-compute[70924]:     </memballoon>
Jul 29 14:58:01 user nova-compute[70924]:   </devices>
Jul 29 14:58:01 user nova-compute[70924]: </domain>
Jul 29 14:58:01 user nova-compute[70924]:  {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 14:58:01 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:57:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-860009977',display_name='tempest-ServerRescueNegativeTestJSON-server-860009977',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-860009977',id=33,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYYUTKa/Li7BbPVzmg4ve1vgvH0FEhtwS0gOMqeRhUXC/Ag9zhCHxbsh4O9uwMJ9PeS5iqh/+F1q/DOCjXtppVcKojs97MuEkw+mKkCC6PAntsB1yiqhawyIRrJr7Iulg==',key_name='tempest-keypair-1342138702',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8fcf4644e7a24bf68b407be2e3d9732c',ramdisk_id='',reservation_id='r-mz1wzk08',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1436708078',owner_user_name='tempest-ServerRescueNegativeTestJSON-1436708078-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:58:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ec7e735cfff48828e0c0c7618f50711',uuid=f3f7eeda-a001-4c35-abeb-e459d701bd93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eafccd28-f902-4bc2-805e-4d2f8bbd4e82", "address": "fa:16:3e:9f:ec:06", "network": {"id": "b2aee530-d195-47bb-b39d-c8bd15b81a08", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-421022738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcf4644e7a24bf68b407be2e3d9732c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeafccd28-f9", "ovs_interfaceid": "eafccd28-f902-4bc2-805e-4d2f8bbd4e82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 14:58:01 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Converting VIF {"id": "eafccd28-f902-4bc2-805e-4d2f8bbd4e82", "address": "fa:16:3e:9f:ec:06", "network": {"id": "b2aee530-d195-47bb-b39d-c8bd15b81a08", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-421022738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcf4644e7a24bf68b407be2e3d9732c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeafccd28-f9", "ovs_interfaceid": "eafccd28-f902-4bc2-805e-4d2f8bbd4e82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:58:01 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:ec:06,bridge_name='br-int',has_traffic_filtering=True,id=eafccd28-f902-4bc2-805e-4d2f8bbd4e82,network=Network(b2aee530-d195-47bb-b39d-c8bd15b81a08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeafccd28-f9') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:58:01 user nova-compute[70924]: DEBUG os_vif [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:ec:06,bridge_name='br-int',has_traffic_filtering=True,id=eafccd28-f902-4bc2-805e-4d2f8bbd4e82,network=Network(b2aee530-d195-47bb-b39d-c8bd15b81a08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeafccd28-f9') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 14:58:01 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:01 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:58:01 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 14:58:01 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:01 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeafccd28-f9, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:58:01 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapeafccd28-f9, col_values=(('external_ids', {'iface-id': 'eafccd28-f902-4bc2-805e-4d2f8bbd4e82', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:ec:06', 'vm-uuid': 'f3f7eeda-a001-4c35-abeb-e459d701bd93'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:58:01 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:01 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:58:01 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:01 user nova-compute[70924]: INFO os_vif [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:ec:06,bridge_name='br-int',has_traffic_filtering=True,id=eafccd28-f902-4bc2-805e-4d2f8bbd4e82,network=Network(b2aee530-d195-47bb-b39d-c8bd15b81a08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeafccd28-f9')
Jul 29 14:58:01 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:58:01 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] No VIF found with MAC fa:16:3e:9f:ec:06, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:58:02 user nova-compute[70924]: DEBUG nova.network.neutron [req-559ec474-b530-4600-91fa-3796b37ad0ce req-d97e6619-13a1-4069-91c8-7a4673c196b2 service nova] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Updated VIF entry in instance network info cache for port eafccd28-f902-4bc2-805e-4d2f8bbd4e82. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:58:02 user nova-compute[70924]: DEBUG nova.network.neutron [req-559ec474-b530-4600-91fa-3796b37ad0ce req-d97e6619-13a1-4069-91c8-7a4673c196b2 service nova] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Updating instance_info_cache with network_info: [{"id": "eafccd28-f902-4bc2-805e-4d2f8bbd4e82", "address": "fa:16:3e:9f:ec:06", "network": {"id": "b2aee530-d195-47bb-b39d-c8bd15b81a08", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-421022738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcf4644e7a24bf68b407be2e3d9732c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeafccd28-f9", "ovs_interfaceid": "eafccd28-f902-4bc2-805e-4d2f8bbd4e82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:58:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-559ec474-b530-4600-91fa-3796b37ad0ce req-d97e6619-13a1-4069-91c8-7a4673c196b2 service nova] Releasing lock "refresh_cache-f3f7eeda-a001-4c35-abeb-e459d701bd93" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:58:02 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:58:02 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Starting heal instance info cache {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 14:58:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "refresh_cache-02c75b00-a1b4-4ef9-ae96-bc67d8038589" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:58:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquired lock "refresh_cache-02c75b00-a1b4-4ef9-ae96-bc67d8038589" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:58:02 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Forcefully refreshing network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 29 14:58:03 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Updating instance_info_cache with network_info: [{"id": "25798da4-8f4d-4db1-afd2-7fb85693bc16", "address": "fa:16:3e:59:2c:bb", "network": {"id": "d5876e18-e2af-45c2-aab5-2d0d552ebfe4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2035085552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9e5c78c1684c359cfab4e32b9c213f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25798da4-8f", "ovs_interfaceid": "25798da4-8f4d-4db1-afd2-7fb85693bc16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:58:03 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Releasing lock "refresh_cache-02c75b00-a1b4-4ef9-ae96-bc67d8038589" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:58:03 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Updated the network info_cache for instance {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 29 14:58:03 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:58:03 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:58:03 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:58:03 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:58:03 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70924) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 14:58:03 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:03 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:03 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:03 user nova-compute[70924]: DEBUG nova.compute.manager [req-4f00a2c6-b259-47e1-a7cf-03ebcf3b5ab5 req-f83e23de-4f4b-48ae-bdd6-97e79e761755 service nova] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Received event network-vif-plugged-eafccd28-f902-4bc2-805e-4d2f8bbd4e82 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:58:03 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-4f00a2c6-b259-47e1-a7cf-03ebcf3b5ab5 req-f83e23de-4f4b-48ae-bdd6-97e79e761755 service nova] Acquiring lock "f3f7eeda-a001-4c35-abeb-e459d701bd93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:58:03 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-4f00a2c6-b259-47e1-a7cf-03ebcf3b5ab5 req-f83e23de-4f4b-48ae-bdd6-97e79e761755 service nova] Lock "f3f7eeda-a001-4c35-abeb-e459d701bd93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:58:03 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-4f00a2c6-b259-47e1-a7cf-03ebcf3b5ab5 req-f83e23de-4f4b-48ae-bdd6-97e79e761755 service nova] Lock "f3f7eeda-a001-4c35-abeb-e459d701bd93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:58:03 user nova-compute[70924]: DEBUG nova.compute.manager [req-4f00a2c6-b259-47e1-a7cf-03ebcf3b5ab5 req-f83e23de-4f4b-48ae-bdd6-97e79e761755 service nova] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] No waiting events found dispatching network-vif-plugged-eafccd28-f902-4bc2-805e-4d2f8bbd4e82 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:58:03 user nova-compute[70924]: WARNING nova.compute.manager [req-4f00a2c6-b259-47e1-a7cf-03ebcf3b5ab5 req-f83e23de-4f4b-48ae-bdd6-97e79e761755 service nova] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Received unexpected event network-vif-plugged-eafccd28-f902-4bc2-805e-4d2f8bbd4e82 for instance with vm_state building and task_state spawning.
Jul 29 14:58:03 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:03 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:03 user nova-compute[70924]: DEBUG nova.compute.manager [req-c80f7c47-2485-4737-bb69-a0aa690b5c9f req-cb08fea3-b3ac-446e-ad9b-6a56e1332a88 service nova] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Received event network-changed-f34f8730-445d-4711-8db4-3c6455cbd24e {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:58:03 user nova-compute[70924]: DEBUG nova.compute.manager [req-c80f7c47-2485-4737-bb69-a0aa690b5c9f req-cb08fea3-b3ac-446e-ad9b-6a56e1332a88 service nova] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Refreshing instance network info cache due to event network-changed-f34f8730-445d-4711-8db4-3c6455cbd24e. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:58:03 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c80f7c47-2485-4737-bb69-a0aa690b5c9f req-cb08fea3-b3ac-446e-ad9b-6a56e1332a88 service nova] Acquiring lock "refresh_cache-1555ef29-8abe-43ca-ad2b-ac2f86180202" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:58:03 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c80f7c47-2485-4737-bb69-a0aa690b5c9f req-cb08fea3-b3ac-446e-ad9b-6a56e1332a88 service nova] Acquired lock "refresh_cache-1555ef29-8abe-43ca-ad2b-ac2f86180202" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:58:03 user nova-compute[70924]: DEBUG nova.network.neutron [req-c80f7c47-2485-4737-bb69-a0aa690b5c9f req-cb08fea3-b3ac-446e-ad9b-6a56e1332a88 service nova] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Refreshing network info cache for port f34f8730-445d-4711-8db4-3c6455cbd24e {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:58:03 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:04 user nova-compute[70924]: DEBUG nova.network.neutron [req-c80f7c47-2485-4737-bb69-a0aa690b5c9f req-cb08fea3-b3ac-446e-ad9b-6a56e1332a88 service nova] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Updated VIF entry in instance network info cache for port f34f8730-445d-4711-8db4-3c6455cbd24e. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:58:04 user nova-compute[70924]: DEBUG nova.network.neutron [req-c80f7c47-2485-4737-bb69-a0aa690b5c9f req-cb08fea3-b3ac-446e-ad9b-6a56e1332a88 service nova] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Updating instance_info_cache with network_info: [{"id": "f34f8730-445d-4711-8db4-3c6455cbd24e", "address": "fa:16:3e:c0:c2:af", "network": {"id": "ff833b6e-b3ce-44ac-88ec-775f193cdfe4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-546934977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f5f9f30926f47afad3cb4c9e89d55c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34f8730-44", "ovs_interfaceid": "f34f8730-445d-4711-8db4-3c6455cbd24e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:58:04 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c80f7c47-2485-4737-bb69-a0aa690b5c9f req-cb08fea3-b3ac-446e-ad9b-6a56e1332a88 service nova] Releasing lock "refresh_cache-1555ef29-8abe-43ca-ad2b-ac2f86180202" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:58:05 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:58:05 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642685.4481163, f3f7eeda-a001-4c35-abeb-e459d701bd93 => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:58:05 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] VM Resumed (Lifecycle Event)
Jul 29 14:58:05 user nova-compute[70924]: DEBUG nova.compute.manager [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Instance event wait completed in 0 seconds for  {{(pid=70924) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 14:58:05 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Guest created on hypervisor {{(pid=70924) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 14:58:05 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Instance spawned successfully.
Jul 29 14:58:05 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 14:58:05 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:58:05 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:58:05 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Found default for hw_cdrom_bus of ide {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:58:05 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Found default for hw_disk_bus of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:58:05 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Found default for hw_input_bus of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:58:05 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Found default for hw_pointer_model of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:58:05 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Found default for hw_video_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:58:05 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Found default for hw_vif_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:58:05 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:58:05 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642685.4519963, f3f7eeda-a001-4c35-abeb-e459d701bd93 => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:58:05 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] VM Started (Lifecycle Event)
Jul 29 14:58:05 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:58:05 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:58:05 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:58:05 user nova-compute[70924]: INFO nova.compute.manager [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Took 5.68 seconds to spawn the instance on the hypervisor.
Jul 29 14:58:05 user nova-compute[70924]: DEBUG nova.compute.manager [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:58:05 user nova-compute[70924]: DEBUG nova.compute.manager [req-097326db-246b-47af-a1f4-733b68382118 req-6e3fd92d-2b9d-4eae-90d6-1859d0a9eb34 service nova] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Received event network-vif-plugged-eafccd28-f902-4bc2-805e-4d2f8bbd4e82 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:58:05 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-097326db-246b-47af-a1f4-733b68382118 req-6e3fd92d-2b9d-4eae-90d6-1859d0a9eb34 service nova] Acquiring lock "f3f7eeda-a001-4c35-abeb-e459d701bd93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:58:05 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-097326db-246b-47af-a1f4-733b68382118 req-6e3fd92d-2b9d-4eae-90d6-1859d0a9eb34 service nova] Lock "f3f7eeda-a001-4c35-abeb-e459d701bd93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:58:05 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-097326db-246b-47af-a1f4-733b68382118 req-6e3fd92d-2b9d-4eae-90d6-1859d0a9eb34 service nova] Lock "f3f7eeda-a001-4c35-abeb-e459d701bd93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:58:05 user nova-compute[70924]: DEBUG nova.compute.manager [req-097326db-246b-47af-a1f4-733b68382118 req-6e3fd92d-2b9d-4eae-90d6-1859d0a9eb34 service nova] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] No waiting events found dispatching network-vif-plugged-eafccd28-f902-4bc2-805e-4d2f8bbd4e82 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:58:05 user nova-compute[70924]: WARNING nova.compute.manager [req-097326db-246b-47af-a1f4-733b68382118 req-6e3fd92d-2b9d-4eae-90d6-1859d0a9eb34 service nova] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Received unexpected event network-vif-plugged-eafccd28-f902-4bc2-805e-4d2f8bbd4e82 for instance with vm_state building and task_state spawning.
Jul 29 14:58:05 user nova-compute[70924]: INFO nova.compute.manager [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Took 6.93 seconds to build instance.
Jul 29 14:58:05 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-6af5baee-d261-47aa-b4cd-24245cbbc970 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "f3f7eeda-a001-4c35-abeb-e459d701bd93" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.030s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:58:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-46bd7755-7794-42fd-97e5-019f889235c9 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Acquiring lock "1555ef29-8abe-43ca-ad2b-ac2f86180202" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:58:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-46bd7755-7794-42fd-97e5-019f889235c9 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "1555ef29-8abe-43ca-ad2b-ac2f86180202" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:58:08 user nova-compute[70924]: INFO nova.compute.manager [None req-46bd7755-7794-42fd-97e5-019f889235c9 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Shelving
Jul 29 14:58:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:08 user nova-compute[70924]: DEBUG nova.compute.manager [req-c38c8afc-2bb5-42d7-9429-1156f08338e2 req-f172095a-c0e5-4140-b29d-ec632439e5ec service nova] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Received event network-vif-unplugged-f34f8730-445d-4711-8db4-3c6455cbd24e {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:58:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c38c8afc-2bb5-42d7-9429-1156f08338e2 req-f172095a-c0e5-4140-b29d-ec632439e5ec service nova] Acquiring lock "1555ef29-8abe-43ca-ad2b-ac2f86180202-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:58:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c38c8afc-2bb5-42d7-9429-1156f08338e2 req-f172095a-c0e5-4140-b29d-ec632439e5ec service nova] Lock "1555ef29-8abe-43ca-ad2b-ac2f86180202-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:58:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c38c8afc-2bb5-42d7-9429-1156f08338e2 req-f172095a-c0e5-4140-b29d-ec632439e5ec service nova] Lock "1555ef29-8abe-43ca-ad2b-ac2f86180202-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:58:08 user nova-compute[70924]: DEBUG nova.compute.manager [req-c38c8afc-2bb5-42d7-9429-1156f08338e2 req-f172095a-c0e5-4140-b29d-ec632439e5ec service nova] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] No waiting events found dispatching network-vif-unplugged-f34f8730-445d-4711-8db4-3c6455cbd24e {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:58:08 user nova-compute[70924]: WARNING nova.compute.manager [req-c38c8afc-2bb5-42d7-9429-1156f08338e2 req-f172095a-c0e5-4140-b29d-ec632439e5ec service nova] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Received unexpected event network-vif-unplugged-f34f8730-445d-4711-8db4-3c6455cbd24e for instance with vm_state active and task_state shelving.
Jul 29 14:58:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:09 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Instance destroyed successfully.
Jul 29 14:58:09 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-46bd7755-7794-42fd-97e5-019f889235c9 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Beginning cold snapshot process
Jul 29 14:58:09 user nova-compute[70924]: DEBUG nova.privsep.utils [None req-46bd7755-7794-42fd-97e5-019f889235c9 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70924) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 29 14:58:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-46bd7755-7794-42fd-97e5-019f889235c9 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/1555ef29-8abe-43ca-ad2b-ac2f86180202/disk /opt/stack/data/nova/instances/snapshots/tmp_nhvtam5/ceea47466fcb4df198ea0315147da2c9 {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:58:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-46bd7755-7794-42fd-97e5-019f889235c9 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/1555ef29-8abe-43ca-ad2b-ac2f86180202/disk /opt/stack/data/nova/instances/snapshots/tmp_nhvtam5/ceea47466fcb4df198ea0315147da2c9" returned: 0 in 0.690s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:58:10 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-46bd7755-7794-42fd-97e5-019f889235c9 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Snapshot extracted, beginning image upload
Jul 29 14:58:10 user nova-compute[70924]: DEBUG nova.compute.manager [req-8da13cad-242f-4fed-ba68-98300a5f971d req-7c28a9c1-0805-47b5-a2b8-f74c52cc5981 service nova] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Received event network-vif-plugged-f34f8730-445d-4711-8db4-3c6455cbd24e {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:58:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-8da13cad-242f-4fed-ba68-98300a5f971d req-7c28a9c1-0805-47b5-a2b8-f74c52cc5981 service nova] Acquiring lock "1555ef29-8abe-43ca-ad2b-ac2f86180202-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:58:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-8da13cad-242f-4fed-ba68-98300a5f971d req-7c28a9c1-0805-47b5-a2b8-f74c52cc5981 service nova] Lock "1555ef29-8abe-43ca-ad2b-ac2f86180202-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:58:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-8da13cad-242f-4fed-ba68-98300a5f971d req-7c28a9c1-0805-47b5-a2b8-f74c52cc5981 service nova] Lock "1555ef29-8abe-43ca-ad2b-ac2f86180202-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:58:10 user nova-compute[70924]: DEBUG nova.compute.manager [req-8da13cad-242f-4fed-ba68-98300a5f971d req-7c28a9c1-0805-47b5-a2b8-f74c52cc5981 service nova] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] No waiting events found dispatching network-vif-plugged-f34f8730-445d-4711-8db4-3c6455cbd24e {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:58:10 user nova-compute[70924]: WARNING nova.compute.manager [req-8da13cad-242f-4fed-ba68-98300a5f971d req-7c28a9c1-0805-47b5-a2b8-f74c52cc5981 service nova] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Received unexpected event network-vif-plugged-f34f8730-445d-4711-8db4-3c6455cbd24e for instance with vm_state active and task_state shelving_image_uploading.
Jul 29 14:58:11 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:13 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-46bd7755-7794-42fd-97e5-019f889235c9 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Snapshot image upload complete
Jul 29 14:58:13 user nova-compute[70924]: DEBUG nova.compute.manager [None req-46bd7755-7794-42fd-97e5-019f889235c9 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:58:13 user nova-compute[70924]: INFO nova.compute.manager [None req-46bd7755-7794-42fd-97e5-019f889235c9 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Shelve offloading
Jul 29 14:58:13 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Instance destroyed successfully.
Jul 29 14:58:13 user nova-compute[70924]: DEBUG nova.compute.manager [None req-46bd7755-7794-42fd-97e5-019f889235c9 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:58:13 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-46bd7755-7794-42fd-97e5-019f889235c9 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Acquiring lock "refresh_cache-1555ef29-8abe-43ca-ad2b-ac2f86180202" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:58:13 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-46bd7755-7794-42fd-97e5-019f889235c9 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Acquired lock "refresh_cache-1555ef29-8abe-43ca-ad2b-ac2f86180202" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:58:13 user nova-compute[70924]: DEBUG nova.network.neutron [None req-46bd7755-7794-42fd-97e5-019f889235c9 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 14:58:13 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:14 user nova-compute[70924]: DEBUG nova.network.neutron [None req-46bd7755-7794-42fd-97e5-019f889235c9 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Updating instance_info_cache with network_info: [{"id": "f34f8730-445d-4711-8db4-3c6455cbd24e", "address": "fa:16:3e:c0:c2:af", "network": {"id": "ff833b6e-b3ce-44ac-88ec-775f193cdfe4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-546934977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f5f9f30926f47afad3cb4c9e89d55c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34f8730-44", "ovs_interfaceid": "f34f8730-445d-4711-8db4-3c6455cbd24e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:58:14 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-46bd7755-7794-42fd-97e5-019f889235c9 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Releasing lock "refresh_cache-1555ef29-8abe-43ca-ad2b-ac2f86180202" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:58:15 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Instance destroyed successfully.
Jul 29 14:58:15 user nova-compute[70924]: DEBUG nova.objects.instance [None req-46bd7755-7794-42fd-97e5-019f889235c9 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lazy-loading 'resources' on Instance uuid 1555ef29-8abe-43ca-ad2b-ac2f86180202 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:58:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-46bd7755-7794-42fd-97e5-019f889235c9 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:56:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-294782032',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-294782032',id=32,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7k8yfFGWAhiv9WTAEC+6fczleFZHosFBEhgzN65FlDOxe0bzyOCT08gSIHyZ/TQjIC3xWZ7z6zR+yTrFH/0d4DbX2ns5rROljHoWjhL3MWWhXMwDOcgatQXM+nTcx+Rg==',key_name='tempest-keypair-391897607',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:56:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='6f5f9f30926f47afad3cb4c9e89d55c5',ramdisk_id='',reservation_id='r-daxoh0gf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-130200384',owner_user_name='tempest-AttachVolumeShelveTestJSON-130200384-project-member',shelved_at='2023-07-29T14:58:13.277848',shelved_host='user',shelved_image_id='49e8bfa8-816a-41e6-a55c-7160c41e5488'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:58:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c9562451ffa45b2aad975335d83fa8c',uuid=1555ef29-8abe-43ca-ad2b-ac2f86180202,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "f34f8730-445d-4711-8db4-3c6455cbd24e", "address": "fa:16:3e:c0:c2:af", "network": {"id": "ff833b6e-b3ce-44ac-88ec-775f193cdfe4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-546934977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f5f9f30926f47afad3cb4c9e89d55c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34f8730-44", "ovs_interfaceid": "f34f8730-445d-4711-8db4-3c6455cbd24e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 14:58:16 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-46bd7755-7794-42fd-97e5-019f889235c9 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Converting VIF {"id": "f34f8730-445d-4711-8db4-3c6455cbd24e", "address": "fa:16:3e:c0:c2:af", "network": {"id": "ff833b6e-b3ce-44ac-88ec-775f193cdfe4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-546934977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f5f9f30926f47afad3cb4c9e89d55c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34f8730-44", "ovs_interfaceid": "f34f8730-445d-4711-8db4-3c6455cbd24e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:58:16 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-46bd7755-7794-42fd-97e5-019f889235c9 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:c2:af,bridge_name='br-int',has_traffic_filtering=True,id=f34f8730-445d-4711-8db4-3c6455cbd24e,network=Network(ff833b6e-b3ce-44ac-88ec-775f193cdfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf34f8730-44') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:58:16 user nova-compute[70924]: DEBUG os_vif [None req-46bd7755-7794-42fd-97e5-019f889235c9 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:c2:af,bridge_name='br-int',has_traffic_filtering=True,id=f34f8730-445d-4711-8db4-3c6455cbd24e,network=Network(ff833b6e-b3ce-44ac-88ec-775f193cdfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf34f8730-44') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 14:58:16 user nova-compute[70924]: DEBUG nova.compute.manager [req-6e934af3-b676-4cb5-b1af-52d70d3c7ee1 req-966d0427-26cf-40de-beaa-e313b3f643e5 service nova] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Received event network-changed-f34f8730-445d-4711-8db4-3c6455cbd24e {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:58:16 user nova-compute[70924]: DEBUG nova.compute.manager [req-6e934af3-b676-4cb5-b1af-52d70d3c7ee1 req-966d0427-26cf-40de-beaa-e313b3f643e5 service nova] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Refreshing instance network info cache due to event network-changed-f34f8730-445d-4711-8db4-3c6455cbd24e. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:58:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-6e934af3-b676-4cb5-b1af-52d70d3c7ee1 req-966d0427-26cf-40de-beaa-e313b3f643e5 service nova] Acquiring lock "refresh_cache-1555ef29-8abe-43ca-ad2b-ac2f86180202" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:58:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-6e934af3-b676-4cb5-b1af-52d70d3c7ee1 req-966d0427-26cf-40de-beaa-e313b3f643e5 service nova] Acquired lock "refresh_cache-1555ef29-8abe-43ca-ad2b-ac2f86180202" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:58:16 user nova-compute[70924]: DEBUG nova.network.neutron [req-6e934af3-b676-4cb5-b1af-52d70d3c7ee1 req-966d0427-26cf-40de-beaa-e313b3f643e5 service nova] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Refreshing network info cache for port f34f8730-445d-4711-8db4-3c6455cbd24e {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:58:16 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:16 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf34f8730-44, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:58:16 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:16 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:58:16 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:16 user nova-compute[70924]: INFO os_vif [None req-46bd7755-7794-42fd-97e5-019f889235c9 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:c2:af,bridge_name='br-int',has_traffic_filtering=True,id=f34f8730-445d-4711-8db4-3c6455cbd24e,network=Network(ff833b6e-b3ce-44ac-88ec-775f193cdfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf34f8730-44')
Jul 29 14:58:16 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-46bd7755-7794-42fd-97e5-019f889235c9 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Deleting instance files /opt/stack/data/nova/instances/1555ef29-8abe-43ca-ad2b-ac2f86180202_del
Jul 29 14:58:16 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-46bd7755-7794-42fd-97e5-019f889235c9 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Deletion of /opt/stack/data/nova/instances/1555ef29-8abe-43ca-ad2b-ac2f86180202_del complete
Jul 29 14:58:16 user nova-compute[70924]: INFO nova.scheduler.client.report [None req-46bd7755-7794-42fd-97e5-019f889235c9 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Deleted allocations for instance 1555ef29-8abe-43ca-ad2b-ac2f86180202
Jul 29 14:58:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-46bd7755-7794-42fd-97e5-019f889235c9 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:58:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-46bd7755-7794-42fd-97e5-019f889235c9 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:58:16 user nova-compute[70924]: DEBUG nova.objects.instance [None req-46bd7755-7794-42fd-97e5-019f889235c9 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lazy-loading 'numa_topology' on Instance uuid 1555ef29-8abe-43ca-ad2b-ac2f86180202 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:58:16 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-46bd7755-7794-42fd-97e5-019f889235c9 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:58:16 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-46bd7755-7794-42fd-97e5-019f889235c9 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:58:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-46bd7755-7794-42fd-97e5-019f889235c9 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.345s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:58:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-fe9839ba-59de-44a7-8e60-34ce420d2f8f tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Acquiring lock "710f0d5a-8420-49c4-bf70-27305dd85bd3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:58:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-fe9839ba-59de-44a7-8e60-34ce420d2f8f tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lock "710f0d5a-8420-49c4-bf70-27305dd85bd3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:58:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-fe9839ba-59de-44a7-8e60-34ce420d2f8f tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Acquiring lock "710f0d5a-8420-49c4-bf70-27305dd85bd3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:58:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-fe9839ba-59de-44a7-8e60-34ce420d2f8f tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lock "710f0d5a-8420-49c4-bf70-27305dd85bd3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:58:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-fe9839ba-59de-44a7-8e60-34ce420d2f8f tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lock "710f0d5a-8420-49c4-bf70-27305dd85bd3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:58:16 user nova-compute[70924]: INFO nova.compute.manager [None req-fe9839ba-59de-44a7-8e60-34ce420d2f8f tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Terminating instance
Jul 29 14:58:16 user nova-compute[70924]: DEBUG nova.compute.manager [None req-fe9839ba-59de-44a7-8e60-34ce420d2f8f tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Start destroying the instance on the hypervisor. {{(pid=70924) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 14:58:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-46bd7755-7794-42fd-97e5-019f889235c9 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "1555ef29-8abe-43ca-ad2b-ac2f86180202" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 8.150s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:58:16 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:16 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:16 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:16 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:16 user nova-compute[70924]: DEBUG nova.network.neutron [req-6e934af3-b676-4cb5-b1af-52d70d3c7ee1 req-966d0427-26cf-40de-beaa-e313b3f643e5 service nova] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Updated VIF entry in instance network info cache for port f34f8730-445d-4711-8db4-3c6455cbd24e. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:58:16 user nova-compute[70924]: DEBUG nova.network.neutron [req-6e934af3-b676-4cb5-b1af-52d70d3c7ee1 req-966d0427-26cf-40de-beaa-e313b3f643e5 service nova] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Updating instance_info_cache with network_info: [{"id": "f34f8730-445d-4711-8db4-3c6455cbd24e", "address": "fa:16:3e:c0:c2:af", "network": {"id": "ff833b6e-b3ce-44ac-88ec-775f193cdfe4", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-546934977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f5f9f30926f47afad3cb4c9e89d55c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapf34f8730-44", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:58:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-6e934af3-b676-4cb5-b1af-52d70d3c7ee1 req-966d0427-26cf-40de-beaa-e313b3f643e5 service nova] Releasing lock "refresh_cache-1555ef29-8abe-43ca-ad2b-ac2f86180202" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:58:17 user nova-compute[70924]: DEBUG nova.compute.manager [req-84b6139c-628b-4808-8bac-410e8a1ca671 req-aca06b4e-5432-418a-abd0-f3a358c90c9d service nova] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Received event network-vif-unplugged-fa798159-0d64-40e0-8418-5889396f6a5f {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:58:17 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-84b6139c-628b-4808-8bac-410e8a1ca671 req-aca06b4e-5432-418a-abd0-f3a358c90c9d service nova] Acquiring lock "710f0d5a-8420-49c4-bf70-27305dd85bd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:58:17 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-84b6139c-628b-4808-8bac-410e8a1ca671 req-aca06b4e-5432-418a-abd0-f3a358c90c9d service nova] Lock "710f0d5a-8420-49c4-bf70-27305dd85bd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:58:17 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-84b6139c-628b-4808-8bac-410e8a1ca671 req-aca06b4e-5432-418a-abd0-f3a358c90c9d service nova] Lock "710f0d5a-8420-49c4-bf70-27305dd85bd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:58:17 user nova-compute[70924]: DEBUG nova.compute.manager [req-84b6139c-628b-4808-8bac-410e8a1ca671 req-aca06b4e-5432-418a-abd0-f3a358c90c9d service nova] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] No waiting events found dispatching network-vif-unplugged-fa798159-0d64-40e0-8418-5889396f6a5f {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:58:17 user nova-compute[70924]: DEBUG nova.compute.manager [req-84b6139c-628b-4808-8bac-410e8a1ca671 req-aca06b4e-5432-418a-abd0-f3a358c90c9d service nova] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Received event network-vif-unplugged-fa798159-0d64-40e0-8418-5889396f6a5f for instance with task_state deleting. {{(pid=70924) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 14:58:17 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:17 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:17 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:17 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Instance destroyed successfully.
Jul 29 14:58:17 user nova-compute[70924]: DEBUG nova.objects.instance [None req-fe9839ba-59de-44a7-8e60-34ce420d2f8f tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lazy-loading 'resources' on Instance uuid 710f0d5a-8420-49c4-bf70-27305dd85bd3 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:58:17 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-fe9839ba-59de-44a7-8e60-34ce420d2f8f tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:53:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-813512746',display_name='tempest-TestMinimumBasicScenario-server-813512746',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-813512746',id=30,image_ref='8f3dcf97-8b65-45cb-b52e-bff81d80db70',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA76T/51PTdIphAR5vmKjW5tUtLn/sQuimAbsDwwFMd+B+5p2qZFOwSM1z2S0WxRqwOdkFbLSkcByFgSatE660bvOjkxrQaY0j/lDrcZkHXhqDCNe3n8ezCtGkqt/N+vPw==',key_name='tempest-TestMinimumBasicScenario-2130533388',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:53:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a03844d646454b6ea55e1b5625f7909a',ramdisk_id='',reservation_id='r-idexnh0b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8f3dcf97-8b65-45cb-b52e-bff81d80db70',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-944069199',owner_user_name='tempest-TestMinimumBasicScenario-944069199-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:55:35Z,user_data=None,user_id='7aa9677ce659431db31a0e513277d692',uuid=710f0d5a-8420-49c4-bf70-27305dd85bd3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fa798159-0d64-40e0-8418-5889396f6a5f", "address": "fa:16:3e:67:60:2e", "network": {"id": "21a19801-8526-40a2-9bcb-dda6cfb435fe", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-761511746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a03844d646454b6ea55e1b5625f7909a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa798159-0d", "ovs_interfaceid": "fa798159-0d64-40e0-8418-5889396f6a5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 14:58:17 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-fe9839ba-59de-44a7-8e60-34ce420d2f8f tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Converting VIF {"id": "fa798159-0d64-40e0-8418-5889396f6a5f", "address": "fa:16:3e:67:60:2e", "network": {"id": "21a19801-8526-40a2-9bcb-dda6cfb435fe", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-761511746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a03844d646454b6ea55e1b5625f7909a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa798159-0d", "ovs_interfaceid": "fa798159-0d64-40e0-8418-5889396f6a5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:58:17 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-fe9839ba-59de-44a7-8e60-34ce420d2f8f tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:67:60:2e,bridge_name='br-int',has_traffic_filtering=True,id=fa798159-0d64-40e0-8418-5889396f6a5f,network=Network(21a19801-8526-40a2-9bcb-dda6cfb435fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa798159-0d') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:58:17 user nova-compute[70924]: DEBUG os_vif [None req-fe9839ba-59de-44a7-8e60-34ce420d2f8f tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:60:2e,bridge_name='br-int',has_traffic_filtering=True,id=fa798159-0d64-40e0-8418-5889396f6a5f,network=Network(21a19801-8526-40a2-9bcb-dda6cfb435fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa798159-0d') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 14:58:17 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:17 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfa798159-0d, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:58:17 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:58:17 user nova-compute[70924]: INFO os_vif [None req-fe9839ba-59de-44a7-8e60-34ce420d2f8f tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:60:2e,bridge_name='br-int',has_traffic_filtering=True,id=fa798159-0d64-40e0-8418-5889396f6a5f,network=Network(21a19801-8526-40a2-9bcb-dda6cfb435fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa798159-0d')
Jul 29 14:58:17 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-fe9839ba-59de-44a7-8e60-34ce420d2f8f tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Deleting instance files /opt/stack/data/nova/instances/710f0d5a-8420-49c4-bf70-27305dd85bd3_del
Jul 29 14:58:17 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-fe9839ba-59de-44a7-8e60-34ce420d2f8f tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Deletion of /opt/stack/data/nova/instances/710f0d5a-8420-49c4-bf70-27305dd85bd3_del complete
Jul 29 14:58:17 user nova-compute[70924]: INFO nova.compute.manager [None req-fe9839ba-59de-44a7-8e60-34ce420d2f8f tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Took 0.96 seconds to destroy the instance on the hypervisor.
Jul 29 14:58:17 user nova-compute[70924]: DEBUG oslo.service.loopingcall [None req-fe9839ba-59de-44a7-8e60-34ce420d2f8f tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70924) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 14:58:17 user nova-compute[70924]: DEBUG nova.compute.manager [-] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Deallocating network for instance {{(pid=70924) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 14:58:17 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] deallocate_for_instance() {{(pid=70924) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 14:58:18 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:18 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:18 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:18 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:18 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:18 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:58:18 user nova-compute[70924]: DEBUG nova.compute.manager [req-ca357478-cc13-46fe-9b9a-7d39f5ae7dd1 req-15f5c77d-8aa5-4b0a-a07b-80b821df7853 service nova] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Received event network-vif-deleted-fa798159-0d64-40e0-8418-5889396f6a5f {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:58:18 user nova-compute[70924]: INFO nova.compute.manager [req-ca357478-cc13-46fe-9b9a-7d39f5ae7dd1 req-15f5c77d-8aa5-4b0a-a07b-80b821df7853 service nova] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Neutron deleted interface fa798159-0d64-40e0-8418-5889396f6a5f; detaching it from the instance and deleting it from the info cache
Jul 29 14:58:18 user nova-compute[70924]: DEBUG nova.network.neutron [req-ca357478-cc13-46fe-9b9a-7d39f5ae7dd1 req-15f5c77d-8aa5-4b0a-a07b-80b821df7853 service nova] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:58:18 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Took 0.86 seconds to deallocate network for instance.
Jul 29 14:58:18 user nova-compute[70924]: DEBUG nova.compute.manager [req-ca357478-cc13-46fe-9b9a-7d39f5ae7dd1 req-15f5c77d-8aa5-4b0a-a07b-80b821df7853 service nova] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Detach interface failed, port_id=fa798159-0d64-40e0-8418-5889396f6a5f, reason: Instance 710f0d5a-8420-49c4-bf70-27305dd85bd3 could not be found. {{(pid=70924) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 29 14:58:18 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-fe9839ba-59de-44a7-8e60-34ce420d2f8f tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:58:18 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-fe9839ba-59de-44a7-8e60-34ce420d2f8f tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:58:18 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:18 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-fe9839ba-59de-44a7-8e60-34ce420d2f8f tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:58:18 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-fe9839ba-59de-44a7-8e60-34ce420d2f8f tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:58:18 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-fe9839ba-59de-44a7-8e60-34ce420d2f8f tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.380s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:58:19 user nova-compute[70924]: INFO nova.scheduler.client.report [None req-fe9839ba-59de-44a7-8e60-34ce420d2f8f tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Deleted allocations for instance 710f0d5a-8420-49c4-bf70-27305dd85bd3
Jul 29 14:58:19 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-fe9839ba-59de-44a7-8e60-34ce420d2f8f tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lock "710f0d5a-8420-49c4-bf70-27305dd85bd3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.475s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:58:19 user nova-compute[70924]: DEBUG nova.compute.manager [req-9561a338-8559-4993-93e9-b2020d1b5007 req-0cd475c7-4da0-4986-9b51-e6ae908c3e5f service nova] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Received event network-vif-plugged-fa798159-0d64-40e0-8418-5889396f6a5f {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:58:19 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-9561a338-8559-4993-93e9-b2020d1b5007 req-0cd475c7-4da0-4986-9b51-e6ae908c3e5f service nova] Acquiring lock "710f0d5a-8420-49c4-bf70-27305dd85bd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:58:19 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-9561a338-8559-4993-93e9-b2020d1b5007 req-0cd475c7-4da0-4986-9b51-e6ae908c3e5f service nova] Lock "710f0d5a-8420-49c4-bf70-27305dd85bd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:58:19 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-9561a338-8559-4993-93e9-b2020d1b5007 req-0cd475c7-4da0-4986-9b51-e6ae908c3e5f service nova] Lock "710f0d5a-8420-49c4-bf70-27305dd85bd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:58:19 user nova-compute[70924]: DEBUG nova.compute.manager [req-9561a338-8559-4993-93e9-b2020d1b5007 req-0cd475c7-4da0-4986-9b51-e6ae908c3e5f service nova] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] No waiting events found dispatching network-vif-plugged-fa798159-0d64-40e0-8418-5889396f6a5f {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:58:19 user nova-compute[70924]: WARNING nova.compute.manager [req-9561a338-8559-4993-93e9-b2020d1b5007 req-0cd475c7-4da0-4986-9b51-e6ae908c3e5f service nova] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Received unexpected event network-vif-plugged-fa798159-0d64-40e0-8418-5889396f6a5f for instance with vm_state deleted and task_state None.
Jul 29 14:58:19 user nova-compute[70924]: DEBUG nova.compute.manager [req-9561a338-8559-4993-93e9-b2020d1b5007 req-0cd475c7-4da0-4986-9b51-e6ae908c3e5f service nova] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Received event network-vif-plugged-fa798159-0d64-40e0-8418-5889396f6a5f {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:58:19 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-9561a338-8559-4993-93e9-b2020d1b5007 req-0cd475c7-4da0-4986-9b51-e6ae908c3e5f service nova] Acquiring lock "710f0d5a-8420-49c4-bf70-27305dd85bd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:58:19 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-9561a338-8559-4993-93e9-b2020d1b5007 req-0cd475c7-4da0-4986-9b51-e6ae908c3e5f service nova] Lock "710f0d5a-8420-49c4-bf70-27305dd85bd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:58:19 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-9561a338-8559-4993-93e9-b2020d1b5007 req-0cd475c7-4da0-4986-9b51-e6ae908c3e5f service nova] Lock "710f0d5a-8420-49c4-bf70-27305dd85bd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:58:19 user nova-compute[70924]: DEBUG nova.compute.manager [req-9561a338-8559-4993-93e9-b2020d1b5007 req-0cd475c7-4da0-4986-9b51-e6ae908c3e5f service nova] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] No waiting events found dispatching network-vif-plugged-fa798159-0d64-40e0-8418-5889396f6a5f {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:58:19 user nova-compute[70924]: WARNING nova.compute.manager [req-9561a338-8559-4993-93e9-b2020d1b5007 req-0cd475c7-4da0-4986-9b51-e6ae908c3e5f service nova] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Received unexpected event network-vif-plugged-fa798159-0d64-40e0-8418-5889396f6a5f for instance with vm_state deleted and task_state None.
Jul 29 14:58:21 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:22 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:22 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:23 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:23 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:24 user nova-compute[70924]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690642689.4067252, 1555ef29-8abe-43ca-ad2b-ac2f86180202 => Stopped> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:58:24 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] VM Stopped (Lifecycle Event)
Jul 29 14:58:24 user nova-compute[70924]: DEBUG nova.compute.manager [None req-1f8c1d51-1549-4fe4-965e-572f9dbaf38d None None] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:58:26 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:32 user nova-compute[70924]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690642697.538719, 710f0d5a-8420-49c4-bf70-27305dd85bd3 => Stopped> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:58:32 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] VM Stopped (Lifecycle Event)
Jul 29 14:58:32 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:32 user nova-compute[70924]: DEBUG nova.compute.manager [None req-0468510d-cc43-4820-b0e0-4766d4b95578 None None] [instance: 710f0d5a-8420-49c4-bf70-27305dd85bd3] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:58:33 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Acquiring lock "47104e57-c193-4a85-a2cf-677f0debe373" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:58:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "47104e57-c193-4a85-a2cf-677f0debe373" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:58:34 user nova-compute[70924]: DEBUG nova.compute.manager [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] Starting instance... {{(pid=70924) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 14:58:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:58:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:58:35 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70924) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 14:58:35 user nova-compute[70924]: INFO nova.compute.claims [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] Claim successful on node user
Jul 29 14:58:35 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:58:35 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:58:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.374s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:58:35 user nova-compute[70924]: DEBUG nova.compute.manager [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] Start building networks asynchronously for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 14:58:35 user nova-compute[70924]: DEBUG nova.compute.manager [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] Allocating IP information in the background. {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 14:58:35 user nova-compute[70924]: DEBUG nova.network.neutron [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] allocate_for_instance() {{(pid=70924) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 14:58:35 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 14:58:35 user nova-compute[70924]: DEBUG nova.compute.manager [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] Start building block device mappings for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 14:58:35 user nova-compute[70924]: DEBUG nova.compute.manager [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] Start spawning the instance on the hypervisor. {{(pid=70924) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 14:58:35 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] Creating instance directory {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 14:58:35 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] Creating image(s)
Jul 29 14:58:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Acquiring lock "/opt/stack/data/nova/instances/47104e57-c193-4a85-a2cf-677f0debe373/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:58:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "/opt/stack/data/nova/instances/47104e57-c193-4a85-a2cf-677f0debe373/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:58:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "/opt/stack/data/nova/instances/47104e57-c193-4a85-a2cf-677f0debe373/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:58:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:58:35 user nova-compute[70924]: DEBUG nova.policy [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '12cb8299e4d24946bc41a86493f4b426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadc9385b3b46eebc6e0d81814521af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70924) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 14:58:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.146s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:58:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Acquiring lock "bd72453517468710f1de26b27fb0ea28688e9009" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:58:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:58:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:58:36 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.145s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:58:36 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/47104e57-c193-4a85-a2cf-677f0debe373/disk 1073741824 {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:58:36 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/47104e57-c193-4a85-a2cf-677f0debe373/disk 1073741824" returned: 0 in 0.058s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:58:36 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.214s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:58:36 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:58:36 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.151s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:58:36 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Checking if we can resize image /opt/stack/data/nova/instances/47104e57-c193-4a85-a2cf-677f0debe373/disk. size=1073741824 {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 14:58:36 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47104e57-c193-4a85-a2cf-677f0debe373/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:58:36 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47104e57-c193-4a85-a2cf-677f0debe373/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:58:36 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Cannot resize image /opt/stack/data/nova/instances/47104e57-c193-4a85-a2cf-677f0debe373/disk to a smaller size. {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 14:58:36 user nova-compute[70924]: DEBUG nova.objects.instance [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lazy-loading 'migration_context' on Instance uuid 47104e57-c193-4a85-a2cf-677f0debe373 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:58:36 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] Created local disks {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 14:58:36 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] Ensure instance console log exists: /opt/stack/data/nova/instances/47104e57-c193-4a85-a2cf-677f0debe373/console.log {{(pid=70924) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 14:58:36 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:58:36 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:58:36 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:58:37 user nova-compute[70924]: DEBUG nova.network.neutron [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] Successfully created port: 5703ca74-726a-4421-bdda-11432cacd536 {{(pid=70924) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 14:58:37 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Acquiring lock "b3efaa8e-7138-40be-a271-8a344eac3e48" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:58:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "b3efaa8e-7138-40be-a271-8a344eac3e48" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:58:38 user nova-compute[70924]: DEBUG nova.compute.manager [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Starting instance... {{(pid=70924) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 14:58:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:58:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:58:38 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70924) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 14:58:38 user nova-compute[70924]: INFO nova.compute.claims [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Claim successful on node user
Jul 29 14:58:38 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:38 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:58:38 user nova-compute[70924]: DEBUG nova.network.neutron [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] Successfully updated port: 5703ca74-726a-4421-bdda-11432cacd536 {{(pid=70924) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 14:58:38 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:58:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Acquiring lock "refresh_cache-47104e57-c193-4a85-a2cf-677f0debe373" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:58:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Acquired lock "refresh_cache-47104e57-c193-4a85-a2cf-677f0debe373" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:58:38 user nova-compute[70924]: DEBUG nova.network.neutron [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 14:58:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.601s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:58:38 user nova-compute[70924]: DEBUG nova.compute.manager [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Start building networks asynchronously for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 14:58:38 user nova-compute[70924]: DEBUG nova.compute.manager [req-12c51bc3-3774-4891-962b-080437b91ad5 req-999a8960-aeb3-469c-bfd9-55c667ac53c2 service nova] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] Received event network-changed-5703ca74-726a-4421-bdda-11432cacd536 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:58:38 user nova-compute[70924]: DEBUG nova.compute.manager [req-12c51bc3-3774-4891-962b-080437b91ad5 req-999a8960-aeb3-469c-bfd9-55c667ac53c2 service nova] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] Refreshing instance network info cache due to event network-changed-5703ca74-726a-4421-bdda-11432cacd536. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:58:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-12c51bc3-3774-4891-962b-080437b91ad5 req-999a8960-aeb3-469c-bfd9-55c667ac53c2 service nova] Acquiring lock "refresh_cache-47104e57-c193-4a85-a2cf-677f0debe373" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:58:38 user nova-compute[70924]: DEBUG nova.compute.manager [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Allocating IP information in the background. {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 14:58:38 user nova-compute[70924]: DEBUG nova.network.neutron [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] allocate_for_instance() {{(pid=70924) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 14:58:38 user nova-compute[70924]: DEBUG nova.network.neutron [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] Instance cache missing network info. {{(pid=70924) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 14:58:38 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 14:58:38 user nova-compute[70924]: DEBUG nova.compute.manager [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Start building block device mappings for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 14:58:38 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:39 user nova-compute[70924]: DEBUG nova.policy [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '761e4287afb94bf4ad93c09a43bada1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0388bcf487e492082e85b183f38765c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70924) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 14:58:39 user nova-compute[70924]: DEBUG nova.compute.manager [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Start spawning the instance on the hypervisor. {{(pid=70924) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 14:58:39 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Creating instance directory {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 14:58:39 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Creating image(s)
Jul 29 14:58:39 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Acquiring lock "/opt/stack/data/nova/instances/b3efaa8e-7138-40be-a271-8a344eac3e48/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:58:39 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "/opt/stack/data/nova/instances/b3efaa8e-7138-40be-a271-8a344eac3e48/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:58:39 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "/opt/stack/data/nova/instances/b3efaa8e-7138-40be-a271-8a344eac3e48/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:58:39 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:58:39 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.161s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:58:39 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Acquiring lock "bd72453517468710f1de26b27fb0ea28688e9009" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:58:39 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:58:39 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:58:39 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.166s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:58:39 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/b3efaa8e-7138-40be-a271-8a344eac3e48/disk 1073741824 {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:58:39 user nova-compute[70924]: DEBUG nova.network.neutron [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] Updating instance_info_cache with network_info: [{"id": "5703ca74-726a-4421-bdda-11432cacd536", "address": "fa:16:3e:62:6c:e1", "network": {"id": "f80826fa-fada-45b9-b969-fd539fd34fd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-465377443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9aadc9385b3b46eebc6e0d81814521af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5703ca74-72", "ovs_interfaceid": "5703ca74-726a-4421-bdda-11432cacd536", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:58:39 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Releasing lock "refresh_cache-47104e57-c193-4a85-a2cf-677f0debe373" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:58:39 user nova-compute[70924]: DEBUG nova.compute.manager [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] Instance network_info: |[{"id": "5703ca74-726a-4421-bdda-11432cacd536", "address": "fa:16:3e:62:6c:e1", "network": {"id": "f80826fa-fada-45b9-b969-fd539fd34fd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-465377443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9aadc9385b3b46eebc6e0d81814521af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5703ca74-72", "ovs_interfaceid": "5703ca74-726a-4421-bdda-11432cacd536", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 14:58:39 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/b3efaa8e-7138-40be-a271-8a344eac3e48/disk 1073741824" returned: 0 in 0.099s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:58:39 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-12c51bc3-3774-4891-962b-080437b91ad5 req-999a8960-aeb3-469c-bfd9-55c667ac53c2 service nova] Acquired lock "refresh_cache-47104e57-c193-4a85-a2cf-677f0debe373" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:58:39 user nova-compute[70924]: DEBUG nova.network.neutron [req-12c51bc3-3774-4891-962b-080437b91ad5 req-999a8960-aeb3-469c-bfd9-55c667ac53c2 service nova] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] Refreshing network info cache for port 5703ca74-726a-4421-bdda-11432cacd536 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:58:39 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] Start _get_guest_xml network_info=[{"id": "5703ca74-726a-4421-bdda-11432cacd536", "address": "fa:16:3e:62:6c:e1", "network": {"id": "f80826fa-fada-45b9-b969-fd539fd34fd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-465377443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9aadc9385b3b46eebc6e0d81814521af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5703ca74-72", "ovs_interfaceid": "5703ca74-726a-4421-bdda-11432cacd536", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '3aba2e73-6832-404b-8bd0-d0503ce82b8c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 14:58:39 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:58:39 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:58:39 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:58:39 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:58:39 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 14:58:39 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] CPU controller missing on host. {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 14:58:39 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 14:58:39 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] CPU controller found on host. {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 14:58:39 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70924) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 14:58:39 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T14:36:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 14:58:39 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Flavor limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 14:58:39 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Image limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 14:58:39 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Flavor pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 14:58:39 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Image pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 14:58:39 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 14:58:39 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 14:58:39 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 14:58:39 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Got 1 possible topologies {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 14:58:39 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 14:58:39 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 14:58:39 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:58:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-238083547',display_name='tempest-AttachVolumeNegativeTest-server-238083547',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-238083547',id=34,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7FfMkGhmgsKAFS+pIpTfwma7RjXgH4n7Q/niWGGZwznk9kIoThyXjpoAIheWSnt1EOLhCdmo0A/ENFnR7oAIN6OMGPY4SbtF76ilO4sybV6YXZaJTcTCd7aGZW7HgRTw==',key_name='tempest-keypair-1870126065',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9aadc9385b3b46eebc6e0d81814521af',ramdisk_id='',reservation_id='r-dmzg0ayj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-972203101',owner_user_name='tempest-AttachVolumeNegativeTest-972203101-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:58:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='12cb8299e4d24946bc41a86493f4b426',uuid=47104e57-c193-4a85-a2cf-677f0debe373,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5703ca74-726a-4421-bdda-11432cacd536", "address": "fa:16:3e:62:6c:e1", "network": {"id": "f80826fa-fada-45b9-b969-fd539fd34fd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-465377443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9aadc9385b3b46eebc6e0d81814521af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5703ca74-72", "ovs_interfaceid": "5703ca74-726a-4421-bdda-11432cacd536", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:58:39 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Converting VIF {"id": "5703ca74-726a-4421-bdda-11432cacd536", "address": "fa:16:3e:62:6c:e1", "network": {"id": "f80826fa-fada-45b9-b969-fd539fd34fd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-465377443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9aadc9385b3b46eebc6e0d81814521af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5703ca74-72", "ovs_interfaceid": "5703ca74-726a-4421-bdda-11432cacd536", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:58:39 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:6c:e1,bridge_name='br-int',has_traffic_filtering=True,id=5703ca74-726a-4421-bdda-11432cacd536,network=Network(f80826fa-fada-45b9-b969-fd539fd34fd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5703ca74-72') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:58:39 user nova-compute[70924]: DEBUG nova.objects.instance [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lazy-loading 'pci_devices' on Instance uuid 47104e57-c193-4a85-a2cf-677f0debe373 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:58:39 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] End _get_guest_xml xml=<domain type="kvm">
Jul 29 14:58:39 user nova-compute[70924]:   <uuid>47104e57-c193-4a85-a2cf-677f0debe373</uuid>
Jul 29 14:58:39 user nova-compute[70924]:   <name>instance-00000022</name>
Jul 29 14:58:39 user nova-compute[70924]:   <memory>524288</memory>
Jul 29 14:58:39 user nova-compute[70924]:   <vcpu>1</vcpu>
Jul 29 14:58:39 user nova-compute[70924]:   <metadata>
Jul 29 14:58:39 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 14:58:39 user nova-compute[70924]:       <nova:package version="0.0.0"/>
Jul 29 14:58:39 user nova-compute[70924]:       <nova:name>tempest-AttachVolumeNegativeTest-server-238083547</nova:name>
Jul 29 14:58:39 user nova-compute[70924]:       <nova:creationTime>2023-07-29 14:58:39</nova:creationTime>
Jul 29 14:58:39 user nova-compute[70924]:       <nova:flavor name="m1.tiny">
Jul 29 14:58:39 user nova-compute[70924]:         <nova:memory>512</nova:memory>
Jul 29 14:58:39 user nova-compute[70924]:         <nova:disk>1</nova:disk>
Jul 29 14:58:39 user nova-compute[70924]:         <nova:swap>0</nova:swap>
Jul 29 14:58:39 user nova-compute[70924]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 14:58:39 user nova-compute[70924]:         <nova:vcpus>1</nova:vcpus>
Jul 29 14:58:39 user nova-compute[70924]:       </nova:flavor>
Jul 29 14:58:39 user nova-compute[70924]:       <nova:owner>
Jul 29 14:58:39 user nova-compute[70924]:         <nova:user uuid="12cb8299e4d24946bc41a86493f4b426">tempest-AttachVolumeNegativeTest-972203101-project-member</nova:user>
Jul 29 14:58:39 user nova-compute[70924]:         <nova:project uuid="9aadc9385b3b46eebc6e0d81814521af">tempest-AttachVolumeNegativeTest-972203101</nova:project>
Jul 29 14:58:39 user nova-compute[70924]:       </nova:owner>
Jul 29 14:58:39 user nova-compute[70924]:       <nova:root type="image" uuid="3aba2e73-6832-404b-8bd0-d0503ce82b8c"/>
Jul 29 14:58:39 user nova-compute[70924]:       <nova:ports>
Jul 29 14:58:39 user nova-compute[70924]:         <nova:port uuid="5703ca74-726a-4421-bdda-11432cacd536">
Jul 29 14:58:39 user nova-compute[70924]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 29 14:58:39 user nova-compute[70924]:         </nova:port>
Jul 29 14:58:39 user nova-compute[70924]:       </nova:ports>
Jul 29 14:58:39 user nova-compute[70924]:     </nova:instance>
Jul 29 14:58:39 user nova-compute[70924]:   </metadata>
Jul 29 14:58:39 user nova-compute[70924]:   <sysinfo type="smbios">
Jul 29 14:58:39 user nova-compute[70924]:     <system>
Jul 29 14:58:39 user nova-compute[70924]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 14:58:39 user nova-compute[70924]:       <entry name="product">OpenStack Nova</entry>
Jul 29 14:58:39 user nova-compute[70924]:       <entry name="version">0.0.0</entry>
Jul 29 14:58:39 user nova-compute[70924]:       <entry name="serial">47104e57-c193-4a85-a2cf-677f0debe373</entry>
Jul 29 14:58:39 user nova-compute[70924]:       <entry name="uuid">47104e57-c193-4a85-a2cf-677f0debe373</entry>
Jul 29 14:58:39 user nova-compute[70924]:       <entry name="family">Virtual Machine</entry>
Jul 29 14:58:39 user nova-compute[70924]:     </system>
Jul 29 14:58:39 user nova-compute[70924]:   </sysinfo>
Jul 29 14:58:39 user nova-compute[70924]:   <os>
Jul 29 14:58:39 user nova-compute[70924]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 14:58:39 user nova-compute[70924]:     <boot dev="hd"/>
Jul 29 14:58:39 user nova-compute[70924]:     <smbios mode="sysinfo"/>
Jul 29 14:58:39 user nova-compute[70924]:   </os>
Jul 29 14:58:39 user nova-compute[70924]:   <features>
Jul 29 14:58:39 user nova-compute[70924]:     <acpi/>
Jul 29 14:58:39 user nova-compute[70924]:     <apic/>
Jul 29 14:58:39 user nova-compute[70924]:     <vmcoreinfo/>
Jul 29 14:58:39 user nova-compute[70924]:   </features>
Jul 29 14:58:39 user nova-compute[70924]:   <clock offset="utc">
Jul 29 14:58:39 user nova-compute[70924]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 14:58:39 user nova-compute[70924]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 14:58:39 user nova-compute[70924]:     <timer name="hpet" present="no"/>
Jul 29 14:58:39 user nova-compute[70924]:   </clock>
Jul 29 14:58:39 user nova-compute[70924]:   <cpu mode="custom" match="exact">
Jul 29 14:58:39 user nova-compute[70924]:     <model>Nehalem</model>
Jul 29 14:58:39 user nova-compute[70924]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 14:58:39 user nova-compute[70924]:   </cpu>
Jul 29 14:58:39 user nova-compute[70924]:   <devices>
Jul 29 14:58:39 user nova-compute[70924]:     <disk type="file" device="disk">
Jul 29 14:58:39 user nova-compute[70924]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 14:58:39 user nova-compute[70924]:       <source file="/opt/stack/data/nova/instances/47104e57-c193-4a85-a2cf-677f0debe373/disk"/>
Jul 29 14:58:39 user nova-compute[70924]:       <target dev="vda" bus="virtio"/>
Jul 29 14:58:39 user nova-compute[70924]:     </disk>
Jul 29 14:58:39 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 14:58:39 user nova-compute[70924]:       <mac address="fa:16:3e:62:6c:e1"/>
Jul 29 14:58:39 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:58:39 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 14:58:39 user nova-compute[70924]:       <target dev="tap5703ca74-72"/>
Jul 29 14:58:39 user nova-compute[70924]:     </interface>
Jul 29 14:58:39 user nova-compute[70924]:     <serial type="pty">
Jul 29 14:58:39 user nova-compute[70924]:       <log file="/opt/stack/data/nova/instances/47104e57-c193-4a85-a2cf-677f0debe373/console.log" append="off"/>
Jul 29 14:58:39 user nova-compute[70924]:     </serial>
Jul 29 14:58:39 user nova-compute[70924]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 14:58:39 user nova-compute[70924]:     <video>
Jul 29 14:58:39 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:58:39 user nova-compute[70924]:     </video>
Jul 29 14:58:39 user nova-compute[70924]:     <rng model="virtio">
Jul 29 14:58:39 user nova-compute[70924]:       <backend model="random">/dev/urandom</backend>
Jul 29 14:58:39 user nova-compute[70924]:     </rng>
Jul 29 14:58:39 user nova-compute[70924]:     <controller type="usb" index="0" model="none"/>
Jul 29 14:58:39 user nova-compute[70924]:     <memballoon model="virtio">
Jul 29 14:58:39 user nova-compute[70924]:       <stats period="10"/>
Jul 29 14:58:39 user nova-compute[70924]:     </memballoon>
Jul 29 14:58:39 user nova-compute[70924]:   </devices>
Jul 29 14:58:39 user nova-compute[70924]: </domain>
Jul 29 14:58:39 user nova-compute[70924]:  {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 14:58:39 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:58:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-238083547',display_name='tempest-AttachVolumeNegativeTest-server-238083547',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-238083547',id=34,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7FfMkGhmgsKAFS+pIpTfwma7RjXgH4n7Q/niWGGZwznk9kIoThyXjpoAIheWSnt1EOLhCdmo0A/ENFnR7oAIN6OMGPY4SbtF76ilO4sybV6YXZaJTcTCd7aGZW7HgRTw==',key_name='tempest-keypair-1870126065',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9aadc9385b3b46eebc6e0d81814521af',ramdisk_id='',reservation_id='r-dmzg0ayj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-972203101',owner_user_name='tempest-AttachVolumeNegativeTest-972203101-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:58:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='12cb8299e4d24946bc41a86493f4b426',uuid=47104e57-c193-4a85-a2cf-677f0debe373,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5703ca74-726a-4421-bdda-11432cacd536", "address": "fa:16:3e:62:6c:e1", "network": {"id": "f80826fa-fada-45b9-b969-fd539fd34fd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-465377443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9aadc9385b3b46eebc6e0d81814521af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5703ca74-72", "ovs_interfaceid": "5703ca74-726a-4421-bdda-11432cacd536", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 14:58:39 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Converting VIF {"id": "5703ca74-726a-4421-bdda-11432cacd536", "address": "fa:16:3e:62:6c:e1", "network": {"id": "f80826fa-fada-45b9-b969-fd539fd34fd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-465377443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9aadc9385b3b46eebc6e0d81814521af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5703ca74-72", "ovs_interfaceid": "5703ca74-726a-4421-bdda-11432cacd536", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:58:39 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:6c:e1,bridge_name='br-int',has_traffic_filtering=True,id=5703ca74-726a-4421-bdda-11432cacd536,network=Network(f80826fa-fada-45b9-b969-fd539fd34fd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5703ca74-72') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:58:39 user nova-compute[70924]: DEBUG os_vif [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:6c:e1,bridge_name='br-int',has_traffic_filtering=True,id=5703ca74-726a-4421-bdda-11432cacd536,network=Network(f80826fa-fada-45b9-b969-fd539fd34fd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5703ca74-72') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 14:58:39 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:39 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:58:39 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 14:58:39 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.167s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:58:39 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b3efaa8e-7138-40be-a271-8a344eac3e48/disk. size=1073741824 {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 14:58:39 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3efaa8e-7138-40be-a271-8a344eac3e48/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:58:39 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:39 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5703ca74-72, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:58:39 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5703ca74-72, col_values=(('external_ids', {'iface-id': '5703ca74-726a-4421-bdda-11432cacd536', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:6c:e1', 'vm-uuid': '47104e57-c193-4a85-a2cf-677f0debe373'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:58:39 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:58:39 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:39 user nova-compute[70924]: INFO os_vif [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:6c:e1,bridge_name='br-int',has_traffic_filtering=True,id=5703ca74-726a-4421-bdda-11432cacd536,network=Network(f80826fa-fada-45b9-b969-fd539fd34fd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5703ca74-72')
Jul 29 14:58:39 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:58:39 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] No VIF found with MAC fa:16:3e:62:6c:e1, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:58:39 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3efaa8e-7138-40be-a271-8a344eac3e48/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:58:39 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Cannot resize image /opt/stack/data/nova/instances/b3efaa8e-7138-40be-a271-8a344eac3e48/disk to a smaller size. {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 14:58:39 user nova-compute[70924]: DEBUG nova.objects.instance [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lazy-loading 'migration_context' on Instance uuid b3efaa8e-7138-40be-a271-8a344eac3e48 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:58:39 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Created local disks {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 14:58:39 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Ensure instance console log exists: /opt/stack/data/nova/instances/b3efaa8e-7138-40be-a271-8a344eac3e48/console.log {{(pid=70924) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 14:58:39 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:58:39 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:58:39 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:58:40 user nova-compute[70924]: DEBUG nova.network.neutron [req-12c51bc3-3774-4891-962b-080437b91ad5 req-999a8960-aeb3-469c-bfd9-55c667ac53c2 service nova] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] Updated VIF entry in instance network info cache for port 5703ca74-726a-4421-bdda-11432cacd536. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:58:40 user nova-compute[70924]: DEBUG nova.network.neutron [req-12c51bc3-3774-4891-962b-080437b91ad5 req-999a8960-aeb3-469c-bfd9-55c667ac53c2 service nova] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] Updating instance_info_cache with network_info: [{"id": "5703ca74-726a-4421-bdda-11432cacd536", "address": "fa:16:3e:62:6c:e1", "network": {"id": "f80826fa-fada-45b9-b969-fd539fd34fd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-465377443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9aadc9385b3b46eebc6e0d81814521af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5703ca74-72", "ovs_interfaceid": "5703ca74-726a-4421-bdda-11432cacd536", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:58:40 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-12c51bc3-3774-4891-962b-080437b91ad5 req-999a8960-aeb3-469c-bfd9-55c667ac53c2 service nova] Releasing lock "refresh_cache-47104e57-c193-4a85-a2cf-677f0debe373" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:58:40 user nova-compute[70924]: DEBUG nova.network.neutron [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Successfully created port: 359ef5f3-1689-4a34-b213-a837a6d5668b {{(pid=70924) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 14:58:41 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:41 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:41 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:41 user nova-compute[70924]: DEBUG nova.network.neutron [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Successfully updated port: 359ef5f3-1689-4a34-b213-a837a6d5668b {{(pid=70924) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 14:58:41 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Acquiring lock "refresh_cache-b3efaa8e-7138-40be-a271-8a344eac3e48" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:58:41 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Acquired lock "refresh_cache-b3efaa8e-7138-40be-a271-8a344eac3e48" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:58:41 user nova-compute[70924]: DEBUG nova.network.neutron [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 14:58:41 user nova-compute[70924]: DEBUG nova.compute.manager [req-1b7ea654-4aa3-4526-a9a1-51b839657763 req-2ee973a0-3eb0-4430-9c22-eb5df165267c service nova] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] Received event network-vif-plugged-5703ca74-726a-4421-bdda-11432cacd536 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:58:41 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-1b7ea654-4aa3-4526-a9a1-51b839657763 req-2ee973a0-3eb0-4430-9c22-eb5df165267c service nova] Acquiring lock "47104e57-c193-4a85-a2cf-677f0debe373-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:58:41 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-1b7ea654-4aa3-4526-a9a1-51b839657763 req-2ee973a0-3eb0-4430-9c22-eb5df165267c service nova] Lock "47104e57-c193-4a85-a2cf-677f0debe373-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:58:41 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-1b7ea654-4aa3-4526-a9a1-51b839657763 req-2ee973a0-3eb0-4430-9c22-eb5df165267c service nova] Lock "47104e57-c193-4a85-a2cf-677f0debe373-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:58:41 user nova-compute[70924]: DEBUG nova.compute.manager [req-1b7ea654-4aa3-4526-a9a1-51b839657763 req-2ee973a0-3eb0-4430-9c22-eb5df165267c service nova] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] No waiting events found dispatching network-vif-plugged-5703ca74-726a-4421-bdda-11432cacd536 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:58:41 user nova-compute[70924]: WARNING nova.compute.manager [req-1b7ea654-4aa3-4526-a9a1-51b839657763 req-2ee973a0-3eb0-4430-9c22-eb5df165267c service nova] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] Received unexpected event network-vif-plugged-5703ca74-726a-4421-bdda-11432cacd536 for instance with vm_state building and task_state spawning.
Jul 29 14:58:41 user nova-compute[70924]: DEBUG nova.network.neutron [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Instance cache missing network info. {{(pid=70924) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 14:58:41 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:41 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:41 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:41 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:41 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:41 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:42 user nova-compute[70924]: DEBUG nova.network.neutron [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Updating instance_info_cache with network_info: [{"id": "359ef5f3-1689-4a34-b213-a837a6d5668b", "address": "fa:16:3e:9c:88:44", "network": {"id": "46d2cfde-13db-4cf3-af0e-4d6742f37044", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1642265305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0388bcf487e492082e85b183f38765c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap359ef5f3-16", "ovs_interfaceid": "359ef5f3-1689-4a34-b213-a837a6d5668b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:58:42 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Releasing lock "refresh_cache-b3efaa8e-7138-40be-a271-8a344eac3e48" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:58:42 user nova-compute[70924]: DEBUG nova.compute.manager [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Instance network_info: |[{"id": "359ef5f3-1689-4a34-b213-a837a6d5668b", "address": "fa:16:3e:9c:88:44", "network": {"id": "46d2cfde-13db-4cf3-af0e-4d6742f37044", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1642265305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0388bcf487e492082e85b183f38765c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap359ef5f3-16", "ovs_interfaceid": "359ef5f3-1689-4a34-b213-a837a6d5668b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 14:58:42 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Start _get_guest_xml network_info=[{"id": "359ef5f3-1689-4a34-b213-a837a6d5668b", "address": "fa:16:3e:9c:88:44", "network": {"id": "46d2cfde-13db-4cf3-af0e-4d6742f37044", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1642265305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0388bcf487e492082e85b183f38765c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap359ef5f3-16", "ovs_interfaceid": "359ef5f3-1689-4a34-b213-a837a6d5668b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '3aba2e73-6832-404b-8bd0-d0503ce82b8c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 14:58:42 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:58:42 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:58:42 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 14:58:42 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] CPU controller missing on host. {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 14:58:42 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 14:58:42 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] CPU controller found on host. {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 14:58:42 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70924) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 14:58:42 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T14:36:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 14:58:42 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Flavor limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 14:58:42 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Image limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 14:58:42 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Flavor pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 14:58:42 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Image pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 14:58:42 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 14:58:42 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 14:58:42 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 14:58:42 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Got 1 possible topologies {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 14:58:42 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 14:58:42 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 14:58:42 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:58:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-151888036',display_name='tempest-AttachVolumeTestJSON-server-151888036',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-151888036',id=35,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOu7s/P/MUQvax9l2hEZsyedKa1s2/6DOUe4Gvh7NV9IPvsrfXmDsBgRPnRO5eFoKleVUb/fil72F9codRnUwvpRBRl48lTdZUBxU2F2SGnvKLPDndPKzwyDV7ormJ2iTg==',key_name='tempest-keypair-2063174849',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0388bcf487e492082e85b183f38765c',ramdisk_id='',reservation_id='r-jhw8v6we',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-651630277',owner_user_name='tempest-AttachVolumeTestJSON-651630277-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:58:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='761e4287afb94bf4ad93c09a43bada1f',uuid=b3efaa8e-7138-40be-a271-8a344eac3e48,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "359ef5f3-1689-4a34-b213-a837a6d5668b", "address": "fa:16:3e:9c:88:44", "network": {"id": "46d2cfde-13db-4cf3-af0e-4d6742f37044", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1642265305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0388bcf487e492082e85b183f38765c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap359ef5f3-16", "ovs_interfaceid": "359ef5f3-1689-4a34-b213-a837a6d5668b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:58:42 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Converting VIF {"id": "359ef5f3-1689-4a34-b213-a837a6d5668b", "address": "fa:16:3e:9c:88:44", "network": {"id": "46d2cfde-13db-4cf3-af0e-4d6742f37044", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1642265305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0388bcf487e492082e85b183f38765c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap359ef5f3-16", "ovs_interfaceid": "359ef5f3-1689-4a34-b213-a837a6d5668b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:58:42 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:88:44,bridge_name='br-int',has_traffic_filtering=True,id=359ef5f3-1689-4a34-b213-a837a6d5668b,network=Network(46d2cfde-13db-4cf3-af0e-4d6742f37044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap359ef5f3-16') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:58:42 user nova-compute[70924]: DEBUG nova.objects.instance [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lazy-loading 'pci_devices' on Instance uuid b3efaa8e-7138-40be-a271-8a344eac3e48 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:58:42 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] End _get_guest_xml xml=<domain type="kvm">
Jul 29 14:58:42 user nova-compute[70924]:   <uuid>b3efaa8e-7138-40be-a271-8a344eac3e48</uuid>
Jul 29 14:58:42 user nova-compute[70924]:   <name>instance-00000023</name>
Jul 29 14:58:42 user nova-compute[70924]:   <memory>524288</memory>
Jul 29 14:58:42 user nova-compute[70924]:   <vcpu>1</vcpu>
Jul 29 14:58:42 user nova-compute[70924]:   <metadata>
Jul 29 14:58:42 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 14:58:42 user nova-compute[70924]:       <nova:package version="0.0.0"/>
Jul 29 14:58:42 user nova-compute[70924]:       <nova:name>tempest-AttachVolumeTestJSON-server-151888036</nova:name>
Jul 29 14:58:42 user nova-compute[70924]:       <nova:creationTime>2023-07-29 14:58:42</nova:creationTime>
Jul 29 14:58:42 user nova-compute[70924]:       <nova:flavor name="m1.tiny">
Jul 29 14:58:42 user nova-compute[70924]:         <nova:memory>512</nova:memory>
Jul 29 14:58:42 user nova-compute[70924]:         <nova:disk>1</nova:disk>
Jul 29 14:58:42 user nova-compute[70924]:         <nova:swap>0</nova:swap>
Jul 29 14:58:42 user nova-compute[70924]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 14:58:42 user nova-compute[70924]:         <nova:vcpus>1</nova:vcpus>
Jul 29 14:58:42 user nova-compute[70924]:       </nova:flavor>
Jul 29 14:58:42 user nova-compute[70924]:       <nova:owner>
Jul 29 14:58:42 user nova-compute[70924]:         <nova:user uuid="761e4287afb94bf4ad93c09a43bada1f">tempest-AttachVolumeTestJSON-651630277-project-member</nova:user>
Jul 29 14:58:42 user nova-compute[70924]:         <nova:project uuid="a0388bcf487e492082e85b183f38765c">tempest-AttachVolumeTestJSON-651630277</nova:project>
Jul 29 14:58:42 user nova-compute[70924]:       </nova:owner>
Jul 29 14:58:42 user nova-compute[70924]:       <nova:root type="image" uuid="3aba2e73-6832-404b-8bd0-d0503ce82b8c"/>
Jul 29 14:58:42 user nova-compute[70924]:       <nova:ports>
Jul 29 14:58:42 user nova-compute[70924]:         <nova:port uuid="359ef5f3-1689-4a34-b213-a837a6d5668b">
Jul 29 14:58:42 user nova-compute[70924]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 29 14:58:42 user nova-compute[70924]:         </nova:port>
Jul 29 14:58:42 user nova-compute[70924]:       </nova:ports>
Jul 29 14:58:42 user nova-compute[70924]:     </nova:instance>
Jul 29 14:58:42 user nova-compute[70924]:   </metadata>
Jul 29 14:58:42 user nova-compute[70924]:   <sysinfo type="smbios">
Jul 29 14:58:42 user nova-compute[70924]:     <system>
Jul 29 14:58:42 user nova-compute[70924]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 14:58:42 user nova-compute[70924]:       <entry name="product">OpenStack Nova</entry>
Jul 29 14:58:42 user nova-compute[70924]:       <entry name="version">0.0.0</entry>
Jul 29 14:58:42 user nova-compute[70924]:       <entry name="serial">b3efaa8e-7138-40be-a271-8a344eac3e48</entry>
Jul 29 14:58:42 user nova-compute[70924]:       <entry name="uuid">b3efaa8e-7138-40be-a271-8a344eac3e48</entry>
Jul 29 14:58:42 user nova-compute[70924]:       <entry name="family">Virtual Machine</entry>
Jul 29 14:58:42 user nova-compute[70924]:     </system>
Jul 29 14:58:42 user nova-compute[70924]:   </sysinfo>
Jul 29 14:58:42 user nova-compute[70924]:   <os>
Jul 29 14:58:42 user nova-compute[70924]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 14:58:42 user nova-compute[70924]:     <boot dev="hd"/>
Jul 29 14:58:42 user nova-compute[70924]:     <smbios mode="sysinfo"/>
Jul 29 14:58:42 user nova-compute[70924]:   </os>
Jul 29 14:58:42 user nova-compute[70924]:   <features>
Jul 29 14:58:42 user nova-compute[70924]:     <acpi/>
Jul 29 14:58:42 user nova-compute[70924]:     <apic/>
Jul 29 14:58:42 user nova-compute[70924]:     <vmcoreinfo/>
Jul 29 14:58:42 user nova-compute[70924]:   </features>
Jul 29 14:58:42 user nova-compute[70924]:   <clock offset="utc">
Jul 29 14:58:42 user nova-compute[70924]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 14:58:42 user nova-compute[70924]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 14:58:42 user nova-compute[70924]:     <timer name="hpet" present="no"/>
Jul 29 14:58:42 user nova-compute[70924]:   </clock>
Jul 29 14:58:42 user nova-compute[70924]:   <cpu mode="custom" match="exact">
Jul 29 14:58:42 user nova-compute[70924]:     <model>Nehalem</model>
Jul 29 14:58:42 user nova-compute[70924]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 14:58:42 user nova-compute[70924]:   </cpu>
Jul 29 14:58:42 user nova-compute[70924]:   <devices>
Jul 29 14:58:42 user nova-compute[70924]:     <disk type="file" device="disk">
Jul 29 14:58:42 user nova-compute[70924]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 14:58:42 user nova-compute[70924]:       <source file="/opt/stack/data/nova/instances/b3efaa8e-7138-40be-a271-8a344eac3e48/disk"/>
Jul 29 14:58:42 user nova-compute[70924]:       <target dev="vda" bus="virtio"/>
Jul 29 14:58:42 user nova-compute[70924]:     </disk>
Jul 29 14:58:42 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 14:58:42 user nova-compute[70924]:       <mac address="fa:16:3e:9c:88:44"/>
Jul 29 14:58:42 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:58:42 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 14:58:42 user nova-compute[70924]:       <target dev="tap359ef5f3-16"/>
Jul 29 14:58:42 user nova-compute[70924]:     </interface>
Jul 29 14:58:42 user nova-compute[70924]:     <serial type="pty">
Jul 29 14:58:42 user nova-compute[70924]:       <log file="/opt/stack/data/nova/instances/b3efaa8e-7138-40be-a271-8a344eac3e48/console.log" append="off"/>
Jul 29 14:58:42 user nova-compute[70924]:     </serial>
Jul 29 14:58:42 user nova-compute[70924]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 14:58:42 user nova-compute[70924]:     <video>
Jul 29 14:58:42 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:58:42 user nova-compute[70924]:     </video>
Jul 29 14:58:42 user nova-compute[70924]:     <rng model="virtio">
Jul 29 14:58:42 user nova-compute[70924]:       <backend model="random">/dev/urandom</backend>
Jul 29 14:58:42 user nova-compute[70924]:     </rng>
Jul 29 14:58:42 user nova-compute[70924]:     <controller type="usb" index="0" model="none"/>
Jul 29 14:58:42 user nova-compute[70924]:     <memballoon model="virtio">
Jul 29 14:58:42 user nova-compute[70924]:       <stats period="10"/>
Jul 29 14:58:42 user nova-compute[70924]:     </memballoon>
Jul 29 14:58:42 user nova-compute[70924]:   </devices>
Jul 29 14:58:42 user nova-compute[70924]: </domain>
Jul 29 14:58:42 user nova-compute[70924]:  {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 14:58:42 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:58:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-151888036',display_name='tempest-AttachVolumeTestJSON-server-151888036',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-151888036',id=35,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOu7s/P/MUQvax9l2hEZsyedKa1s2/6DOUe4Gvh7NV9IPvsrfXmDsBgRPnRO5eFoKleVUb/fil72F9codRnUwvpRBRl48lTdZUBxU2F2SGnvKLPDndPKzwyDV7ormJ2iTg==',key_name='tempest-keypair-2063174849',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0388bcf487e492082e85b183f38765c',ramdisk_id='',reservation_id='r-jhw8v6we',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-651630277',owner_user_name='tempest-AttachVolumeTestJSON-651630277-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:58:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='761e4287afb94bf4ad93c09a43bada1f',uuid=b3efaa8e-7138-40be-a271-8a344eac3e48,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "359ef5f3-1689-4a34-b213-a837a6d5668b", "address": "fa:16:3e:9c:88:44", "network": {"id": "46d2cfde-13db-4cf3-af0e-4d6742f37044", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1642265305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0388bcf487e492082e85b183f38765c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap359ef5f3-16", "ovs_interfaceid": "359ef5f3-1689-4a34-b213-a837a6d5668b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 14:58:42 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Converting VIF {"id": "359ef5f3-1689-4a34-b213-a837a6d5668b", "address": "fa:16:3e:9c:88:44", "network": {"id": "46d2cfde-13db-4cf3-af0e-4d6742f37044", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1642265305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0388bcf487e492082e85b183f38765c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap359ef5f3-16", "ovs_interfaceid": "359ef5f3-1689-4a34-b213-a837a6d5668b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:58:42 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:88:44,bridge_name='br-int',has_traffic_filtering=True,id=359ef5f3-1689-4a34-b213-a837a6d5668b,network=Network(46d2cfde-13db-4cf3-af0e-4d6742f37044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap359ef5f3-16') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:58:42 user nova-compute[70924]: DEBUG os_vif [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:88:44,bridge_name='br-int',has_traffic_filtering=True,id=359ef5f3-1689-4a34-b213-a837a6d5668b,network=Network(46d2cfde-13db-4cf3-af0e-4d6742f37044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap359ef5f3-16') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 14:58:42 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:42 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:58:42 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 14:58:42 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:42 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap359ef5f3-16, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:58:42 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap359ef5f3-16, col_values=(('external_ids', {'iface-id': '359ef5f3-1689-4a34-b213-a837a6d5668b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:88:44', 'vm-uuid': 'b3efaa8e-7138-40be-a271-8a344eac3e48'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:58:42 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:42 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:58:42 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:42 user nova-compute[70924]: INFO os_vif [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:88:44,bridge_name='br-int',has_traffic_filtering=True,id=359ef5f3-1689-4a34-b213-a837a6d5668b,network=Network(46d2cfde-13db-4cf3-af0e-4d6742f37044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap359ef5f3-16')
Jul 29 14:58:42 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:58:42 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] No VIF found with MAC fa:16:3e:9c:88:44, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:58:43 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642723.3570523, 47104e57-c193-4a85-a2cf-677f0debe373 => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:58:43 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] VM Resumed (Lifecycle Event)
Jul 29 14:58:43 user nova-compute[70924]: DEBUG nova.compute.manager [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] Instance event wait completed in 0 seconds for  {{(pid=70924) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 14:58:43 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] Guest created on hypervisor {{(pid=70924) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 14:58:43 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] Instance spawned successfully.
Jul 29 14:58:43 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 14:58:43 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:58:43 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:58:43 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] Found default for hw_cdrom_bus of ide {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:58:43 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] Found default for hw_disk_bus of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:58:43 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] Found default for hw_input_bus of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:58:43 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] Found default for hw_pointer_model of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:58:43 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] Found default for hw_video_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:58:43 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] Found default for hw_vif_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:58:43 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:58:43 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642723.359716, 47104e57-c193-4a85-a2cf-677f0debe373 => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:58:43 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] VM Started (Lifecycle Event)
Jul 29 14:58:43 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:58:43 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:58:43 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:58:43 user nova-compute[70924]: INFO nova.compute.manager [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] Took 7.84 seconds to spawn the instance on the hypervisor.
Jul 29 14:58:43 user nova-compute[70924]: DEBUG nova.compute.manager [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:58:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:43 user nova-compute[70924]: DEBUG nova.compute.manager [req-eaa7b067-26e0-4a22-aa44-661fc986acb3 req-f8ffb92d-ef22-4cce-8a7f-ec7a65354ddb service nova] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Received event network-changed-359ef5f3-1689-4a34-b213-a837a6d5668b {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:58:43 user nova-compute[70924]: DEBUG nova.compute.manager [req-eaa7b067-26e0-4a22-aa44-661fc986acb3 req-f8ffb92d-ef22-4cce-8a7f-ec7a65354ddb service nova] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Refreshing instance network info cache due to event network-changed-359ef5f3-1689-4a34-b213-a837a6d5668b. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:58:43 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-eaa7b067-26e0-4a22-aa44-661fc986acb3 req-f8ffb92d-ef22-4cce-8a7f-ec7a65354ddb service nova] Acquiring lock "refresh_cache-b3efaa8e-7138-40be-a271-8a344eac3e48" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:58:43 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-eaa7b067-26e0-4a22-aa44-661fc986acb3 req-f8ffb92d-ef22-4cce-8a7f-ec7a65354ddb service nova] Acquired lock "refresh_cache-b3efaa8e-7138-40be-a271-8a344eac3e48" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:58:43 user nova-compute[70924]: DEBUG nova.network.neutron [req-eaa7b067-26e0-4a22-aa44-661fc986acb3 req-f8ffb92d-ef22-4cce-8a7f-ec7a65354ddb service nova] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Refreshing network info cache for port 359ef5f3-1689-4a34-b213-a837a6d5668b {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:58:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:43 user nova-compute[70924]: INFO nova.compute.manager [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] Took 8.73 seconds to build instance.
Jul 29 14:58:43 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0b7f0582-8e3d-4f64-a477-d41ed318d4ce tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "47104e57-c193-4a85-a2cf-677f0debe373" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.837s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:58:43 user nova-compute[70924]: DEBUG nova.compute.manager [req-2478ba1b-4c9b-411e-8551-977ff193ecb9 req-775e792e-e918-4f7d-a86d-ae4b11cf4e93 service nova] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Received event network-vif-plugged-359ef5f3-1689-4a34-b213-a837a6d5668b {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:58:43 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-2478ba1b-4c9b-411e-8551-977ff193ecb9 req-775e792e-e918-4f7d-a86d-ae4b11cf4e93 service nova] Acquiring lock "b3efaa8e-7138-40be-a271-8a344eac3e48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:58:43 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-2478ba1b-4c9b-411e-8551-977ff193ecb9 req-775e792e-e918-4f7d-a86d-ae4b11cf4e93 service nova] Lock "b3efaa8e-7138-40be-a271-8a344eac3e48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:58:43 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-2478ba1b-4c9b-411e-8551-977ff193ecb9 req-775e792e-e918-4f7d-a86d-ae4b11cf4e93 service nova] Lock "b3efaa8e-7138-40be-a271-8a344eac3e48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:58:43 user nova-compute[70924]: DEBUG nova.compute.manager [req-2478ba1b-4c9b-411e-8551-977ff193ecb9 req-775e792e-e918-4f7d-a86d-ae4b11cf4e93 service nova] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] No waiting events found dispatching network-vif-plugged-359ef5f3-1689-4a34-b213-a837a6d5668b {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:58:43 user nova-compute[70924]: WARNING nova.compute.manager [req-2478ba1b-4c9b-411e-8551-977ff193ecb9 req-775e792e-e918-4f7d-a86d-ae4b11cf4e93 service nova] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Received unexpected event network-vif-plugged-359ef5f3-1689-4a34-b213-a837a6d5668b for instance with vm_state building and task_state spawning.
Jul 29 14:58:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:44 user nova-compute[70924]: DEBUG nova.network.neutron [req-eaa7b067-26e0-4a22-aa44-661fc986acb3 req-f8ffb92d-ef22-4cce-8a7f-ec7a65354ddb service nova] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Updated VIF entry in instance network info cache for port 359ef5f3-1689-4a34-b213-a837a6d5668b. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:58:44 user nova-compute[70924]: DEBUG nova.network.neutron [req-eaa7b067-26e0-4a22-aa44-661fc986acb3 req-f8ffb92d-ef22-4cce-8a7f-ec7a65354ddb service nova] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Updating instance_info_cache with network_info: [{"id": "359ef5f3-1689-4a34-b213-a837a6d5668b", "address": "fa:16:3e:9c:88:44", "network": {"id": "46d2cfde-13db-4cf3-af0e-4d6742f37044", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1642265305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0388bcf487e492082e85b183f38765c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap359ef5f3-16", "ovs_interfaceid": "359ef5f3-1689-4a34-b213-a837a6d5668b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:58:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-eaa7b067-26e0-4a22-aa44-661fc986acb3 req-f8ffb92d-ef22-4cce-8a7f-ec7a65354ddb service nova] Releasing lock "refresh_cache-b3efaa8e-7138-40be-a271-8a344eac3e48" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:58:44 user nova-compute[70924]: DEBUG nova.compute.manager [req-eaa7b067-26e0-4a22-aa44-661fc986acb3 req-f8ffb92d-ef22-4cce-8a7f-ec7a65354ddb service nova] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] Received event network-vif-plugged-5703ca74-726a-4421-bdda-11432cacd536 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:58:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-eaa7b067-26e0-4a22-aa44-661fc986acb3 req-f8ffb92d-ef22-4cce-8a7f-ec7a65354ddb service nova] Acquiring lock "47104e57-c193-4a85-a2cf-677f0debe373-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:58:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-eaa7b067-26e0-4a22-aa44-661fc986acb3 req-f8ffb92d-ef22-4cce-8a7f-ec7a65354ddb service nova] Lock "47104e57-c193-4a85-a2cf-677f0debe373-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:58:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-eaa7b067-26e0-4a22-aa44-661fc986acb3 req-f8ffb92d-ef22-4cce-8a7f-ec7a65354ddb service nova] Lock "47104e57-c193-4a85-a2cf-677f0debe373-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:58:44 user nova-compute[70924]: DEBUG nova.compute.manager [req-eaa7b067-26e0-4a22-aa44-661fc986acb3 req-f8ffb92d-ef22-4cce-8a7f-ec7a65354ddb service nova] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] No waiting events found dispatching network-vif-plugged-5703ca74-726a-4421-bdda-11432cacd536 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:58:44 user nova-compute[70924]: WARNING nova.compute.manager [req-eaa7b067-26e0-4a22-aa44-661fc986acb3 req-f8ffb92d-ef22-4cce-8a7f-ec7a65354ddb service nova] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] Received unexpected event network-vif-plugged-5703ca74-726a-4421-bdda-11432cacd536 for instance with vm_state building and task_state spawning.
Jul 29 14:58:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:45 user nova-compute[70924]: DEBUG nova.compute.manager [req-7ad41b85-28f1-489b-824c-e29e7363c356 req-cf00db86-89cb-4a39-b770-2807bad1ed3f service nova] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Received event network-vif-plugged-359ef5f3-1689-4a34-b213-a837a6d5668b {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:58:45 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-7ad41b85-28f1-489b-824c-e29e7363c356 req-cf00db86-89cb-4a39-b770-2807bad1ed3f service nova] Acquiring lock "b3efaa8e-7138-40be-a271-8a344eac3e48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:58:45 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-7ad41b85-28f1-489b-824c-e29e7363c356 req-cf00db86-89cb-4a39-b770-2807bad1ed3f service nova] Lock "b3efaa8e-7138-40be-a271-8a344eac3e48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:58:45 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-7ad41b85-28f1-489b-824c-e29e7363c356 req-cf00db86-89cb-4a39-b770-2807bad1ed3f service nova] Lock "b3efaa8e-7138-40be-a271-8a344eac3e48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:58:45 user nova-compute[70924]: DEBUG nova.compute.manager [req-7ad41b85-28f1-489b-824c-e29e7363c356 req-cf00db86-89cb-4a39-b770-2807bad1ed3f service nova] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] No waiting events found dispatching network-vif-plugged-359ef5f3-1689-4a34-b213-a837a6d5668b {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:58:45 user nova-compute[70924]: WARNING nova.compute.manager [req-7ad41b85-28f1-489b-824c-e29e7363c356 req-cf00db86-89cb-4a39-b770-2807bad1ed3f service nova] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Received unexpected event network-vif-plugged-359ef5f3-1689-4a34-b213-a837a6d5668b for instance with vm_state building and task_state spawning.
Jul 29 14:58:46 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642726.035323, b3efaa8e-7138-40be-a271-8a344eac3e48 => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:58:46 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] VM Resumed (Lifecycle Event)
Jul 29 14:58:46 user nova-compute[70924]: DEBUG nova.compute.manager [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Instance event wait completed in 0 seconds for  {{(pid=70924) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 14:58:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Guest created on hypervisor {{(pid=70924) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 14:58:46 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Instance spawned successfully.
Jul 29 14:58:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 14:58:46 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:58:46 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:58:46 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:58:46 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642726.0357094, b3efaa8e-7138-40be-a271-8a344eac3e48 => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:58:46 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] VM Started (Lifecycle Event)
Jul 29 14:58:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Found default for hw_cdrom_bus of ide {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:58:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Found default for hw_disk_bus of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:58:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Found default for hw_input_bus of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:58:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Found default for hw_pointer_model of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:58:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Found default for hw_video_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:58:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Found default for hw_vif_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:58:46 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:58:46 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:58:46 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:58:46 user nova-compute[70924]: INFO nova.compute.manager [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Took 7.23 seconds to spawn the instance on the hypervisor.
Jul 29 14:58:46 user nova-compute[70924]: DEBUG nova.compute.manager [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:58:46 user nova-compute[70924]: INFO nova.compute.manager [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Took 8.26 seconds to build instance.
Jul 29 14:58:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5473695c-0c75-4c71-9dbe-cafebb5baf6f tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "b3efaa8e-7138-40be-a271-8a344eac3e48" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.378s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:58:47 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:48 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a882bd94-34d2-4fac-bb6d-7f3ab601d95f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Acquiring lock "b001d812-892a-4756-9f37-fc0c5ef5f0a7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:58:48 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a882bd94-34d2-4fac-bb6d-7f3ab601d95f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "b001d812-892a-4756-9f37-fc0c5ef5f0a7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:58:48 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a882bd94-34d2-4fac-bb6d-7f3ab601d95f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Acquiring lock "b001d812-892a-4756-9f37-fc0c5ef5f0a7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:58:48 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a882bd94-34d2-4fac-bb6d-7f3ab601d95f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "b001d812-892a-4756-9f37-fc0c5ef5f0a7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:58:48 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a882bd94-34d2-4fac-bb6d-7f3ab601d95f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "b001d812-892a-4756-9f37-fc0c5ef5f0a7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:58:48 user nova-compute[70924]: INFO nova.compute.manager [None req-a882bd94-34d2-4fac-bb6d-7f3ab601d95f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Terminating instance
Jul 29 14:58:48 user nova-compute[70924]: DEBUG nova.compute.manager [None req-a882bd94-34d2-4fac-bb6d-7f3ab601d95f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Start destroying the instance on the hypervisor. {{(pid=70924) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 14:58:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:49 user nova-compute[70924]: DEBUG nova.compute.manager [req-61d6cf1c-e78c-42ee-823a-ed2d1f9909b0 req-5e3f424c-e7da-4116-aa28-2102cb30f4a5 service nova] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Received event network-vif-unplugged-a17ada4e-69e7-42ef-b08d-f405a5da6368 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:58:49 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-61d6cf1c-e78c-42ee-823a-ed2d1f9909b0 req-5e3f424c-e7da-4116-aa28-2102cb30f4a5 service nova] Acquiring lock "b001d812-892a-4756-9f37-fc0c5ef5f0a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:58:49 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-61d6cf1c-e78c-42ee-823a-ed2d1f9909b0 req-5e3f424c-e7da-4116-aa28-2102cb30f4a5 service nova] Lock "b001d812-892a-4756-9f37-fc0c5ef5f0a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:58:49 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-61d6cf1c-e78c-42ee-823a-ed2d1f9909b0 req-5e3f424c-e7da-4116-aa28-2102cb30f4a5 service nova] Lock "b001d812-892a-4756-9f37-fc0c5ef5f0a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:58:49 user nova-compute[70924]: DEBUG nova.compute.manager [req-61d6cf1c-e78c-42ee-823a-ed2d1f9909b0 req-5e3f424c-e7da-4116-aa28-2102cb30f4a5 service nova] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] No waiting events found dispatching network-vif-unplugged-a17ada4e-69e7-42ef-b08d-f405a5da6368 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:58:49 user nova-compute[70924]: DEBUG nova.compute.manager [req-61d6cf1c-e78c-42ee-823a-ed2d1f9909b0 req-5e3f424c-e7da-4116-aa28-2102cb30f4a5 service nova] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Received event network-vif-unplugged-a17ada4e-69e7-42ef-b08d-f405a5da6368 for instance with task_state deleting. {{(pid=70924) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 14:58:49 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Instance destroyed successfully.
Jul 29 14:58:49 user nova-compute[70924]: DEBUG nova.objects.instance [None req-a882bd94-34d2-4fac-bb6d-7f3ab601d95f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lazy-loading 'resources' on Instance uuid b001d812-892a-4756-9f37-fc0c5ef5f0a7 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:58:49 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-a882bd94-34d2-4fac-bb6d-7f3ab601d95f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:53:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-987712595',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-987712595',id=31,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:55:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5a9e5c78c1684c359cfab4e32b9c213f',ramdisk_id='',reservation_id='r-r6j2fqy4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2089253815',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:57:03Z,user_data=None,user_id='43582a8a85c54b5e9d16d11b12bf50d4',uuid=b001d812-892a-4756-9f37-fc0c5ef5f0a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a17ada4e-69e7-42ef-b08d-f405a5da6368", "address": "fa:16:3e:62:06:29", "network": {"id": "d5876e18-e2af-45c2-aab5-2d0d552ebfe4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2035085552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9e5c78c1684c359cfab4e32b9c213f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa17ada4e-69", "ovs_interfaceid": "a17ada4e-69e7-42ef-b08d-f405a5da6368", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 14:58:49 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-a882bd94-34d2-4fac-bb6d-7f3ab601d95f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Converting VIF {"id": "a17ada4e-69e7-42ef-b08d-f405a5da6368", "address": "fa:16:3e:62:06:29", "network": {"id": "d5876e18-e2af-45c2-aab5-2d0d552ebfe4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2035085552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9e5c78c1684c359cfab4e32b9c213f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa17ada4e-69", "ovs_interfaceid": "a17ada4e-69e7-42ef-b08d-f405a5da6368", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:58:49 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-a882bd94-34d2-4fac-bb6d-7f3ab601d95f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:62:06:29,bridge_name='br-int',has_traffic_filtering=True,id=a17ada4e-69e7-42ef-b08d-f405a5da6368,network=Network(d5876e18-e2af-45c2-aab5-2d0d552ebfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa17ada4e-69') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:58:49 user nova-compute[70924]: DEBUG os_vif [None req-a882bd94-34d2-4fac-bb6d-7f3ab601d95f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:06:29,bridge_name='br-int',has_traffic_filtering=True,id=a17ada4e-69e7-42ef-b08d-f405a5da6368,network=Network(d5876e18-e2af-45c2-aab5-2d0d552ebfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa17ada4e-69') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 14:58:49 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:49 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa17ada4e-69, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:58:49 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:49 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:58:49 user nova-compute[70924]: INFO os_vif [None req-a882bd94-34d2-4fac-bb6d-7f3ab601d95f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:06:29,bridge_name='br-int',has_traffic_filtering=True,id=a17ada4e-69e7-42ef-b08d-f405a5da6368,network=Network(d5876e18-e2af-45c2-aab5-2d0d552ebfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa17ada4e-69')
Jul 29 14:58:49 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a882bd94-34d2-4fac-bb6d-7f3ab601d95f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] calling os-brick to detach iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 14:58:49 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a882bd94-34d2-4fac-bb6d-7f3ab601d95f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, {'target_iqns': ['iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mDXsQUNA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:58:49 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-a882bd94-34d2-4fac-bb6d-7f3ab601d95f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:58:49 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-a882bd94-34d2-4fac-bb6d-7f3ab601d95f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:58:49 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-a882bd94-34d2-4fac-bb6d-7f3ab601d95f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:58:49 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a882bd94-34d2-4fac-bb6d-7f3ab601d95f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb', 0)] {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 14:58:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:58:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:58:49 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d7da34-686b-4461-82cd-e6af29cff3d3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:58:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:58:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:58:49 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[14653693-3e40-4c74-aaa4-52f06bdb72c3]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:58:49 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a882bd94-34d2-4fac-bb6d-7f3ab601d95f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:58:49 user nova-compute[70924]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb (non-flash)
Jul 29 14:58:49 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:58:49 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a882bd94-34d2-4fac-bb6d-7f3ab601d95f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:58:49 user nova-compute[70924]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb (non-flash)
Jul 29 14:58:49 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:58:49 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a882bd94-34d2-4fac-bb6d-7f3ab601d95f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feedc3895a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb'): ({'sdg'}, set())}) {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 14:58:49 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-a882bd94-34d2-4fac-bb6d-7f3ab601d95f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Removing single pathed devices sdg {{(pid=70924) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 14:58:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:58:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:58:49 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f549c84-37ba-42f8-a66f-7591d6a12fd9]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:58:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:58:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:58:49 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6909f661-c5ac-4083-bf20-d35869acfc48]: (4, ('ok\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:58:49 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-a882bd94-34d2-4fac-bb6d-7f3ab601d95f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Flushing IO for device /dev/sdg {{(pid=70924) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 14:58:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:58:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:58:49 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c0d7ea-b80b-4ec0-b606-793c53138796]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:58:49 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-a882bd94-34d2-4fac-bb6d-7f3ab601d95f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=70924) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 14:58:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:58:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.077s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:58:49 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[74485396-f09d-4dee-b1ce-dac5ca8539b8]: (4, ('1', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:58:49 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-a882bd94-34d2-4fac-bb6d-7f3ab601d95f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 14:58:49 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-a882bd94-34d2-4fac-bb6d-7f3ab601d95f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] SCSI volumes sdg have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 14:58:49 user nova-compute[70924]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26264376561306238', '/dev/disk/by-id/scsi-1SCST_BIO80218a23-bd7ea0b80d64a81e', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_80218a23') {{(pid=81998) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 29 14:58:49 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e564e2-b769-46b4-8930-12f4b19ca65b]: (4, None) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:58:49 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a882bd94-34d2-4fac-bb6d-7f3ab601d95f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb')] {{(pid=70924) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 14:58:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:58:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:58:49 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f6d435-bc49-42c3-b0a8-97e8908b4fbb]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:58:49 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a882bd94-34d2-4fac-bb6d-7f3ab601d95f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:58:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb -p 172.16.0.220:3260 --logout {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:58:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:58:49 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c3681f-59ce-4c82-9fc0-705f69545162]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:58:49 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a882bd94-34d2-4fac-bb6d-7f3ab601d95f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb, portal: 172.16.0.220,3260]
Jul 29 14:58:49 user nova-compute[70924]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb, portal: 172.16.0.220,3260] successful.
Jul 29 14:58:49 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:58:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb -p 172.16.0.220:3260 --op delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:58:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf3a486-19b2-4b15-b277-e028bef200fb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:58:49 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c39509d-99a2-4b71-a538-1e49d639d647]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:58:49 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a882bd94-34d2-4fac-bb6d-7f3ab601d95f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:58:49 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-a882bd94-34d2-4fac-bb6d-7f3ab601d95f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:58:49 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a882bd94-34d2-4fac-bb6d-7f3ab601d95f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] <== disconnect_volume: return (367ms) None {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:58:49 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a882bd94-34d2-4fac-bb6d-7f3ab601d95f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Disconnected iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 14:58:49 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-a882bd94-34d2-4fac-bb6d-7f3ab601d95f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Deleting instance files /opt/stack/data/nova/instances/b001d812-892a-4756-9f37-fc0c5ef5f0a7_del
Jul 29 14:58:49 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-a882bd94-34d2-4fac-bb6d-7f3ab601d95f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Deletion of /opt/stack/data/nova/instances/b001d812-892a-4756-9f37-fc0c5ef5f0a7_del complete
Jul 29 14:58:49 user nova-compute[70924]: INFO nova.compute.manager [None req-a882bd94-34d2-4fac-bb6d-7f3ab601d95f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Took 1.35 seconds to destroy the instance on the hypervisor.
Jul 29 14:58:49 user nova-compute[70924]: DEBUG oslo.service.loopingcall [None req-a882bd94-34d2-4fac-bb6d-7f3ab601d95f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70924) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 14:58:49 user nova-compute[70924]: DEBUG nova.compute.manager [-] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Deallocating network for instance {{(pid=70924) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 14:58:49 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] deallocate_for_instance() {{(pid=70924) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 14:58:50 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:50 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:58:50 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Took 0.92 seconds to deallocate network for instance.
Jul 29 14:58:51 user nova-compute[70924]: DEBUG nova.compute.manager [req-a444a990-36ca-4cbf-9f94-db83593b0b3a req-e022dac7-2574-4b43-a609-27a4fdfa6fae service nova] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Received event network-vif-plugged-a17ada4e-69e7-42ef-b08d-f405a5da6368 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:58:51 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a444a990-36ca-4cbf-9f94-db83593b0b3a req-e022dac7-2574-4b43-a609-27a4fdfa6fae service nova] Acquiring lock "b001d812-892a-4756-9f37-fc0c5ef5f0a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:58:51 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a444a990-36ca-4cbf-9f94-db83593b0b3a req-e022dac7-2574-4b43-a609-27a4fdfa6fae service nova] Lock "b001d812-892a-4756-9f37-fc0c5ef5f0a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:58:51 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a444a990-36ca-4cbf-9f94-db83593b0b3a req-e022dac7-2574-4b43-a609-27a4fdfa6fae service nova] Lock "b001d812-892a-4756-9f37-fc0c5ef5f0a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:58:51 user nova-compute[70924]: DEBUG nova.compute.manager [req-a444a990-36ca-4cbf-9f94-db83593b0b3a req-e022dac7-2574-4b43-a609-27a4fdfa6fae service nova] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] No waiting events found dispatching network-vif-plugged-a17ada4e-69e7-42ef-b08d-f405a5da6368 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:58:51 user nova-compute[70924]: WARNING nova.compute.manager [req-a444a990-36ca-4cbf-9f94-db83593b0b3a req-e022dac7-2574-4b43-a609-27a4fdfa6fae service nova] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Received unexpected event network-vif-plugged-a17ada4e-69e7-42ef-b08d-f405a5da6368 for instance with vm_state active and task_state deleting.
Jul 29 14:58:51 user nova-compute[70924]: DEBUG nova.compute.manager [req-a444a990-36ca-4cbf-9f94-db83593b0b3a req-e022dac7-2574-4b43-a609-27a4fdfa6fae service nova] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Received event network-vif-deleted-a17ada4e-69e7-42ef-b08d-f405a5da6368 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:58:51 user nova-compute[70924]: INFO nova.compute.manager [None req-a882bd94-34d2-4fac-bb6d-7f3ab601d95f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Took 0.93 seconds to detach 1 volumes for instance.
Jul 29 14:58:51 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a882bd94-34d2-4fac-bb6d-7f3ab601d95f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:58:51 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a882bd94-34d2-4fac-bb6d-7f3ab601d95f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:58:52 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-a882bd94-34d2-4fac-bb6d-7f3ab601d95f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:58:52 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-a882bd94-34d2-4fac-bb6d-7f3ab601d95f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:58:52 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a882bd94-34d2-4fac-bb6d-7f3ab601d95f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.403s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:58:52 user nova-compute[70924]: INFO nova.scheduler.client.report [None req-a882bd94-34d2-4fac-bb6d-7f3ab601d95f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Deleted allocations for instance b001d812-892a-4756-9f37-fc0c5ef5f0a7
Jul 29 14:58:52 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a882bd94-34d2-4fac-bb6d-7f3ab601d95f tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "b001d812-892a-4756-9f37-fc0c5ef5f0a7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.925s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:58:52 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:53 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:54 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:54 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:58:56 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:58:57 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:58 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:58:58 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:58:58 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:58:58 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:58:58 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:58:58 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Auditing locally available compute resources for user (node: user) {{(pid=70924) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 14:58:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f7eeda-a001-4c35-abeb-e459d701bd93/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:58:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f7eeda-a001-4c35-abeb-e459d701bd93/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:58:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f7eeda-a001-4c35-abeb-e459d701bd93/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:58:58 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f7eeda-a001-4c35-abeb-e459d701bd93/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:58:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c31a724f-3006-4e5d-a9b5-847fd6cd170a/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:58:59 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c31a724f-3006-4e5d-a9b5-847fd6cd170a/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:58:59 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c31a724f-3006-4e5d-a9b5-847fd6cd170a/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:58:59 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:58:59 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c31a724f-3006-4e5d-a9b5-847fd6cd170a/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:58:59 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 14:58:59 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3efaa8e-7138-40be-a271-8a344eac3e48/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:58:59 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3efaa8e-7138-40be-a271-8a344eac3e48/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:58:59 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3efaa8e-7138-40be-a271-8a344eac3e48/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:58:59 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3efaa8e-7138-40be-a271-8a344eac3e48/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:58:59 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:59:00 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:59:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:59:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:59:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:59:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47104e57-c193-4a85-a2cf-677f0debe373/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:59:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47104e57-c193-4a85-a2cf-677f0debe373/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:59:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47104e57-c193-4a85-a2cf-677f0debe373/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:59:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47104e57-c193-4a85-a2cf-677f0debe373/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:59:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk.rescue --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:59:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk.rescue --force-share --output=json" returned: 0 in 0.159s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:59:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk.rescue --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:59:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk.rescue --force-share --output=json" returned: 0 in 0.153s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:59:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:59:01 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:59:01 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:59:01 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:59:01 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:59:01 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:59:01 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:59:01 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:59:01 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:59:01 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:59:01 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Hypervisor/Node resource view: name=user free_ram=7730MB free_disk=25.101478576660156GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70924) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 14:59:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:59:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:59:02 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance db656346-c4af-43da-9600-fd39f1b9e4dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:59:02 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 02c75b00-a1b4-4ef9-ae96-bc67d8038589 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:59:02 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 9ec07c62-951b-4e3a-bffa-e01dfb4665ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:59:02 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 091e384f-7851-4ac9-b566-990df0497fc5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:59:02 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance c31a724f-3006-4e5d-a9b5-847fd6cd170a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:59:02 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance f3f7eeda-a001-4c35-abeb-e459d701bd93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:59:02 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 47104e57-c193-4a85-a2cf-677f0debe373 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:59:02 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance b3efaa8e-7138-40be-a271-8a344eac3e48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:59:02 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 14:59:02 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 14:59:02 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:59:02 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:59:02 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Compute_service record updated for user:user {{(pid=70924) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 14:59:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.538s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:59:03 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:59:03 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Starting heal instance info cache {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 14:59:03 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "refresh_cache-9ec07c62-951b-4e3a-bffa-e01dfb4665ec" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:59:03 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquired lock "refresh_cache-9ec07c62-951b-4e3a-bffa-e01dfb4665ec" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:59:03 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Forcefully refreshing network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 29 14:59:03 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:59:04 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Updating instance_info_cache with network_info: [{"id": "cb01658e-4dd9-426e-9b45-340ea19db056", "address": "fa:16:3e:75:a4:24", "network": {"id": "b2aee530-d195-47bb-b39d-c8bd15b81a08", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-421022738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcf4644e7a24bf68b407be2e3d9732c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb01658e-4d", "ovs_interfaceid": "cb01658e-4dd9-426e-9b45-340ea19db056", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:59:04 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Releasing lock "refresh_cache-9ec07c62-951b-4e3a-bffa-e01dfb4665ec" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:59:04 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Updated the network info_cache for instance {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 29 14:59:04 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:59:04 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:59:04 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:59:04 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:59:04 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70924) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 14:59:04 user nova-compute[70924]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690642729.2984533, b001d812-892a-4756-9f37-fc0c5ef5f0a7 => Stopped> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:59:04 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] VM Stopped (Lifecycle Event)
Jul 29 14:59:04 user nova-compute[70924]: DEBUG nova.compute.manager [None req-ea50eed5-b973-40ef-ac65-5e01b9f34ff5 None None] [instance: b001d812-892a-4756-9f37-fc0c5ef5f0a7] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:59:04 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:59:05 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:59:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:59:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:59:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Acquiring lock "5865be57-b5f2-4132-bc71-cc41bfe9f897" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:59:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lock "5865be57-b5f2-4132-bc71-cc41bfe9f897" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:59:11 user nova-compute[70924]: DEBUG nova.compute.manager [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Starting instance... {{(pid=70924) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 14:59:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:59:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:59:11 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70924) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 14:59:11 user nova-compute[70924]: INFO nova.compute.claims [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Claim successful on node user
Jul 29 14:59:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Acquiring lock "14f9924f-8d4d-4193-927b-02cfb0f5f57a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:59:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "14f9924f-8d4d-4193-927b-02cfb0f5f57a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:59:11 user nova-compute[70924]: DEBUG nova.compute.manager [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] Starting instance... {{(pid=70924) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 14:59:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:59:11 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:59:11 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:59:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.534s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:59:12 user nova-compute[70924]: DEBUG nova.compute.manager [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Start building networks asynchronously for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 14:59:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.123s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:59:12 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70924) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 14:59:12 user nova-compute[70924]: INFO nova.compute.claims [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] Claim successful on node user
Jul 29 14:59:12 user nova-compute[70924]: DEBUG nova.compute.manager [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Allocating IP information in the background. {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 14:59:12 user nova-compute[70924]: DEBUG nova.network.neutron [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] allocate_for_instance() {{(pid=70924) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 14:59:12 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 14:59:12 user nova-compute[70924]: DEBUG nova.compute.manager [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Start building block device mappings for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 14:59:12 user nova-compute[70924]: DEBUG nova.policy [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7aa9677ce659431db31a0e513277d692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a03844d646454b6ea55e1b5625f7909a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70924) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 14:59:12 user nova-compute[70924]: DEBUG nova.compute.manager [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Start spawning the instance on the hypervisor. {{(pid=70924) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 14:59:12 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Creating instance directory {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 14:59:12 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Creating image(s)
Jul 29 14:59:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Acquiring lock "/opt/stack/data/nova/instances/5865be57-b5f2-4132-bc71-cc41bfe9f897/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:59:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lock "/opt/stack/data/nova/instances/5865be57-b5f2-4132-bc71-cc41bfe9f897/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:59:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lock "/opt/stack/data/nova/instances/5865be57-b5f2-4132-bc71-cc41bfe9f897/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:59:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Acquiring lock "487dc6b53db6d4d9f29443c756b9825cfa0de0f6" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:59:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lock "487dc6b53db6d4d9f29443c756b9825cfa0de0f6" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:59:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/487dc6b53db6d4d9f29443c756b9825cfa0de0f6.part --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:59:12 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:59:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/487dc6b53db6d4d9f29443c756b9825cfa0de0f6.part --force-share --output=json" returned: 0 in 0.154s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:59:12 user nova-compute[70924]: DEBUG nova.virt.images [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] c83df43a-b354-45a0-a7db-20c65b231425 was qcow2, converting to raw {{(pid=70924) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 29 14:59:12 user nova-compute[70924]: DEBUG nova.privsep.utils [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70924) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 29 14:59:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/487dc6b53db6d4d9f29443c756b9825cfa0de0f6.part /opt/stack/data/nova/instances/_base/487dc6b53db6d4d9f29443c756b9825cfa0de0f6.converted {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:59:13 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:59:13 user nova-compute[70924]: DEBUG nova.network.neutron [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Successfully created port: 6641ec75-757f-44fa-980b-5b0f270432eb {{(pid=70924) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 14:59:13 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.032s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:59:13 user nova-compute[70924]: DEBUG nova.compute.manager [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] Start building networks asynchronously for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 14:59:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/487dc6b53db6d4d9f29443c756b9825cfa0de0f6.part /opt/stack/data/nova/instances/_base/487dc6b53db6d4d9f29443c756b9825cfa0de0f6.converted" returned: 0 in 0.165s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:59:13 user nova-compute[70924]: DEBUG nova.compute.manager [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] Allocating IP information in the background. {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 14:59:13 user nova-compute[70924]: DEBUG nova.network.neutron [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] allocate_for_instance() {{(pid=70924) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 14:59:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/487dc6b53db6d4d9f29443c756b9825cfa0de0f6.converted --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:59:13 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 14:59:13 user nova-compute[70924]: DEBUG nova.compute.manager [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] Start building block device mappings for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 14:59:13 user nova-compute[70924]: INFO nova.virt.block_device [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] Booting with volume snapshot 4b7fe678-3247-4500-9ecc-00da9053ab87 at /dev/vda
Jul 29 14:59:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/487dc6b53db6d4d9f29443c756b9825cfa0de0f6.converted --force-share --output=json" returned: 0 in 0.143s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:59:13 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lock "487dc6b53db6d4d9f29443c756b9825cfa0de0f6" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.023s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:59:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/487dc6b53db6d4d9f29443c756b9825cfa0de0f6 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:59:13 user nova-compute[70924]: DEBUG nova.policy [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'da204646e8f84693ad470ed1d3eadd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a974cbbf734f51897c3e632ae9e45f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70924) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 14:59:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/487dc6b53db6d4d9f29443c756b9825cfa0de0f6 --force-share --output=json" returned: 0 in 0.151s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:59:13 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Acquiring lock "487dc6b53db6d4d9f29443c756b9825cfa0de0f6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:59:13 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lock "487dc6b53db6d4d9f29443c756b9825cfa0de0f6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:59:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/487dc6b53db6d4d9f29443c756b9825cfa0de0f6 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:59:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/487dc6b53db6d4d9f29443c756b9825cfa0de0f6 --force-share --output=json" returned: 0 in 0.141s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:59:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/487dc6b53db6d4d9f29443c756b9825cfa0de0f6,backing_fmt=raw /opt/stack/data/nova/instances/5865be57-b5f2-4132-bc71-cc41bfe9f897/disk 1073741824 {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:59:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/487dc6b53db6d4d9f29443c756b9825cfa0de0f6,backing_fmt=raw /opt/stack/data/nova/instances/5865be57-b5f2-4132-bc71-cc41bfe9f897/disk 1073741824" returned: 0 in 0.051s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:59:13 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lock "487dc6b53db6d4d9f29443c756b9825cfa0de0f6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.201s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:59:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/487dc6b53db6d4d9f29443c756b9825cfa0de0f6 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:59:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/487dc6b53db6d4d9f29443c756b9825cfa0de0f6 --force-share --output=json" returned: 0 in 0.147s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:59:13 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5865be57-b5f2-4132-bc71-cc41bfe9f897/disk. size=1073741824 {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 14:59:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5865be57-b5f2-4132-bc71-cc41bfe9f897/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:59:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5865be57-b5f2-4132-bc71-cc41bfe9f897/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:59:13 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Cannot resize image /opt/stack/data/nova/instances/5865be57-b5f2-4132-bc71-cc41bfe9f897/disk to a smaller size. {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 14:59:13 user nova-compute[70924]: DEBUG nova.objects.instance [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lazy-loading 'migration_context' on Instance uuid 5865be57-b5f2-4132-bc71-cc41bfe9f897 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:59:13 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:59:13 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Created local disks {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 14:59:13 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Ensure instance console log exists: /opt/stack/data/nova/instances/5865be57-b5f2-4132-bc71-cc41bfe9f897/console.log {{(pid=70924) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 14:59:13 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:59:13 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:59:13 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:59:14 user nova-compute[70924]: DEBUG nova.network.neutron [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Successfully updated port: 6641ec75-757f-44fa-980b-5b0f270432eb {{(pid=70924) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 14:59:14 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Acquiring lock "refresh_cache-5865be57-b5f2-4132-bc71-cc41bfe9f897" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:59:14 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Acquired lock "refresh_cache-5865be57-b5f2-4132-bc71-cc41bfe9f897" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:59:14 user nova-compute[70924]: DEBUG nova.network.neutron [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 14:59:14 user nova-compute[70924]: DEBUG nova.compute.manager [req-a5d99308-787c-4749-8ff8-dd1f25da49b4 req-ed9207fa-468c-4bde-9872-479a34e00e32 service nova] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Received event network-changed-6641ec75-757f-44fa-980b-5b0f270432eb {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:59:14 user nova-compute[70924]: DEBUG nova.compute.manager [req-a5d99308-787c-4749-8ff8-dd1f25da49b4 req-ed9207fa-468c-4bde-9872-479a34e00e32 service nova] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Refreshing instance network info cache due to event network-changed-6641ec75-757f-44fa-980b-5b0f270432eb. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:59:14 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a5d99308-787c-4749-8ff8-dd1f25da49b4 req-ed9207fa-468c-4bde-9872-479a34e00e32 service nova] Acquiring lock "refresh_cache-5865be57-b5f2-4132-bc71-cc41bfe9f897" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:59:14 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:59:14 user nova-compute[70924]: DEBUG nova.network.neutron [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Instance cache missing network info. {{(pid=70924) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 14:59:14 user nova-compute[70924]: DEBUG nova.network.neutron [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] Successfully created port: 078ca632-af45-4d44-8e01-7cef910a77ee {{(pid=70924) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 14:59:15 user nova-compute[70924]: DEBUG nova.network.neutron [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Updating instance_info_cache with network_info: [{"id": "6641ec75-757f-44fa-980b-5b0f270432eb", "address": "fa:16:3e:03:b3:5f", "network": {"id": "21a19801-8526-40a2-9bcb-dda6cfb435fe", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-761511746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a03844d646454b6ea55e1b5625f7909a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6641ec75-75", "ovs_interfaceid": "6641ec75-757f-44fa-980b-5b0f270432eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:59:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Releasing lock "refresh_cache-5865be57-b5f2-4132-bc71-cc41bfe9f897" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:59:15 user nova-compute[70924]: DEBUG nova.compute.manager [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Instance network_info: |[{"id": "6641ec75-757f-44fa-980b-5b0f270432eb", "address": "fa:16:3e:03:b3:5f", "network": {"id": "21a19801-8526-40a2-9bcb-dda6cfb435fe", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-761511746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a03844d646454b6ea55e1b5625f7909a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6641ec75-75", "ovs_interfaceid": "6641ec75-757f-44fa-980b-5b0f270432eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 14:59:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a5d99308-787c-4749-8ff8-dd1f25da49b4 req-ed9207fa-468c-4bde-9872-479a34e00e32 service nova] Acquired lock "refresh_cache-5865be57-b5f2-4132-bc71-cc41bfe9f897" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:59:15 user nova-compute[70924]: DEBUG nova.network.neutron [req-a5d99308-787c-4749-8ff8-dd1f25da49b4 req-ed9207fa-468c-4bde-9872-479a34e00e32 service nova] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Refreshing network info cache for port 6641ec75-757f-44fa-980b-5b0f270432eb {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:59:15 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Start _get_guest_xml network_info=[{"id": "6641ec75-757f-44fa-980b-5b0f270432eb", "address": "fa:16:3e:03:b3:5f", "network": {"id": "21a19801-8526-40a2-9bcb-dda6cfb435fe", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-761511746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a03844d646454b6ea55e1b5625f7909a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6641ec75-75", "ovs_interfaceid": "6641ec75-757f-44fa-980b-5b0f270432eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:59:08Z,direct_url=<?>,disk_format='qcow2',id=c83df43a-b354-45a0-a7db-20c65b231425,min_disk=0,min_ram=0,name='tempest-scenario-img--1601208570',owner='a03844d646454b6ea55e1b5625f7909a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:59:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': 'c83df43a-b354-45a0-a7db-20c65b231425'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 14:59:15 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:59:15 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:59:15 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 14:59:15 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] CPU controller missing on host. {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 14:59:15 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 14:59:15 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] CPU controller found on host. {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 14:59:15 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70924) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 14:59:15 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T14:36:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:59:08Z,direct_url=<?>,disk_format='qcow2',id=c83df43a-b354-45a0-a7db-20c65b231425,min_disk=0,min_ram=0,name='tempest-scenario-img--1601208570',owner='a03844d646454b6ea55e1b5625f7909a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:59:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 14:59:15 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Flavor limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 14:59:15 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Image limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 14:59:15 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Flavor pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 14:59:15 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Image pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 14:59:15 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 14:59:15 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 14:59:15 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 14:59:15 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Got 1 possible topologies {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 14:59:15 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 14:59:15 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 14:59:15 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:59:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1371283640',display_name='tempest-TestMinimumBasicScenario-server-1371283640',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1371283640',id=36,image_ref='c83df43a-b354-45a0-a7db-20c65b231425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMM7cK7PNk76BhV8usJuNDNcA0r482y6nz4W0CPMN7SflEic7LFaV/LqSedVzFDIbFKoE1zXWCSnEHzpbKbpwtMgn+vx36311Wv0CEeHkPZaZ23MspqtwlC96510GhE0pA==',key_name='tempest-TestMinimumBasicScenario-1965420479',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a03844d646454b6ea55e1b5625f7909a',ramdisk_id='',reservation_id='r-dauoklbi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c83df43a-b354-45a0-a7db-20c65b231425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-944069199',owner_user_name='tempest-TestMinimumBasicScenario-944069199-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:59:12Z,user_data=None,user_id='7aa9677ce659431db31a0e513277d692',uuid=5865be57-b5f2-4132-bc71-cc41bfe9f897,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6641ec75-757f-44fa-980b-5b0f270432eb", "address": "fa:16:3e:03:b3:5f", "network": {"id": "21a19801-8526-40a2-9bcb-dda6cfb435fe", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-761511746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a03844d646454b6ea55e1b5625f7909a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6641ec75-75", "ovs_interfaceid": "6641ec75-757f-44fa-980b-5b0f270432eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:59:15 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Converting VIF {"id": "6641ec75-757f-44fa-980b-5b0f270432eb", "address": "fa:16:3e:03:b3:5f", "network": {"id": "21a19801-8526-40a2-9bcb-dda6cfb435fe", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-761511746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a03844d646454b6ea55e1b5625f7909a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6641ec75-75", "ovs_interfaceid": "6641ec75-757f-44fa-980b-5b0f270432eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:59:15 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:b3:5f,bridge_name='br-int',has_traffic_filtering=True,id=6641ec75-757f-44fa-980b-5b0f270432eb,network=Network(21a19801-8526-40a2-9bcb-dda6cfb435fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6641ec75-75') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:59:15 user nova-compute[70924]: DEBUG nova.objects.instance [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lazy-loading 'pci_devices' on Instance uuid 5865be57-b5f2-4132-bc71-cc41bfe9f897 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:59:15 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] End _get_guest_xml xml=<domain type="kvm">
Jul 29 14:59:15 user nova-compute[70924]:   <uuid>5865be57-b5f2-4132-bc71-cc41bfe9f897</uuid>
Jul 29 14:59:15 user nova-compute[70924]:   <name>instance-00000024</name>
Jul 29 14:59:15 user nova-compute[70924]:   <memory>524288</memory>
Jul 29 14:59:15 user nova-compute[70924]:   <vcpu>1</vcpu>
Jul 29 14:59:15 user nova-compute[70924]:   <metadata>
Jul 29 14:59:15 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 14:59:15 user nova-compute[70924]:       <nova:package version="0.0.0"/>
Jul 29 14:59:15 user nova-compute[70924]:       <nova:name>tempest-TestMinimumBasicScenario-server-1371283640</nova:name>
Jul 29 14:59:15 user nova-compute[70924]:       <nova:creationTime>2023-07-29 14:59:15</nova:creationTime>
Jul 29 14:59:15 user nova-compute[70924]:       <nova:flavor name="m1.tiny">
Jul 29 14:59:15 user nova-compute[70924]:         <nova:memory>512</nova:memory>
Jul 29 14:59:15 user nova-compute[70924]:         <nova:disk>1</nova:disk>
Jul 29 14:59:15 user nova-compute[70924]:         <nova:swap>0</nova:swap>
Jul 29 14:59:15 user nova-compute[70924]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 14:59:15 user nova-compute[70924]:         <nova:vcpus>1</nova:vcpus>
Jul 29 14:59:15 user nova-compute[70924]:       </nova:flavor>
Jul 29 14:59:15 user nova-compute[70924]:       <nova:owner>
Jul 29 14:59:15 user nova-compute[70924]:         <nova:user uuid="7aa9677ce659431db31a0e513277d692">tempest-TestMinimumBasicScenario-944069199-project-member</nova:user>
Jul 29 14:59:15 user nova-compute[70924]:         <nova:project uuid="a03844d646454b6ea55e1b5625f7909a">tempest-TestMinimumBasicScenario-944069199</nova:project>
Jul 29 14:59:15 user nova-compute[70924]:       </nova:owner>
Jul 29 14:59:15 user nova-compute[70924]:       <nova:root type="image" uuid="c83df43a-b354-45a0-a7db-20c65b231425"/>
Jul 29 14:59:15 user nova-compute[70924]:       <nova:ports>
Jul 29 14:59:15 user nova-compute[70924]:         <nova:port uuid="6641ec75-757f-44fa-980b-5b0f270432eb">
Jul 29 14:59:15 user nova-compute[70924]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 29 14:59:15 user nova-compute[70924]:         </nova:port>
Jul 29 14:59:15 user nova-compute[70924]:       </nova:ports>
Jul 29 14:59:15 user nova-compute[70924]:     </nova:instance>
Jul 29 14:59:15 user nova-compute[70924]:   </metadata>
Jul 29 14:59:15 user nova-compute[70924]:   <sysinfo type="smbios">
Jul 29 14:59:15 user nova-compute[70924]:     <system>
Jul 29 14:59:15 user nova-compute[70924]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 14:59:15 user nova-compute[70924]:       <entry name="product">OpenStack Nova</entry>
Jul 29 14:59:15 user nova-compute[70924]:       <entry name="version">0.0.0</entry>
Jul 29 14:59:15 user nova-compute[70924]:       <entry name="serial">5865be57-b5f2-4132-bc71-cc41bfe9f897</entry>
Jul 29 14:59:15 user nova-compute[70924]:       <entry name="uuid">5865be57-b5f2-4132-bc71-cc41bfe9f897</entry>
Jul 29 14:59:15 user nova-compute[70924]:       <entry name="family">Virtual Machine</entry>
Jul 29 14:59:15 user nova-compute[70924]:     </system>
Jul 29 14:59:15 user nova-compute[70924]:   </sysinfo>
Jul 29 14:59:15 user nova-compute[70924]:   <os>
Jul 29 14:59:15 user nova-compute[70924]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 14:59:15 user nova-compute[70924]:     <boot dev="hd"/>
Jul 29 14:59:15 user nova-compute[70924]:     <smbios mode="sysinfo"/>
Jul 29 14:59:15 user nova-compute[70924]:   </os>
Jul 29 14:59:15 user nova-compute[70924]:   <features>
Jul 29 14:59:15 user nova-compute[70924]:     <acpi/>
Jul 29 14:59:15 user nova-compute[70924]:     <apic/>
Jul 29 14:59:15 user nova-compute[70924]:     <vmcoreinfo/>
Jul 29 14:59:15 user nova-compute[70924]:   </features>
Jul 29 14:59:15 user nova-compute[70924]:   <clock offset="utc">
Jul 29 14:59:15 user nova-compute[70924]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 14:59:15 user nova-compute[70924]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 14:59:15 user nova-compute[70924]:     <timer name="hpet" present="no"/>
Jul 29 14:59:15 user nova-compute[70924]:   </clock>
Jul 29 14:59:15 user nova-compute[70924]:   <cpu mode="custom" match="exact">
Jul 29 14:59:15 user nova-compute[70924]:     <model>Nehalem</model>
Jul 29 14:59:15 user nova-compute[70924]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 14:59:15 user nova-compute[70924]:   </cpu>
Jul 29 14:59:15 user nova-compute[70924]:   <devices>
Jul 29 14:59:15 user nova-compute[70924]:     <disk type="file" device="disk">
Jul 29 14:59:15 user nova-compute[70924]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 14:59:15 user nova-compute[70924]:       <source file="/opt/stack/data/nova/instances/5865be57-b5f2-4132-bc71-cc41bfe9f897/disk"/>
Jul 29 14:59:15 user nova-compute[70924]:       <target dev="vda" bus="virtio"/>
Jul 29 14:59:15 user nova-compute[70924]:     </disk>
Jul 29 14:59:15 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 14:59:15 user nova-compute[70924]:       <mac address="fa:16:3e:03:b3:5f"/>
Jul 29 14:59:15 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:59:15 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 14:59:15 user nova-compute[70924]:       <target dev="tap6641ec75-75"/>
Jul 29 14:59:15 user nova-compute[70924]:     </interface>
Jul 29 14:59:15 user nova-compute[70924]:     <serial type="pty">
Jul 29 14:59:15 user nova-compute[70924]:       <log file="/opt/stack/data/nova/instances/5865be57-b5f2-4132-bc71-cc41bfe9f897/console.log" append="off"/>
Jul 29 14:59:15 user nova-compute[70924]:     </serial>
Jul 29 14:59:15 user nova-compute[70924]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 14:59:15 user nova-compute[70924]:     <video>
Jul 29 14:59:15 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:59:15 user nova-compute[70924]:     </video>
Jul 29 14:59:15 user nova-compute[70924]:     <rng model="virtio">
Jul 29 14:59:15 user nova-compute[70924]:       <backend model="random">/dev/urandom</backend>
Jul 29 14:59:15 user nova-compute[70924]:     </rng>
Jul 29 14:59:15 user nova-compute[70924]:     <controller type="usb" index="0" model="none"/>
Jul 29 14:59:15 user nova-compute[70924]:     <memballoon model="virtio">
Jul 29 14:59:15 user nova-compute[70924]:       <stats period="10"/>
Jul 29 14:59:15 user nova-compute[70924]:     </memballoon>
Jul 29 14:59:15 user nova-compute[70924]:   </devices>
Jul 29 14:59:15 user nova-compute[70924]: </domain>
Jul 29 14:59:15 user nova-compute[70924]:  {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 14:59:15 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:59:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1371283640',display_name='tempest-TestMinimumBasicScenario-server-1371283640',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1371283640',id=36,image_ref='c83df43a-b354-45a0-a7db-20c65b231425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMM7cK7PNk76BhV8usJuNDNcA0r482y6nz4W0CPMN7SflEic7LFaV/LqSedVzFDIbFKoE1zXWCSnEHzpbKbpwtMgn+vx36311Wv0CEeHkPZaZ23MspqtwlC96510GhE0pA==',key_name='tempest-TestMinimumBasicScenario-1965420479',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a03844d646454b6ea55e1b5625f7909a',ramdisk_id='',reservation_id='r-dauoklbi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c83df43a-b354-45a0-a7db-20c65b231425',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-944069199',owner_user_name='tempest-TestMinimumBasicScenario-944069199-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:59:12Z,user_data=None,user_id='7aa9677ce659431db31a0e513277d692',uuid=5865be57-b5f2-4132-bc71-cc41bfe9f897,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6641ec75-757f-44fa-980b-5b0f270432eb", "address": "fa:16:3e:03:b3:5f", "network": {"id": "21a19801-8526-40a2-9bcb-dda6cfb435fe", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-761511746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a03844d646454b6ea55e1b5625f7909a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6641ec75-75", "ovs_interfaceid": "6641ec75-757f-44fa-980b-5b0f270432eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 14:59:15 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Converting VIF {"id": "6641ec75-757f-44fa-980b-5b0f270432eb", "address": "fa:16:3e:03:b3:5f", "network": {"id": "21a19801-8526-40a2-9bcb-dda6cfb435fe", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-761511746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a03844d646454b6ea55e1b5625f7909a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6641ec75-75", "ovs_interfaceid": "6641ec75-757f-44fa-980b-5b0f270432eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:59:15 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:b3:5f,bridge_name='br-int',has_traffic_filtering=True,id=6641ec75-757f-44fa-980b-5b0f270432eb,network=Network(21a19801-8526-40a2-9bcb-dda6cfb435fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6641ec75-75') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:59:15 user nova-compute[70924]: DEBUG os_vif [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:b3:5f,bridge_name='br-int',has_traffic_filtering=True,id=6641ec75-757f-44fa-980b-5b0f270432eb,network=Network(21a19801-8526-40a2-9bcb-dda6cfb435fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6641ec75-75') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 14:59:15 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:59:15 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:59:15 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 14:59:15 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:59:15 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6641ec75-75, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:59:15 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6641ec75-75, col_values=(('external_ids', {'iface-id': '6641ec75-757f-44fa-980b-5b0f270432eb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:b3:5f', 'vm-uuid': '5865be57-b5f2-4132-bc71-cc41bfe9f897'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:59:15 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:59:15 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:59:15 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:59:15 user nova-compute[70924]: INFO os_vif [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:b3:5f,bridge_name='br-int',has_traffic_filtering=True,id=6641ec75-757f-44fa-980b-5b0f270432eb,network=Network(21a19801-8526-40a2-9bcb-dda6cfb435fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6641ec75-75')
Jul 29 14:59:15 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:59:15 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] No VIF found with MAC fa:16:3e:03:b3:5f, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:59:16 user nova-compute[70924]: DEBUG nova.network.neutron [req-a5d99308-787c-4749-8ff8-dd1f25da49b4 req-ed9207fa-468c-4bde-9872-479a34e00e32 service nova] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Updated VIF entry in instance network info cache for port 6641ec75-757f-44fa-980b-5b0f270432eb. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:59:16 user nova-compute[70924]: DEBUG nova.network.neutron [req-a5d99308-787c-4749-8ff8-dd1f25da49b4 req-ed9207fa-468c-4bde-9872-479a34e00e32 service nova] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Updating instance_info_cache with network_info: [{"id": "6641ec75-757f-44fa-980b-5b0f270432eb", "address": "fa:16:3e:03:b3:5f", "network": {"id": "21a19801-8526-40a2-9bcb-dda6cfb435fe", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-761511746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a03844d646454b6ea55e1b5625f7909a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6641ec75-75", "ovs_interfaceid": "6641ec75-757f-44fa-980b-5b0f270432eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:59:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a5d99308-787c-4749-8ff8-dd1f25da49b4 req-ed9207fa-468c-4bde-9872-479a34e00e32 service nova] Releasing lock "refresh_cache-5865be57-b5f2-4132-bc71-cc41bfe9f897" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:59:16 user nova-compute[70924]: DEBUG nova.network.neutron [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] Successfully updated port: 078ca632-af45-4d44-8e01-7cef910a77ee {{(pid=70924) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 14:59:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Acquiring lock "refresh_cache-14f9924f-8d4d-4193-927b-02cfb0f5f57a" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:59:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Acquired lock "refresh_cache-14f9924f-8d4d-4193-927b-02cfb0f5f57a" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:59:16 user nova-compute[70924]: DEBUG nova.network.neutron [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 14:59:16 user nova-compute[70924]: DEBUG nova.network.neutron [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] Instance cache missing network info. {{(pid=70924) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 14:59:16 user nova-compute[70924]: DEBUG nova.compute.manager [req-b35f6aae-a934-4cdb-aa47-0492984f1892 req-f8eff4e4-7038-4f00-b0a6-e91135f4c691 service nova] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] Received event network-changed-078ca632-af45-4d44-8e01-7cef910a77ee {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:59:16 user nova-compute[70924]: DEBUG nova.compute.manager [req-b35f6aae-a934-4cdb-aa47-0492984f1892 req-f8eff4e4-7038-4f00-b0a6-e91135f4c691 service nova] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] Refreshing instance network info cache due to event network-changed-078ca632-af45-4d44-8e01-7cef910a77ee. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:59:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b35f6aae-a934-4cdb-aa47-0492984f1892 req-f8eff4e4-7038-4f00-b0a6-e91135f4c691 service nova] Acquiring lock "refresh_cache-14f9924f-8d4d-4193-927b-02cfb0f5f57a" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:59:16 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:59:16 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:59:16 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:59:16 user nova-compute[70924]: DEBUG nova.network.neutron [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] Updating instance_info_cache with network_info: [{"id": "078ca632-af45-4d44-8e01-7cef910a77ee", "address": "fa:16:3e:1b:a2:ac", "network": {"id": "c19ed38b-2acd-421a-9e4b-f60df3db2f1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1812407562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a974cbbf734f51897c3e632ae9e45f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap078ca632-af", "ovs_interfaceid": "078ca632-af45-4d44-8e01-7cef910a77ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:59:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Releasing lock "refresh_cache-14f9924f-8d4d-4193-927b-02cfb0f5f57a" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:59:16 user nova-compute[70924]: DEBUG nova.compute.manager [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] Instance network_info: |[{"id": "078ca632-af45-4d44-8e01-7cef910a77ee", "address": "fa:16:3e:1b:a2:ac", "network": {"id": "c19ed38b-2acd-421a-9e4b-f60df3db2f1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1812407562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a974cbbf734f51897c3e632ae9e45f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap078ca632-af", "ovs_interfaceid": "078ca632-af45-4d44-8e01-7cef910a77ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 14:59:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b35f6aae-a934-4cdb-aa47-0492984f1892 req-f8eff4e4-7038-4f00-b0a6-e91135f4c691 service nova] Acquired lock "refresh_cache-14f9924f-8d4d-4193-927b-02cfb0f5f57a" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:59:16 user nova-compute[70924]: DEBUG nova.network.neutron [req-b35f6aae-a934-4cdb-aa47-0492984f1892 req-f8eff4e4-7038-4f00-b0a6-e91135f4c691 service nova] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] Refreshing network info cache for port 078ca632-af45-4d44-8e01-7cef910a77ee {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:59:17 user nova-compute[70924]: DEBUG nova.compute.manager [req-f0afcc44-a463-4028-8ec6-0c38193dc227 req-7cc14fec-f07d-43c4-9453-1aa4beea48a8 service nova] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Received event network-vif-plugged-6641ec75-757f-44fa-980b-5b0f270432eb {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:59:17 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-f0afcc44-a463-4028-8ec6-0c38193dc227 req-7cc14fec-f07d-43c4-9453-1aa4beea48a8 service nova] Acquiring lock "5865be57-b5f2-4132-bc71-cc41bfe9f897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:59:17 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-f0afcc44-a463-4028-8ec6-0c38193dc227 req-7cc14fec-f07d-43c4-9453-1aa4beea48a8 service nova] Lock "5865be57-b5f2-4132-bc71-cc41bfe9f897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:59:17 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-f0afcc44-a463-4028-8ec6-0c38193dc227 req-7cc14fec-f07d-43c4-9453-1aa4beea48a8 service nova] Lock "5865be57-b5f2-4132-bc71-cc41bfe9f897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:59:17 user nova-compute[70924]: DEBUG nova.compute.manager [req-f0afcc44-a463-4028-8ec6-0c38193dc227 req-7cc14fec-f07d-43c4-9453-1aa4beea48a8 service nova] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] No waiting events found dispatching network-vif-plugged-6641ec75-757f-44fa-980b-5b0f270432eb {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:59:17 user nova-compute[70924]: WARNING nova.compute.manager [req-f0afcc44-a463-4028-8ec6-0c38193dc227 req-7cc14fec-f07d-43c4-9453-1aa4beea48a8 service nova] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Received unexpected event network-vif-plugged-6641ec75-757f-44fa-980b-5b0f270432eb for instance with vm_state building and task_state spawning.
Jul 29 14:59:17 user nova-compute[70924]: DEBUG nova.network.neutron [req-b35f6aae-a934-4cdb-aa47-0492984f1892 req-f8eff4e4-7038-4f00-b0a6-e91135f4c691 service nova] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] Updated VIF entry in instance network info cache for port 078ca632-af45-4d44-8e01-7cef910a77ee. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:59:17 user nova-compute[70924]: DEBUG nova.network.neutron [req-b35f6aae-a934-4cdb-aa47-0492984f1892 req-f8eff4e4-7038-4f00-b0a6-e91135f4c691 service nova] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] Updating instance_info_cache with network_info: [{"id": "078ca632-af45-4d44-8e01-7cef910a77ee", "address": "fa:16:3e:1b:a2:ac", "network": {"id": "c19ed38b-2acd-421a-9e4b-f60df3db2f1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1812407562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a974cbbf734f51897c3e632ae9e45f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap078ca632-af", "ovs_interfaceid": "078ca632-af45-4d44-8e01-7cef910a77ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:59:17 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:59:17 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:59:17 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b35f6aae-a934-4cdb-aa47-0492984f1892 req-f8eff4e4-7038-4f00-b0a6-e91135f4c691 service nova] Releasing lock "refresh_cache-14f9924f-8d4d-4193-927b-02cfb0f5f57a" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:59:17 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:59:17 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:59:18 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:59:19 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642759.029675, 5865be57-b5f2-4132-bc71-cc41bfe9f897 => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:59:19 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] VM Resumed (Lifecycle Event)
Jul 29 14:59:19 user nova-compute[70924]: DEBUG nova.compute.manager [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Instance event wait completed in 0 seconds for  {{(pid=70924) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 14:59:19 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Guest created on hypervisor {{(pid=70924) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 14:59:19 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Instance spawned successfully.
Jul 29 14:59:19 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 14:59:19 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:59:19 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:59:19 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Found default for hw_cdrom_bus of ide {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:59:19 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Found default for hw_disk_bus of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:59:19 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Found default for hw_input_bus of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:59:19 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Found default for hw_pointer_model of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:59:19 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Found default for hw_video_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:59:19 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Found default for hw_vif_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:59:19 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:59:19 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642759.0323868, 5865be57-b5f2-4132-bc71-cc41bfe9f897 => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:59:19 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] VM Started (Lifecycle Event)
Jul 29 14:59:19 user nova-compute[70924]: DEBUG nova.compute.manager [req-b10608ef-397e-4501-bc37-451f5548f98a req-021cf5c3-6c04-4bb2-b168-adc7ee10cbb2 service nova] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Received event network-vif-plugged-6641ec75-757f-44fa-980b-5b0f270432eb {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:59:19 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b10608ef-397e-4501-bc37-451f5548f98a req-021cf5c3-6c04-4bb2-b168-adc7ee10cbb2 service nova] Acquiring lock "5865be57-b5f2-4132-bc71-cc41bfe9f897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:59:19 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b10608ef-397e-4501-bc37-451f5548f98a req-021cf5c3-6c04-4bb2-b168-adc7ee10cbb2 service nova] Lock "5865be57-b5f2-4132-bc71-cc41bfe9f897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:59:19 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b10608ef-397e-4501-bc37-451f5548f98a req-021cf5c3-6c04-4bb2-b168-adc7ee10cbb2 service nova] Lock "5865be57-b5f2-4132-bc71-cc41bfe9f897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:59:19 user nova-compute[70924]: DEBUG nova.compute.manager [req-b10608ef-397e-4501-bc37-451f5548f98a req-021cf5c3-6c04-4bb2-b168-adc7ee10cbb2 service nova] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] No waiting events found dispatching network-vif-plugged-6641ec75-757f-44fa-980b-5b0f270432eb {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:59:19 user nova-compute[70924]: WARNING nova.compute.manager [req-b10608ef-397e-4501-bc37-451f5548f98a req-021cf5c3-6c04-4bb2-b168-adc7ee10cbb2 service nova] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Received unexpected event network-vif-plugged-6641ec75-757f-44fa-980b-5b0f270432eb for instance with vm_state building and task_state spawning.
Jul 29 14:59:19 user nova-compute[70924]: DEBUG os_brick.utils [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:59:19 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:59:19 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:59:19 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:59:19 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[fadc57e9-cf03-4b9a-b84e-1b90ade05e8a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f2127c4a30d9\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:59:19 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:59:19 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:59:19 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:59:19 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6561325-fe0f-4cff-8b21-7f7ab3c2788c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:59:19 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:59:19 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:59:19 user nova-compute[70924]: INFO nova.compute.manager [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Took 6.94 seconds to spawn the instance on the hypervisor.
Jul 29 14:59:19 user nova-compute[70924]: DEBUG nova.compute.manager [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:59:19 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:59:19 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[df44192c-9709-45b6-84dc-9dc22ca8b373]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:59:19 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7e8732-ecb5-4b92-a386-adc519fa258b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:59:19 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Running cmd (subprocess): nvme version {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:59:19 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] 'nvme version' failed. Not Retrying. {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:59:19 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.nvmeof [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] nvme not present on system {{(pid=70924) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 14:59:19 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:59:19 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:59:19 user nova-compute[70924]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 14:59:19 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff661789-cc82-4504-80cb-fd1af051d942]: (4, '') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:59:19 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70924) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 14:59:19 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 14:59:19 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] LIGHTOS: no hostnqn found. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 14:59:19 user nova-compute[70924]: DEBUG os_brick.utils [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f2127c4a30d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:59:19 user nova-compute[70924]: DEBUG nova.virt.block_device [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] Updating existing volume attachment record: 22b176da-040b-4a2a-8568-241ef88e7118 {{(pid=70924) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 14:59:19 user nova-compute[70924]: INFO nova.compute.manager [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Took 7.90 seconds to build instance.
Jul 29 14:59:19 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-13ed201c-93c8-479f-a23d-bb498aab2115 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lock "5865be57-b5f2-4132-bc71-cc41bfe9f897" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.016s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:59:20 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:59:23 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:59:25 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:59:26 user nova-compute[70924]: DEBUG nova.compute.manager [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] Start spawning the instance on the hypervisor. {{(pid=70924) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 14:59:26 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] Creating instance directory {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 14:59:26 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] Creating image(s)
Jul 29 14:59:26 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] Did not create local disks {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 29 14:59:26 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] Ensure instance console log exists: /opt/stack/data/nova/instances/14f9924f-8d4d-4193-927b-02cfb0f5f57a/console.log {{(pid=70924) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 14:59:26 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:59:26 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:59:26 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:59:26 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] Start _get_guest_xml network_info=[{"id": "078ca632-af45-4d44-8e01-7cef910a77ee", "address": "fa:16:3e:1b:a2:ac", "network": {"id": "c19ed38b-2acd-421a-9e4b-f60df3db2f1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1812407562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a974cbbf734f51897c3e632ae9e45f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap078ca632-af", "ovs_interfaceid": "078ca632-af45-4d44-8e01-7cef910a77ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CzIjaLDt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '14f9924f-8d4d-4193-927b-02cfb0f5f57a', 'attached_at': '', 'detached_at': '', 'volume_id': 'ab9daafc-459b-4a5f-8230-13af56e2d1ef', 'serial': 'ab9daafc-459b-4a5f-8230-13af56e2d1ef'}, 'attachment_id': '22b176da-040b-4a2a-8568-241ef88e7118', 'volume_type': None} {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 14:59:26 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:59:26 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:59:26 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 14:59:26 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] CPU controller missing on host. {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 14:59:26 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 14:59:26 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] CPU controller found on host. {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 14:59:26 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70924) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 14:59:26 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T14:36:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 14:59:26 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Flavor limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 14:59:26 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Image limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 14:59:26 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Flavor pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 14:59:26 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Image pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 14:59:26 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 14:59:26 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 14:59:26 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 14:59:26 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Got 1 possible topologies {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 14:59:26 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 14:59:26 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 14:59:26 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] Calling os-brick to attach iSCSI Volume {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 14:59:26 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CzIjaLDt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:59:26 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:59:26 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:59:26 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:59:26 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:59:26 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:59:26 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:59:26 user nova-compute[70924]: INFO os_brick.initiator.connectors.iscsi [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 14:59:26 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef -p 172.16.0.220:3260 {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:59:26 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:59:26 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d752940-c524-4787-9581-7dc022306afb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:59:26 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 14:59:26 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:59:26 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef -p 172.16.0.220:3260 --interface default --op new {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:59:26 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:59:26 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae12bc41-4d9f-43ae-8574-1d536a9393ec]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef] added\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:59:26 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef] added
Jul 29 14:59:26 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:59:26 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:59:26 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:59:26 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b476f2-b31e-48e3-ac82-32b401fa2301]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:59:26 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:59:26 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:59:26 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:59:26 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ca3940-acd2-4b41-baf4-a409ca269a1f]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:59:26 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:59:26 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CzIjaLDt {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:59:26 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CzIjaLDt" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:59:26 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7db1436-25a3-48ad-b973-aae48a9cc3ad]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:59:26 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CzIjaLDt'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:59:26 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:59:26 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:59:26 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7cef379-a178-42b0-8aa5-531a2ec4cd0e]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:59:26 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:59:26 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:59:26 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:59:26 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[221adb67-acb6-468d-a39d-8ac9b5c0b500]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:59:26 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:59:26 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:59:26 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:59:26 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:59:26 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef -p 172.16.0.220:3260 --login {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:59:26 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:59:26 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[95bb32ad-018e-465e-8442-a14f831d940b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:59:26 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef, portal: 172.16.0.220,3260]
Jul 29 14:59:26 user nova-compute[70924]: Login to [iface: default, target: iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef, portal: 172.16.0.220,3260] successful.
Jul 29 14:59:26 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:59:26 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:59:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.130s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:59:27 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d4c1a1-bc41-41a3-8b16-f2f8dff04339]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:59:27 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:59:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:59:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:59:27 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ababa5-c873-4c24-8d7b-f8444a24e3c8]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:59:27 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:59:27 user nova-compute[70924]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef (non-flash)
Jul 29 14:59:27 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:59:27 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:59:27 user nova-compute[70924]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef (non-flash)
Jul 29 14:59:27 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:59:27 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.389s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:59:27 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Connected to 172.16.0.220:3260 {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 14:59:27 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] HCTL ('34', '-', '-', 0) found on session 40 with lun 0 {{(pid=70924) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 14:59:27 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70924) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 14:59:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:59:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:59:27 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c26dcb-ef93-473c-9b85-1ef12022441e]: (4, ('- - 0', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:59:27 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 14:59:27 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CzIjaLDt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 14:59:28 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.428s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:59:28 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] <== connect_volume: return (1429ms) {'type': 'block', 'scsi_wwn': '23833643331656433', 'path': '/dev/sdc'} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:59:28 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833643331656433', 'path': '/dev/sdc'} {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 14:59:28 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:59:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-279085785',display_name='tempest-TestVolumeBootPattern-server-279085785',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-279085785',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99a974cbbf734f51897c3e632ae9e45f',ramdisk_id='',reservation_id='r-8w0q9jfv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1030839740',owner_user_name='tempest-TestVolumeBootPattern-1030839740-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:59:13Z,user_data=None,user_id='da204646e8f84693ad470ed1d3eadd7c',uuid=14f9924f-8d4d-4193-927b-02cfb0f5f57a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "078ca632-af45-4d44-8e01-7cef910a77ee", "address": "fa:16:3e:1b:a2:ac", "network": {"id": "c19ed38b-2acd-421a-9e4b-f60df3db2f1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1812407562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a974cbbf734f51897c3e632ae9e45f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap078ca632-af", "ovs_interfaceid": "078ca632-af45-4d44-8e01-7cef910a77ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:59:28 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Converting VIF {"id": "078ca632-af45-4d44-8e01-7cef910a77ee", "address": "fa:16:3e:1b:a2:ac", "network": {"id": "c19ed38b-2acd-421a-9e4b-f60df3db2f1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1812407562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a974cbbf734f51897c3e632ae9e45f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap078ca632-af", "ovs_interfaceid": "078ca632-af45-4d44-8e01-7cef910a77ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:59:28 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:a2:ac,bridge_name='br-int',has_traffic_filtering=True,id=078ca632-af45-4d44-8e01-7cef910a77ee,network=Network(c19ed38b-2acd-421a-9e4b-f60df3db2f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap078ca632-af') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:59:28 user nova-compute[70924]: DEBUG nova.objects.instance [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lazy-loading 'pci_devices' on Instance uuid 14f9924f-8d4d-4193-927b-02cfb0f5f57a {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:59:28 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] End _get_guest_xml xml=<domain type="kvm">
Jul 29 14:59:28 user nova-compute[70924]:   <uuid>14f9924f-8d4d-4193-927b-02cfb0f5f57a</uuid>
Jul 29 14:59:28 user nova-compute[70924]:   <name>instance-00000025</name>
Jul 29 14:59:28 user nova-compute[70924]:   <memory>524288</memory>
Jul 29 14:59:28 user nova-compute[70924]:   <vcpu>1</vcpu>
Jul 29 14:59:28 user nova-compute[70924]:   <metadata>
Jul 29 14:59:28 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 14:59:28 user nova-compute[70924]:       <nova:package version="0.0.0"/>
Jul 29 14:59:28 user nova-compute[70924]:       <nova:name>tempest-TestVolumeBootPattern-server-279085785</nova:name>
Jul 29 14:59:28 user nova-compute[70924]:       <nova:creationTime>2023-07-29 14:59:26</nova:creationTime>
Jul 29 14:59:28 user nova-compute[70924]:       <nova:flavor name="m1.tiny">
Jul 29 14:59:28 user nova-compute[70924]:         <nova:memory>512</nova:memory>
Jul 29 14:59:28 user nova-compute[70924]:         <nova:disk>1</nova:disk>
Jul 29 14:59:28 user nova-compute[70924]:         <nova:swap>0</nova:swap>
Jul 29 14:59:28 user nova-compute[70924]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 14:59:28 user nova-compute[70924]:         <nova:vcpus>1</nova:vcpus>
Jul 29 14:59:28 user nova-compute[70924]:       </nova:flavor>
Jul 29 14:59:28 user nova-compute[70924]:       <nova:owner>
Jul 29 14:59:28 user nova-compute[70924]:         <nova:user uuid="da204646e8f84693ad470ed1d3eadd7c">tempest-TestVolumeBootPattern-1030839740-project-member</nova:user>
Jul 29 14:59:28 user nova-compute[70924]:         <nova:project uuid="99a974cbbf734f51897c3e632ae9e45f">tempest-TestVolumeBootPattern-1030839740</nova:project>
Jul 29 14:59:28 user nova-compute[70924]:       </nova:owner>
Jul 29 14:59:28 user nova-compute[70924]:       <nova:ports>
Jul 29 14:59:28 user nova-compute[70924]:         <nova:port uuid="078ca632-af45-4d44-8e01-7cef910a77ee">
Jul 29 14:59:28 user nova-compute[70924]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 29 14:59:28 user nova-compute[70924]:         </nova:port>
Jul 29 14:59:28 user nova-compute[70924]:       </nova:ports>
Jul 29 14:59:28 user nova-compute[70924]:     </nova:instance>
Jul 29 14:59:28 user nova-compute[70924]:   </metadata>
Jul 29 14:59:28 user nova-compute[70924]:   <sysinfo type="smbios">
Jul 29 14:59:28 user nova-compute[70924]:     <system>
Jul 29 14:59:28 user nova-compute[70924]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 14:59:28 user nova-compute[70924]:       <entry name="product">OpenStack Nova</entry>
Jul 29 14:59:28 user nova-compute[70924]:       <entry name="version">0.0.0</entry>
Jul 29 14:59:28 user nova-compute[70924]:       <entry name="serial">14f9924f-8d4d-4193-927b-02cfb0f5f57a</entry>
Jul 29 14:59:28 user nova-compute[70924]:       <entry name="uuid">14f9924f-8d4d-4193-927b-02cfb0f5f57a</entry>
Jul 29 14:59:28 user nova-compute[70924]:       <entry name="family">Virtual Machine</entry>
Jul 29 14:59:28 user nova-compute[70924]:     </system>
Jul 29 14:59:28 user nova-compute[70924]:   </sysinfo>
Jul 29 14:59:28 user nova-compute[70924]:   <os>
Jul 29 14:59:28 user nova-compute[70924]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 14:59:28 user nova-compute[70924]:     <boot dev="hd"/>
Jul 29 14:59:28 user nova-compute[70924]:     <smbios mode="sysinfo"/>
Jul 29 14:59:28 user nova-compute[70924]:   </os>
Jul 29 14:59:28 user nova-compute[70924]:   <features>
Jul 29 14:59:28 user nova-compute[70924]:     <acpi/>
Jul 29 14:59:28 user nova-compute[70924]:     <apic/>
Jul 29 14:59:28 user nova-compute[70924]:     <vmcoreinfo/>
Jul 29 14:59:28 user nova-compute[70924]:   </features>
Jul 29 14:59:28 user nova-compute[70924]:   <clock offset="utc">
Jul 29 14:59:28 user nova-compute[70924]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 14:59:28 user nova-compute[70924]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 14:59:28 user nova-compute[70924]:     <timer name="hpet" present="no"/>
Jul 29 14:59:28 user nova-compute[70924]:   </clock>
Jul 29 14:59:28 user nova-compute[70924]:   <cpu mode="custom" match="exact">
Jul 29 14:59:28 user nova-compute[70924]:     <model>Nehalem</model>
Jul 29 14:59:28 user nova-compute[70924]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 14:59:28 user nova-compute[70924]:   </cpu>
Jul 29 14:59:28 user nova-compute[70924]:   <devices>
Jul 29 14:59:28 user nova-compute[70924]:     <disk type="block" device="disk">
Jul 29 14:59:28 user nova-compute[70924]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:59:28 user nova-compute[70924]:       <source dev="/dev/sdc"/>
Jul 29 14:59:28 user nova-compute[70924]:       <target dev="vda" bus="virtio"/>
Jul 29 14:59:28 user nova-compute[70924]:       <serial>ab9daafc-459b-4a5f-8230-13af56e2d1ef</serial>
Jul 29 14:59:28 user nova-compute[70924]:     </disk>
Jul 29 14:59:28 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 14:59:28 user nova-compute[70924]:       <mac address="fa:16:3e:1b:a2:ac"/>
Jul 29 14:59:28 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:59:28 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 14:59:28 user nova-compute[70924]:       <target dev="tap078ca632-af"/>
Jul 29 14:59:28 user nova-compute[70924]:     </interface>
Jul 29 14:59:28 user nova-compute[70924]:     <serial type="pty">
Jul 29 14:59:28 user nova-compute[70924]:       <log file="/opt/stack/data/nova/instances/14f9924f-8d4d-4193-927b-02cfb0f5f57a/console.log" append="off"/>
Jul 29 14:59:28 user nova-compute[70924]:     </serial>
Jul 29 14:59:28 user nova-compute[70924]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 14:59:28 user nova-compute[70924]:     <video>
Jul 29 14:59:28 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 14:59:28 user nova-compute[70924]:     </video>
Jul 29 14:59:28 user nova-compute[70924]:     <rng model="virtio">
Jul 29 14:59:28 user nova-compute[70924]:       <backend model="random">/dev/urandom</backend>
Jul 29 14:59:28 user nova-compute[70924]:     </rng>
Jul 29 14:59:28 user nova-compute[70924]:     <controller type="usb" index="0" model="none"/>
Jul 29 14:59:28 user nova-compute[70924]:     <memballoon model="virtio">
Jul 29 14:59:28 user nova-compute[70924]:       <stats period="10"/>
Jul 29 14:59:28 user nova-compute[70924]:     </memballoon>
Jul 29 14:59:28 user nova-compute[70924]:   </devices>
Jul 29 14:59:28 user nova-compute[70924]: </domain>
Jul 29 14:59:28 user nova-compute[70924]:  {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 14:59:28 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:59:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-279085785',display_name='tempest-TestVolumeBootPattern-server-279085785',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-279085785',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99a974cbbf734f51897c3e632ae9e45f',ramdisk_id='',reservation_id='r-8w0q9jfv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1030839740',owner_user_name='tempest-TestVolumeBootPattern-1030839740-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:59:13Z,user_data=None,user_id='da204646e8f84693ad470ed1d3eadd7c',uuid=14f9924f-8d4d-4193-927b-02cfb0f5f57a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "078ca632-af45-4d44-8e01-7cef910a77ee", "address": "fa:16:3e:1b:a2:ac", "network": {"id": "c19ed38b-2acd-421a-9e4b-f60df3db2f1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1812407562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a974cbbf734f51897c3e632ae9e45f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap078ca632-af", "ovs_interfaceid": "078ca632-af45-4d44-8e01-7cef910a77ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 14:59:28 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Converting VIF {"id": "078ca632-af45-4d44-8e01-7cef910a77ee", "address": "fa:16:3e:1b:a2:ac", "network": {"id": "c19ed38b-2acd-421a-9e4b-f60df3db2f1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1812407562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a974cbbf734f51897c3e632ae9e45f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap078ca632-af", "ovs_interfaceid": "078ca632-af45-4d44-8e01-7cef910a77ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:59:28 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:a2:ac,bridge_name='br-int',has_traffic_filtering=True,id=078ca632-af45-4d44-8e01-7cef910a77ee,network=Network(c19ed38b-2acd-421a-9e4b-f60df3db2f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap078ca632-af') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:59:28 user nova-compute[70924]: DEBUG os_vif [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:a2:ac,bridge_name='br-int',has_traffic_filtering=True,id=078ca632-af45-4d44-8e01-7cef910a77ee,network=Network(c19ed38b-2acd-421a-9e4b-f60df3db2f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap078ca632-af') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 14:59:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:59:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:59:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 14:59:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:59:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap078ca632-af, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:59:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap078ca632-af, col_values=(('external_ids', {'iface-id': '078ca632-af45-4d44-8e01-7cef910a77ee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:a2:ac', 'vm-uuid': '14f9924f-8d4d-4193-927b-02cfb0f5f57a'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:59:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:59:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:59:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:59:28 user nova-compute[70924]: INFO os_vif [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:a2:ac,bridge_name='br-int',has_traffic_filtering=True,id=078ca632-af45-4d44-8e01-7cef910a77ee,network=Network(c19ed38b-2acd-421a-9e4b-f60df3db2f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap078ca632-af')
Jul 29 14:59:28 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:59:28 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] No VIF found with MAC fa:16:3e:1b:a2:ac, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:59:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:59:29 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:59:29 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:59:29 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:59:29 user nova-compute[70924]: DEBUG nova.compute.manager [req-937fd960-14b4-4f2b-b8eb-c1cf0b0f7209 req-c01ab5ec-f682-411e-bf0e-db67e3cbb1f1 service nova] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] Received event network-vif-plugged-078ca632-af45-4d44-8e01-7cef910a77ee {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:59:29 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-937fd960-14b4-4f2b-b8eb-c1cf0b0f7209 req-c01ab5ec-f682-411e-bf0e-db67e3cbb1f1 service nova] Acquiring lock "14f9924f-8d4d-4193-927b-02cfb0f5f57a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:59:29 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-937fd960-14b4-4f2b-b8eb-c1cf0b0f7209 req-c01ab5ec-f682-411e-bf0e-db67e3cbb1f1 service nova] Lock "14f9924f-8d4d-4193-927b-02cfb0f5f57a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:59:29 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-937fd960-14b4-4f2b-b8eb-c1cf0b0f7209 req-c01ab5ec-f682-411e-bf0e-db67e3cbb1f1 service nova] Lock "14f9924f-8d4d-4193-927b-02cfb0f5f57a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:59:29 user nova-compute[70924]: DEBUG nova.compute.manager [req-937fd960-14b4-4f2b-b8eb-c1cf0b0f7209 req-c01ab5ec-f682-411e-bf0e-db67e3cbb1f1 service nova] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] No waiting events found dispatching network-vif-plugged-078ca632-af45-4d44-8e01-7cef910a77ee {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:59:29 user nova-compute[70924]: WARNING nova.compute.manager [req-937fd960-14b4-4f2b-b8eb-c1cf0b0f7209 req-c01ab5ec-f682-411e-bf0e-db67e3cbb1f1 service nova] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] Received unexpected event network-vif-plugged-078ca632-af45-4d44-8e01-7cef910a77ee for instance with vm_state building and task_state spawning.
Jul 29 14:59:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:59:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:59:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:59:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:59:31 user nova-compute[70924]: DEBUG nova.compute.manager [req-297f9836-e5b1-405d-85c6-77984131e78f req-fad8b3c1-9c5b-499f-a510-e12d9886c9a1 service nova] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] Received event network-vif-plugged-078ca632-af45-4d44-8e01-7cef910a77ee {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:59:31 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-297f9836-e5b1-405d-85c6-77984131e78f req-fad8b3c1-9c5b-499f-a510-e12d9886c9a1 service nova] Acquiring lock "14f9924f-8d4d-4193-927b-02cfb0f5f57a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:59:31 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-297f9836-e5b1-405d-85c6-77984131e78f req-fad8b3c1-9c5b-499f-a510-e12d9886c9a1 service nova] Lock "14f9924f-8d4d-4193-927b-02cfb0f5f57a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:59:31 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-297f9836-e5b1-405d-85c6-77984131e78f req-fad8b3c1-9c5b-499f-a510-e12d9886c9a1 service nova] Lock "14f9924f-8d4d-4193-927b-02cfb0f5f57a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:59:31 user nova-compute[70924]: DEBUG nova.compute.manager [req-297f9836-e5b1-405d-85c6-77984131e78f req-fad8b3c1-9c5b-499f-a510-e12d9886c9a1 service nova] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] No waiting events found dispatching network-vif-plugged-078ca632-af45-4d44-8e01-7cef910a77ee {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:59:31 user nova-compute[70924]: WARNING nova.compute.manager [req-297f9836-e5b1-405d-85c6-77984131e78f req-fad8b3c1-9c5b-499f-a510-e12d9886c9a1 service nova] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] Received unexpected event network-vif-plugged-078ca632-af45-4d44-8e01-7cef910a77ee for instance with vm_state building and task_state spawning.
Jul 29 14:59:31 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642771.951536, 14f9924f-8d4d-4193-927b-02cfb0f5f57a => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:59:31 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] VM Resumed (Lifecycle Event)
Jul 29 14:59:31 user nova-compute[70924]: DEBUG nova.compute.manager [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] Instance event wait completed in 0 seconds for  {{(pid=70924) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 14:59:31 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] Guest created on hypervisor {{(pid=70924) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 14:59:31 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] Instance spawned successfully.
Jul 29 14:59:31 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 14:59:31 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:59:31 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:59:31 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] Found default for hw_cdrom_bus of ide {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:59:31 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] Found default for hw_disk_bus of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:59:31 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] Found default for hw_input_bus of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:59:31 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] Found default for hw_pointer_model of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:59:31 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] Found default for hw_video_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:59:31 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] Found default for hw_vif_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:59:32 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:59:32 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642771.9518015, 14f9924f-8d4d-4193-927b-02cfb0f5f57a => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:59:32 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] VM Started (Lifecycle Event)
Jul 29 14:59:32 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:59:32 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:59:32 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:59:32 user nova-compute[70924]: INFO nova.compute.manager [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] Took 5.38 seconds to spawn the instance on the hypervisor.
Jul 29 14:59:32 user nova-compute[70924]: DEBUG nova.compute.manager [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:59:32 user nova-compute[70924]: INFO nova.compute.manager [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] Took 20.31 seconds to build instance.
Jul 29 14:59:32 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-29cef564-de25-40a0-93ce-a833474cfd4c tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "14f9924f-8d4d-4193-927b-02cfb0f5f57a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.434s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:59:33 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:59:33 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:59:38 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:59:38 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:59:39 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-35cf6bf2-7716-4621-8f4a-57f83f9dee5a tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Acquiring lock "c31a724f-3006-4e5d-a9b5-847fd6cd170a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:59:39 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-35cf6bf2-7716-4621-8f4a-57f83f9dee5a tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "c31a724f-3006-4e5d-a9b5-847fd6cd170a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:59:39 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-35cf6bf2-7716-4621-8f4a-57f83f9dee5a tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Acquiring lock "c31a724f-3006-4e5d-a9b5-847fd6cd170a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:59:39 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-35cf6bf2-7716-4621-8f4a-57f83f9dee5a tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "c31a724f-3006-4e5d-a9b5-847fd6cd170a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:59:39 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-35cf6bf2-7716-4621-8f4a-57f83f9dee5a tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "c31a724f-3006-4e5d-a9b5-847fd6cd170a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:59:39 user nova-compute[70924]: INFO nova.compute.manager [None req-35cf6bf2-7716-4621-8f4a-57f83f9dee5a tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] Terminating instance
Jul 29 14:59:39 user nova-compute[70924]: DEBUG nova.compute.manager [None req-35cf6bf2-7716-4621-8f4a-57f83f9dee5a tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] Start destroying the instance on the hypervisor. {{(pid=70924) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 14:59:39 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:59:39 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:59:39 user nova-compute[70924]: DEBUG nova.compute.manager [req-7d757db2-0826-46f8-8562-d9980e6756ca req-327316a7-d3e1-41f2-ab63-3aff851bd05d service nova] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] Received event network-vif-unplugged-31895092-6af7-4934-895e-f8455642368c {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:59:39 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-7d757db2-0826-46f8-8562-d9980e6756ca req-327316a7-d3e1-41f2-ab63-3aff851bd05d service nova] Acquiring lock "c31a724f-3006-4e5d-a9b5-847fd6cd170a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:59:39 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-7d757db2-0826-46f8-8562-d9980e6756ca req-327316a7-d3e1-41f2-ab63-3aff851bd05d service nova] Lock "c31a724f-3006-4e5d-a9b5-847fd6cd170a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:59:39 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-7d757db2-0826-46f8-8562-d9980e6756ca req-327316a7-d3e1-41f2-ab63-3aff851bd05d service nova] Lock "c31a724f-3006-4e5d-a9b5-847fd6cd170a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:59:39 user nova-compute[70924]: DEBUG nova.compute.manager [req-7d757db2-0826-46f8-8562-d9980e6756ca req-327316a7-d3e1-41f2-ab63-3aff851bd05d service nova] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] No waiting events found dispatching network-vif-unplugged-31895092-6af7-4934-895e-f8455642368c {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:59:39 user nova-compute[70924]: DEBUG nova.compute.manager [req-7d757db2-0826-46f8-8562-d9980e6756ca req-327316a7-d3e1-41f2-ab63-3aff851bd05d service nova] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] Received event network-vif-unplugged-31895092-6af7-4934-895e-f8455642368c for instance with task_state deleting. {{(pid=70924) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 14:59:39 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:59:39 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:59:40 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:59:40 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:59:40 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:59:40 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] Instance destroyed successfully.
Jul 29 14:59:40 user nova-compute[70924]: DEBUG nova.objects.instance [None req-35cf6bf2-7716-4621-8f4a-57f83f9dee5a tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lazy-loading 'resources' on Instance uuid c31a724f-3006-4e5d-a9b5-847fd6cd170a {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:59:40 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-35cf6bf2-7716-4621-8f4a-57f83f9dee5a tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:49:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1437543645',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1437543645',id=26,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:49:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5a9e5c78c1684c359cfab4e32b9c213f',ramdisk_id='',reservation_id='r-jbuysvy6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2089253815',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:51:24Z,user_data=None,user_id='43582a8a85c54b5e9d16d11b12bf50d4',uuid=c31a724f-3006-4e5d-a9b5-847fd6cd170a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "31895092-6af7-4934-895e-f8455642368c", "address": "fa:16:3e:09:8e:63", "network": {"id": "d5876e18-e2af-45c2-aab5-2d0d552ebfe4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2035085552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9e5c78c1684c359cfab4e32b9c213f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31895092-6a", "ovs_interfaceid": "31895092-6af7-4934-895e-f8455642368c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 14:59:40 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-35cf6bf2-7716-4621-8f4a-57f83f9dee5a tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Converting VIF {"id": "31895092-6af7-4934-895e-f8455642368c", "address": "fa:16:3e:09:8e:63", "network": {"id": "d5876e18-e2af-45c2-aab5-2d0d552ebfe4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2035085552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9e5c78c1684c359cfab4e32b9c213f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31895092-6a", "ovs_interfaceid": "31895092-6af7-4934-895e-f8455642368c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:59:40 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-35cf6bf2-7716-4621-8f4a-57f83f9dee5a tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:8e:63,bridge_name='br-int',has_traffic_filtering=True,id=31895092-6af7-4934-895e-f8455642368c,network=Network(d5876e18-e2af-45c2-aab5-2d0d552ebfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31895092-6a') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:59:40 user nova-compute[70924]: DEBUG os_vif [None req-35cf6bf2-7716-4621-8f4a-57f83f9dee5a tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:8e:63,bridge_name='br-int',has_traffic_filtering=True,id=31895092-6af7-4934-895e-f8455642368c,network=Network(d5876e18-e2af-45c2-aab5-2d0d552ebfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31895092-6a') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 14:59:40 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:59:40 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap31895092-6a, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:59:40 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:59:40 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:59:40 user nova-compute[70924]: INFO os_vif [None req-35cf6bf2-7716-4621-8f4a-57f83f9dee5a tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:8e:63,bridge_name='br-int',has_traffic_filtering=True,id=31895092-6af7-4934-895e-f8455642368c,network=Network(d5876e18-e2af-45c2-aab5-2d0d552ebfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31895092-6a')
Jul 29 14:59:40 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-35cf6bf2-7716-4621-8f4a-57f83f9dee5a tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] Deleting instance files /opt/stack/data/nova/instances/c31a724f-3006-4e5d-a9b5-847fd6cd170a_del
Jul 29 14:59:40 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-35cf6bf2-7716-4621-8f4a-57f83f9dee5a tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] Deletion of /opt/stack/data/nova/instances/c31a724f-3006-4e5d-a9b5-847fd6cd170a_del complete
Jul 29 14:59:40 user nova-compute[70924]: INFO nova.compute.manager [None req-35cf6bf2-7716-4621-8f4a-57f83f9dee5a tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] Took 0.89 seconds to destroy the instance on the hypervisor.
Jul 29 14:59:40 user nova-compute[70924]: DEBUG oslo.service.loopingcall [None req-35cf6bf2-7716-4621-8f4a-57f83f9dee5a tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70924) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 14:59:40 user nova-compute[70924]: DEBUG nova.compute.manager [-] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] Deallocating network for instance {{(pid=70924) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 14:59:40 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] deallocate_for_instance() {{(pid=70924) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 14:59:41 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:59:41 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] Took 0.66 seconds to deallocate network for instance.
Jul 29 14:59:41 user nova-compute[70924]: DEBUG nova.compute.manager [req-52d5a4cb-4c9e-447f-aa1f-8b25dc4dda3f req-10a1145e-3c25-4815-9770-005754468923 service nova] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] Received event network-vif-deleted-31895092-6af7-4934-895e-f8455642368c {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:59:41 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-35cf6bf2-7716-4621-8f4a-57f83f9dee5a tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:59:41 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-35cf6bf2-7716-4621-8f4a-57f83f9dee5a tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:59:41 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-35cf6bf2-7716-4621-8f4a-57f83f9dee5a tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:59:41 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-35cf6bf2-7716-4621-8f4a-57f83f9dee5a tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:59:41 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-35cf6bf2-7716-4621-8f4a-57f83f9dee5a tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.371s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:59:41 user nova-compute[70924]: INFO nova.scheduler.client.report [None req-35cf6bf2-7716-4621-8f4a-57f83f9dee5a tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Deleted allocations for instance c31a724f-3006-4e5d-a9b5-847fd6cd170a
Jul 29 14:59:41 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-35cf6bf2-7716-4621-8f4a-57f83f9dee5a tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "c31a724f-3006-4e5d-a9b5-847fd6cd170a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.128s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:59:41 user nova-compute[70924]: DEBUG nova.compute.manager [req-f12f20c1-c8b3-4431-a14b-4a0d7624551d req-767f03af-6070-4760-be8e-e60a01b580dd service nova] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] Received event network-vif-plugged-31895092-6af7-4934-895e-f8455642368c {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:59:41 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-f12f20c1-c8b3-4431-a14b-4a0d7624551d req-767f03af-6070-4760-be8e-e60a01b580dd service nova] Acquiring lock "c31a724f-3006-4e5d-a9b5-847fd6cd170a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:59:41 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-f12f20c1-c8b3-4431-a14b-4a0d7624551d req-767f03af-6070-4760-be8e-e60a01b580dd service nova] Lock "c31a724f-3006-4e5d-a9b5-847fd6cd170a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:59:41 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-f12f20c1-c8b3-4431-a14b-4a0d7624551d req-767f03af-6070-4760-be8e-e60a01b580dd service nova] Lock "c31a724f-3006-4e5d-a9b5-847fd6cd170a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:59:41 user nova-compute[70924]: DEBUG nova.compute.manager [req-f12f20c1-c8b3-4431-a14b-4a0d7624551d req-767f03af-6070-4760-be8e-e60a01b580dd service nova] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] No waiting events found dispatching network-vif-plugged-31895092-6af7-4934-895e-f8455642368c {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:59:41 user nova-compute[70924]: WARNING nova.compute.manager [req-f12f20c1-c8b3-4431-a14b-4a0d7624551d req-767f03af-6070-4760-be8e-e60a01b580dd service nova] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] Received unexpected event network-vif-plugged-31895092-6af7-4934-895e-f8455642368c for instance with vm_state deleted and task_state None.
Jul 29 14:59:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:59:45 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:59:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:59:49 user nova-compute[70924]: DEBUG nova.compute.manager [req-f539cd31-8475-4d33-8892-8c83d046848e req-c3cb16ee-e892-490c-8cb0-01681a5ebe5d service nova] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Received event network-changed-eafccd28-f902-4bc2-805e-4d2f8bbd4e82 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:59:49 user nova-compute[70924]: DEBUG nova.compute.manager [req-f539cd31-8475-4d33-8892-8c83d046848e req-c3cb16ee-e892-490c-8cb0-01681a5ebe5d service nova] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Refreshing instance network info cache due to event network-changed-eafccd28-f902-4bc2-805e-4d2f8bbd4e82. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:59:49 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-f539cd31-8475-4d33-8892-8c83d046848e req-c3cb16ee-e892-490c-8cb0-01681a5ebe5d service nova] Acquiring lock "refresh_cache-f3f7eeda-a001-4c35-abeb-e459d701bd93" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:59:49 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-f539cd31-8475-4d33-8892-8c83d046848e req-c3cb16ee-e892-490c-8cb0-01681a5ebe5d service nova] Acquired lock "refresh_cache-f3f7eeda-a001-4c35-abeb-e459d701bd93" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:59:49 user nova-compute[70924]: DEBUG nova.network.neutron [req-f539cd31-8475-4d33-8892-8c83d046848e req-c3cb16ee-e892-490c-8cb0-01681a5ebe5d service nova] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Refreshing network info cache for port eafccd28-f902-4bc2-805e-4d2f8bbd4e82 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:59:49 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-87cfd3a6-ec90-4796-ac7a-5c1e26b89e83 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Acquiring lock "f3f7eeda-a001-4c35-abeb-e459d701bd93" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:59:49 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-87cfd3a6-ec90-4796-ac7a-5c1e26b89e83 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "f3f7eeda-a001-4c35-abeb-e459d701bd93" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:59:50 user nova-compute[70924]: DEBUG nova.objects.instance [None req-87cfd3a6-ec90-4796-ac7a-5c1e26b89e83 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lazy-loading 'flavor' on Instance uuid f3f7eeda-a001-4c35-abeb-e459d701bd93 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:59:50 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-87cfd3a6-ec90-4796-ac7a-5c1e26b89e83 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "f3f7eeda-a001-4c35-abeb-e459d701bd93" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:59:50 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-87cfd3a6-ec90-4796-ac7a-5c1e26b89e83 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Acquiring lock "f3f7eeda-a001-4c35-abeb-e459d701bd93" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:59:50 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-87cfd3a6-ec90-4796-ac7a-5c1e26b89e83 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "f3f7eeda-a001-4c35-abeb-e459d701bd93" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:59:50 user nova-compute[70924]: INFO nova.compute.manager [None req-87cfd3a6-ec90-4796-ac7a-5c1e26b89e83 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Attaching volume 5d7f71e8-1d8c-4745-85b9-9685f0bfd592 to /dev/vdb
Jul 29 14:59:50 user nova-compute[70924]: DEBUG os_brick.utils [None req-87cfd3a6-ec90-4796-ac7a-5c1e26b89e83 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:59:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:59:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:59:50 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec1ab2e-6023-4682-b332-dd0f2efd8b66]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f2127c4a30d9\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:59:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:59:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:59:50 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[371dcf66-fb16-4bac-b750-3f153f797e78]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:59:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:59:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:59:50 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10d492f-a98b-41e8-9443-dfb85880167e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:59:50 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9229c33-7de9-4616-98e1-497ad120d897]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:59:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-87cfd3a6-ec90-4796-ac7a-5c1e26b89e83 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Running cmd (subprocess): nvme version {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:59:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-87cfd3a6-ec90-4796-ac7a-5c1e26b89e83 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] 'nvme version' failed. Not Retrying. {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:59:50 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:59:50 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.nvmeof [None req-87cfd3a6-ec90-4796-ac7a-5c1e26b89e83 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] nvme not present on system {{(pid=70924) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 14:59:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:59:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:59:50 user nova-compute[70924]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 14:59:50 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b610d89-659c-4d43-8f0d-ff2ead5839ff]: (4, '') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:59:50 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-87cfd3a6-ec90-4796-ac7a-5c1e26b89e83 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70924) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 14:59:50 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-87cfd3a6-ec90-4796-ac7a-5c1e26b89e83 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 14:59:50 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-87cfd3a6-ec90-4796-ac7a-5c1e26b89e83 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] LIGHTOS: no hostnqn found. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 14:59:50 user nova-compute[70924]: DEBUG os_brick.utils [None req-87cfd3a6-ec90-4796-ac7a-5c1e26b89e83 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f2127c4a30d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:59:50 user nova-compute[70924]: DEBUG nova.virt.block_device [None req-87cfd3a6-ec90-4796-ac7a-5c1e26b89e83 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Updating existing volume attachment record: fb1c3668-0aaf-44d0-bdeb-fed1f39b91b5 {{(pid=70924) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 14:59:50 user nova-compute[70924]: DEBUG nova.network.neutron [req-f539cd31-8475-4d33-8892-8c83d046848e req-c3cb16ee-e892-490c-8cb0-01681a5ebe5d service nova] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Updated VIF entry in instance network info cache for port eafccd28-f902-4bc2-805e-4d2f8bbd4e82. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:59:50 user nova-compute[70924]: DEBUG nova.network.neutron [req-f539cd31-8475-4d33-8892-8c83d046848e req-c3cb16ee-e892-490c-8cb0-01681a5ebe5d service nova] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Updating instance_info_cache with network_info: [{"id": "eafccd28-f902-4bc2-805e-4d2f8bbd4e82", "address": "fa:16:3e:9f:ec:06", "network": {"id": "b2aee530-d195-47bb-b39d-c8bd15b81a08", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-421022738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcf4644e7a24bf68b407be2e3d9732c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeafccd28-f9", "ovs_interfaceid": "eafccd28-f902-4bc2-805e-4d2f8bbd4e82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:59:50 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-f539cd31-8475-4d33-8892-8c83d046848e req-c3cb16ee-e892-490c-8cb0-01681a5ebe5d service nova] Releasing lock "refresh_cache-f3f7eeda-a001-4c35-abeb-e459d701bd93" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:59:51 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:59:53 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:59:54 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:59:55 user nova-compute[70924]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690642780.3335347, c31a724f-3006-4e5d-a9b5-847fd6cd170a => Stopped> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:59:55 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] VM Stopped (Lifecycle Event)
Jul 29 14:59:55 user nova-compute[70924]: DEBUG nova.compute.manager [None req-5b443b48-cc4c-4b78-bbef-7996a39a5c36 None None] [instance: c31a724f-3006-4e5d-a9b5-847fd6cd170a] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:59:55 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:59:56 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:59:57 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:59:57 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87cfd3a6-ec90-4796-ac7a-5c1e26b89e83 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Calling os-brick to attach iSCSI Volume {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 14:59:57 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-87cfd3a6-ec90-4796-ac7a-5c1e26b89e83 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IpOBjLvQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:59:57 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-87cfd3a6-ec90-4796-ac7a-5c1e26b89e83 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:59:57 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-87cfd3a6-ec90-4796-ac7a-5c1e26b89e83 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:59:57 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-87cfd3a6-ec90-4796-ac7a-5c1e26b89e83 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:59:57 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-87cfd3a6-ec90-4796-ac7a-5c1e26b89e83 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:59:57 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-87cfd3a6-ec90-4796-ac7a-5c1e26b89e83 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:59:57 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-87cfd3a6-ec90-4796-ac7a-5c1e26b89e83 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:59:57 user nova-compute[70924]: INFO os_brick.initiator.connectors.iscsi [None req-87cfd3a6-ec90-4796-ac7a-5c1e26b89e83 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 14:59:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 -p 172.16.0.220:3260 {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:59:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:59:57 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[66db7266-2011-4b58-ad53-0eb2edeebedf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:59:57 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-87cfd3a6-ec90-4796-ac7a-5c1e26b89e83 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 14:59:57 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:59:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 -p 172.16.0.220:3260 --interface default --op new {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:59:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:59:57 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1b2ae0-3be9-4444-b601-7007ae6b42e3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592] added\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:59:57 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-87cfd3a6-ec90-4796-ac7a-5c1e26b89e83 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592] added
Jul 29 14:59:57 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:59:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:59:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:59:57 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[260ef018-3969-4298-876a-ac49d6625c57]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:59:57 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-87cfd3a6-ec90-4796-ac7a-5c1e26b89e83 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:59:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:59:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:59:57 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef146ef-0626-467d-a867-72bafe658624]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:59:57 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-87cfd3a6-ec90-4796-ac7a-5c1e26b89e83 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:59:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IpOBjLvQ {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:59:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IpOBjLvQ" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:59:57 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e334a62-2d0c-4f85-8d1e-ce0b3c5397a8]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:59:57 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-87cfd3a6-ec90-4796-ac7a-5c1e26b89e83 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IpOBjLvQ'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:59:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:59:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:59:58 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1767b648-e157-442f-a546-dec6d915e86c]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:59:58 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-87cfd3a6-ec90-4796-ac7a-5c1e26b89e83 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:59:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:59:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:59:58 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1bc96d-0ed8-45b3-9023-eca0006f041c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:59:58 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-87cfd3a6-ec90-4796-ac7a-5c1e26b89e83 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:59:58 user nova-compute[70924]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef (non-flash)
Jul 29 14:59:58 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:59:58 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-87cfd3a6-ec90-4796-ac7a-5c1e26b89e83 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:59:58 user nova-compute[70924]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef (non-flash)
Jul 29 14:59:58 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:59:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 -p 172.16.0.220:3260 --login {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:59:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:59:58 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4514828-4668-472b-97c1-2edd3a22e21f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:59:58 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-87cfd3a6-ec90-4796-ac7a-5c1e26b89e83 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592, portal: 172.16.0.220,3260]
Jul 29 14:59:58 user nova-compute[70924]: Login to [iface: default, target: iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592, portal: 172.16.0.220,3260] successful.
Jul 29 14:59:58 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:59:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:59:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:59:58 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[780307fe-118c-4ca8-8a54-6ed3f54298d2]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:59:58 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-87cfd3a6-ec90-4796-ac7a-5c1e26b89e83 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:59:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:59:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:59:58 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f83b2942-1d74-42da-ac28-8e124ecf2443]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:59:58 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-87cfd3a6-ec90-4796-ac7a-5c1e26b89e83 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:59:58 user nova-compute[70924]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef (non-flash)
Jul 29 14:59:58 user nova-compute[70924]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 (non-flash)
Jul 29 14:59:58 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:59:58 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-87cfd3a6-ec90-4796-ac7a-5c1e26b89e83 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 14:59:58 user nova-compute[70924]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef (non-flash)
Jul 29 14:59:58 user nova-compute[70924]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 (non-flash)
Jul 29 14:59:58 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:59:58 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-87cfd3a6-ec90-4796-ac7a-5c1e26b89e83 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:59:58 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-87cfd3a6-ec90-4796-ac7a-5c1e26b89e83 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Connected to 172.16.0.220:3260 {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 14:59:58 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-87cfd3a6-ec90-4796-ac7a-5c1e26b89e83 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] HCTL ('35', '-', '-', 0) found on session 41 with lun 0 {{(pid=70924) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 14:59:58 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-87cfd3a6-ec90-4796-ac7a-5c1e26b89e83 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70924) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 14:59:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:59:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:59:58 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa8f670-9730-40b6-9409-ee27b9f92d0e]: (4, ('- - 0', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:59:58 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-87cfd3a6-ec90-4796-ac7a-5c1e26b89e83 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Searching for a device in session 41 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 14:59:58 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-87cfd3a6-ec90-4796-ac7a-5c1e26b89e83 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IpOBjLvQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 14:59:58 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:59:59 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:59:59 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-87cfd3a6-ec90-4796-ac7a-5c1e26b89e83 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:59:59 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-87cfd3a6-ec90-4796-ac7a-5c1e26b89e83 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '23133373430326435', 'path': '/dev/sdd'} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:59:59 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87cfd3a6-ec90-4796-ac7a-5c1e26b89e83 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23133373430326435', 'path': '/dev/sdd'} {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 14:59:59 user nova-compute[70924]: DEBUG nova.objects.instance [None req-87cfd3a6-ec90-4796-ac7a-5c1e26b89e83 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lazy-loading 'flavor' on Instance uuid f3f7eeda-a001-4c35-abeb-e459d701bd93 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:59:59 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-87cfd3a6-ec90-4796-ac7a-5c1e26b89e83 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] attach device xml: <disk type="block" device="disk">
Jul 29 14:59:59 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:59:59 user nova-compute[70924]:   <source dev="/dev/sdd"/>
Jul 29 14:59:59 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 14:59:59 user nova-compute[70924]:   <serial>5d7f71e8-1d8c-4745-85b9-9685f0bfd592</serial>
Jul 29 14:59:59 user nova-compute[70924]: </disk>
Jul 29 14:59:59 user nova-compute[70924]:  {{(pid=70924) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 29 14:59:59 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:59:59 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-87cfd3a6-ec90-4796-ac7a-5c1e26b89e83 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:59:59 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-87cfd3a6-ec90-4796-ac7a-5c1e26b89e83 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:59:59 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-87cfd3a6-ec90-4796-ac7a-5c1e26b89e83 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] No VIF found with MAC fa:16:3e:9f:ec:06, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:59:59 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-87cfd3a6-ec90-4796-ac7a-5c1e26b89e83 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "f3f7eeda-a001-4c35-abeb-e459d701bd93" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.519s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:00:00 user nova-compute[70924]: INFO nova.compute.manager [None req-68ca9d55-9364-4f40-86cd-d4ed79f9a748 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Rescuing
Jul 29 15:00:00 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-68ca9d55-9364-4f40-86cd-d4ed79f9a748 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Acquiring lock "refresh_cache-f3f7eeda-a001-4c35-abeb-e459d701bd93" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:00:00 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-68ca9d55-9364-4f40-86cd-d4ed79f9a748 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Acquired lock "refresh_cache-f3f7eeda-a001-4c35-abeb-e459d701bd93" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:00:00 user nova-compute[70924]: DEBUG nova.network.neutron [None req-68ca9d55-9364-4f40-86cd-d4ed79f9a748 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 15:00:00 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:00:00 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:00:00 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:00:00 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:00:00 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:00:00 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:00:00 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Auditing locally available compute resources for user (node: user) {{(pid=70924) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 15:00:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f7eeda-a001-4c35-abeb-e459d701bd93/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f7eeda-a001-4c35-abeb-e459d701bd93/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f7eeda-a001-4c35-abeb-e459d701bd93/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f7eeda-a001-4c35-abeb-e459d701bd93/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:00 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 15:00:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5865be57-b5f2-4132-bc71-cc41bfe9f897/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:01 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5865be57-b5f2-4132-bc71-cc41bfe9f897/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:01 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5865be57-b5f2-4132-bc71-cc41bfe9f897/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:01 user nova-compute[70924]: DEBUG nova.network.neutron [None req-68ca9d55-9364-4f40-86cd-d4ed79f9a748 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Updating instance_info_cache with network_info: [{"id": "eafccd28-f902-4bc2-805e-4d2f8bbd4e82", "address": "fa:16:3e:9f:ec:06", "network": {"id": "b2aee530-d195-47bb-b39d-c8bd15b81a08", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-421022738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcf4644e7a24bf68b407be2e3d9732c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeafccd28-f9", "ovs_interfaceid": "eafccd28-f902-4bc2-805e-4d2f8bbd4e82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:00:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-68ca9d55-9364-4f40-86cd-d4ed79f9a748 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Releasing lock "refresh_cache-f3f7eeda-a001-4c35-abeb-e459d701bd93" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:00:01 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:00:01 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5865be57-b5f2-4132-bc71-cc41bfe9f897/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:01 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 15:00:01 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3efaa8e-7138-40be-a271-8a344eac3e48/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:01 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3efaa8e-7138-40be-a271-8a344eac3e48/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:01 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3efaa8e-7138-40be-a271-8a344eac3e48/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:01 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3efaa8e-7138-40be-a271-8a344eac3e48/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:01 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:01 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:01 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:01 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:00:01 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:01 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 15:00:01 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:00:01 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47104e57-c193-4a85-a2cf-677f0debe373/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47104e57-c193-4a85-a2cf-677f0debe373/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47104e57-c193-4a85-a2cf-677f0debe373/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:02 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:00:02 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:00:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47104e57-c193-4a85-a2cf-677f0debe373/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:02 user nova-compute[70924]: DEBUG nova.compute.manager [req-8cf9face-7cd0-458c-80b5-4c9127581832 req-d900c0d6-38b2-4cbb-8e4e-b060f8ea1bf8 service nova] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Received event network-vif-unplugged-eafccd28-f902-4bc2-805e-4d2f8bbd4e82 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:00:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-8cf9face-7cd0-458c-80b5-4c9127581832 req-d900c0d6-38b2-4cbb-8e4e-b060f8ea1bf8 service nova] Acquiring lock "f3f7eeda-a001-4c35-abeb-e459d701bd93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:00:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-8cf9face-7cd0-458c-80b5-4c9127581832 req-d900c0d6-38b2-4cbb-8e4e-b060f8ea1bf8 service nova] Lock "f3f7eeda-a001-4c35-abeb-e459d701bd93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:00:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-8cf9face-7cd0-458c-80b5-4c9127581832 req-d900c0d6-38b2-4cbb-8e4e-b060f8ea1bf8 service nova] Lock "f3f7eeda-a001-4c35-abeb-e459d701bd93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:00:02 user nova-compute[70924]: DEBUG nova.compute.manager [req-8cf9face-7cd0-458c-80b5-4c9127581832 req-d900c0d6-38b2-4cbb-8e4e-b060f8ea1bf8 service nova] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] No waiting events found dispatching network-vif-unplugged-eafccd28-f902-4bc2-805e-4d2f8bbd4e82 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:00:02 user nova-compute[70924]: WARNING nova.compute.manager [req-8cf9face-7cd0-458c-80b5-4c9127581832 req-d900c0d6-38b2-4cbb-8e4e-b060f8ea1bf8 service nova] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Received unexpected event network-vif-unplugged-eafccd28-f902-4bc2-805e-4d2f8bbd4e82 for instance with vm_state active and task_state rescuing.
Jul 29 15:00:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk.rescue --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Acquiring lock "1555ef29-8abe-43ca-ad2b-ac2f86180202" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:00:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "1555ef29-8abe-43ca-ad2b-ac2f86180202" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:00:02 user nova-compute[70924]: INFO nova.compute.manager [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Unshelving
Jul 29 15:00:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk.rescue --force-share --output=json" returned: 0 in 0.154s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk.rescue --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:02 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:00:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:00:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:00:02 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:00:02 user nova-compute[70924]: DEBUG nova.objects.instance [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lazy-loading 'pci_requests' on Instance uuid 1555ef29-8abe-43ca-ad2b-ac2f86180202 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:00:02 user nova-compute[70924]: DEBUG nova.objects.instance [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lazy-loading 'numa_topology' on Instance uuid 1555ef29-8abe-43ca-ad2b-ac2f86180202 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:00:02 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70924) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 15:00:02 user nova-compute[70924]: INFO nova.compute.claims [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Claim successful on node user
Jul 29 15:00:02 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Instance destroyed successfully.
Jul 29 15:00:02 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-68ca9d55-9364-4f40-86cd-d4ed79f9a748 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Attempting rescue
Jul 29 15:00:02 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-68ca9d55-9364-4f40-86cd-d4ed79f9a748 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=70924) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 29 15:00:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:02 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-68ca9d55-9364-4f40-86cd-d4ed79f9a748 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Instance directory exists: not creating {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 29 15:00:02 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-68ca9d55-9364-4f40-86cd-d4ed79f9a748 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Creating image(s)
Jul 29 15:00:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-68ca9d55-9364-4f40-86cd-d4ed79f9a748 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Acquiring lock "/opt/stack/data/nova/instances/f3f7eeda-a001-4c35-abeb-e459d701bd93/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:00:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-68ca9d55-9364-4f40-86cd-d4ed79f9a748 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "/opt/stack/data/nova/instances/f3f7eeda-a001-4c35-abeb-e459d701bd93/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:00:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-68ca9d55-9364-4f40-86cd-d4ed79f9a748 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "/opt/stack/data/nova/instances/f3f7eeda-a001-4c35-abeb-e459d701bd93/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:00:02 user nova-compute[70924]: DEBUG nova.objects.instance [None req-68ca9d55-9364-4f40-86cd-d4ed79f9a748 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lazy-loading 'trusted_certs' on Instance uuid f3f7eeda-a001-4c35-abeb-e459d701bd93 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:00:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-68ca9d55-9364-4f40-86cd-d4ed79f9a748 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Acquiring lock "bd72453517468710f1de26b27fb0ea28688e9009" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:00:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-68ca9d55-9364-4f40-86cd-d4ed79f9a748 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:00:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-68ca9d55-9364-4f40-86cd-d4ed79f9a748 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-68ca9d55-9364-4f40-86cd-d4ed79f9a748 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.152s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-68ca9d55-9364-4f40-86cd-d4ed79f9a748 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/f3f7eeda-a001-4c35-abeb-e459d701bd93/disk.rescue {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-68ca9d55-9364-4f40-86cd-d4ed79f9a748 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/f3f7eeda-a001-4c35-abeb-e459d701bd93/disk.rescue" returned: 0 in 0.062s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-68ca9d55-9364-4f40-86cd-d4ed79f9a748 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.219s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:00:02 user nova-compute[70924]: DEBUG nova.objects.instance [None req-68ca9d55-9364-4f40-86cd-d4ed79f9a748 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lazy-loading 'migration_context' on Instance uuid f3f7eeda-a001-4c35-abeb-e459d701bd93 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:00:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:02 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-68ca9d55-9364-4f40-86cd-d4ed79f9a748 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Created local disks {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 15:00:02 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-68ca9d55-9364-4f40-86cd-d4ed79f9a748 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Start _get_guest_xml network_info=[{"id": "eafccd28-f902-4bc2-805e-4d2f8bbd4e82", "address": "fa:16:3e:9f:ec:06", "network": {"id": "b2aee530-d195-47bb-b39d-c8bd15b81a08", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-421022738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-421022738-network", "vif_mac": "fa:16:3e:9f:ec:06"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcf4644e7a24bf68b407be2e3d9732c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeafccd28-f9", "ovs_interfaceid": "eafccd28-f902-4bc2-805e-4d2f8bbd4e82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '3aba2e73-6832-404b-8bd0-d0503ce82b8c', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 15:00:02 user nova-compute[70924]: DEBUG nova.objects.instance [None req-68ca9d55-9364-4f40-86cd-d4ed79f9a748 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lazy-loading 'resources' on Instance uuid f3f7eeda-a001-4c35-abeb-e459d701bd93 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:00:02 user nova-compute[70924]: DEBUG nova.objects.instance [None req-68ca9d55-9364-4f40-86cd-d4ed79f9a748 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lazy-loading 'numa_topology' on Instance uuid f3f7eeda-a001-4c35-abeb-e459d701bd93 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:00:03 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-68ca9d55-9364-4f40-86cd-d4ed79f9a748 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:00:03 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-68ca9d55-9364-4f40-86cd-d4ed79f9a748 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:00:03 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-68ca9d55-9364-4f40-86cd-d4ed79f9a748 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 15:00:03 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-68ca9d55-9364-4f40-86cd-d4ed79f9a748 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] CPU controller missing on host. {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 15:00:03 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-68ca9d55-9364-4f40-86cd-d4ed79f9a748 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 15:00:03 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-68ca9d55-9364-4f40-86cd-d4ed79f9a748 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] CPU controller found on host. {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 15:00:03 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-68ca9d55-9364-4f40-86cd-d4ed79f9a748 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70924) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 15:00:03 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-68ca9d55-9364-4f40-86cd-d4ed79f9a748 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T14:36:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 15:00:03 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-68ca9d55-9364-4f40-86cd-d4ed79f9a748 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Flavor limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 15:00:03 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-68ca9d55-9364-4f40-86cd-d4ed79f9a748 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Image limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 15:00:03 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-68ca9d55-9364-4f40-86cd-d4ed79f9a748 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Flavor pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 15:00:03 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-68ca9d55-9364-4f40-86cd-d4ed79f9a748 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Image pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 15:00:03 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-68ca9d55-9364-4f40-86cd-d4ed79f9a748 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 15:00:03 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-68ca9d55-9364-4f40-86cd-d4ed79f9a748 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 15:00:03 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-68ca9d55-9364-4f40-86cd-d4ed79f9a748 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 15:00:03 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-68ca9d55-9364-4f40-86cd-d4ed79f9a748 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Got 1 possible topologies {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 15:00:03 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-68ca9d55-9364-4f40-86cd-d4ed79f9a748 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 15:00:03 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-68ca9d55-9364-4f40-86cd-d4ed79f9a748 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 15:00:03 user nova-compute[70924]: DEBUG nova.objects.instance [None req-68ca9d55-9364-4f40-86cd-d4ed79f9a748 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lazy-loading 'vcpu_model' on Instance uuid f3f7eeda-a001-4c35-abeb-e459d701bd93 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:00:03 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-68ca9d55-9364-4f40-86cd-d4ed79f9a748 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:57:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-860009977',display_name='tempest-ServerRescueNegativeTestJSON-server-860009977',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-860009977',id=33,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYYUTKa/Li7BbPVzmg4ve1vgvH0FEhtwS0gOMqeRhUXC/Ag9zhCHxbsh4O9uwMJ9PeS5iqh/+F1q/DOCjXtppVcKojs97MuEkw+mKkCC6PAntsB1yiqhawyIRrJr7Iulg==',key_name='tempest-keypair-1342138702',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:58:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8fcf4644e7a24bf68b407be2e3d9732c',ramdisk_id='',reservation_id='r-mz1wzk08',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1436708078',owner_user_name='tempest-ServerRescueNegativeTestJSON-1436708078-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:58:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ec7e735cfff48828e0c0c7618f50711',uuid=f3f7eeda-a001-4c35-abeb-e459d701bd93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eafccd28-f902-4bc2-805e-4d2f8bbd4e82", "address": "fa:16:3e:9f:ec:06", "network": {"id": "b2aee530-d195-47bb-b39d-c8bd15b81a08", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-421022738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-421022738-network", "vif_mac": "fa:16:3e:9f:ec:06"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcf4644e7a24bf68b407be2e3d9732c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeafccd28-f9", "ovs_interfaceid": "eafccd28-f902-4bc2-805e-4d2f8bbd4e82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 15:00:03 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-68ca9d55-9364-4f40-86cd-d4ed79f9a748 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Converting VIF {"id": "eafccd28-f902-4bc2-805e-4d2f8bbd4e82", "address": "fa:16:3e:9f:ec:06", "network": {"id": "b2aee530-d195-47bb-b39d-c8bd15b81a08", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-421022738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-421022738-network", "vif_mac": "fa:16:3e:9f:ec:06"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcf4644e7a24bf68b407be2e3d9732c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeafccd28-f9", "ovs_interfaceid": "eafccd28-f902-4bc2-805e-4d2f8bbd4e82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 15:00:03 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-68ca9d55-9364-4f40-86cd-d4ed79f9a748 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9f:ec:06,bridge_name='br-int',has_traffic_filtering=True,id=eafccd28-f902-4bc2-805e-4d2f8bbd4e82,network=Network(b2aee530-d195-47bb-b39d-c8bd15b81a08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeafccd28-f9') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 15:00:03 user nova-compute[70924]: DEBUG nova.objects.instance [None req-68ca9d55-9364-4f40-86cd-d4ed79f9a748 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lazy-loading 'pci_devices' on Instance uuid f3f7eeda-a001-4c35-abeb-e459d701bd93 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:00:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:03 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-68ca9d55-9364-4f40-86cd-d4ed79f9a748 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] End _get_guest_xml xml=<domain type="kvm">
Jul 29 15:00:03 user nova-compute[70924]:   <uuid>f3f7eeda-a001-4c35-abeb-e459d701bd93</uuid>
Jul 29 15:00:03 user nova-compute[70924]:   <name>instance-00000021</name>
Jul 29 15:00:03 user nova-compute[70924]:   <memory>524288</memory>
Jul 29 15:00:03 user nova-compute[70924]:   <vcpu>1</vcpu>
Jul 29 15:00:03 user nova-compute[70924]:   <metadata>
Jul 29 15:00:03 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 15:00:03 user nova-compute[70924]:       <nova:package version="0.0.0"/>
Jul 29 15:00:03 user nova-compute[70924]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-860009977</nova:name>
Jul 29 15:00:03 user nova-compute[70924]:       <nova:creationTime>2023-07-29 15:00:03</nova:creationTime>
Jul 29 15:00:03 user nova-compute[70924]:       <nova:flavor name="m1.tiny">
Jul 29 15:00:03 user nova-compute[70924]:         <nova:memory>512</nova:memory>
Jul 29 15:00:03 user nova-compute[70924]:         <nova:disk>1</nova:disk>
Jul 29 15:00:03 user nova-compute[70924]:         <nova:swap>0</nova:swap>
Jul 29 15:00:03 user nova-compute[70924]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 15:00:03 user nova-compute[70924]:         <nova:vcpus>1</nova:vcpus>
Jul 29 15:00:03 user nova-compute[70924]:       </nova:flavor>
Jul 29 15:00:03 user nova-compute[70924]:       <nova:owner>
Jul 29 15:00:03 user nova-compute[70924]:         <nova:user uuid="8ec7e735cfff48828e0c0c7618f50711">tempest-ServerRescueNegativeTestJSON-1436708078-project-member</nova:user>
Jul 29 15:00:03 user nova-compute[70924]:         <nova:project uuid="8fcf4644e7a24bf68b407be2e3d9732c">tempest-ServerRescueNegativeTestJSON-1436708078</nova:project>
Jul 29 15:00:03 user nova-compute[70924]:       </nova:owner>
Jul 29 15:00:03 user nova-compute[70924]:       <nova:root type="image" uuid="3aba2e73-6832-404b-8bd0-d0503ce82b8c"/>
Jul 29 15:00:03 user nova-compute[70924]:       <nova:ports>
Jul 29 15:00:03 user nova-compute[70924]:         <nova:port uuid="eafccd28-f902-4bc2-805e-4d2f8bbd4e82">
Jul 29 15:00:03 user nova-compute[70924]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 29 15:00:03 user nova-compute[70924]:         </nova:port>
Jul 29 15:00:03 user nova-compute[70924]:       </nova:ports>
Jul 29 15:00:03 user nova-compute[70924]:     </nova:instance>
Jul 29 15:00:03 user nova-compute[70924]:   </metadata>
Jul 29 15:00:03 user nova-compute[70924]:   <sysinfo type="smbios">
Jul 29 15:00:03 user nova-compute[70924]:     <system>
Jul 29 15:00:03 user nova-compute[70924]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 15:00:03 user nova-compute[70924]:       <entry name="product">OpenStack Nova</entry>
Jul 29 15:00:03 user nova-compute[70924]:       <entry name="version">0.0.0</entry>
Jul 29 15:00:03 user nova-compute[70924]:       <entry name="serial">f3f7eeda-a001-4c35-abeb-e459d701bd93</entry>
Jul 29 15:00:03 user nova-compute[70924]:       <entry name="uuid">f3f7eeda-a001-4c35-abeb-e459d701bd93</entry>
Jul 29 15:00:03 user nova-compute[70924]:       <entry name="family">Virtual Machine</entry>
Jul 29 15:00:03 user nova-compute[70924]:     </system>
Jul 29 15:00:03 user nova-compute[70924]:   </sysinfo>
Jul 29 15:00:03 user nova-compute[70924]:   <os>
Jul 29 15:00:03 user nova-compute[70924]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 15:00:03 user nova-compute[70924]:     <smbios mode="sysinfo"/>
Jul 29 15:00:03 user nova-compute[70924]:   </os>
Jul 29 15:00:03 user nova-compute[70924]:   <features>
Jul 29 15:00:03 user nova-compute[70924]:     <acpi/>
Jul 29 15:00:03 user nova-compute[70924]:     <apic/>
Jul 29 15:00:03 user nova-compute[70924]:     <vmcoreinfo/>
Jul 29 15:00:03 user nova-compute[70924]:   </features>
Jul 29 15:00:03 user nova-compute[70924]:   <clock offset="utc">
Jul 29 15:00:03 user nova-compute[70924]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 15:00:03 user nova-compute[70924]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 15:00:03 user nova-compute[70924]:     <timer name="hpet" present="no"/>
Jul 29 15:00:03 user nova-compute[70924]:   </clock>
Jul 29 15:00:03 user nova-compute[70924]:   <cpu mode="custom" match="exact">
Jul 29 15:00:03 user nova-compute[70924]:     <model>Nehalem</model>
Jul 29 15:00:03 user nova-compute[70924]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 15:00:03 user nova-compute[70924]:   </cpu>
Jul 29 15:00:03 user nova-compute[70924]:   <devices>
Jul 29 15:00:03 user nova-compute[70924]:     <disk type="file" device="disk">
Jul 29 15:00:03 user nova-compute[70924]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 15:00:03 user nova-compute[70924]:       <source file="/opt/stack/data/nova/instances/f3f7eeda-a001-4c35-abeb-e459d701bd93/disk.rescue"/>
Jul 29 15:00:03 user nova-compute[70924]:       <target dev="vda" bus="virtio"/>
Jul 29 15:00:03 user nova-compute[70924]:     </disk>
Jul 29 15:00:03 user nova-compute[70924]:     <disk type="file" device="disk">
Jul 29 15:00:03 user nova-compute[70924]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 15:00:03 user nova-compute[70924]:       <source file="/opt/stack/data/nova/instances/f3f7eeda-a001-4c35-abeb-e459d701bd93/disk"/>
Jul 29 15:00:03 user nova-compute[70924]:       <target dev="vdb" bus="virtio"/>
Jul 29 15:00:03 user nova-compute[70924]:     </disk>
Jul 29 15:00:03 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 15:00:03 user nova-compute[70924]:       <mac address="fa:16:3e:9f:ec:06"/>
Jul 29 15:00:03 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 15:00:03 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 15:00:03 user nova-compute[70924]:       <target dev="tapeafccd28-f9"/>
Jul 29 15:00:03 user nova-compute[70924]:     </interface>
Jul 29 15:00:03 user nova-compute[70924]:     <serial type="pty">
Jul 29 15:00:03 user nova-compute[70924]:       <log file="/opt/stack/data/nova/instances/f3f7eeda-a001-4c35-abeb-e459d701bd93/console.log" append="off"/>
Jul 29 15:00:03 user nova-compute[70924]:     </serial>
Jul 29 15:00:03 user nova-compute[70924]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 15:00:03 user nova-compute[70924]:     <video>
Jul 29 15:00:03 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 15:00:03 user nova-compute[70924]:     </video>
Jul 29 15:00:03 user nova-compute[70924]:     <rng model="virtio">
Jul 29 15:00:03 user nova-compute[70924]:       <backend model="random">/dev/urandom</backend>
Jul 29 15:00:03 user nova-compute[70924]:     </rng>
Jul 29 15:00:03 user nova-compute[70924]:     <controller type="usb" index="0" model="none"/>
Jul 29 15:00:03 user nova-compute[70924]:     <memballoon model="virtio">
Jul 29 15:00:03 user nova-compute[70924]:       <stats period="10"/>
Jul 29 15:00:03 user nova-compute[70924]:     </memballoon>
Jul 29 15:00:03 user nova-compute[70924]:   </devices>
Jul 29 15:00:03 user nova-compute[70924]: </domain>
Jul 29 15:00:03 user nova-compute[70924]:  {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 15:00:03 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:00:03 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Instance destroyed successfully.
Jul 29 15:00:03 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:00:03 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.732s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:00:03 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-68ca9d55-9364-4f40-86cd-d4ed79f9a748 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 15:00:03 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-68ca9d55-9364-4f40-86cd-d4ed79f9a748 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 15:00:03 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-68ca9d55-9364-4f40-86cd-d4ed79f9a748 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] No VIF found with MAC fa:16:3e:9f:ec:06, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 15:00:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:03 user nova-compute[70924]: INFO nova.network.neutron [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Updating port f34f8730-445d-4711-8db4-3c6455cbd24e with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Jul 29 15:00:07 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:00:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Acquiring lock "refresh_cache-1555ef29-8abe-43ca-ad2b-ac2f86180202" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:00:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Acquired lock "refresh_cache-1555ef29-8abe-43ca-ad2b-ac2f86180202" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:00:07 user nova-compute[70924]: DEBUG nova.network.neutron [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 15:00:07 user nova-compute[70924]: DEBUG nova.compute.manager [req-7527b363-d99c-4df5-b1a9-683dcd6f0286 req-12ef8cd5-87ee-42e3-b5e4-f1e9aa2f2535 service nova] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Received event network-vif-plugged-eafccd28-f902-4bc2-805e-4d2f8bbd4e82 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:00:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-7527b363-d99c-4df5-b1a9-683dcd6f0286 req-12ef8cd5-87ee-42e3-b5e4-f1e9aa2f2535 service nova] Acquiring lock "f3f7eeda-a001-4c35-abeb-e459d701bd93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:00:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-7527b363-d99c-4df5-b1a9-683dcd6f0286 req-12ef8cd5-87ee-42e3-b5e4-f1e9aa2f2535 service nova] Lock "f3f7eeda-a001-4c35-abeb-e459d701bd93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:00:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-7527b363-d99c-4df5-b1a9-683dcd6f0286 req-12ef8cd5-87ee-42e3-b5e4-f1e9aa2f2535 service nova] Lock "f3f7eeda-a001-4c35-abeb-e459d701bd93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:00:07 user nova-compute[70924]: DEBUG nova.compute.manager [req-7527b363-d99c-4df5-b1a9-683dcd6f0286 req-12ef8cd5-87ee-42e3-b5e4-f1e9aa2f2535 service nova] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] No waiting events found dispatching network-vif-plugged-eafccd28-f902-4bc2-805e-4d2f8bbd4e82 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:00:07 user nova-compute[70924]: WARNING nova.compute.manager [req-7527b363-d99c-4df5-b1a9-683dcd6f0286 req-12ef8cd5-87ee-42e3-b5e4-f1e9aa2f2535 service nova] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Received unexpected event network-vif-plugged-eafccd28-f902-4bc2-805e-4d2f8bbd4e82 for instance with vm_state active and task_state rescuing.
Jul 29 15:00:07 user nova-compute[70924]: DEBUG nova.compute.manager [req-6388116d-b49a-4550-9112-3638e2ae1031 req-f914a04c-c07f-4f49-b234-59eea2cd01bd service nova] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Received event network-changed-f34f8730-445d-4711-8db4-3c6455cbd24e {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:00:07 user nova-compute[70924]: DEBUG nova.compute.manager [req-6388116d-b49a-4550-9112-3638e2ae1031 req-f914a04c-c07f-4f49-b234-59eea2cd01bd service nova] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Refreshing instance network info cache due to event network-changed-f34f8730-445d-4711-8db4-3c6455cbd24e. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 15:00:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-6388116d-b49a-4550-9112-3638e2ae1031 req-f914a04c-c07f-4f49-b234-59eea2cd01bd service nova] Acquiring lock "refresh_cache-1555ef29-8abe-43ca-ad2b-ac2f86180202" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:00:07 user nova-compute[70924]: DEBUG nova.compute.manager [req-57b94602-aaa1-43cb-9aed-133aa6e5f05d req-07798a4b-50e7-408f-b2de-f08f9501cd06 service nova] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Received event network-vif-plugged-eafccd28-f902-4bc2-805e-4d2f8bbd4e82 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:00:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-57b94602-aaa1-43cb-9aed-133aa6e5f05d req-07798a4b-50e7-408f-b2de-f08f9501cd06 service nova] Acquiring lock "f3f7eeda-a001-4c35-abeb-e459d701bd93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:00:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-57b94602-aaa1-43cb-9aed-133aa6e5f05d req-07798a4b-50e7-408f-b2de-f08f9501cd06 service nova] Lock "f3f7eeda-a001-4c35-abeb-e459d701bd93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:00:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-57b94602-aaa1-43cb-9aed-133aa6e5f05d req-07798a4b-50e7-408f-b2de-f08f9501cd06 service nova] Lock "f3f7eeda-a001-4c35-abeb-e459d701bd93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:00:07 user nova-compute[70924]: DEBUG nova.compute.manager [req-57b94602-aaa1-43cb-9aed-133aa6e5f05d req-07798a4b-50e7-408f-b2de-f08f9501cd06 service nova] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] No waiting events found dispatching network-vif-plugged-eafccd28-f902-4bc2-805e-4d2f8bbd4e82 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:00:07 user nova-compute[70924]: WARNING nova.compute.manager [req-57b94602-aaa1-43cb-9aed-133aa6e5f05d req-07798a4b-50e7-408f-b2de-f08f9501cd06 service nova] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Received unexpected event network-vif-plugged-eafccd28-f902-4bc2-805e-4d2f8bbd4e82 for instance with vm_state active and task_state rescuing.
Jul 29 15:00:07 user nova-compute[70924]: DEBUG nova.compute.manager [req-57b94602-aaa1-43cb-9aed-133aa6e5f05d req-07798a4b-50e7-408f-b2de-f08f9501cd06 service nova] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Received event network-vif-plugged-eafccd28-f902-4bc2-805e-4d2f8bbd4e82 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:00:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-57b94602-aaa1-43cb-9aed-133aa6e5f05d req-07798a4b-50e7-408f-b2de-f08f9501cd06 service nova] Acquiring lock "f3f7eeda-a001-4c35-abeb-e459d701bd93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:00:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-57b94602-aaa1-43cb-9aed-133aa6e5f05d req-07798a4b-50e7-408f-b2de-f08f9501cd06 service nova] Lock "f3f7eeda-a001-4c35-abeb-e459d701bd93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:00:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-57b94602-aaa1-43cb-9aed-133aa6e5f05d req-07798a4b-50e7-408f-b2de-f08f9501cd06 service nova] Lock "f3f7eeda-a001-4c35-abeb-e459d701bd93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:00:07 user nova-compute[70924]: DEBUG nova.compute.manager [req-57b94602-aaa1-43cb-9aed-133aa6e5f05d req-07798a4b-50e7-408f-b2de-f08f9501cd06 service nova] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] No waiting events found dispatching network-vif-plugged-eafccd28-f902-4bc2-805e-4d2f8bbd4e82 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:00:07 user nova-compute[70924]: WARNING nova.compute.manager [req-57b94602-aaa1-43cb-9aed-133aa6e5f05d req-07798a4b-50e7-408f-b2de-f08f9501cd06 service nova] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Received unexpected event network-vif-plugged-eafccd28-f902-4bc2-805e-4d2f8bbd4e82 for instance with vm_state active and task_state rescuing.
Jul 29 15:00:07 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Removed pending event for f3f7eeda-a001-4c35-abeb-e459d701bd93 due to event {{(pid=70924) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 29 15:00:07 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642806.943641, f3f7eeda-a001-4c35-abeb-e459d701bd93 => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 15:00:07 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] VM Resumed (Lifecycle Event)
Jul 29 15:00:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Acquiring lock "79063387-5fb9-4ce2-81c3-f9a094c0fd22" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:00:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Lock "79063387-5fb9-4ce2-81c3-f9a094c0fd22" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:00:07 user nova-compute[70924]: DEBUG nova.compute.manager [None req-68ca9d55-9364-4f40-86cd-d4ed79f9a748 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:00:07 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:00:07 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:00:07 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Hypervisor/Node resource view: name=user free_ram=7529MB free_disk=25.13524627685547GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70924) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 15:00:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:00:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:00:07 user nova-compute[70924]: DEBUG nova.compute.manager [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Starting instance... {{(pid=70924) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 15:00:07 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:00:07 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 15:00:07 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 29 15:00:07 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642806.9450912, f3f7eeda-a001-4c35-abeb-e459d701bd93 => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 15:00:07 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] VM Started (Lifecycle Event)
Jul 29 15:00:07 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:00:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:00:07 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 15:00:07 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance db656346-c4af-43da-9600-fd39f1b9e4dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:00:07 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 02c75b00-a1b4-4ef9-ae96-bc67d8038589 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:00:07 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 9ec07c62-951b-4e3a-bffa-e01dfb4665ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:00:07 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 091e384f-7851-4ac9-b566-990df0497fc5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:00:07 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance f3f7eeda-a001-4c35-abeb-e459d701bd93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:00:07 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 47104e57-c193-4a85-a2cf-677f0debe373 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:00:07 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance b3efaa8e-7138-40be-a271-8a344eac3e48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:00:07 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 5865be57-b5f2-4132-bc71-cc41bfe9f897 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:00:07 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 14f9924f-8d4d-4193-927b-02cfb0f5f57a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:00:07 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (e285c8ee-f39c-4daa-8d15-3de9c4f5f832): {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Jul 29 15:00:07 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 79063387-5fb9-4ce2-81c3-f9a094c0fd22 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Jul 29 15:00:07 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 15:00:07 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 15:00:07 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:00:07 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:00:07 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Compute_service record updated for user:user {{(pid=70924) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 15:00:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.504s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:00:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.392s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:00:07 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70924) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 15:00:07 user nova-compute[70924]: INFO nova.compute.claims [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Claim successful on node user
Jul 29 15:00:08 user nova-compute[70924]: DEBUG nova.network.neutron [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Updating instance_info_cache with network_info: [{"id": "f34f8730-445d-4711-8db4-3c6455cbd24e", "address": "fa:16:3e:c0:c2:af", "network": {"id": "ff833b6e-b3ce-44ac-88ec-775f193cdfe4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-546934977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f5f9f30926f47afad3cb4c9e89d55c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34f8730-44", "ovs_interfaceid": "f34f8730-445d-4711-8db4-3c6455cbd24e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:00:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Releasing lock "refresh_cache-1555ef29-8abe-43ca-ad2b-ac2f86180202" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:00:08 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Creating instance directory {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 15:00:08 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Creating image(s)
Jul 29 15:00:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Acquiring lock "/opt/stack/data/nova/instances/1555ef29-8abe-43ca-ad2b-ac2f86180202/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:00:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "/opt/stack/data/nova/instances/1555ef29-8abe-43ca-ad2b-ac2f86180202/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:00:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "/opt/stack/data/nova/instances/1555ef29-8abe-43ca-ad2b-ac2f86180202/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:00:08 user nova-compute[70924]: DEBUG nova.objects.instance [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1555ef29-8abe-43ca-ad2b-ac2f86180202 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:00:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-6388116d-b49a-4550-9112-3638e2ae1031 req-f914a04c-c07f-4f49-b234-59eea2cd01bd service nova] Acquired lock "refresh_cache-1555ef29-8abe-43ca-ad2b-ac2f86180202" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:00:08 user nova-compute[70924]: DEBUG nova.network.neutron [req-6388116d-b49a-4550-9112-3638e2ae1031 req-f914a04c-c07f-4f49-b234-59eea2cd01bd service nova] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Refreshing network info cache for port f34f8730-445d-4711-8db4-3c6455cbd24e {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 15:00:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Acquiring lock "79cee0a79aaddda984afe8d28281e9c556228c3f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:00:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "79cee0a79aaddda984afe8d28281e9c556228c3f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:00:08 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:00:08 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:00:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.457s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:00:08 user nova-compute[70924]: DEBUG nova.compute.manager [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Start building networks asynchronously for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 15:00:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79cee0a79aaddda984afe8d28281e9c556228c3f.part --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:00:09 user nova-compute[70924]: DEBUG nova.compute.manager [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Allocating IP information in the background. {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 15:00:09 user nova-compute[70924]: DEBUG nova.network.neutron [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] allocate_for_instance() {{(pid=70924) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 15:00:09 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 15:00:09 user nova-compute[70924]: DEBUG nova.compute.manager [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Start building block device mappings for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 15:00:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79cee0a79aaddda984afe8d28281e9c556228c3f.part --force-share --output=json" returned: 0 in 0.156s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:09 user nova-compute[70924]: DEBUG nova.virt.images [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] 49e8bfa8-816a-41e6-a55c-7160c41e5488 was qcow2, converting to raw {{(pid=70924) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 29 15:00:09 user nova-compute[70924]: DEBUG nova.privsep.utils [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70924) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 29 15:00:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/79cee0a79aaddda984afe8d28281e9c556228c3f.part /opt/stack/data/nova/instances/_base/79cee0a79aaddda984afe8d28281e9c556228c3f.converted {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:09 user nova-compute[70924]: DEBUG nova.policy [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '698114cda101425195dae0e5b9445c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6a612c609a43ba81cb1636c323b0d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70924) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 15:00:09 user nova-compute[70924]: DEBUG nova.compute.manager [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Start spawning the instance on the hypervisor. {{(pid=70924) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 15:00:09 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Creating instance directory {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 15:00:09 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Creating image(s)
Jul 29 15:00:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Acquiring lock "/opt/stack/data/nova/instances/79063387-5fb9-4ce2-81c3-f9a094c0fd22/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:00:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Lock "/opt/stack/data/nova/instances/79063387-5fb9-4ce2-81c3-f9a094c0fd22/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:00:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Lock "/opt/stack/data/nova/instances/79063387-5fb9-4ce2-81c3-f9a094c0fd22/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:00:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.140s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Acquiring lock "bd72453517468710f1de26b27fb0ea28688e9009" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:00:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:00:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/79cee0a79aaddda984afe8d28281e9c556228c3f.part /opt/stack/data/nova/instances/_base/79cee0a79aaddda984afe8d28281e9c556228c3f.converted" returned: 0 in 0.386s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79cee0a79aaddda984afe8d28281e9c556228c3f.converted --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.146s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/79063387-5fb9-4ce2-81c3-f9a094c0fd22/disk 1073741824 {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:09 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:00:09 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Starting heal instance info cache {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 15:00:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/79063387-5fb9-4ce2-81c3-f9a094c0fd22/disk 1073741824" returned: 0 in 0.067s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:00:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:09 user nova-compute[70924]: DEBUG nova.network.neutron [req-6388116d-b49a-4550-9112-3638e2ae1031 req-f914a04c-c07f-4f49-b234-59eea2cd01bd service nova] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Updated VIF entry in instance network info cache for port f34f8730-445d-4711-8db4-3c6455cbd24e. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 15:00:09 user nova-compute[70924]: DEBUG nova.network.neutron [req-6388116d-b49a-4550-9112-3638e2ae1031 req-f914a04c-c07f-4f49-b234-59eea2cd01bd service nova] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Updating instance_info_cache with network_info: [{"id": "f34f8730-445d-4711-8db4-3c6455cbd24e", "address": "fa:16:3e:c0:c2:af", "network": {"id": "ff833b6e-b3ce-44ac-88ec-775f193cdfe4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-546934977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f5f9f30926f47afad3cb4c9e89d55c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34f8730-44", "ovs_interfaceid": "f34f8730-445d-4711-8db4-3c6455cbd24e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:00:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79cee0a79aaddda984afe8d28281e9c556228c3f.converted --force-share --output=json" returned: 0 in 0.216s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-6388116d-b49a-4550-9112-3638e2ae1031 req-f914a04c-c07f-4f49-b234-59eea2cd01bd service nova] Releasing lock "refresh_cache-1555ef29-8abe-43ca-ad2b-ac2f86180202" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:00:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "79cee0a79aaddda984afe8d28281e9c556228c3f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.709s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:00:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79cee0a79aaddda984afe8d28281e9c556228c3f --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.145s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:09 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Checking if we can resize image /opt/stack/data/nova/instances/79063387-5fb9-4ce2-81c3-f9a094c0fd22/disk. size=1073741824 {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 15:00:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79063387-5fb9-4ce2-81c3-f9a094c0fd22/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "refresh_cache-091e384f-7851-4ac9-b566-990df0497fc5" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:00:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquired lock "refresh_cache-091e384f-7851-4ac9-b566-990df0497fc5" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:00:09 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Forcefully refreshing network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 29 15:00:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79cee0a79aaddda984afe8d28281e9c556228c3f --force-share --output=json" returned: 0 in 0.140s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Acquiring lock "79cee0a79aaddda984afe8d28281e9c556228c3f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:00:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "79cee0a79aaddda984afe8d28281e9c556228c3f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:00:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79cee0a79aaddda984afe8d28281e9c556228c3f --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79063387-5fb9-4ce2-81c3-f9a094c0fd22/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:10 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Cannot resize image /opt/stack/data/nova/instances/79063387-5fb9-4ce2-81c3-f9a094c0fd22/disk to a smaller size. {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 15:00:10 user nova-compute[70924]: DEBUG nova.objects.instance [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Lazy-loading 'migration_context' on Instance uuid 79063387-5fb9-4ce2-81c3-f9a094c0fd22 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:00:10 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Created local disks {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 15:00:10 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Ensure instance console log exists: /opt/stack/data/nova/instances/79063387-5fb9-4ce2-81c3-f9a094c0fd22/console.log {{(pid=70924) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 15:00:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:00:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:00:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:00:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79cee0a79aaddda984afe8d28281e9c556228c3f --force-share --output=json" returned: 0 in 0.165s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/79cee0a79aaddda984afe8d28281e9c556228c3f,backing_fmt=raw /opt/stack/data/nova/instances/1555ef29-8abe-43ca-ad2b-ac2f86180202/disk 1073741824 {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/79cee0a79aaddda984afe8d28281e9c556228c3f,backing_fmt=raw /opt/stack/data/nova/instances/1555ef29-8abe-43ca-ad2b-ac2f86180202/disk 1073741824" returned: 0 in 0.374s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "79cee0a79aaddda984afe8d28281e9c556228c3f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.544s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:00:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79cee0a79aaddda984afe8d28281e9c556228c3f --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:10 user nova-compute[70924]: DEBUG nova.network.neutron [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Successfully created port: 0166d121-c15e-4189-a56c-d252e9e3de80 {{(pid=70924) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 15:00:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79cee0a79aaddda984afe8d28281e9c556228c3f --force-share --output=json" returned: 0 in 0.147s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:10 user nova-compute[70924]: DEBUG nova.objects.instance [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lazy-loading 'migration_context' on Instance uuid 1555ef29-8abe-43ca-ad2b-ac2f86180202 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:00:10 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Rebasing disk image.
Jul 29 15:00:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.141s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 -F raw /opt/stack/data/nova/instances/1555ef29-8abe-43ca-ad2b-ac2f86180202/disk {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:11 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Updating instance_info_cache with network_info: [{"id": "1da26b57-ec30-415a-8a43-fe0e662667e1", "address": "fa:16:3e:7c:7f:15", "network": {"id": "b2aee530-d195-47bb-b39d-c8bd15b81a08", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-421022738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcf4644e7a24bf68b407be2e3d9732c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1da26b57-ec", "ovs_interfaceid": "1da26b57-ec30-415a-8a43-fe0e662667e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:00:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Releasing lock "refresh_cache-091e384f-7851-4ac9-b566-990df0497fc5" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:00:11 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Updated the network info_cache for instance {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 29 15:00:11 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:00:11 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:00:11 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:00:11 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70924) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 15:00:11 user nova-compute[70924]: DEBUG nova.network.neutron [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Successfully updated port: 0166d121-c15e-4189-a56c-d252e9e3de80 {{(pid=70924) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 15:00:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Acquiring lock "refresh_cache-79063387-5fb9-4ce2-81c3-f9a094c0fd22" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:00:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Acquired lock "refresh_cache-79063387-5fb9-4ce2-81c3-f9a094c0fd22" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:00:11 user nova-compute[70924]: DEBUG nova.network.neutron [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 15:00:11 user nova-compute[70924]: DEBUG nova.compute.manager [req-691a80e8-1621-4a6e-b085-c394763d960b req-d62083fa-bb77-4726-878b-d6cd9c36bc7a service nova] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Received event network-changed-0166d121-c15e-4189-a56c-d252e9e3de80 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:00:11 user nova-compute[70924]: DEBUG nova.compute.manager [req-691a80e8-1621-4a6e-b085-c394763d960b req-d62083fa-bb77-4726-878b-d6cd9c36bc7a service nova] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Refreshing instance network info cache due to event network-changed-0166d121-c15e-4189-a56c-d252e9e3de80. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 15:00:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-691a80e8-1621-4a6e-b085-c394763d960b req-d62083fa-bb77-4726-878b-d6cd9c36bc7a service nova] Acquiring lock "refresh_cache-79063387-5fb9-4ce2-81c3-f9a094c0fd22" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:00:11 user nova-compute[70924]: DEBUG nova.network.neutron [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Instance cache missing network info. {{(pid=70924) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 15:00:12 user nova-compute[70924]: DEBUG nova.network.neutron [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Updating instance_info_cache with network_info: [{"id": "0166d121-c15e-4189-a56c-d252e9e3de80", "address": "fa:16:3e:5e:ce:a8", "network": {"id": "a901bee5-6b26-45c7-8f4a-69ffb0b46b73", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1220595772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b6a612c609a43ba81cb1636c323b0d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0166d121-c1", "ovs_interfaceid": "0166d121-c15e-4189-a56c-d252e9e3de80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:00:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Releasing lock "refresh_cache-79063387-5fb9-4ce2-81c3-f9a094c0fd22" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:00:12 user nova-compute[70924]: DEBUG nova.compute.manager [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Instance network_info: |[{"id": "0166d121-c15e-4189-a56c-d252e9e3de80", "address": "fa:16:3e:5e:ce:a8", "network": {"id": "a901bee5-6b26-45c7-8f4a-69ffb0b46b73", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1220595772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b6a612c609a43ba81cb1636c323b0d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0166d121-c1", "ovs_interfaceid": "0166d121-c15e-4189-a56c-d252e9e3de80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 15:00:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-691a80e8-1621-4a6e-b085-c394763d960b req-d62083fa-bb77-4726-878b-d6cd9c36bc7a service nova] Acquired lock "refresh_cache-79063387-5fb9-4ce2-81c3-f9a094c0fd22" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:00:12 user nova-compute[70924]: DEBUG nova.network.neutron [req-691a80e8-1621-4a6e-b085-c394763d960b req-d62083fa-bb77-4726-878b-d6cd9c36bc7a service nova] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Refreshing network info cache for port 0166d121-c15e-4189-a56c-d252e9e3de80 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 15:00:12 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Start _get_guest_xml network_info=[{"id": "0166d121-c15e-4189-a56c-d252e9e3de80", "address": "fa:16:3e:5e:ce:a8", "network": {"id": "a901bee5-6b26-45c7-8f4a-69ffb0b46b73", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1220595772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b6a612c609a43ba81cb1636c323b0d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0166d121-c1", "ovs_interfaceid": "0166d121-c15e-4189-a56c-d252e9e3de80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '3aba2e73-6832-404b-8bd0-d0503ce82b8c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 15:00:12 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:00:12 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:00:12 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 15:00:12 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] CPU controller missing on host. {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 15:00:12 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:00:12 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 15:00:12 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] CPU controller found on host. {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 15:00:12 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70924) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 15:00:12 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T14:36:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 15:00:12 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Flavor limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 15:00:12 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Image limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 15:00:12 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Flavor pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 15:00:12 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Image pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 15:00:12 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 15:00:12 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 15:00:12 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 15:00:12 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Got 1 possible topologies {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 15:00:12 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 15:00:12 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 15:00:12 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T15:00:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1634106950',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1634106950',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1634106',id=38,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQormZKeP+C/l2PclvQj9tkdDdTNQ3qcBDksLlDKhZM4wmtbwYYkRoO6FUrYoFKsTk7g7auFc6hu0KvtISW8cnrZ8AzJn2aw4m356dNYYx+cdqBBMT+YVuL83hmybO+1Q==',key_name='tempest-keypair-166337349',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b6a612c609a43ba81cb1636c323b0d4',ramdisk_id='',reservation_id='r-6gpkrrsa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1572725490',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T15:00:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='698114cda101425195dae0e5b9445c09',uuid=79063387-5fb9-4ce2-81c3-f9a094c0fd22,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0166d121-c15e-4189-a56c-d252e9e3de80", "address": "fa:16:3e:5e:ce:a8", "network": {"id": "a901bee5-6b26-45c7-8f4a-69ffb0b46b73", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1220595772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b6a612c609a43ba81cb1636c323b0d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0166d121-c1", "ovs_interfaceid": "0166d121-c15e-4189-a56c-d252e9e3de80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 15:00:12 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Converting VIF {"id": "0166d121-c15e-4189-a56c-d252e9e3de80", "address": "fa:16:3e:5e:ce:a8", "network": {"id": "a901bee5-6b26-45c7-8f4a-69ffb0b46b73", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1220595772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b6a612c609a43ba81cb1636c323b0d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0166d121-c1", "ovs_interfaceid": "0166d121-c15e-4189-a56c-d252e9e3de80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 15:00:12 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:ce:a8,bridge_name='br-int',has_traffic_filtering=True,id=0166d121-c15e-4189-a56c-d252e9e3de80,network=Network(a901bee5-6b26-45c7-8f4a-69ffb0b46b73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0166d121-c1') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 15:00:12 user nova-compute[70924]: DEBUG nova.objects.instance [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Lazy-loading 'pci_devices' on Instance uuid 79063387-5fb9-4ce2-81c3-f9a094c0fd22 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:00:12 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] End _get_guest_xml xml=<domain type="kvm">
Jul 29 15:00:12 user nova-compute[70924]:   <uuid>79063387-5fb9-4ce2-81c3-f9a094c0fd22</uuid>
Jul 29 15:00:12 user nova-compute[70924]:   <name>instance-00000026</name>
Jul 29 15:00:12 user nova-compute[70924]:   <memory>524288</memory>
Jul 29 15:00:12 user nova-compute[70924]:   <vcpu>1</vcpu>
Jul 29 15:00:12 user nova-compute[70924]:   <metadata>
Jul 29 15:00:12 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 15:00:12 user nova-compute[70924]:       <nova:package version="0.0.0"/>
Jul 29 15:00:12 user nova-compute[70924]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1634106950</nova:name>
Jul 29 15:00:12 user nova-compute[70924]:       <nova:creationTime>2023-07-29 15:00:12</nova:creationTime>
Jul 29 15:00:12 user nova-compute[70924]:       <nova:flavor name="m1.tiny">
Jul 29 15:00:12 user nova-compute[70924]:         <nova:memory>512</nova:memory>
Jul 29 15:00:12 user nova-compute[70924]:         <nova:disk>1</nova:disk>
Jul 29 15:00:12 user nova-compute[70924]:         <nova:swap>0</nova:swap>
Jul 29 15:00:12 user nova-compute[70924]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 15:00:12 user nova-compute[70924]:         <nova:vcpus>1</nova:vcpus>
Jul 29 15:00:12 user nova-compute[70924]:       </nova:flavor>
Jul 29 15:00:12 user nova-compute[70924]:       <nova:owner>
Jul 29 15:00:12 user nova-compute[70924]:         <nova:user uuid="698114cda101425195dae0e5b9445c09">tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member</nova:user>
Jul 29 15:00:12 user nova-compute[70924]:         <nova:project uuid="4b6a612c609a43ba81cb1636c323b0d4">tempest-TestServerVolumeAttachScenarioOldVersion-1572725490</nova:project>
Jul 29 15:00:12 user nova-compute[70924]:       </nova:owner>
Jul 29 15:00:12 user nova-compute[70924]:       <nova:root type="image" uuid="3aba2e73-6832-404b-8bd0-d0503ce82b8c"/>
Jul 29 15:00:12 user nova-compute[70924]:       <nova:ports>
Jul 29 15:00:12 user nova-compute[70924]:         <nova:port uuid="0166d121-c15e-4189-a56c-d252e9e3de80">
Jul 29 15:00:12 user nova-compute[70924]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 29 15:00:12 user nova-compute[70924]:         </nova:port>
Jul 29 15:00:12 user nova-compute[70924]:       </nova:ports>
Jul 29 15:00:12 user nova-compute[70924]:     </nova:instance>
Jul 29 15:00:12 user nova-compute[70924]:   </metadata>
Jul 29 15:00:12 user nova-compute[70924]:   <sysinfo type="smbios">
Jul 29 15:00:12 user nova-compute[70924]:     <system>
Jul 29 15:00:12 user nova-compute[70924]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 15:00:12 user nova-compute[70924]:       <entry name="product">OpenStack Nova</entry>
Jul 29 15:00:12 user nova-compute[70924]:       <entry name="version">0.0.0</entry>
Jul 29 15:00:12 user nova-compute[70924]:       <entry name="serial">79063387-5fb9-4ce2-81c3-f9a094c0fd22</entry>
Jul 29 15:00:12 user nova-compute[70924]:       <entry name="uuid">79063387-5fb9-4ce2-81c3-f9a094c0fd22</entry>
Jul 29 15:00:12 user nova-compute[70924]:       <entry name="family">Virtual Machine</entry>
Jul 29 15:00:12 user nova-compute[70924]:     </system>
Jul 29 15:00:12 user nova-compute[70924]:   </sysinfo>
Jul 29 15:00:12 user nova-compute[70924]:   <os>
Jul 29 15:00:12 user nova-compute[70924]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 15:00:12 user nova-compute[70924]:     <boot dev="hd"/>
Jul 29 15:00:12 user nova-compute[70924]:     <smbios mode="sysinfo"/>
Jul 29 15:00:12 user nova-compute[70924]:   </os>
Jul 29 15:00:12 user nova-compute[70924]:   <features>
Jul 29 15:00:12 user nova-compute[70924]:     <acpi/>
Jul 29 15:00:12 user nova-compute[70924]:     <apic/>
Jul 29 15:00:12 user nova-compute[70924]:     <vmcoreinfo/>
Jul 29 15:00:12 user nova-compute[70924]:   </features>
Jul 29 15:00:12 user nova-compute[70924]:   <clock offset="utc">
Jul 29 15:00:12 user nova-compute[70924]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 15:00:12 user nova-compute[70924]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 15:00:12 user nova-compute[70924]:     <timer name="hpet" present="no"/>
Jul 29 15:00:12 user nova-compute[70924]:   </clock>
Jul 29 15:00:12 user nova-compute[70924]:   <cpu mode="custom" match="exact">
Jul 29 15:00:12 user nova-compute[70924]:     <model>Nehalem</model>
Jul 29 15:00:12 user nova-compute[70924]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 15:00:12 user nova-compute[70924]:   </cpu>
Jul 29 15:00:12 user nova-compute[70924]:   <devices>
Jul 29 15:00:12 user nova-compute[70924]:     <disk type="file" device="disk">
Jul 29 15:00:12 user nova-compute[70924]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 15:00:12 user nova-compute[70924]:       <source file="/opt/stack/data/nova/instances/79063387-5fb9-4ce2-81c3-f9a094c0fd22/disk"/>
Jul 29 15:00:12 user nova-compute[70924]:       <target dev="vda" bus="virtio"/>
Jul 29 15:00:12 user nova-compute[70924]:     </disk>
Jul 29 15:00:12 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 15:00:12 user nova-compute[70924]:       <mac address="fa:16:3e:5e:ce:a8"/>
Jul 29 15:00:12 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 15:00:12 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 15:00:12 user nova-compute[70924]:       <target dev="tap0166d121-c1"/>
Jul 29 15:00:12 user nova-compute[70924]:     </interface>
Jul 29 15:00:12 user nova-compute[70924]:     <serial type="pty">
Jul 29 15:00:12 user nova-compute[70924]:       <log file="/opt/stack/data/nova/instances/79063387-5fb9-4ce2-81c3-f9a094c0fd22/console.log" append="off"/>
Jul 29 15:00:12 user nova-compute[70924]:     </serial>
Jul 29 15:00:12 user nova-compute[70924]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 15:00:12 user nova-compute[70924]:     <video>
Jul 29 15:00:12 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 15:00:12 user nova-compute[70924]:     </video>
Jul 29 15:00:12 user nova-compute[70924]:     <rng model="virtio">
Jul 29 15:00:12 user nova-compute[70924]:       <backend model="random">/dev/urandom</backend>
Jul 29 15:00:12 user nova-compute[70924]:     </rng>
Jul 29 15:00:12 user nova-compute[70924]:     <controller type="usb" index="0" model="none"/>
Jul 29 15:00:12 user nova-compute[70924]:     <memballoon model="virtio">
Jul 29 15:00:12 user nova-compute[70924]:       <stats period="10"/>
Jul 29 15:00:12 user nova-compute[70924]:     </memballoon>
Jul 29 15:00:12 user nova-compute[70924]:   </devices>
Jul 29 15:00:12 user nova-compute[70924]: </domain>
Jul 29 15:00:12 user nova-compute[70924]:  {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 15:00:12 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T15:00:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1634106950',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1634106950',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1634106',id=38,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQormZKeP+C/l2PclvQj9tkdDdTNQ3qcBDksLlDKhZM4wmtbwYYkRoO6FUrYoFKsTk7g7auFc6hu0KvtISW8cnrZ8AzJn2aw4m356dNYYx+cdqBBMT+YVuL83hmybO+1Q==',key_name='tempest-keypair-166337349',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b6a612c609a43ba81cb1636c323b0d4',ramdisk_id='',reservation_id='r-6gpkrrsa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1572725490',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T15:00:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='698114cda101425195dae0e5b9445c09',uuid=79063387-5fb9-4ce2-81c3-f9a094c0fd22,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0166d121-c15e-4189-a56c-d252e9e3de80", "address": "fa:16:3e:5e:ce:a8", "network": {"id": "a901bee5-6b26-45c7-8f4a-69ffb0b46b73", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1220595772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b6a612c609a43ba81cb1636c323b0d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0166d121-c1", "ovs_interfaceid": "0166d121-c15e-4189-a56c-d252e9e3de80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 15:00:12 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Converting VIF {"id": "0166d121-c15e-4189-a56c-d252e9e3de80", "address": "fa:16:3e:5e:ce:a8", "network": {"id": "a901bee5-6b26-45c7-8f4a-69ffb0b46b73", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1220595772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b6a612c609a43ba81cb1636c323b0d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0166d121-c1", "ovs_interfaceid": "0166d121-c15e-4189-a56c-d252e9e3de80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 15:00:12 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:ce:a8,bridge_name='br-int',has_traffic_filtering=True,id=0166d121-c15e-4189-a56c-d252e9e3de80,network=Network(a901bee5-6b26-45c7-8f4a-69ffb0b46b73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0166d121-c1') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 15:00:12 user nova-compute[70924]: DEBUG os_vif [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:ce:a8,bridge_name='br-int',has_traffic_filtering=True,id=0166d121-c15e-4189-a56c-d252e9e3de80,network=Network(a901bee5-6b26-45c7-8f4a-69ffb0b46b73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0166d121-c1') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 15:00:12 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:00:12 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:00:12 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 15:00:12 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:00:12 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0166d121-c1, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:00:12 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0166d121-c1, col_values=(('external_ids', {'iface-id': '0166d121-c15e-4189-a56c-d252e9e3de80', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:ce:a8', 'vm-uuid': '79063387-5fb9-4ce2-81c3-f9a094c0fd22'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:00:12 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:00:12 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:00:12 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:00:12 user nova-compute[70924]: INFO os_vif [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:ce:a8,bridge_name='br-int',has_traffic_filtering=True,id=0166d121-c15e-4189-a56c-d252e9e3de80,network=Network(a901bee5-6b26-45c7-8f4a-69ffb0b46b73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0166d121-c1')
Jul 29 15:00:12 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 15:00:12 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] No VIF found with MAC fa:16:3e:5e:ce:a8, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 15:00:12 user nova-compute[70924]: DEBUG nova.network.neutron [req-691a80e8-1621-4a6e-b085-c394763d960b req-d62083fa-bb77-4726-878b-d6cd9c36bc7a service nova] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Updated VIF entry in instance network info cache for port 0166d121-c15e-4189-a56c-d252e9e3de80. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 15:00:12 user nova-compute[70924]: DEBUG nova.network.neutron [req-691a80e8-1621-4a6e-b085-c394763d960b req-d62083fa-bb77-4726-878b-d6cd9c36bc7a service nova] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Updating instance_info_cache with network_info: [{"id": "0166d121-c15e-4189-a56c-d252e9e3de80", "address": "fa:16:3e:5e:ce:a8", "network": {"id": "a901bee5-6b26-45c7-8f4a-69ffb0b46b73", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1220595772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b6a612c609a43ba81cb1636c323b0d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0166d121-c1", "ovs_interfaceid": "0166d121-c15e-4189-a56c-d252e9e3de80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:00:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-691a80e8-1621-4a6e-b085-c394763d960b req-d62083fa-bb77-4726-878b-d6cd9c36bc7a service nova] Releasing lock "refresh_cache-79063387-5fb9-4ce2-81c3-f9a094c0fd22" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:00:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 -F raw /opt/stack/data/nova/instances/1555ef29-8abe-43ca-ad2b-ac2f86180202/disk" returned: 0 in 2.132s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:13 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Created local disks {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 15:00:13 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Ensure instance console log exists: /opt/stack/data/nova/instances/1555ef29-8abe-43ca-ad2b-ac2f86180202/console.log {{(pid=70924) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 15:00:13 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:00:13 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:00:13 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:00:13 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Start _get_guest_xml network_info=[{"id": "f34f8730-445d-4711-8db4-3c6455cbd24e", "address": "fa:16:3e:c0:c2:af", "network": {"id": "ff833b6e-b3ce-44ac-88ec-775f193cdfe4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-546934977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f5f9f30926f47afad3cb4c9e89d55c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34f8730-44", "ovs_interfaceid": "f34f8730-445d-4711-8db4-3c6455cbd24e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='1394a2acb30f1ba67338a66d5d67b897',container_format='bare',created_at=2023-07-29T14:58:09Z,direct_url=<?>,disk_format='qcow2',id=49e8bfa8-816a-41e6-a55c-7160c41e5488,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-294782032-shelved',owner='6f5f9f30926f47afad3cb4c9e89d55c5',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-07-29T14:58:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '3aba2e73-6832-404b-8bd0-d0503ce82b8c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 15:00:13 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:00:13 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:00:13 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 15:00:13 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] CPU controller missing on host. {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 15:00:13 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 15:00:13 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] CPU controller found on host. {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 15:00:13 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70924) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 15:00:13 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T14:36:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='1394a2acb30f1ba67338a66d5d67b897',container_format='bare',created_at=2023-07-29T14:58:09Z,direct_url=<?>,disk_format='qcow2',id=49e8bfa8-816a-41e6-a55c-7160c41e5488,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-294782032-shelved',owner='6f5f9f30926f47afad3cb4c9e89d55c5',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-07-29T14:58:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 15:00:13 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Flavor limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 15:00:13 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Image limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 15:00:13 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Flavor pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 15:00:13 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Image pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 15:00:13 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 15:00:13 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 15:00:13 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 15:00:13 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Got 1 possible topologies {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 15:00:13 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 15:00:13 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 15:00:13 user nova-compute[70924]: DEBUG nova.objects.instance [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1555ef29-8abe-43ca-ad2b-ac2f86180202 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:00:13 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-29T14:56:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-294782032',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-294782032',id=32,image_ref='49e8bfa8-816a-41e6-a55c-7160c41e5488',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-391897607',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:56:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='6f5f9f30926f47afad3cb4c9e89d55c5',ramdisk_id='',reservation_id='r-daxoh0gf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-130200384',owner_user_name='tempest-AttachVolumeShelveTestJSON-130200384-project-member',shelved_at='2023-07-29T14:58:13.277848',shelved_host='user',shelved_image_id='49e8bfa8-816a-41e6-a55c-7160c41e5488'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T15:00:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c9562451ffa45b2aad975335d83fa8c',uuid=1555ef29-8abe-43ca-ad2b-ac2f86180202,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "f34f8730-445d-4711-8db4-3c6455cbd24e", "address": "fa:16:3e:c0:c2:af", "network": {"id": "ff833b6e-b3ce-44ac-88ec-775f193cdfe4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-546934977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f5f9f30926f47afad3cb4c9e89d55c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34f8730-44", "ovs_interfaceid": "f34f8730-445d-4711-8db4-3c6455cbd24e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 15:00:13 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Converting VIF {"id": "f34f8730-445d-4711-8db4-3c6455cbd24e", "address": "fa:16:3e:c0:c2:af", "network": {"id": "ff833b6e-b3ce-44ac-88ec-775f193cdfe4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-546934977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f5f9f30926f47afad3cb4c9e89d55c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34f8730-44", "ovs_interfaceid": "f34f8730-445d-4711-8db4-3c6455cbd24e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 15:00:13 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:c2:af,bridge_name='br-int',has_traffic_filtering=True,id=f34f8730-445d-4711-8db4-3c6455cbd24e,network=Network(ff833b6e-b3ce-44ac-88ec-775f193cdfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf34f8730-44') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 15:00:13 user nova-compute[70924]: DEBUG nova.objects.instance [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lazy-loading 'pci_devices' on Instance uuid 1555ef29-8abe-43ca-ad2b-ac2f86180202 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:00:13 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] End _get_guest_xml xml=<domain type="kvm">
Jul 29 15:00:13 user nova-compute[70924]:   <uuid>1555ef29-8abe-43ca-ad2b-ac2f86180202</uuid>
Jul 29 15:00:13 user nova-compute[70924]:   <name>instance-00000020</name>
Jul 29 15:00:13 user nova-compute[70924]:   <memory>524288</memory>
Jul 29 15:00:13 user nova-compute[70924]:   <vcpu>1</vcpu>
Jul 29 15:00:13 user nova-compute[70924]:   <metadata>
Jul 29 15:00:13 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 15:00:13 user nova-compute[70924]:       <nova:package version="0.0.0"/>
Jul 29 15:00:13 user nova-compute[70924]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-294782032</nova:name>
Jul 29 15:00:13 user nova-compute[70924]:       <nova:creationTime>2023-07-29 15:00:13</nova:creationTime>
Jul 29 15:00:13 user nova-compute[70924]:       <nova:flavor name="m1.tiny">
Jul 29 15:00:13 user nova-compute[70924]:         <nova:memory>512</nova:memory>
Jul 29 15:00:13 user nova-compute[70924]:         <nova:disk>1</nova:disk>
Jul 29 15:00:13 user nova-compute[70924]:         <nova:swap>0</nova:swap>
Jul 29 15:00:13 user nova-compute[70924]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 15:00:13 user nova-compute[70924]:         <nova:vcpus>1</nova:vcpus>
Jul 29 15:00:13 user nova-compute[70924]:       </nova:flavor>
Jul 29 15:00:13 user nova-compute[70924]:       <nova:owner>
Jul 29 15:00:13 user nova-compute[70924]:         <nova:user uuid="7c9562451ffa45b2aad975335d83fa8c">tempest-AttachVolumeShelveTestJSON-130200384-project-member</nova:user>
Jul 29 15:00:13 user nova-compute[70924]:         <nova:project uuid="6f5f9f30926f47afad3cb4c9e89d55c5">tempest-AttachVolumeShelveTestJSON-130200384</nova:project>
Jul 29 15:00:13 user nova-compute[70924]:       </nova:owner>
Jul 29 15:00:13 user nova-compute[70924]:       <nova:root type="image" uuid="49e8bfa8-816a-41e6-a55c-7160c41e5488"/>
Jul 29 15:00:13 user nova-compute[70924]:       <nova:ports>
Jul 29 15:00:13 user nova-compute[70924]:         <nova:port uuid="f34f8730-445d-4711-8db4-3c6455cbd24e">
Jul 29 15:00:13 user nova-compute[70924]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 29 15:00:13 user nova-compute[70924]:         </nova:port>
Jul 29 15:00:13 user nova-compute[70924]:       </nova:ports>
Jul 29 15:00:13 user nova-compute[70924]:     </nova:instance>
Jul 29 15:00:13 user nova-compute[70924]:   </metadata>
Jul 29 15:00:13 user nova-compute[70924]:   <sysinfo type="smbios">
Jul 29 15:00:13 user nova-compute[70924]:     <system>
Jul 29 15:00:13 user nova-compute[70924]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 15:00:13 user nova-compute[70924]:       <entry name="product">OpenStack Nova</entry>
Jul 29 15:00:13 user nova-compute[70924]:       <entry name="version">0.0.0</entry>
Jul 29 15:00:13 user nova-compute[70924]:       <entry name="serial">1555ef29-8abe-43ca-ad2b-ac2f86180202</entry>
Jul 29 15:00:13 user nova-compute[70924]:       <entry name="uuid">1555ef29-8abe-43ca-ad2b-ac2f86180202</entry>
Jul 29 15:00:13 user nova-compute[70924]:       <entry name="family">Virtual Machine</entry>
Jul 29 15:00:13 user nova-compute[70924]:     </system>
Jul 29 15:00:13 user nova-compute[70924]:   </sysinfo>
Jul 29 15:00:13 user nova-compute[70924]:   <os>
Jul 29 15:00:13 user nova-compute[70924]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 15:00:13 user nova-compute[70924]:     <boot dev="hd"/>
Jul 29 15:00:13 user nova-compute[70924]:     <smbios mode="sysinfo"/>
Jul 29 15:00:13 user nova-compute[70924]:   </os>
Jul 29 15:00:13 user nova-compute[70924]:   <features>
Jul 29 15:00:13 user nova-compute[70924]:     <acpi/>
Jul 29 15:00:13 user nova-compute[70924]:     <apic/>
Jul 29 15:00:13 user nova-compute[70924]:     <vmcoreinfo/>
Jul 29 15:00:13 user nova-compute[70924]:   </features>
Jul 29 15:00:13 user nova-compute[70924]:   <clock offset="utc">
Jul 29 15:00:13 user nova-compute[70924]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 15:00:13 user nova-compute[70924]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 15:00:13 user nova-compute[70924]:     <timer name="hpet" present="no"/>
Jul 29 15:00:13 user nova-compute[70924]:   </clock>
Jul 29 15:00:13 user nova-compute[70924]:   <cpu mode="custom" match="exact">
Jul 29 15:00:13 user nova-compute[70924]:     <model>Nehalem</model>
Jul 29 15:00:13 user nova-compute[70924]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 15:00:13 user nova-compute[70924]:   </cpu>
Jul 29 15:00:13 user nova-compute[70924]:   <devices>
Jul 29 15:00:13 user nova-compute[70924]:     <disk type="file" device="disk">
Jul 29 15:00:13 user nova-compute[70924]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 15:00:13 user nova-compute[70924]:       <source file="/opt/stack/data/nova/instances/1555ef29-8abe-43ca-ad2b-ac2f86180202/disk"/>
Jul 29 15:00:13 user nova-compute[70924]:       <target dev="vda" bus="virtio"/>
Jul 29 15:00:13 user nova-compute[70924]:     </disk>
Jul 29 15:00:13 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 15:00:13 user nova-compute[70924]:       <mac address="fa:16:3e:c0:c2:af"/>
Jul 29 15:00:13 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 15:00:13 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 15:00:13 user nova-compute[70924]:       <target dev="tapf34f8730-44"/>
Jul 29 15:00:13 user nova-compute[70924]:     </interface>
Jul 29 15:00:13 user nova-compute[70924]:     <serial type="pty">
Jul 29 15:00:13 user nova-compute[70924]:       <log file="/opt/stack/data/nova/instances/1555ef29-8abe-43ca-ad2b-ac2f86180202/console.log" append="off"/>
Jul 29 15:00:13 user nova-compute[70924]:     </serial>
Jul 29 15:00:13 user nova-compute[70924]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 15:00:13 user nova-compute[70924]:     <video>
Jul 29 15:00:13 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 15:00:13 user nova-compute[70924]:     </video>
Jul 29 15:00:13 user nova-compute[70924]:     <rng model="virtio">
Jul 29 15:00:13 user nova-compute[70924]:       <backend model="random">/dev/urandom</backend>
Jul 29 15:00:13 user nova-compute[70924]:     </rng>
Jul 29 15:00:13 user nova-compute[70924]:     <controller type="usb" index="0" model="none"/>
Jul 29 15:00:13 user nova-compute[70924]:     <memballoon model="virtio">
Jul 29 15:00:13 user nova-compute[70924]:       <stats period="10"/>
Jul 29 15:00:13 user nova-compute[70924]:     </memballoon>
Jul 29 15:00:13 user nova-compute[70924]:   </devices>
Jul 29 15:00:13 user nova-compute[70924]: </domain>
Jul 29 15:00:13 user nova-compute[70924]:  {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 15:00:13 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-29T14:56:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-294782032',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-294782032',id=32,image_ref='49e8bfa8-816a-41e6-a55c-7160c41e5488',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-391897607',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:56:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='6f5f9f30926f47afad3cb4c9e89d55c5',ramdisk_id='',reservation_id='r-daxoh0gf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-130200384',owner_user_name='tempest-AttachVolumeShelveTestJSON-130200384-project-member',shelved_at='2023-07-29T14:58:13.277848',shelved_host='user',shelved_image_id='49e8bfa8-816a-41e6-a55c-7160c41e5488'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T15:00:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c9562451ffa45b2aad975335d83fa8c',uuid=1555ef29-8abe-43ca-ad2b-ac2f86180202,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "f34f8730-445d-4711-8db4-3c6455cbd24e", "address": "fa:16:3e:c0:c2:af", "network": {"id": "ff833b6e-b3ce-44ac-88ec-775f193cdfe4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-546934977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f5f9f30926f47afad3cb4c9e89d55c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34f8730-44", "ovs_interfaceid": "f34f8730-445d-4711-8db4-3c6455cbd24e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 15:00:13 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Converting VIF {"id": "f34f8730-445d-4711-8db4-3c6455cbd24e", "address": "fa:16:3e:c0:c2:af", "network": {"id": "ff833b6e-b3ce-44ac-88ec-775f193cdfe4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-546934977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f5f9f30926f47afad3cb4c9e89d55c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34f8730-44", "ovs_interfaceid": "f34f8730-445d-4711-8db4-3c6455cbd24e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 15:00:13 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:c2:af,bridge_name='br-int',has_traffic_filtering=True,id=f34f8730-445d-4711-8db4-3c6455cbd24e,network=Network(ff833b6e-b3ce-44ac-88ec-775f193cdfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf34f8730-44') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 15:00:13 user nova-compute[70924]: DEBUG os_vif [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:c2:af,bridge_name='br-int',has_traffic_filtering=True,id=f34f8730-445d-4711-8db4-3c6455cbd24e,network=Network(ff833b6e-b3ce-44ac-88ec-775f193cdfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf34f8730-44') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 15:00:13 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:00:13 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:00:13 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 15:00:13 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:00:13 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf34f8730-44, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:00:13 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf34f8730-44, col_values=(('external_ids', {'iface-id': 'f34f8730-445d-4711-8db4-3c6455cbd24e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:c2:af', 'vm-uuid': '1555ef29-8abe-43ca-ad2b-ac2f86180202'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:00:13 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:00:13 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:00:13 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:00:13 user nova-compute[70924]: INFO os_vif [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:c2:af,bridge_name='br-int',has_traffic_filtering=True,id=f34f8730-445d-4711-8db4-3c6455cbd24e,network=Network(ff833b6e-b3ce-44ac-88ec-775f193cdfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf34f8730-44')
Jul 29 15:00:13 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 15:00:13 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] No VIF found with MAC fa:16:3e:c0:c2:af, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 15:00:14 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:00:14 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:00:14 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:00:14 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:00:14 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:00:14 user nova-compute[70924]: DEBUG nova.compute.manager [req-eb265c99-d926-4b53-97b3-4b542a40ea40 req-8c209573-b988-42d2-b1f3-0ebfd7eb9c5c service nova] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Received event network-vif-plugged-0166d121-c15e-4189-a56c-d252e9e3de80 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:00:14 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-eb265c99-d926-4b53-97b3-4b542a40ea40 req-8c209573-b988-42d2-b1f3-0ebfd7eb9c5c service nova] Acquiring lock "79063387-5fb9-4ce2-81c3-f9a094c0fd22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:00:14 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-eb265c99-d926-4b53-97b3-4b542a40ea40 req-8c209573-b988-42d2-b1f3-0ebfd7eb9c5c service nova] Lock "79063387-5fb9-4ce2-81c3-f9a094c0fd22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:00:14 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-eb265c99-d926-4b53-97b3-4b542a40ea40 req-8c209573-b988-42d2-b1f3-0ebfd7eb9c5c service nova] Lock "79063387-5fb9-4ce2-81c3-f9a094c0fd22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:00:14 user nova-compute[70924]: DEBUG nova.compute.manager [req-eb265c99-d926-4b53-97b3-4b542a40ea40 req-8c209573-b988-42d2-b1f3-0ebfd7eb9c5c service nova] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] No waiting events found dispatching network-vif-plugged-0166d121-c15e-4189-a56c-d252e9e3de80 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:00:14 user nova-compute[70924]: WARNING nova.compute.manager [req-eb265c99-d926-4b53-97b3-4b542a40ea40 req-8c209573-b988-42d2-b1f3-0ebfd7eb9c5c service nova] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Received unexpected event network-vif-plugged-0166d121-c15e-4189-a56c-d252e9e3de80 for instance with vm_state building and task_state spawning.
Jul 29 15:00:14 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:00:14 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:00:15 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:00:15 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:00:15 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:00:15 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:00:15 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:00:15 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:00:15 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:00:16 user nova-compute[70924]: DEBUG nova.compute.manager [req-b6463e90-21e3-45f7-af9c-ef310bbe787b req-46604dde-836a-4a11-8807-bf81affe7892 service nova] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Received event network-vif-plugged-0166d121-c15e-4189-a56c-d252e9e3de80 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:00:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b6463e90-21e3-45f7-af9c-ef310bbe787b req-46604dde-836a-4a11-8807-bf81affe7892 service nova] Acquiring lock "79063387-5fb9-4ce2-81c3-f9a094c0fd22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:00:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b6463e90-21e3-45f7-af9c-ef310bbe787b req-46604dde-836a-4a11-8807-bf81affe7892 service nova] Lock "79063387-5fb9-4ce2-81c3-f9a094c0fd22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:00:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b6463e90-21e3-45f7-af9c-ef310bbe787b req-46604dde-836a-4a11-8807-bf81affe7892 service nova] Lock "79063387-5fb9-4ce2-81c3-f9a094c0fd22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:00:16 user nova-compute[70924]: DEBUG nova.compute.manager [req-b6463e90-21e3-45f7-af9c-ef310bbe787b req-46604dde-836a-4a11-8807-bf81affe7892 service nova] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] No waiting events found dispatching network-vif-plugged-0166d121-c15e-4189-a56c-d252e9e3de80 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:00:16 user nova-compute[70924]: WARNING nova.compute.manager [req-b6463e90-21e3-45f7-af9c-ef310bbe787b req-46604dde-836a-4a11-8807-bf81affe7892 service nova] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Received unexpected event network-vif-plugged-0166d121-c15e-4189-a56c-d252e9e3de80 for instance with vm_state building and task_state spawning.
Jul 29 15:00:16 user nova-compute[70924]: DEBUG nova.compute.manager [req-b6463e90-21e3-45f7-af9c-ef310bbe787b req-46604dde-836a-4a11-8807-bf81affe7892 service nova] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Received event network-vif-plugged-f34f8730-445d-4711-8db4-3c6455cbd24e {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:00:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b6463e90-21e3-45f7-af9c-ef310bbe787b req-46604dde-836a-4a11-8807-bf81affe7892 service nova] Acquiring lock "1555ef29-8abe-43ca-ad2b-ac2f86180202-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:00:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b6463e90-21e3-45f7-af9c-ef310bbe787b req-46604dde-836a-4a11-8807-bf81affe7892 service nova] Lock "1555ef29-8abe-43ca-ad2b-ac2f86180202-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:00:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b6463e90-21e3-45f7-af9c-ef310bbe787b req-46604dde-836a-4a11-8807-bf81affe7892 service nova] Lock "1555ef29-8abe-43ca-ad2b-ac2f86180202-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:00:16 user nova-compute[70924]: DEBUG nova.compute.manager [req-b6463e90-21e3-45f7-af9c-ef310bbe787b req-46604dde-836a-4a11-8807-bf81affe7892 service nova] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] No waiting events found dispatching network-vif-plugged-f34f8730-445d-4711-8db4-3c6455cbd24e {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:00:16 user nova-compute[70924]: WARNING nova.compute.manager [req-b6463e90-21e3-45f7-af9c-ef310bbe787b req-46604dde-836a-4a11-8807-bf81affe7892 service nova] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Received unexpected event network-vif-plugged-f34f8730-445d-4711-8db4-3c6455cbd24e for instance with vm_state shelved_offloaded and task_state spawning.
Jul 29 15:00:16 user nova-compute[70924]: DEBUG nova.compute.manager [req-b6463e90-21e3-45f7-af9c-ef310bbe787b req-46604dde-836a-4a11-8807-bf81affe7892 service nova] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Received event network-vif-plugged-f34f8730-445d-4711-8db4-3c6455cbd24e {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:00:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b6463e90-21e3-45f7-af9c-ef310bbe787b req-46604dde-836a-4a11-8807-bf81affe7892 service nova] Acquiring lock "1555ef29-8abe-43ca-ad2b-ac2f86180202-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:00:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b6463e90-21e3-45f7-af9c-ef310bbe787b req-46604dde-836a-4a11-8807-bf81affe7892 service nova] Lock "1555ef29-8abe-43ca-ad2b-ac2f86180202-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:00:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b6463e90-21e3-45f7-af9c-ef310bbe787b req-46604dde-836a-4a11-8807-bf81affe7892 service nova] Lock "1555ef29-8abe-43ca-ad2b-ac2f86180202-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:00:16 user nova-compute[70924]: DEBUG nova.compute.manager [req-b6463e90-21e3-45f7-af9c-ef310bbe787b req-46604dde-836a-4a11-8807-bf81affe7892 service nova] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] No waiting events found dispatching network-vif-plugged-f34f8730-445d-4711-8db4-3c6455cbd24e {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:00:16 user nova-compute[70924]: WARNING nova.compute.manager [req-b6463e90-21e3-45f7-af9c-ef310bbe787b req-46604dde-836a-4a11-8807-bf81affe7892 service nova] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Received unexpected event network-vif-plugged-f34f8730-445d-4711-8db4-3c6455cbd24e for instance with vm_state shelved_offloaded and task_state spawning.
Jul 29 15:00:17 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642817.724878, 79063387-5fb9-4ce2-81c3-f9a094c0fd22 => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 15:00:17 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] VM Resumed (Lifecycle Event)
Jul 29 15:00:17 user nova-compute[70924]: DEBUG nova.compute.manager [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Instance event wait completed in 0 seconds for  {{(pid=70924) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 15:00:17 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Guest created on hypervisor {{(pid=70924) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 15:00:17 user nova-compute[70924]: DEBUG nova.compute.manager [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Instance event wait completed in 0 seconds for  {{(pid=70924) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 15:00:17 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Guest created on hypervisor {{(pid=70924) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 15:00:17 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:00:17 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Instance spawned successfully.
Jul 29 15:00:17 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 15:00:17 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Instance spawned successfully.
Jul 29 15:00:17 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 15:00:17 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Found default for hw_cdrom_bus of ide {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:00:17 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Found default for hw_disk_bus of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:00:17 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Found default for hw_input_bus of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:00:17 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Found default for hw_pointer_model of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:00:17 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Found default for hw_video_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:00:17 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Found default for hw_vif_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:00:17 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 15:00:17 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642817.7284899, 79063387-5fb9-4ce2-81c3-f9a094c0fd22 => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 15:00:17 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] VM Started (Lifecycle Event)
Jul 29 15:00:17 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:00:17 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 15:00:17 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 15:00:17 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642817.7347798, 1555ef29-8abe-43ca-ad2b-ac2f86180202 => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 15:00:17 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] VM Resumed (Lifecycle Event)
Jul 29 15:00:17 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:00:17 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 15:00:17 user nova-compute[70924]: INFO nova.compute.manager [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Took 8.50 seconds to spawn the instance on the hypervisor.
Jul 29 15:00:17 user nova-compute[70924]: DEBUG nova.compute.manager [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:00:17 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 15:00:17 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642817.7385895, 1555ef29-8abe-43ca-ad2b-ac2f86180202 => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 15:00:17 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] VM Started (Lifecycle Event)
Jul 29 15:00:17 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:00:17 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 15:00:17 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 15:00:18 user nova-compute[70924]: DEBUG nova.compute.manager [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:00:18 user nova-compute[70924]: INFO nova.compute.manager [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Took 10.69 seconds to build instance.
Jul 29 15:00:18 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ee641210-b9d5-4441-9a74-67b4bfc60ffa tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Lock "79063387-5fb9-4ce2-81c3-f9a094c0fd22" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.800s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:00:18 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a7aac7c1-634f-4f3d-8690-4973735df7ca tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "1555ef29-8abe-43ca-ad2b-ac2f86180202" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 15.723s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:00:18 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:00:19 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:00:23 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:00:24 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:00:26 user nova-compute[70924]: DEBUG nova.compute.manager [req-b21fda29-ccd4-4a97-aa60-d720e536d595 req-b576598d-d3da-4997-a60a-a9a276b6c0b1 service nova] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] Received event network-changed-5703ca74-726a-4421-bdda-11432cacd536 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:00:26 user nova-compute[70924]: DEBUG nova.compute.manager [req-b21fda29-ccd4-4a97-aa60-d720e536d595 req-b576598d-d3da-4997-a60a-a9a276b6c0b1 service nova] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] Refreshing instance network info cache due to event network-changed-5703ca74-726a-4421-bdda-11432cacd536. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 15:00:26 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b21fda29-ccd4-4a97-aa60-d720e536d595 req-b576598d-d3da-4997-a60a-a9a276b6c0b1 service nova] Acquiring lock "refresh_cache-47104e57-c193-4a85-a2cf-677f0debe373" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:00:26 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b21fda29-ccd4-4a97-aa60-d720e536d595 req-b576598d-d3da-4997-a60a-a9a276b6c0b1 service nova] Acquired lock "refresh_cache-47104e57-c193-4a85-a2cf-677f0debe373" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:00:26 user nova-compute[70924]: DEBUG nova.network.neutron [req-b21fda29-ccd4-4a97-aa60-d720e536d595 req-b576598d-d3da-4997-a60a-a9a276b6c0b1 service nova] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] Refreshing network info cache for port 5703ca74-726a-4421-bdda-11432cacd536 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 15:00:26 user nova-compute[70924]: DEBUG nova.network.neutron [req-b21fda29-ccd4-4a97-aa60-d720e536d595 req-b576598d-d3da-4997-a60a-a9a276b6c0b1 service nova] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] Updated VIF entry in instance network info cache for port 5703ca74-726a-4421-bdda-11432cacd536. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 15:00:26 user nova-compute[70924]: DEBUG nova.network.neutron [req-b21fda29-ccd4-4a97-aa60-d720e536d595 req-b576598d-d3da-4997-a60a-a9a276b6c0b1 service nova] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] Updating instance_info_cache with network_info: [{"id": "5703ca74-726a-4421-bdda-11432cacd536", "address": "fa:16:3e:62:6c:e1", "network": {"id": "f80826fa-fada-45b9-b969-fd539fd34fd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-465377443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9aadc9385b3b46eebc6e0d81814521af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5703ca74-72", "ovs_interfaceid": "5703ca74-726a-4421-bdda-11432cacd536", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:00:26 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b21fda29-ccd4-4a97-aa60-d720e536d595 req-b576598d-d3da-4997-a60a-a9a276b6c0b1 service nova] Releasing lock "refresh_cache-47104e57-c193-4a85-a2cf-677f0debe373" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:00:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:00:29 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:00:29 user nova-compute[70924]: DEBUG nova.compute.manager [req-a17b4d04-9e72-4610-b6ab-0b184531bcf1 req-9372ce23-6e39-4977-a099-22de53e89ce4 service nova] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Received event network-changed-359ef5f3-1689-4a34-b213-a837a6d5668b {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:00:29 user nova-compute[70924]: DEBUG nova.compute.manager [req-a17b4d04-9e72-4610-b6ab-0b184531bcf1 req-9372ce23-6e39-4977-a099-22de53e89ce4 service nova] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Refreshing instance network info cache due to event network-changed-359ef5f3-1689-4a34-b213-a837a6d5668b. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 15:00:29 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a17b4d04-9e72-4610-b6ab-0b184531bcf1 req-9372ce23-6e39-4977-a099-22de53e89ce4 service nova] Acquiring lock "refresh_cache-b3efaa8e-7138-40be-a271-8a344eac3e48" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:00:29 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a17b4d04-9e72-4610-b6ab-0b184531bcf1 req-9372ce23-6e39-4977-a099-22de53e89ce4 service nova] Acquired lock "refresh_cache-b3efaa8e-7138-40be-a271-8a344eac3e48" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:00:29 user nova-compute[70924]: DEBUG nova.network.neutron [req-a17b4d04-9e72-4610-b6ab-0b184531bcf1 req-9372ce23-6e39-4977-a099-22de53e89ce4 service nova] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Refreshing network info cache for port 359ef5f3-1689-4a34-b213-a837a6d5668b {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 15:00:29 user nova-compute[70924]: DEBUG nova.network.neutron [req-a17b4d04-9e72-4610-b6ab-0b184531bcf1 req-9372ce23-6e39-4977-a099-22de53e89ce4 service nova] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Updated VIF entry in instance network info cache for port 359ef5f3-1689-4a34-b213-a837a6d5668b. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 15:00:29 user nova-compute[70924]: DEBUG nova.network.neutron [req-a17b4d04-9e72-4610-b6ab-0b184531bcf1 req-9372ce23-6e39-4977-a099-22de53e89ce4 service nova] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Updating instance_info_cache with network_info: [{"id": "359ef5f3-1689-4a34-b213-a837a6d5668b", "address": "fa:16:3e:9c:88:44", "network": {"id": "46d2cfde-13db-4cf3-af0e-4d6742f37044", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1642265305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0388bcf487e492082e85b183f38765c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap359ef5f3-16", "ovs_interfaceid": "359ef5f3-1689-4a34-b213-a837a6d5668b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:00:29 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a17b4d04-9e72-4610-b6ab-0b184531bcf1 req-9372ce23-6e39-4977-a099-22de53e89ce4 service nova] Releasing lock "refresh_cache-b3efaa8e-7138-40be-a271-8a344eac3e48" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:00:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-16456aa2-34f4-4874-86fa-03cbfbba8466 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Acquiring lock "47104e57-c193-4a85-a2cf-677f0debe373" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:00:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-16456aa2-34f4-4874-86fa-03cbfbba8466 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "47104e57-c193-4a85-a2cf-677f0debe373" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:00:30 user nova-compute[70924]: DEBUG nova.objects.instance [None req-16456aa2-34f4-4874-86fa-03cbfbba8466 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lazy-loading 'flavor' on Instance uuid 47104e57-c193-4a85-a2cf-677f0debe373 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:00:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-16456aa2-34f4-4874-86fa-03cbfbba8466 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "47104e57-c193-4a85-a2cf-677f0debe373" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.086s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:00:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-16456aa2-34f4-4874-86fa-03cbfbba8466 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Acquiring lock "47104e57-c193-4a85-a2cf-677f0debe373" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:00:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-16456aa2-34f4-4874-86fa-03cbfbba8466 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "47104e57-c193-4a85-a2cf-677f0debe373" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:00:30 user nova-compute[70924]: INFO nova.compute.manager [None req-16456aa2-34f4-4874-86fa-03cbfbba8466 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] Attaching volume 19aec498-852a-41ef-b0eb-8b9f3dc2318f to /dev/vdb
Jul 29 15:00:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-f10ebaba-d609-4b32-93a3-24bfaaa8787b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Acquiring lock "02c75b00-a1b4-4ef9-ae96-bc67d8038589" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:00:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-f10ebaba-d609-4b32-93a3-24bfaaa8787b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "02c75b00-a1b4-4ef9-ae96-bc67d8038589" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:00:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-f10ebaba-d609-4b32-93a3-24bfaaa8787b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Acquiring lock "02c75b00-a1b4-4ef9-ae96-bc67d8038589-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:00:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-f10ebaba-d609-4b32-93a3-24bfaaa8787b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "02c75b00-a1b4-4ef9-ae96-bc67d8038589-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:00:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-f10ebaba-d609-4b32-93a3-24bfaaa8787b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "02c75b00-a1b4-4ef9-ae96-bc67d8038589-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:00:30 user nova-compute[70924]: INFO nova.compute.manager [None req-f10ebaba-d609-4b32-93a3-24bfaaa8787b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Terminating instance
Jul 29 15:00:30 user nova-compute[70924]: DEBUG nova.compute.manager [None req-f10ebaba-d609-4b32-93a3-24bfaaa8787b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Start destroying the instance on the hypervisor. {{(pid=70924) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 15:00:30 user nova-compute[70924]: DEBUG os_brick.utils [None req-16456aa2-34f4-4874-86fa-03cbfbba8466 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 15:00:30 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:30 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:30 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[868ecd05-2a69-413f-ae69-4bfc1e654d96]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f2127c4a30d9\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:00:30 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:00:30 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:30 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[43799752-04e8-4c44-9e70-24c6e5519044]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:00:30 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:00:30 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.028s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:30 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[02816ebe-6468-4b53-81ae-cc14bd1fde4a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:00:30 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2ba737-1d0c-4fee-9254-eaf73c5a08e1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:00:30 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-16456aa2-34f4-4874-86fa-03cbfbba8466 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Running cmd (subprocess): nvme version {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:30 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-16456aa2-34f4-4874-86fa-03cbfbba8466 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] 'nvme version' failed. Not Retrying. {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 15:00:30 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.nvmeof [None req-16456aa2-34f4-4874-86fa-03cbfbba8466 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] nvme not present on system {{(pid=70924) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 15:00:30 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:30 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 15:00:30 user nova-compute[70924]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 15:00:30 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae47474-80d0-459d-a48a-7a8ce8b88ad9]: (4, '') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:00:30 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-16456aa2-34f4-4874-86fa-03cbfbba8466 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70924) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 15:00:30 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-16456aa2-34f4-4874-86fa-03cbfbba8466 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 15:00:30 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-16456aa2-34f4-4874-86fa-03cbfbba8466 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] LIGHTOS: no hostnqn found. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 15:00:30 user nova-compute[70924]: DEBUG os_brick.utils [None req-16456aa2-34f4-4874-86fa-03cbfbba8466 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] <== get_connector_properties: return (194ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f2127c4a30d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 15:00:30 user nova-compute[70924]: DEBUG nova.virt.block_device [None req-16456aa2-34f4-4874-86fa-03cbfbba8466 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] Updating existing volume attachment record: 5758453f-88a7-43ce-8942-a140d255fac2 {{(pid=70924) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 15:00:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:00:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:00:31 user nova-compute[70924]: DEBUG nova.compute.manager [req-8589fa76-84d3-494f-9fac-886110868b18 req-ededeb91-19c4-4213-bdd6-8e276e729cb4 service nova] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Received event network-vif-unplugged-25798da4-8f4d-4db1-afd2-7fb85693bc16 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:00:31 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-8589fa76-84d3-494f-9fac-886110868b18 req-ededeb91-19c4-4213-bdd6-8e276e729cb4 service nova] Acquiring lock "02c75b00-a1b4-4ef9-ae96-bc67d8038589-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:00:31 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-8589fa76-84d3-494f-9fac-886110868b18 req-ededeb91-19c4-4213-bdd6-8e276e729cb4 service nova] Lock "02c75b00-a1b4-4ef9-ae96-bc67d8038589-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:00:31 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-8589fa76-84d3-494f-9fac-886110868b18 req-ededeb91-19c4-4213-bdd6-8e276e729cb4 service nova] Lock "02c75b00-a1b4-4ef9-ae96-bc67d8038589-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:00:31 user nova-compute[70924]: DEBUG nova.compute.manager [req-8589fa76-84d3-494f-9fac-886110868b18 req-ededeb91-19c4-4213-bdd6-8e276e729cb4 service nova] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] No waiting events found dispatching network-vif-unplugged-25798da4-8f4d-4db1-afd2-7fb85693bc16 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:00:31 user nova-compute[70924]: DEBUG nova.compute.manager [req-8589fa76-84d3-494f-9fac-886110868b18 req-ededeb91-19c4-4213-bdd6-8e276e729cb4 service nova] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Received event network-vif-unplugged-25798da4-8f4d-4db1-afd2-7fb85693bc16 for instance with task_state deleting. {{(pid=70924) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 15:00:31 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Instance destroyed successfully.
Jul 29 15:00:31 user nova-compute[70924]: DEBUG nova.objects.instance [None req-f10ebaba-d609-4b32-93a3-24bfaaa8787b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lazy-loading 'resources' on Instance uuid 02c75b00-a1b4-4ef9-ae96-bc67d8038589 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:00:31 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-f10ebaba-d609-4b32-93a3-24bfaaa8787b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:43:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-796517517',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-796517517',id=13,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:45:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5a9e5c78c1684c359cfab4e32b9c213f',ramdisk_id='',reservation_id='r-zsivy5aj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2089253815',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:47:40Z,user_data=None,user_id='43582a8a85c54b5e9d16d11b12bf50d4',uuid=02c75b00-a1b4-4ef9-ae96-bc67d8038589,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "25798da4-8f4d-4db1-afd2-7fb85693bc16", "address": "fa:16:3e:59:2c:bb", "network": {"id": "d5876e18-e2af-45c2-aab5-2d0d552ebfe4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2035085552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9e5c78c1684c359cfab4e32b9c213f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25798da4-8f", "ovs_interfaceid": "25798da4-8f4d-4db1-afd2-7fb85693bc16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 15:00:31 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-f10ebaba-d609-4b32-93a3-24bfaaa8787b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Converting VIF {"id": "25798da4-8f4d-4db1-afd2-7fb85693bc16", "address": "fa:16:3e:59:2c:bb", "network": {"id": "d5876e18-e2af-45c2-aab5-2d0d552ebfe4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2035085552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9e5c78c1684c359cfab4e32b9c213f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25798da4-8f", "ovs_interfaceid": "25798da4-8f4d-4db1-afd2-7fb85693bc16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 15:00:31 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-f10ebaba-d609-4b32-93a3-24bfaaa8787b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:2c:bb,bridge_name='br-int',has_traffic_filtering=True,id=25798da4-8f4d-4db1-afd2-7fb85693bc16,network=Network(d5876e18-e2af-45c2-aab5-2d0d552ebfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25798da4-8f') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 15:00:31 user nova-compute[70924]: DEBUG os_vif [None req-f10ebaba-d609-4b32-93a3-24bfaaa8787b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:2c:bb,bridge_name='br-int',has_traffic_filtering=True,id=25798da4-8f4d-4db1-afd2-7fb85693bc16,network=Network(d5876e18-e2af-45c2-aab5-2d0d552ebfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25798da4-8f') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 15:00:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:00:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap25798da4-8f, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:00:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:00:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:00:31 user nova-compute[70924]: INFO os_vif [None req-f10ebaba-d609-4b32-93a3-24bfaaa8787b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:2c:bb,bridge_name='br-int',has_traffic_filtering=True,id=25798da4-8f4d-4db1-afd2-7fb85693bc16,network=Network(d5876e18-e2af-45c2-aab5-2d0d552ebfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25798da4-8f')
Jul 29 15:00:31 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f10ebaba-d609-4b32-93a3-24bfaaa8787b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] calling os-brick to detach iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 15:00:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f10ebaba-d609-4b32-93a3-24bfaaa8787b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, {'target_iqns': ['iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kNagZKpr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 15:00:31 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-f10ebaba-d609-4b32-93a3-24bfaaa8787b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 15:00:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-f10ebaba-d609-4b32-93a3-24bfaaa8787b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 15:00:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-f10ebaba-d609-4b32-93a3-24bfaaa8787b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 15:00:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f10ebaba-d609-4b32-93a3-24bfaaa8787b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453', 0)] {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 15:00:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:31 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b2c6eb-fd9f-40e4-bad6-69047c0d4369]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:00:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:31 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b44c85d8-c95a-4fb5-9477-92d745cb1731]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:00:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f10ebaba-d609-4b32-93a3-24bfaaa8787b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 15:00:31 user nova-compute[70924]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef (non-flash)
Jul 29 15:00:31 user nova-compute[70924]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 (non-flash)
Jul 29 15:00:31 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 15:00:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f10ebaba-d609-4b32-93a3-24bfaaa8787b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 (non-flash)
Jul 29 15:00:31 user nova-compute[70924]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef (non-flash)
Jul 29 15:00:31 user nova-compute[70924]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 (non-flash)
Jul 29 15:00:31 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 15:00:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f10ebaba-d609-4b32-93a3-24bfaaa8787b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feecc5e8b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453'): ({'sdb'}, set())}) {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 15:00:31 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-f10ebaba-d609-4b32-93a3-24bfaaa8787b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Removing single pathed devices sdb {{(pid=70924) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 15:00:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:31 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[439d55bf-e14d-4f9f-8852-aeca4df460a2]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:00:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:31 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31d9bc4-c690-426d-b8be-1b49a79d5943]: (4, ('ok\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:00:31 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-f10ebaba-d609-4b32-93a3-24bfaaa8787b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Flushing IO for device /dev/sdb {{(pid=70924) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 15:00:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:31 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b74563e-2df2-4ec9-ab24-309c21381329]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:00:31 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-f10ebaba-d609-4b32-93a3-24bfaaa8787b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70924) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 15:00:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:31 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a149e88-9178-4b71-ae52-51c85cc5a440]: (4, ('1', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:00:31 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-f10ebaba-d609-4b32-93a3-24bfaaa8787b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 15:00:31 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-f10ebaba-d609-4b32-93a3-24bfaaa8787b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] SCSI volumes sdb have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 15:00:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f10ebaba-d609-4b32-93a3-24bfaaa8787b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453')] {{(pid=70924) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 15:00:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:31 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fbe774a-3d44-4eba-bf1a-16bf54c0f232]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:00:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f10ebaba-d609-4b32-93a3-24bfaaa8787b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:00:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 -p 172.16.0.220:3260 --logout {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:31 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ffa375-0b62-447a-a181-5545fa5b5e6d]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:00:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f10ebaba-d609-4b32-93a3-24bfaaa8787b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453, portal: 172.16.0.220,3260]
Jul 29 15:00:31 user nova-compute[70924]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453, portal: 172.16.0.220,3260] successful.
Jul 29 15:00:31 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:00:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 -p 172.16.0.220:3260 --op delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8161c51-93db-4707-bf78-63cb674c3453 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:31 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae78988-12ce-4bb1-8439-e20164f21fb5]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:00:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f10ebaba-d609-4b32-93a3-24bfaaa8787b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:00:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-f10ebaba-d609-4b32-93a3-24bfaaa8787b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 15:00:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f10ebaba-d609-4b32-93a3-24bfaaa8787b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] <== disconnect_volume: return (313ms) None {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 15:00:31 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f10ebaba-d609-4b32-93a3-24bfaaa8787b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Disconnected iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 15:00:31 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-f10ebaba-d609-4b32-93a3-24bfaaa8787b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Deleting instance files /opt/stack/data/nova/instances/02c75b00-a1b4-4ef9-ae96-bc67d8038589_del
Jul 29 15:00:31 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-f10ebaba-d609-4b32-93a3-24bfaaa8787b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Deletion of /opt/stack/data/nova/instances/02c75b00-a1b4-4ef9-ae96-bc67d8038589_del complete
Jul 29 15:00:31 user nova-compute[70924]: INFO nova.compute.manager [None req-f10ebaba-d609-4b32-93a3-24bfaaa8787b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Took 1.33 seconds to destroy the instance on the hypervisor.
Jul 29 15:00:31 user nova-compute[70924]: DEBUG oslo.service.loopingcall [None req-f10ebaba-d609-4b32-93a3-24bfaaa8787b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70924) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 15:00:31 user nova-compute[70924]: DEBUG nova.compute.manager [-] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Deallocating network for instance {{(pid=70924) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 15:00:31 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] deallocate_for_instance() {{(pid=70924) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 15:00:32 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:00:32 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Took 0.94 seconds to deallocate network for instance.
Jul 29 15:00:33 user nova-compute[70924]: DEBUG nova.compute.manager [req-dbebf6c9-aef3-4e32-900c-b997ed4db25a req-d05be4eb-d0d9-4fa5-9d0a-9a2f2aca7eee service nova] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Received event network-vif-plugged-25798da4-8f4d-4db1-afd2-7fb85693bc16 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:00:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-dbebf6c9-aef3-4e32-900c-b997ed4db25a req-d05be4eb-d0d9-4fa5-9d0a-9a2f2aca7eee service nova] Acquiring lock "02c75b00-a1b4-4ef9-ae96-bc67d8038589-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:00:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-dbebf6c9-aef3-4e32-900c-b997ed4db25a req-d05be4eb-d0d9-4fa5-9d0a-9a2f2aca7eee service nova] Lock "02c75b00-a1b4-4ef9-ae96-bc67d8038589-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:00:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-dbebf6c9-aef3-4e32-900c-b997ed4db25a req-d05be4eb-d0d9-4fa5-9d0a-9a2f2aca7eee service nova] Lock "02c75b00-a1b4-4ef9-ae96-bc67d8038589-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:00:33 user nova-compute[70924]: DEBUG nova.compute.manager [req-dbebf6c9-aef3-4e32-900c-b997ed4db25a req-d05be4eb-d0d9-4fa5-9d0a-9a2f2aca7eee service nova] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] No waiting events found dispatching network-vif-plugged-25798da4-8f4d-4db1-afd2-7fb85693bc16 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:00:33 user nova-compute[70924]: WARNING nova.compute.manager [req-dbebf6c9-aef3-4e32-900c-b997ed4db25a req-d05be4eb-d0d9-4fa5-9d0a-9a2f2aca7eee service nova] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Received unexpected event network-vif-plugged-25798da4-8f4d-4db1-afd2-7fb85693bc16 for instance with vm_state active and task_state deleting.
Jul 29 15:00:33 user nova-compute[70924]: DEBUG nova.compute.manager [req-dbebf6c9-aef3-4e32-900c-b997ed4db25a req-d05be4eb-d0d9-4fa5-9d0a-9a2f2aca7eee service nova] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Received event network-vif-deleted-25798da4-8f4d-4db1-afd2-7fb85693bc16 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:00:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ba903af0-f89b-4fd3-a1d6-9c4349fcc273 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Acquiring lock "b3efaa8e-7138-40be-a271-8a344eac3e48" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:00:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ba903af0-f89b-4fd3-a1d6-9c4349fcc273 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "b3efaa8e-7138-40be-a271-8a344eac3e48" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:00:33 user nova-compute[70924]: DEBUG nova.objects.instance [None req-ba903af0-f89b-4fd3-a1d6-9c4349fcc273 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lazy-loading 'flavor' on Instance uuid b3efaa8e-7138-40be-a271-8a344eac3e48 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:00:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ba903af0-f89b-4fd3-a1d6-9c4349fcc273 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "b3efaa8e-7138-40be-a271-8a344eac3e48" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:00:33 user nova-compute[70924]: INFO nova.compute.manager [None req-f10ebaba-d609-4b32-93a3-24bfaaa8787b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Took 0.83 seconds to detach 1 volumes for instance.
Jul 29 15:00:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ba903af0-f89b-4fd3-a1d6-9c4349fcc273 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Acquiring lock "b3efaa8e-7138-40be-a271-8a344eac3e48" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:00:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ba903af0-f89b-4fd3-a1d6-9c4349fcc273 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "b3efaa8e-7138-40be-a271-8a344eac3e48" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:00:33 user nova-compute[70924]: INFO nova.compute.manager [None req-ba903af0-f89b-4fd3-a1d6-9c4349fcc273 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Attaching volume 2788765e-da70-4875-b1bd-b9ab878d93a3 to /dev/vdb
Jul 29 15:00:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-f10ebaba-d609-4b32-93a3-24bfaaa8787b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:00:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-f10ebaba-d609-4b32-93a3-24bfaaa8787b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:00:33 user nova-compute[70924]: DEBUG os_brick.utils [None req-ba903af0-f89b-4fd3-a1d6-9c4349fcc273 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 15:00:33 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:33 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:33 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb39a015-a616-401e-a963-094fa9ab3ae0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f2127c4a30d9\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:00:33 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:33 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:33 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[263e29e9-afcc-43fa-bf0e-ebb347d2473f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:00:33 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:33 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:33 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ac2d02-f83c-4e3d-9603-49b15133a5c4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:00:33 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f967b4-8478-4583-96a1-d3d55627fe9c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:00:33 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-ba903af0-f89b-4fd3-a1d6-9c4349fcc273 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Running cmd (subprocess): nvme version {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:33 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-ba903af0-f89b-4fd3-a1d6-9c4349fcc273 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] 'nvme version' failed. Not Retrying. {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 15:00:33 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ba903af0-f89b-4fd3-a1d6-9c4349fcc273 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] nvme not present on system {{(pid=70924) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 15:00:33 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:33 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 15:00:33 user nova-compute[70924]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 15:00:33 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3c2b32-a269-4388-8a97-7fdfd43364a6]: (4, '') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:00:33 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-ba903af0-f89b-4fd3-a1d6-9c4349fcc273 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70924) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 15:00:33 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-ba903af0-f89b-4fd3-a1d6-9c4349fcc273 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 15:00:33 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-ba903af0-f89b-4fd3-a1d6-9c4349fcc273 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] LIGHTOS: no hostnqn found. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 15:00:33 user nova-compute[70924]: DEBUG os_brick.utils [None req-ba903af0-f89b-4fd3-a1d6-9c4349fcc273 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f2127c4a30d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 15:00:33 user nova-compute[70924]: DEBUG nova.virt.block_device [None req-ba903af0-f89b-4fd3-a1d6-9c4349fcc273 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Updating existing volume attachment record: 2905c7f4-8ae0-40fe-a725-334f1c4173d6 {{(pid=70924) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 15:00:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:00:34 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-f10ebaba-d609-4b32-93a3-24bfaaa8787b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:00:34 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-f10ebaba-d609-4b32-93a3-24bfaaa8787b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:00:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-f10ebaba-d609-4b32-93a3-24bfaaa8787b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.437s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:00:34 user nova-compute[70924]: INFO nova.scheduler.client.report [None req-f10ebaba-d609-4b32-93a3-24bfaaa8787b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Deleted allocations for instance 02c75b00-a1b4-4ef9-ae96-bc67d8038589
Jul 29 15:00:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-f10ebaba-d609-4b32-93a3-24bfaaa8787b tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "02c75b00-a1b4-4ef9-ae96-bc67d8038589" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.752s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:00:36 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:00:38 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16456aa2-34f4-4874-86fa-03cbfbba8466 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] Calling os-brick to attach iSCSI Volume {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 15:00:38 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-16456aa2-34f4-4874-86fa-03cbfbba8466 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'misYeogz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 15:00:38 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-16456aa2-34f4-4874-86fa-03cbfbba8466 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 15:00:38 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-16456aa2-34f4-4874-86fa-03cbfbba8466 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 15:00:38 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-16456aa2-34f4-4874-86fa-03cbfbba8466 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 15:00:38 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-16456aa2-34f4-4874-86fa-03cbfbba8466 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 15:00:38 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-16456aa2-34f4-4874-86fa-03cbfbba8466 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 15:00:38 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-16456aa2-34f4-4874-86fa-03cbfbba8466 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 15:00:38 user nova-compute[70924]: INFO os_brick.initiator.connectors.iscsi [None req-16456aa2-34f4-4874-86fa-03cbfbba8466 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 15:00:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f -p 172.16.0.220:3260 {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:38 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5d4c7e-a895-41cb-baed-64251d14924f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:00:38 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-16456aa2-34f4-4874-86fa-03cbfbba8466 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 15:00:38 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:00:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f -p 172.16.0.220:3260 --interface default --op new {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:38 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6972204a-e6a1-4087-9d3e-cfa46c5440c6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f] added\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:00:38 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-16456aa2-34f4-4874-86fa-03cbfbba8466 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f] added
Jul 29 15:00:38 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:00:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:38 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f6c6dbe-d6d5-429c-ba12-85fa645916d9]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:00:38 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-16456aa2-34f4-4874-86fa-03cbfbba8466 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:00:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:38 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[31bae0d1-d037-4522-bc30-fbac1d1e4660]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:00:38 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-16456aa2-34f4-4874-86fa-03cbfbba8466 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:00:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v misYeogz {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v misYeogz" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:38 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[088699c4-be5e-4a6f-9802-7de96153bec2]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:00:38 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-16456aa2-34f4-4874-86fa-03cbfbba8466 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'misYeogz'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:00:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:38 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2cd302-5414-45e0-b9dd-f46e2f368b7e]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:00:38 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-16456aa2-34f4-4874-86fa-03cbfbba8466 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:00:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:38 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea91920-a2b8-416d-b427-7acf102227c5]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:00:38 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-16456aa2-34f4-4874-86fa-03cbfbba8466 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef (non-flash)
Jul 29 15:00:38 user nova-compute[70924]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 (non-flash)
Jul 29 15:00:38 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 15:00:38 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-16456aa2-34f4-4874-86fa-03cbfbba8466 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef (non-flash)
Jul 29 15:00:38 user nova-compute[70924]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 (non-flash)
Jul 29 15:00:38 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 15:00:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f -p 172.16.0.220:3260 --login {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:38 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a74f74d-241f-4051-b825-c2838fe7070c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:00:38 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-16456aa2-34f4-4874-86fa-03cbfbba8466 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f, portal: 172.16.0.220,3260]
Jul 29 15:00:38 user nova-compute[70924]: Login to [iface: default, target: iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f, portal: 172.16.0.220,3260] successful.
Jul 29 15:00:38 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:00:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:38 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74e1a2b-1e36-4409-afc9-495a4f8a5630]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:00:38 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-16456aa2-34f4-4874-86fa-03cbfbba8466 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:00:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:38 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0a6adc-bad4-4426-9eab-a5a5beaf7ca1]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:00:38 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-16456aa2-34f4-4874-86fa-03cbfbba8466 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef (non-flash)
Jul 29 15:00:38 user nova-compute[70924]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 (non-flash)
Jul 29 15:00:38 user nova-compute[70924]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f (non-flash)
Jul 29 15:00:38 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 15:00:38 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-16456aa2-34f4-4874-86fa-03cbfbba8466 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef (non-flash)
Jul 29 15:00:38 user nova-compute[70924]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 (non-flash)
Jul 29 15:00:38 user nova-compute[70924]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f (non-flash)
Jul 29 15:00:38 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 15:00:38 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-16456aa2-34f4-4874-86fa-03cbfbba8466 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 15:00:38 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-16456aa2-34f4-4874-86fa-03cbfbba8466 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Connected to 172.16.0.220:3260 {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 15:00:38 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-16456aa2-34f4-4874-86fa-03cbfbba8466 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=70924) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 15:00:38 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-16456aa2-34f4-4874-86fa-03cbfbba8466 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70924) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 15:00:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:38 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d68e7e3c-7c83-42df-8611-bd1d486045b5]: (4, ('- - 0', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:00:38 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-16456aa2-34f4-4874-86fa-03cbfbba8466 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: None {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 15:00:39 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:00:39 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-16456aa2-34f4-4874-86fa-03cbfbba8466 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 15:00:39 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-16456aa2-34f4-4874-86fa-03cbfbba8466 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'misYeogz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 15:00:39 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-16456aa2-34f4-4874-86fa-03cbfbba8466 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 15:00:39 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-16456aa2-34f4-4874-86fa-03cbfbba8466 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '26438343866303238', 'path': '/dev/sdb'} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 15:00:39 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16456aa2-34f4-4874-86fa-03cbfbba8466 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26438343866303238', 'path': '/dev/sdb'} {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 15:00:39 user nova-compute[70924]: DEBUG nova.objects.instance [None req-16456aa2-34f4-4874-86fa-03cbfbba8466 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lazy-loading 'flavor' on Instance uuid 47104e57-c193-4a85-a2cf-677f0debe373 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:00:39 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-16456aa2-34f4-4874-86fa-03cbfbba8466 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] attach device xml: <disk type="block" device="disk">
Jul 29 15:00:39 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 15:00:39 user nova-compute[70924]:   <source dev="/dev/sdb"/>
Jul 29 15:00:39 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 15:00:39 user nova-compute[70924]:   <serial>19aec498-852a-41ef-b0eb-8b9f3dc2318f</serial>
Jul 29 15:00:39 user nova-compute[70924]: </disk>
Jul 29 15:00:39 user nova-compute[70924]:  {{(pid=70924) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 29 15:00:40 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-16456aa2-34f4-4874-86fa-03cbfbba8466 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 15:00:40 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-16456aa2-34f4-4874-86fa-03cbfbba8466 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 15:00:40 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-16456aa2-34f4-4874-86fa-03cbfbba8466 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] No VIF found with MAC fa:16:3e:62:6c:e1, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 15:00:40 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-16456aa2-34f4-4874-86fa-03cbfbba8466 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "47104e57-c193-4a85-a2cf-677f0debe373" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.954s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:00:41 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba903af0-f89b-4fd3-a1d6-9c4349fcc273 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Calling os-brick to attach iSCSI Volume {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 15:00:41 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba903af0-f89b-4fd3-a1d6-9c4349fcc273 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2788765e-da70-4875-b1bd-b9ab878d93a3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LZCpmhaY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 15:00:41 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-ba903af0-f89b-4fd3-a1d6-9c4349fcc273 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 15:00:41 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-ba903af0-f89b-4fd3-a1d6-9c4349fcc273 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 15:00:41 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-ba903af0-f89b-4fd3-a1d6-9c4349fcc273 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 15:00:41 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-ba903af0-f89b-4fd3-a1d6-9c4349fcc273 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 15:00:41 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-ba903af0-f89b-4fd3-a1d6-9c4349fcc273 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2788765e-da70-4875-b1bd-b9ab878d93a3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 15:00:41 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-ba903af0-f89b-4fd3-a1d6-9c4349fcc273 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2788765e-da70-4875-b1bd-b9ab878d93a3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 15:00:41 user nova-compute[70924]: INFO os_brick.initiator.connectors.iscsi [None req-ba903af0-f89b-4fd3-a1d6-9c4349fcc273 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 15:00:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2788765e-da70-4875-b1bd-b9ab878d93a3 -p 172.16.0.220:3260 {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2788765e-da70-4875-b1bd-b9ab878d93a3 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:41 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cdbabcc-8b72-47f4-a836-809c2b0a86c3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:00:41 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba903af0-f89b-4fd3-a1d6-9c4349fcc273 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 15:00:41 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:00:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2788765e-da70-4875-b1bd-b9ab878d93a3 -p 172.16.0.220:3260 --interface default --op new {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2788765e-da70-4875-b1bd-b9ab878d93a3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:41 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3163490-4672-4370-b5e9-3206a8e96c8f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2788765e-da70-4875-b1bd-b9ab878d93a3] added\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:00:41 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba903af0-f89b-4fd3-a1d6-9c4349fcc273 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2788765e-da70-4875-b1bd-b9ab878d93a3] added
Jul 29 15:00:41 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:00:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2788765e-da70-4875-b1bd-b9ab878d93a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2788765e-da70-4875-b1bd-b9ab878d93a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:41 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[4815d72d-8769-462a-bc5f-9fd73c8bee5f]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:00:41 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba903af0-f89b-4fd3-a1d6-9c4349fcc273 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:00:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2788765e-da70-4875-b1bd-b9ab878d93a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2788765e-da70-4875-b1bd-b9ab878d93a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:41 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b32e439-b5d9-4bcf-baa4-c10fe0b94b47]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:00:41 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba903af0-f89b-4fd3-a1d6-9c4349fcc273 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:00:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2788765e-da70-4875-b1bd-b9ab878d93a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LZCpmhaY {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2788765e-da70-4875-b1bd-b9ab878d93a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LZCpmhaY" returned: 0 in 0.025s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:41 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb9d0ab-f822-418f-a7c7-2aa31800346b]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:00:41 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba903af0-f89b-4fd3-a1d6-9c4349fcc273 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LZCpmhaY'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:00:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2788765e-da70-4875-b1bd-b9ab878d93a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2788765e-da70-4875-b1bd-b9ab878d93a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:41 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[202d7950-b193-4660-894e-b1edeeb6778d]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:00:41 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba903af0-f89b-4fd3-a1d6-9c4349fcc273 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:00:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:41 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b48bcd-f1aa-4c96-b9df-6a044b07f188]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:00:41 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba903af0-f89b-4fd3-a1d6-9c4349fcc273 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef (non-flash)
Jul 29 15:00:41 user nova-compute[70924]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 (non-flash)
Jul 29 15:00:41 user nova-compute[70924]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f (non-flash)
Jul 29 15:00:41 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 15:00:41 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba903af0-f89b-4fd3-a1d6-9c4349fcc273 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef (non-flash)
Jul 29 15:00:41 user nova-compute[70924]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 (non-flash)
Jul 29 15:00:41 user nova-compute[70924]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f (non-flash)
Jul 29 15:00:41 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 15:00:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2788765e-da70-4875-b1bd-b9ab878d93a3 -p 172.16.0.220:3260 --login {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2788765e-da70-4875-b1bd-b9ab878d93a3 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:41 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e78a0e36-75ba-4952-93dc-e495a962a10c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2788765e-da70-4875-b1bd-b9ab878d93a3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2788765e-da70-4875-b1bd-b9ab878d93a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:00:41 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba903af0-f89b-4fd3-a1d6-9c4349fcc273 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2788765e-da70-4875-b1bd-b9ab878d93a3, portal: 172.16.0.220,3260]
Jul 29 15:00:41 user nova-compute[70924]: Login to [iface: default, target: iqn.2010-10.org.openstack:2788765e-da70-4875-b1bd-b9ab878d93a3, portal: 172.16.0.220,3260] successful.
Jul 29 15:00:41 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:00:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2788765e-da70-4875-b1bd-b9ab878d93a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:41 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:00:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2788765e-da70-4875-b1bd-b9ab878d93a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.110s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:41 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca81cba-14cc-4ae7-bb4e-33df39bb7d30]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:00:41 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba903af0-f89b-4fd3-a1d6-9c4349fcc273 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:00:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:41 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d6b9c1-1c3e-4fd6-8fa8-9c1e1a3cf415]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2788765e-da70-4875-b1bd-b9ab878d93a3 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:00:41 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba903af0-f89b-4fd3-a1d6-9c4349fcc273 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef (non-flash)
Jul 29 15:00:41 user nova-compute[70924]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 (non-flash)
Jul 29 15:00:41 user nova-compute[70924]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f (non-flash)
Jul 29 15:00:41 user nova-compute[70924]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2788765e-da70-4875-b1bd-b9ab878d93a3 (non-flash)
Jul 29 15:00:41 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 15:00:41 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba903af0-f89b-4fd3-a1d6-9c4349fcc273 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef (non-flash)
Jul 29 15:00:41 user nova-compute[70924]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 (non-flash)
Jul 29 15:00:41 user nova-compute[70924]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f (non-flash)
Jul 29 15:00:41 user nova-compute[70924]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2788765e-da70-4875-b1bd-b9ab878d93a3 (non-flash)
Jul 29 15:00:41 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 15:00:41 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-ba903af0-f89b-4fd3-a1d6-9c4349fcc273 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2788765e-da70-4875-b1bd-b9ab878d93a3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.393s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 15:00:41 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba903af0-f89b-4fd3-a1d6-9c4349fcc273 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Connected to 172.16.0.220:3260 {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 15:00:41 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-ba903af0-f89b-4fd3-a1d6-9c4349fcc273 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] HCTL ('36', '-', '-', 0) found on session 43 with lun 0 {{(pid=70924) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 15:00:41 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-ba903af0-f89b-4fd3-a1d6-9c4349fcc273 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70924) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 15:00:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:41 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e06f92d-1734-4d12-89d4-e7bf68adb9b5]: (4, ('- - 0', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:00:41 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-ba903af0-f89b-4fd3-a1d6-9c4349fcc273 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Searching for a device in session 43 and hctl ['36', '*', '*', 0] yield: None {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 15:00:41 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:00:42 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-ba903af0-f89b-4fd3-a1d6-9c4349fcc273 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Searching for a device in session 43 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 15:00:42 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba903af0-f89b-4fd3-a1d6-9c4349fcc273 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LZCpmhaY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 15:00:42 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-ba903af0-f89b-4fd3-a1d6-9c4349fcc273 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.421s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 15:00:42 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba903af0-f89b-4fd3-a1d6-9c4349fcc273 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] <== connect_volume: return (1422ms) {'type': 'block', 'scsi_wwn': '26264643263613436', 'path': '/dev/sde'} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 15:00:42 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba903af0-f89b-4fd3-a1d6-9c4349fcc273 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26264643263613436', 'path': '/dev/sde'} {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 15:00:42 user nova-compute[70924]: DEBUG nova.objects.instance [None req-ba903af0-f89b-4fd3-a1d6-9c4349fcc273 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lazy-loading 'flavor' on Instance uuid b3efaa8e-7138-40be-a271-8a344eac3e48 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:00:42 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-ba903af0-f89b-4fd3-a1d6-9c4349fcc273 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] attach device xml: <disk type="block" device="disk">
Jul 29 15:00:42 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 15:00:42 user nova-compute[70924]:   <source dev="/dev/sde"/>
Jul 29 15:00:42 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 15:00:42 user nova-compute[70924]:   <serial>2788765e-da70-4875-b1bd-b9ab878d93a3</serial>
Jul 29 15:00:42 user nova-compute[70924]: </disk>
Jul 29 15:00:42 user nova-compute[70924]:  {{(pid=70924) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 29 15:00:43 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-ba903af0-f89b-4fd3-a1d6-9c4349fcc273 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 15:00:43 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-ba903af0-f89b-4fd3-a1d6-9c4349fcc273 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 15:00:43 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-ba903af0-f89b-4fd3-a1d6-9c4349fcc273 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] No VIF found with MAC fa:16:3e:9c:88:44, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 15:00:43 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ba903af0-f89b-4fd3-a1d6-9c4349fcc273 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "b3efaa8e-7138-40be-a271-8a344eac3e48" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.658s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:00:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:00:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Acquiring lock "1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:00:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:00:44 user nova-compute[70924]: DEBUG nova.compute.manager [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] Starting instance... {{(pid=70924) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 15:00:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:00:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:00:44 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70924) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 15:00:44 user nova-compute[70924]: INFO nova.compute.claims [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] Claim successful on node user
Jul 29 15:00:44 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:00:44 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:00:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.454s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:00:44 user nova-compute[70924]: DEBUG nova.compute.manager [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] Start building networks asynchronously for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 15:00:44 user nova-compute[70924]: DEBUG nova.compute.manager [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] Allocating IP information in the background. {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 15:00:44 user nova-compute[70924]: DEBUG nova.network.neutron [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] allocate_for_instance() {{(pid=70924) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 15:00:44 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 15:00:45 user nova-compute[70924]: DEBUG nova.compute.manager [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] Start building block device mappings for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 15:00:45 user nova-compute[70924]: DEBUG nova.policy [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '12cb8299e4d24946bc41a86493f4b426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadc9385b3b46eebc6e0d81814521af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70924) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 15:00:45 user nova-compute[70924]: DEBUG nova.compute.manager [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] Start spawning the instance on the hypervisor. {{(pid=70924) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 15:00:45 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] Creating instance directory {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 15:00:45 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] Creating image(s)
Jul 29 15:00:45 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Acquiring lock "/opt/stack/data/nova/instances/1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:00:45 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "/opt/stack/data/nova/instances/1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:00:45 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "/opt/stack/data/nova/instances/1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:00:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.135s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:45 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Acquiring lock "bd72453517468710f1de26b27fb0ea28688e9009" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:00:45 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:00:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.161s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a/disk 1073741824 {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a/disk 1073741824" returned: 0 in 0.151s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:45 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.320s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:00:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.131s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:45 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a/disk. size=1073741824 {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 15:00:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:45 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Cannot resize image /opt/stack/data/nova/instances/1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a/disk to a smaller size. {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 15:00:45 user nova-compute[70924]: DEBUG nova.objects.instance [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lazy-loading 'migration_context' on Instance uuid 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:00:45 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] Created local disks {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 15:00:45 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] Ensure instance console log exists: /opt/stack/data/nova/instances/1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a/console.log {{(pid=70924) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 15:00:45 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:00:45 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:00:45 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:00:45 user nova-compute[70924]: DEBUG nova.network.neutron [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] Successfully created port: b952c385-68ec-4618-9d28-de94c56d27d9 {{(pid=70924) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 15:00:46 user nova-compute[70924]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690642831.4393482, 02c75b00-a1b4-4ef9-ae96-bc67d8038589 => Stopped> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 15:00:46 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] VM Stopped (Lifecycle Event)
Jul 29 15:00:46 user nova-compute[70924]: DEBUG nova.compute.manager [None req-ee227399-441a-436b-b1bd-3a50fb244046 None None] [instance: 02c75b00-a1b4-4ef9-ae96-bc67d8038589] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:00:46 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:00:46 user nova-compute[70924]: DEBUG nova.network.neutron [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] Successfully updated port: b952c385-68ec-4618-9d28-de94c56d27d9 {{(pid=70924) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 15:00:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Acquiring lock "refresh_cache-1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:00:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Acquired lock "refresh_cache-1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:00:46 user nova-compute[70924]: DEBUG nova.network.neutron [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 15:00:46 user nova-compute[70924]: DEBUG nova.compute.manager [req-05155d70-de82-4457-a2d4-ec9140a4845e req-08296ddb-a021-4aaf-aeea-952a044a4f98 service nova] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] Received event network-changed-b952c385-68ec-4618-9d28-de94c56d27d9 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:00:46 user nova-compute[70924]: DEBUG nova.compute.manager [req-05155d70-de82-4457-a2d4-ec9140a4845e req-08296ddb-a021-4aaf-aeea-952a044a4f98 service nova] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] Refreshing instance network info cache due to event network-changed-b952c385-68ec-4618-9d28-de94c56d27d9. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 15:00:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-05155d70-de82-4457-a2d4-ec9140a4845e req-08296ddb-a021-4aaf-aeea-952a044a4f98 service nova] Acquiring lock "refresh_cache-1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:00:46 user nova-compute[70924]: DEBUG nova.network.neutron [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] Instance cache missing network info. {{(pid=70924) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 15:00:47 user nova-compute[70924]: DEBUG nova.network.neutron [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] Updating instance_info_cache with network_info: [{"id": "b952c385-68ec-4618-9d28-de94c56d27d9", "address": "fa:16:3e:98:e1:17", "network": {"id": "f80826fa-fada-45b9-b969-fd539fd34fd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-465377443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9aadc9385b3b46eebc6e0d81814521af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb952c385-68", "ovs_interfaceid": "b952c385-68ec-4618-9d28-de94c56d27d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:00:47 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Releasing lock "refresh_cache-1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:00:47 user nova-compute[70924]: DEBUG nova.compute.manager [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] Instance network_info: |[{"id": "b952c385-68ec-4618-9d28-de94c56d27d9", "address": "fa:16:3e:98:e1:17", "network": {"id": "f80826fa-fada-45b9-b969-fd539fd34fd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-465377443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9aadc9385b3b46eebc6e0d81814521af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb952c385-68", "ovs_interfaceid": "b952c385-68ec-4618-9d28-de94c56d27d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 15:00:47 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-05155d70-de82-4457-a2d4-ec9140a4845e req-08296ddb-a021-4aaf-aeea-952a044a4f98 service nova] Acquired lock "refresh_cache-1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:00:47 user nova-compute[70924]: DEBUG nova.network.neutron [req-05155d70-de82-4457-a2d4-ec9140a4845e req-08296ddb-a021-4aaf-aeea-952a044a4f98 service nova] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] Refreshing network info cache for port b952c385-68ec-4618-9d28-de94c56d27d9 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 15:00:47 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] Start _get_guest_xml network_info=[{"id": "b952c385-68ec-4618-9d28-de94c56d27d9", "address": "fa:16:3e:98:e1:17", "network": {"id": "f80826fa-fada-45b9-b969-fd539fd34fd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-465377443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9aadc9385b3b46eebc6e0d81814521af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb952c385-68", "ovs_interfaceid": "b952c385-68ec-4618-9d28-de94c56d27d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '3aba2e73-6832-404b-8bd0-d0503ce82b8c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 15:00:47 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:00:47 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:00:47 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 15:00:47 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] CPU controller missing on host. {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 15:00:47 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 15:00:47 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] CPU controller found on host. {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 15:00:47 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70924) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 15:00:47 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T14:36:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 15:00:47 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Flavor limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 15:00:47 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Image limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 15:00:47 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Flavor pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 15:00:47 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Image pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 15:00:47 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 15:00:47 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 15:00:47 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 15:00:47 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Got 1 possible topologies {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 15:00:47 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 15:00:47 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 15:00:47 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T15:00:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-691515032',display_name='tempest-AttachVolumeNegativeTest-server-691515032',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-691515032',id=39,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKcNThJfGgCC0X/qLoz3jQvWXwel/9sE1MjOrF+HqDzAWn0RGOThbp2zXruoqrRm110J21yfgdgrM0ukUEskJEHR9KQRzkyrIqSa1RVWOLrGeRKx3dBgrZ8At/D3U5mH0A==',key_name='tempest-keypair-368297878',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9aadc9385b3b46eebc6e0d81814521af',ramdisk_id='',reservation_id='r-y9qzxt1r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-972203101',owner_user_name='tempest-AttachVolumeNegativeTest-972203101-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T15:00:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='12cb8299e4d24946bc41a86493f4b426',uuid=1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b952c385-68ec-4618-9d28-de94c56d27d9", "address": "fa:16:3e:98:e1:17", "network": {"id": "f80826fa-fada-45b9-b969-fd539fd34fd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-465377443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9aadc9385b3b46eebc6e0d81814521af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb952c385-68", "ovs_interfaceid": "b952c385-68ec-4618-9d28-de94c56d27d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 15:00:47 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Converting VIF {"id": "b952c385-68ec-4618-9d28-de94c56d27d9", "address": "fa:16:3e:98:e1:17", "network": {"id": "f80826fa-fada-45b9-b969-fd539fd34fd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-465377443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9aadc9385b3b46eebc6e0d81814521af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb952c385-68", "ovs_interfaceid": "b952c385-68ec-4618-9d28-de94c56d27d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 15:00:47 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:e1:17,bridge_name='br-int',has_traffic_filtering=True,id=b952c385-68ec-4618-9d28-de94c56d27d9,network=Network(f80826fa-fada-45b9-b969-fd539fd34fd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb952c385-68') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 15:00:47 user nova-compute[70924]: DEBUG nova.objects.instance [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lazy-loading 'pci_devices' on Instance uuid 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:00:47 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] End _get_guest_xml xml=<domain type="kvm">
Jul 29 15:00:47 user nova-compute[70924]:   <uuid>1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a</uuid>
Jul 29 15:00:47 user nova-compute[70924]:   <name>instance-00000027</name>
Jul 29 15:00:47 user nova-compute[70924]:   <memory>524288</memory>
Jul 29 15:00:47 user nova-compute[70924]:   <vcpu>1</vcpu>
Jul 29 15:00:47 user nova-compute[70924]:   <metadata>
Jul 29 15:00:47 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 15:00:47 user nova-compute[70924]:       <nova:package version="0.0.0"/>
Jul 29 15:00:47 user nova-compute[70924]:       <nova:name>tempest-AttachVolumeNegativeTest-server-691515032</nova:name>
Jul 29 15:00:47 user nova-compute[70924]:       <nova:creationTime>2023-07-29 15:00:47</nova:creationTime>
Jul 29 15:00:47 user nova-compute[70924]:       <nova:flavor name="m1.tiny">
Jul 29 15:00:47 user nova-compute[70924]:         <nova:memory>512</nova:memory>
Jul 29 15:00:47 user nova-compute[70924]:         <nova:disk>1</nova:disk>
Jul 29 15:00:47 user nova-compute[70924]:         <nova:swap>0</nova:swap>
Jul 29 15:00:47 user nova-compute[70924]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 15:00:47 user nova-compute[70924]:         <nova:vcpus>1</nova:vcpus>
Jul 29 15:00:47 user nova-compute[70924]:       </nova:flavor>
Jul 29 15:00:47 user nova-compute[70924]:       <nova:owner>
Jul 29 15:00:47 user nova-compute[70924]:         <nova:user uuid="12cb8299e4d24946bc41a86493f4b426">tempest-AttachVolumeNegativeTest-972203101-project-member</nova:user>
Jul 29 15:00:47 user nova-compute[70924]:         <nova:project uuid="9aadc9385b3b46eebc6e0d81814521af">tempest-AttachVolumeNegativeTest-972203101</nova:project>
Jul 29 15:00:47 user nova-compute[70924]:       </nova:owner>
Jul 29 15:00:47 user nova-compute[70924]:       <nova:root type="image" uuid="3aba2e73-6832-404b-8bd0-d0503ce82b8c"/>
Jul 29 15:00:47 user nova-compute[70924]:       <nova:ports>
Jul 29 15:00:47 user nova-compute[70924]:         <nova:port uuid="b952c385-68ec-4618-9d28-de94c56d27d9">
Jul 29 15:00:47 user nova-compute[70924]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 29 15:00:47 user nova-compute[70924]:         </nova:port>
Jul 29 15:00:47 user nova-compute[70924]:       </nova:ports>
Jul 29 15:00:47 user nova-compute[70924]:     </nova:instance>
Jul 29 15:00:47 user nova-compute[70924]:   </metadata>
Jul 29 15:00:47 user nova-compute[70924]:   <sysinfo type="smbios">
Jul 29 15:00:47 user nova-compute[70924]:     <system>
Jul 29 15:00:47 user nova-compute[70924]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 15:00:47 user nova-compute[70924]:       <entry name="product">OpenStack Nova</entry>
Jul 29 15:00:47 user nova-compute[70924]:       <entry name="version">0.0.0</entry>
Jul 29 15:00:47 user nova-compute[70924]:       <entry name="serial">1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a</entry>
Jul 29 15:00:47 user nova-compute[70924]:       <entry name="uuid">1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a</entry>
Jul 29 15:00:47 user nova-compute[70924]:       <entry name="family">Virtual Machine</entry>
Jul 29 15:00:47 user nova-compute[70924]:     </system>
Jul 29 15:00:47 user nova-compute[70924]:   </sysinfo>
Jul 29 15:00:47 user nova-compute[70924]:   <os>
Jul 29 15:00:47 user nova-compute[70924]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 15:00:47 user nova-compute[70924]:     <boot dev="hd"/>
Jul 29 15:00:47 user nova-compute[70924]:     <smbios mode="sysinfo"/>
Jul 29 15:00:47 user nova-compute[70924]:   </os>
Jul 29 15:00:47 user nova-compute[70924]:   <features>
Jul 29 15:00:47 user nova-compute[70924]:     <acpi/>
Jul 29 15:00:47 user nova-compute[70924]:     <apic/>
Jul 29 15:00:47 user nova-compute[70924]:     <vmcoreinfo/>
Jul 29 15:00:47 user nova-compute[70924]:   </features>
Jul 29 15:00:47 user nova-compute[70924]:   <clock offset="utc">
Jul 29 15:00:47 user nova-compute[70924]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 15:00:47 user nova-compute[70924]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 15:00:47 user nova-compute[70924]:     <timer name="hpet" present="no"/>
Jul 29 15:00:47 user nova-compute[70924]:   </clock>
Jul 29 15:00:47 user nova-compute[70924]:   <cpu mode="custom" match="exact">
Jul 29 15:00:47 user nova-compute[70924]:     <model>Nehalem</model>
Jul 29 15:00:47 user nova-compute[70924]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 15:00:47 user nova-compute[70924]:   </cpu>
Jul 29 15:00:47 user nova-compute[70924]:   <devices>
Jul 29 15:00:47 user nova-compute[70924]:     <disk type="file" device="disk">
Jul 29 15:00:47 user nova-compute[70924]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 15:00:47 user nova-compute[70924]:       <source file="/opt/stack/data/nova/instances/1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a/disk"/>
Jul 29 15:00:47 user nova-compute[70924]:       <target dev="vda" bus="virtio"/>
Jul 29 15:00:47 user nova-compute[70924]:     </disk>
Jul 29 15:00:47 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 15:00:47 user nova-compute[70924]:       <mac address="fa:16:3e:98:e1:17"/>
Jul 29 15:00:47 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 15:00:47 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 15:00:47 user nova-compute[70924]:       <target dev="tapb952c385-68"/>
Jul 29 15:00:47 user nova-compute[70924]:     </interface>
Jul 29 15:00:47 user nova-compute[70924]:     <serial type="pty">
Jul 29 15:00:47 user nova-compute[70924]:       <log file="/opt/stack/data/nova/instances/1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a/console.log" append="off"/>
Jul 29 15:00:47 user nova-compute[70924]:     </serial>
Jul 29 15:00:47 user nova-compute[70924]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 15:00:47 user nova-compute[70924]:     <video>
Jul 29 15:00:47 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 15:00:47 user nova-compute[70924]:     </video>
Jul 29 15:00:47 user nova-compute[70924]:     <rng model="virtio">
Jul 29 15:00:47 user nova-compute[70924]:       <backend model="random">/dev/urandom</backend>
Jul 29 15:00:47 user nova-compute[70924]:     </rng>
Jul 29 15:00:47 user nova-compute[70924]:     <controller type="usb" index="0" model="none"/>
Jul 29 15:00:47 user nova-compute[70924]:     <memballoon model="virtio">
Jul 29 15:00:47 user nova-compute[70924]:       <stats period="10"/>
Jul 29 15:00:47 user nova-compute[70924]:     </memballoon>
Jul 29 15:00:47 user nova-compute[70924]:   </devices>
Jul 29 15:00:47 user nova-compute[70924]: </domain>
Jul 29 15:00:47 user nova-compute[70924]:  {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 15:00:47 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T15:00:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-691515032',display_name='tempest-AttachVolumeNegativeTest-server-691515032',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-691515032',id=39,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKcNThJfGgCC0X/qLoz3jQvWXwel/9sE1MjOrF+HqDzAWn0RGOThbp2zXruoqrRm110J21yfgdgrM0ukUEskJEHR9KQRzkyrIqSa1RVWOLrGeRKx3dBgrZ8At/D3U5mH0A==',key_name='tempest-keypair-368297878',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9aadc9385b3b46eebc6e0d81814521af',ramdisk_id='',reservation_id='r-y9qzxt1r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-972203101',owner_user_name='tempest-AttachVolumeNegativeTest-972203101-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T15:00:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='12cb8299e4d24946bc41a86493f4b426',uuid=1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b952c385-68ec-4618-9d28-de94c56d27d9", "address": "fa:16:3e:98:e1:17", "network": {"id": "f80826fa-fada-45b9-b969-fd539fd34fd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-465377443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9aadc9385b3b46eebc6e0d81814521af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb952c385-68", "ovs_interfaceid": "b952c385-68ec-4618-9d28-de94c56d27d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 15:00:47 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Converting VIF {"id": "b952c385-68ec-4618-9d28-de94c56d27d9", "address": "fa:16:3e:98:e1:17", "network": {"id": "f80826fa-fada-45b9-b969-fd539fd34fd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-465377443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9aadc9385b3b46eebc6e0d81814521af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb952c385-68", "ovs_interfaceid": "b952c385-68ec-4618-9d28-de94c56d27d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 15:00:47 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:e1:17,bridge_name='br-int',has_traffic_filtering=True,id=b952c385-68ec-4618-9d28-de94c56d27d9,network=Network(f80826fa-fada-45b9-b969-fd539fd34fd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb952c385-68') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 15:00:47 user nova-compute[70924]: DEBUG os_vif [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:e1:17,bridge_name='br-int',has_traffic_filtering=True,id=b952c385-68ec-4618-9d28-de94c56d27d9,network=Network(f80826fa-fada-45b9-b969-fd539fd34fd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb952c385-68') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 15:00:47 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:00:47 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:00:47 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 15:00:47 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:00:47 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb952c385-68, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:00:47 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb952c385-68, col_values=(('external_ids', {'iface-id': 'b952c385-68ec-4618-9d28-de94c56d27d9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:e1:17', 'vm-uuid': '1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:00:47 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:00:47 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:00:47 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:00:47 user nova-compute[70924]: INFO os_vif [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:e1:17,bridge_name='br-int',has_traffic_filtering=True,id=b952c385-68ec-4618-9d28-de94c56d27d9,network=Network(f80826fa-fada-45b9-b969-fd539fd34fd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb952c385-68')
Jul 29 15:00:47 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 15:00:47 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] No VIF found with MAC fa:16:3e:98:e1:17, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 15:00:47 user nova-compute[70924]: DEBUG nova.network.neutron [req-05155d70-de82-4457-a2d4-ec9140a4845e req-08296ddb-a021-4aaf-aeea-952a044a4f98 service nova] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] Updated VIF entry in instance network info cache for port b952c385-68ec-4618-9d28-de94c56d27d9. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 15:00:47 user nova-compute[70924]: DEBUG nova.network.neutron [req-05155d70-de82-4457-a2d4-ec9140a4845e req-08296ddb-a021-4aaf-aeea-952a044a4f98 service nova] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] Updating instance_info_cache with network_info: [{"id": "b952c385-68ec-4618-9d28-de94c56d27d9", "address": "fa:16:3e:98:e1:17", "network": {"id": "f80826fa-fada-45b9-b969-fd539fd34fd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-465377443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9aadc9385b3b46eebc6e0d81814521af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb952c385-68", "ovs_interfaceid": "b952c385-68ec-4618-9d28-de94c56d27d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:00:47 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-05155d70-de82-4457-a2d4-ec9140a4845e req-08296ddb-a021-4aaf-aeea-952a044a4f98 service nova] Releasing lock "refresh_cache-1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:00:48 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9ab2da98-72c9-4a54-904d-bc76842a0259 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Acquiring lock "b3efaa8e-7138-40be-a271-8a344eac3e48" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:00:48 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9ab2da98-72c9-4a54-904d-bc76842a0259 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "b3efaa8e-7138-40be-a271-8a344eac3e48" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:00:48 user nova-compute[70924]: DEBUG nova.objects.instance [None req-9ab2da98-72c9-4a54-904d-bc76842a0259 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lazy-loading 'flavor' on Instance uuid b3efaa8e-7138-40be-a271-8a344eac3e48 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:00:48 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9ab2da98-72c9-4a54-904d-bc76842a0259 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "b3efaa8e-7138-40be-a271-8a344eac3e48" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:00:48 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9ab2da98-72c9-4a54-904d-bc76842a0259 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Acquiring lock "b3efaa8e-7138-40be-a271-8a344eac3e48" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:00:48 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9ab2da98-72c9-4a54-904d-bc76842a0259 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "b3efaa8e-7138-40be-a271-8a344eac3e48" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:00:48 user nova-compute[70924]: INFO nova.compute.manager [None req-9ab2da98-72c9-4a54-904d-bc76842a0259 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Attaching volume c517614a-d0b1-4c29-88b3-2a386dd10b24 to /dev/vdc
Jul 29 15:00:48 user nova-compute[70924]: DEBUG os_brick.utils [None req-9ab2da98-72c9-4a54-904d-bc76842a0259 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 15:00:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:48 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c4f8fd-192c-4d4c-b70f-158fda844eac]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f2127c4a30d9\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:00:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:48 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29421c3-172c-427d-876e-ecdb8313e2dd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:00:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:48 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b043b7-78a8-445d-bcca-27627790306a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:00:48 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[21cad4a8-ea58-4055-a211-cd8c090c49de]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:00:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-9ab2da98-72c9-4a54-904d-bc76842a0259 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Running cmd (subprocess): nvme version {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-9ab2da98-72c9-4a54-904d-bc76842a0259 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] 'nvme version' failed. Not Retrying. {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 15:00:48 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9ab2da98-72c9-4a54-904d-bc76842a0259 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] nvme not present on system {{(pid=70924) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 15:00:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:48 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 15:00:48 user nova-compute[70924]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 15:00:48 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbae9021-9bf2-4193-b5c9-2773f8cf2824]: (4, '') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:00:48 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-9ab2da98-72c9-4a54-904d-bc76842a0259 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70924) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 15:00:48 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-9ab2da98-72c9-4a54-904d-bc76842a0259 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 15:00:48 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-9ab2da98-72c9-4a54-904d-bc76842a0259 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] LIGHTOS: no hostnqn found. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 15:00:48 user nova-compute[70924]: DEBUG os_brick.utils [None req-9ab2da98-72c9-4a54-904d-bc76842a0259 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f2127c4a30d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 15:00:48 user nova-compute[70924]: DEBUG nova.virt.block_device [None req-9ab2da98-72c9-4a54-904d-bc76842a0259 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Updating existing volume attachment record: 1059c19a-e30a-4ab8-bf54-3e88b7015887 {{(pid=70924) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 15:00:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:00:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:00:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:00:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:00:48 user nova-compute[70924]: DEBUG nova.compute.manager [req-070fa35d-1d52-40b9-b4d7-c0197f3509ca req-3287c201-ba8d-4051-99b2-ce264db35c4c service nova] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] Received event network-vif-plugged-b952c385-68ec-4618-9d28-de94c56d27d9 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:00:48 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-070fa35d-1d52-40b9-b4d7-c0197f3509ca req-3287c201-ba8d-4051-99b2-ce264db35c4c service nova] Acquiring lock "1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:00:48 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-070fa35d-1d52-40b9-b4d7-c0197f3509ca req-3287c201-ba8d-4051-99b2-ce264db35c4c service nova] Lock "1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:00:48 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-070fa35d-1d52-40b9-b4d7-c0197f3509ca req-3287c201-ba8d-4051-99b2-ce264db35c4c service nova] Lock "1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:00:48 user nova-compute[70924]: DEBUG nova.compute.manager [req-070fa35d-1d52-40b9-b4d7-c0197f3509ca req-3287c201-ba8d-4051-99b2-ce264db35c4c service nova] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] No waiting events found dispatching network-vif-plugged-b952c385-68ec-4618-9d28-de94c56d27d9 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:00:48 user nova-compute[70924]: WARNING nova.compute.manager [req-070fa35d-1d52-40b9-b4d7-c0197f3509ca req-3287c201-ba8d-4051-99b2-ce264db35c4c service nova] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] Received unexpected event network-vif-plugged-b952c385-68ec-4618-9d28-de94c56d27d9 for instance with vm_state building and task_state spawning.
Jul 29 15:00:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:00:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:00:49 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:00:50 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642850.8474257, 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 15:00:50 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] VM Resumed (Lifecycle Event)
Jul 29 15:00:50 user nova-compute[70924]: DEBUG nova.compute.manager [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] Instance event wait completed in 0 seconds for  {{(pid=70924) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 15:00:50 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] Guest created on hypervisor {{(pid=70924) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 15:00:50 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] Instance spawned successfully.
Jul 29 15:00:50 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 15:00:50 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:00:50 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 15:00:50 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] Found default for hw_cdrom_bus of ide {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:00:50 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] Found default for hw_disk_bus of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:00:50 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] Found default for hw_input_bus of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:00:50 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] Found default for hw_pointer_model of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:00:50 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] Found default for hw_video_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:00:50 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] Found default for hw_vif_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:00:50 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 15:00:50 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642850.851442, 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 15:00:50 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] VM Started (Lifecycle Event)
Jul 29 15:00:50 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:00:50 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 15:00:50 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 15:00:50 user nova-compute[70924]: DEBUG nova.compute.manager [req-e5bce3c1-b391-4bde-8c15-d1530ea89a21 req-e1aec0cc-40a8-46fa-8118-7d2ac310b62d service nova] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] Received event network-vif-plugged-b952c385-68ec-4618-9d28-de94c56d27d9 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:00:50 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-e5bce3c1-b391-4bde-8c15-d1530ea89a21 req-e1aec0cc-40a8-46fa-8118-7d2ac310b62d service nova] Acquiring lock "1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:00:50 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-e5bce3c1-b391-4bde-8c15-d1530ea89a21 req-e1aec0cc-40a8-46fa-8118-7d2ac310b62d service nova] Lock "1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:00:50 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-e5bce3c1-b391-4bde-8c15-d1530ea89a21 req-e1aec0cc-40a8-46fa-8118-7d2ac310b62d service nova] Lock "1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:00:50 user nova-compute[70924]: DEBUG nova.compute.manager [req-e5bce3c1-b391-4bde-8c15-d1530ea89a21 req-e1aec0cc-40a8-46fa-8118-7d2ac310b62d service nova] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] No waiting events found dispatching network-vif-plugged-b952c385-68ec-4618-9d28-de94c56d27d9 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:00:50 user nova-compute[70924]: WARNING nova.compute.manager [req-e5bce3c1-b391-4bde-8c15-d1530ea89a21 req-e1aec0cc-40a8-46fa-8118-7d2ac310b62d service nova] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] Received unexpected event network-vif-plugged-b952c385-68ec-4618-9d28-de94c56d27d9 for instance with vm_state building and task_state spawning.
Jul 29 15:00:50 user nova-compute[70924]: INFO nova.compute.manager [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] Took 5.84 seconds to spawn the instance on the hypervisor.
Jul 29 15:00:50 user nova-compute[70924]: DEBUG nova.compute.manager [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:00:51 user nova-compute[70924]: INFO nova.compute.manager [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] Took 6.62 seconds to build instance.
Jul 29 15:00:51 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-7cb8fb84-7925-4bdc-929b-4993d3af1bc7 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.718s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:00:52 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:00:54 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:00:56 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:00:56 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ab2da98-72c9-4a54-904d-bc76842a0259 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Calling os-brick to attach iSCSI Volume {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 15:00:56 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab2da98-72c9-4a54-904d-bc76842a0259 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c517614a-d0b1-4c29-88b3-2a386dd10b24'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rEfqJDsN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 15:00:56 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-9ab2da98-72c9-4a54-904d-bc76842a0259 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 15:00:56 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-9ab2da98-72c9-4a54-904d-bc76842a0259 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 15:00:56 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-9ab2da98-72c9-4a54-904d-bc76842a0259 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 15:00:56 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-9ab2da98-72c9-4a54-904d-bc76842a0259 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 15:00:56 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-9ab2da98-72c9-4a54-904d-bc76842a0259 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c517614a-d0b1-4c29-88b3-2a386dd10b24" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 15:00:56 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-9ab2da98-72c9-4a54-904d-bc76842a0259 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c517614a-d0b1-4c29-88b3-2a386dd10b24" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 15:00:56 user nova-compute[70924]: INFO os_brick.initiator.connectors.iscsi [None req-9ab2da98-72c9-4a54-904d-bc76842a0259 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 15:00:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c517614a-d0b1-4c29-88b3-2a386dd10b24 -p 172.16.0.220:3260 {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c517614a-d0b1-4c29-88b3-2a386dd10b24 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:56 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7b4319-2910-4005-9979-1cd3e1017357]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:00:56 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab2da98-72c9-4a54-904d-bc76842a0259 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 15:00:56 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:00:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c517614a-d0b1-4c29-88b3-2a386dd10b24 -p 172.16.0.220:3260 --interface default --op new {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c517614a-d0b1-4c29-88b3-2a386dd10b24 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:56 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[02fb80e1-8043-403d-ba1f-3d8c368e16d3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c517614a-d0b1-4c29-88b3-2a386dd10b24] added\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:00:56 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab2da98-72c9-4a54-904d-bc76842a0259 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c517614a-d0b1-4c29-88b3-2a386dd10b24] added
Jul 29 15:00:56 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:00:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c517614a-d0b1-4c29-88b3-2a386dd10b24 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c517614a-d0b1-4c29-88b3-2a386dd10b24 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:56 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9811c832-31d5-4cc1-a660-2a03aab41aab]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:00:56 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab2da98-72c9-4a54-904d-bc76842a0259 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:00:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c517614a-d0b1-4c29-88b3-2a386dd10b24 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c517614a-d0b1-4c29-88b3-2a386dd10b24 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:56 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b0c2d9-44ff-4fd1-b9d2-b6de9482cf15]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:00:56 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab2da98-72c9-4a54-904d-bc76842a0259 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:00:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c517614a-d0b1-4c29-88b3-2a386dd10b24 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rEfqJDsN {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c517614a-d0b1-4c29-88b3-2a386dd10b24 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rEfqJDsN" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:56 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2106bfc6-4f1a-455c-acb3-9f83712bd1a0]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:00:56 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab2da98-72c9-4a54-904d-bc76842a0259 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rEfqJDsN'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:00:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c517614a-d0b1-4c29-88b3-2a386dd10b24 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c517614a-d0b1-4c29-88b3-2a386dd10b24 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:56 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee6ecc0-ec27-4cfc-8cc2-b6867dd2d920]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:00:56 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab2da98-72c9-4a54-904d-bc76842a0259 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:00:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:56 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[079b5c1d-7a8d-4ba8-9f09-99cdf593030e]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2788765e-da70-4875-b1bd-b9ab878d93a3 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:00:56 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab2da98-72c9-4a54-904d-bc76842a0259 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef (non-flash)
Jul 29 15:00:56 user nova-compute[70924]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 (non-flash)
Jul 29 15:00:56 user nova-compute[70924]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f (non-flash)
Jul 29 15:00:56 user nova-compute[70924]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2788765e-da70-4875-b1bd-b9ab878d93a3 (non-flash)
Jul 29 15:00:56 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 15:00:56 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab2da98-72c9-4a54-904d-bc76842a0259 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef (non-flash)
Jul 29 15:00:56 user nova-compute[70924]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 (non-flash)
Jul 29 15:00:56 user nova-compute[70924]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f (non-flash)
Jul 29 15:00:56 user nova-compute[70924]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2788765e-da70-4875-b1bd-b9ab878d93a3 (non-flash)
Jul 29 15:00:56 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 15:00:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c517614a-d0b1-4c29-88b3-2a386dd10b24 -p 172.16.0.220:3260 --login {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c517614a-d0b1-4c29-88b3-2a386dd10b24 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:56 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a81f3e2-48dd-4b61-baf0-f58126fb799b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c517614a-d0b1-4c29-88b3-2a386dd10b24, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c517614a-d0b1-4c29-88b3-2a386dd10b24, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:00:56 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab2da98-72c9-4a54-904d-bc76842a0259 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c517614a-d0b1-4c29-88b3-2a386dd10b24, portal: 172.16.0.220,3260]
Jul 29 15:00:56 user nova-compute[70924]: Login to [iface: default, target: iqn.2010-10.org.openstack:c517614a-d0b1-4c29-88b3-2a386dd10b24, portal: 172.16.0.220,3260] successful.
Jul 29 15:00:56 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:00:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c517614a-d0b1-4c29-88b3-2a386dd10b24 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c517614a-d0b1-4c29-88b3-2a386dd10b24 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:56 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d47d28-1529-4d53-80c0-31bd43585269]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:00:56 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab2da98-72c9-4a54-904d-bc76842a0259 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:00:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:56 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[027589ed-0558-4306-bf98-c4daa4dc96fd]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2788765e-da70-4875-b1bd-b9ab878d93a3 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c517614a-d0b1-4c29-88b3-2a386dd10b24 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:00:56 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab2da98-72c9-4a54-904d-bc76842a0259 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef (non-flash)
Jul 29 15:00:56 user nova-compute[70924]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 (non-flash)
Jul 29 15:00:56 user nova-compute[70924]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f (non-flash)
Jul 29 15:00:56 user nova-compute[70924]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2788765e-da70-4875-b1bd-b9ab878d93a3 (non-flash)
Jul 29 15:00:56 user nova-compute[70924]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c517614a-d0b1-4c29-88b3-2a386dd10b24 (non-flash)
Jul 29 15:00:56 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 15:00:56 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab2da98-72c9-4a54-904d-bc76842a0259 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef (non-flash)
Jul 29 15:00:56 user nova-compute[70924]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 (non-flash)
Jul 29 15:00:56 user nova-compute[70924]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f (non-flash)
Jul 29 15:00:56 user nova-compute[70924]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2788765e-da70-4875-b1bd-b9ab878d93a3 (non-flash)
Jul 29 15:00:56 user nova-compute[70924]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c517614a-d0b1-4c29-88b3-2a386dd10b24 (non-flash)
Jul 29 15:00:56 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 15:00:56 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-9ab2da98-72c9-4a54-904d-bc76842a0259 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c517614a-d0b1-4c29-88b3-2a386dd10b24" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 15:00:56 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab2da98-72c9-4a54-904d-bc76842a0259 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Connected to 172.16.0.220:3260 {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 15:00:56 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-9ab2da98-72c9-4a54-904d-bc76842a0259 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] HCTL ('37', '-', '-', 0) found on session 44 with lun 0 {{(pid=70924) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 15:00:56 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-9ab2da98-72c9-4a54-904d-bc76842a0259 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=70924) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 15:00:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:00:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:00:56 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5231a9-4221-4540-add0-1eaf11625ae6]: (4, ('- - 0', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:00:56 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-9ab2da98-72c9-4a54-904d-bc76842a0259 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Searching for a device in session 44 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 15:00:56 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab2da98-72c9-4a54-904d-bc76842a0259 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rEfqJDsN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 15:00:57 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:00:57 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-9ab2da98-72c9-4a54-904d-bc76842a0259 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 15:00:57 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab2da98-72c9-4a54-904d-bc76842a0259 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '26533646337383539', 'path': '/dev/sdf'} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 15:00:57 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ab2da98-72c9-4a54-904d-bc76842a0259 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26533646337383539', 'path': '/dev/sdf'} {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 15:00:57 user nova-compute[70924]: DEBUG nova.objects.instance [None req-9ab2da98-72c9-4a54-904d-bc76842a0259 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lazy-loading 'flavor' on Instance uuid b3efaa8e-7138-40be-a271-8a344eac3e48 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:00:57 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-9ab2da98-72c9-4a54-904d-bc76842a0259 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] attach device xml: <disk type="block" device="disk">
Jul 29 15:00:57 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 15:00:57 user nova-compute[70924]:   <source dev="/dev/sdf"/>
Jul 29 15:00:57 user nova-compute[70924]:   <target dev="vdc" bus="virtio"/>
Jul 29 15:00:57 user nova-compute[70924]:   <serial>c517614a-d0b1-4c29-88b3-2a386dd10b24</serial>
Jul 29 15:00:57 user nova-compute[70924]: </disk>
Jul 29 15:00:57 user nova-compute[70924]:  {{(pid=70924) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 29 15:00:58 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-9ab2da98-72c9-4a54-904d-bc76842a0259 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 15:00:58 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-9ab2da98-72c9-4a54-904d-bc76842a0259 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 15:00:58 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-9ab2da98-72c9-4a54-904d-bc76842a0259 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] No BDM found with device name vdc, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 15:00:58 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-9ab2da98-72c9-4a54-904d-bc76842a0259 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] No VIF found with MAC fa:16:3e:9c:88:44, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 15:00:58 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9ab2da98-72c9-4a54-904d-bc76842a0259 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "b3efaa8e-7138-40be-a271-8a344eac3e48" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.944s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:00:58 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:00:59 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:00:59 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:00:59 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a34a6620-9fb4-4e87-a388-78c52f7ff2ba tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Acquiring lock "b3efaa8e-7138-40be-a271-8a344eac3e48" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:00:59 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a34a6620-9fb4-4e87-a388-78c52f7ff2ba tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "b3efaa8e-7138-40be-a271-8a344eac3e48" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:00:59 user nova-compute[70924]: INFO nova.compute.manager [None req-a34a6620-9fb4-4e87-a388-78c52f7ff2ba tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Detaching volume 2788765e-da70-4875-b1bd-b9ab878d93a3
Jul 29 15:00:59 user nova-compute[70924]: INFO nova.virt.block_device [None req-a34a6620-9fb4-4e87-a388-78c52f7ff2ba tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Attempting to driver detach volume 2788765e-da70-4875-b1bd-b9ab878d93a3 from mountpoint /dev/vdb
Jul 29 15:00:59 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-a34a6620-9fb4-4e87-a388-78c52f7ff2ba tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Attempting to detach device vdb from instance b3efaa8e-7138-40be-a271-8a344eac3e48 from the persistent domain config. {{(pid=70924) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 29 15:00:59 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-a34a6620-9fb4-4e87-a388-78c52f7ff2ba tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 15:00:59 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 15:00:59 user nova-compute[70924]:   <source dev="/dev/sde"/>
Jul 29 15:00:59 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 15:00:59 user nova-compute[70924]:   <serial>2788765e-da70-4875-b1bd-b9ab878d93a3</serial>
Jul 29 15:00:59 user nova-compute[70924]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 15:00:59 user nova-compute[70924]: </disk>
Jul 29 15:00:59 user nova-compute[70924]:  {{(pid=70924) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 15:00:59 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-a34a6620-9fb4-4e87-a388-78c52f7ff2ba tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Successfully detached device vdb from instance b3efaa8e-7138-40be-a271-8a344eac3e48 from the persistent domain config.
Jul 29 15:00:59 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-a34a6620-9fb4-4e87-a388-78c52f7ff2ba tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b3efaa8e-7138-40be-a271-8a344eac3e48 from the live domain config. {{(pid=70924) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 29 15:00:59 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-a34a6620-9fb4-4e87-a388-78c52f7ff2ba tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 15:00:59 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 15:00:59 user nova-compute[70924]:   <source dev="/dev/sde"/>
Jul 29 15:00:59 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 15:00:59 user nova-compute[70924]:   <serial>2788765e-da70-4875-b1bd-b9ab878d93a3</serial>
Jul 29 15:00:59 user nova-compute[70924]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 15:00:59 user nova-compute[70924]: </disk>
Jul 29 15:00:59 user nova-compute[70924]:  {{(pid=70924) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 15:01:00 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Received event <DeviceRemovedEvent: 1690642860.0162532, b3efaa8e-7138-40be-a271-8a344eac3e48 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70924) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 29 15:01:00 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-a34a6620-9fb4-4e87-a388-78c52f7ff2ba tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b3efaa8e-7138-40be-a271-8a344eac3e48 {{(pid=70924) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 29 15:01:00 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-a34a6620-9fb4-4e87-a388-78c52f7ff2ba tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Successfully detached device vdb from instance b3efaa8e-7138-40be-a271-8a344eac3e48 from the live domain config.
Jul 29 15:01:00 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a34a6620-9fb4-4e87-a388-78c52f7ff2ba tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] calling os-brick to detach iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 15:01:00 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34a6620-9fb4-4e87-a388-78c52f7ff2ba tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, {'target_iqns': ['iqn.2010-10.org.openstack:2788765e-da70-4875-b1bd-b9ab878d93a3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LZCpmhaY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 15:01:00 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-a34a6620-9fb4-4e87-a388-78c52f7ff2ba tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 15:01:00 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-a34a6620-9fb4-4e87-a388-78c52f7ff2ba tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 15:01:00 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-a34a6620-9fb4-4e87-a388-78c52f7ff2ba tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 15:01:00 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34a6620-9fb4-4e87-a388-78c52f7ff2ba tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2788765e-da70-4875-b1bd-b9ab878d93a3', 0)] {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 15:01:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:01:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:01:00 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f287f00-1b71-4717-ab89-cddcdb101bf8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2788765e-da70-4875-b1bd-b9ab878d93a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c517614a-d0b1-4c29-88b3-2a386dd10b24\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:01:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:01:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:01:00 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed847c31-60d0-4b78-bbb8-b3f9e019ad1a]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2788765e-da70-4875-b1bd-b9ab878d93a3 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c517614a-d0b1-4c29-88b3-2a386dd10b24 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:01:00 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34a6620-9fb4-4e87-a388-78c52f7ff2ba tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef (non-flash)
Jul 29 15:01:00 user nova-compute[70924]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 (non-flash)
Jul 29 15:01:00 user nova-compute[70924]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f (non-flash)
Jul 29 15:01:00 user nova-compute[70924]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2788765e-da70-4875-b1bd-b9ab878d93a3 (non-flash)
Jul 29 15:01:00 user nova-compute[70924]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c517614a-d0b1-4c29-88b3-2a386dd10b24 (non-flash)
Jul 29 15:01:00 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 15:01:00 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34a6620-9fb4-4e87-a388-78c52f7ff2ba tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef (non-flash)
Jul 29 15:01:00 user nova-compute[70924]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 (non-flash)
Jul 29 15:01:00 user nova-compute[70924]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f (non-flash)
Jul 29 15:01:00 user nova-compute[70924]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2788765e-da70-4875-b1bd-b9ab878d93a3 (non-flash)
Jul 29 15:01:00 user nova-compute[70924]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c517614a-d0b1-4c29-88b3-2a386dd10b24 (non-flash)
Jul 29 15:01:00 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 15:01:00 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34a6620-9fb4-4e87-a388-78c52f7ff2ba tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feedc448430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2788765e-da70-4875-b1bd-b9ab878d93a3'): ({'sde'}, set())}) {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 15:01:00 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-a34a6620-9fb4-4e87-a388-78c52f7ff2ba tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Removing single pathed devices sde {{(pid=70924) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 15:01:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:01:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:01:00 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1ca754-51fa-46cd-9b8a-6295a61574db]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:01:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:01:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:01:00 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a5ac479-b0e9-451b-b1fe-c663775ffccd]: (4, ('ok\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:01:00 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-a34a6620-9fb4-4e87-a388-78c52f7ff2ba tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Flushing IO for device /dev/sde {{(pid=70924) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 15:01:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:01:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:01:00 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[df6847bd-6077-4a4c-98ff-bbb04f6b26ac]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:01:00 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-a34a6620-9fb4-4e87-a388-78c52f7ff2ba tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70924) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 15:01:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:01:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:01:00 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd64b514-6929-47ff-9b3e-3fca7189679b]: (4, ('1', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:01:00 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-a34a6620-9fb4-4e87-a388-78c52f7ff2ba tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 15:01:00 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-a34a6620-9fb4-4e87-a388-78c52f7ff2ba tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] SCSI volumes sde have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 15:01:00 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34a6620-9fb4-4e87-a388-78c52f7ff2ba tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2788765e-da70-4875-b1bd-b9ab878d93a3')] {{(pid=70924) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 15:01:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2788765e-da70-4875-b1bd-b9ab878d93a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:01:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2788765e-da70-4875-b1bd-b9ab878d93a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:01:00 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0705344-5d25-4a6f-ac32-63e2a1f512c8]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:01:00 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34a6620-9fb4-4e87-a388-78c52f7ff2ba tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:01:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2788765e-da70-4875-b1bd-b9ab878d93a3 -p 172.16.0.220:3260 --logout {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:01:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2788765e-da70-4875-b1bd-b9ab878d93a3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:01:00 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ebc943-a340-4946-82e4-911b79d0921d]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:2788765e-da70-4875-b1bd-b9ab878d93a3, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:2788765e-da70-4875-b1bd-b9ab878d93a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:01:00 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34a6620-9fb4-4e87-a388-78c52f7ff2ba tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:2788765e-da70-4875-b1bd-b9ab878d93a3, portal: 172.16.0.220,3260]
Jul 29 15:01:00 user nova-compute[70924]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:2788765e-da70-4875-b1bd-b9ab878d93a3, portal: 172.16.0.220,3260] successful.
Jul 29 15:01:00 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:01:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2788765e-da70-4875-b1bd-b9ab878d93a3 -p 172.16.0.220:3260 --op delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:01:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2788765e-da70-4875-b1bd-b9ab878d93a3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:01:00 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff6e054-89a2-43ca-bdae-fe56701057fc]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:01:00 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34a6620-9fb4-4e87-a388-78c52f7ff2ba tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:01:00 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-a34a6620-9fb4-4e87-a388-78c52f7ff2ba tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 15:01:00 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34a6620-9fb4-4e87-a388-78c52f7ff2ba tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] <== disconnect_volume: return (293ms) None {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 15:01:00 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a34a6620-9fb4-4e87-a388-78c52f7ff2ba tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Disconnected iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 15:01:01 user nova-compute[70924]: DEBUG nova.objects.instance [None req-a34a6620-9fb4-4e87-a388-78c52f7ff2ba tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lazy-loading 'flavor' on Instance uuid b3efaa8e-7138-40be-a271-8a344eac3e48 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:01:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a34a6620-9fb4-4e87-a388-78c52f7ff2ba tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "b3efaa8e-7138-40be-a271-8a344eac3e48" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.659s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:01:01 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:01:01 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:01:01 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:01:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:01:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:01:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:01:01 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Auditing locally available compute resources for user (node: user) {{(pid=70924) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 15:01:01 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f7eeda-a001-4c35-abeb-e459d701bd93/disk.rescue --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:01:01 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f7eeda-a001-4c35-abeb-e459d701bd93/disk.rescue --force-share --output=json" returned: 0 in 0.149s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:01:01 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f7eeda-a001-4c35-abeb-e459d701bd93/disk.rescue --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:01:01 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f7eeda-a001-4c35-abeb-e459d701bd93/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:01:01 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /opt/stack/data/nova/instances/f3f7eeda-a001-4c35-abeb-e459d701bd93/disk (vdb) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 15:01:01 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5865be57-b5f2-4132-bc71-cc41bfe9f897/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:01:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5865be57-b5f2-4132-bc71-cc41bfe9f897/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:01:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5865be57-b5f2-4132-bc71-cc41bfe9f897/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:01:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-c476e09b-c59d-40d7-8f91-26480fbaa617 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Acquiring lock "b3efaa8e-7138-40be-a271-8a344eac3e48" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:01:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-c476e09b-c59d-40d7-8f91-26480fbaa617 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "b3efaa8e-7138-40be-a271-8a344eac3e48" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:01:02 user nova-compute[70924]: INFO nova.compute.manager [None req-c476e09b-c59d-40d7-8f91-26480fbaa617 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Detaching volume c517614a-d0b1-4c29-88b3-2a386dd10b24
Jul 29 15:01:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5865be57-b5f2-4132-bc71-cc41bfe9f897/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:01:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:01:02 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:01:02 user nova-compute[70924]: INFO nova.virt.block_device [None req-c476e09b-c59d-40d7-8f91-26480fbaa617 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Attempting to driver detach volume c517614a-d0b1-4c29-88b3-2a386dd10b24 from mountpoint /dev/vdc
Jul 29 15:01:02 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-c476e09b-c59d-40d7-8f91-26480fbaa617 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Attempting to detach device vdc from instance b3efaa8e-7138-40be-a271-8a344eac3e48 from the persistent domain config. {{(pid=70924) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 29 15:01:02 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-c476e09b-c59d-40d7-8f91-26480fbaa617 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 15:01:02 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 15:01:02 user nova-compute[70924]:   <source dev="/dev/sdf"/>
Jul 29 15:01:02 user nova-compute[70924]:   <target dev="vdc" bus="virtio"/>
Jul 29 15:01:02 user nova-compute[70924]:   <serial>c517614a-d0b1-4c29-88b3-2a386dd10b24</serial>
Jul 29 15:01:02 user nova-compute[70924]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 29 15:01:02 user nova-compute[70924]: </disk>
Jul 29 15:01:02 user nova-compute[70924]:  {{(pid=70924) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 15:01:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:01:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:01:02 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-c476e09b-c59d-40d7-8f91-26480fbaa617 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Successfully detached device vdc from instance b3efaa8e-7138-40be-a271-8a344eac3e48 from the persistent domain config.
Jul 29 15:01:02 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-c476e09b-c59d-40d7-8f91-26480fbaa617 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance b3efaa8e-7138-40be-a271-8a344eac3e48 from the live domain config. {{(pid=70924) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 29 15:01:02 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-c476e09b-c59d-40d7-8f91-26480fbaa617 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 15:01:02 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 15:01:02 user nova-compute[70924]:   <source dev="/dev/sdf"/>
Jul 29 15:01:02 user nova-compute[70924]:   <target dev="vdc" bus="virtio"/>
Jul 29 15:01:02 user nova-compute[70924]:   <serial>c517614a-d0b1-4c29-88b3-2a386dd10b24</serial>
Jul 29 15:01:02 user nova-compute[70924]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 29 15:01:02 user nova-compute[70924]: </disk>
Jul 29 15:01:02 user nova-compute[70924]:  {{(pid=70924) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 15:01:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:01:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3efaa8e-7138-40be-a271-8a344eac3e48/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:01:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3efaa8e-7138-40be-a271-8a344eac3e48/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:01:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3efaa8e-7138-40be-a271-8a344eac3e48/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:01:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a2a6f9bd-0b75-4b21-af36-ee85db6363e9 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Acquiring lock "14f9924f-8d4d-4193-927b-02cfb0f5f57a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:01:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a2a6f9bd-0b75-4b21-af36-ee85db6363e9 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "14f9924f-8d4d-4193-927b-02cfb0f5f57a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:01:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a2a6f9bd-0b75-4b21-af36-ee85db6363e9 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Acquiring lock "14f9924f-8d4d-4193-927b-02cfb0f5f57a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:01:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a2a6f9bd-0b75-4b21-af36-ee85db6363e9 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "14f9924f-8d4d-4193-927b-02cfb0f5f57a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:01:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a2a6f9bd-0b75-4b21-af36-ee85db6363e9 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "14f9924f-8d4d-4193-927b-02cfb0f5f57a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:01:02 user nova-compute[70924]: INFO nova.compute.manager [None req-a2a6f9bd-0b75-4b21-af36-ee85db6363e9 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] Terminating instance
Jul 29 15:01:02 user nova-compute[70924]: DEBUG nova.compute.manager [None req-a2a6f9bd-0b75-4b21-af36-ee85db6363e9 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] Start destroying the instance on the hypervisor. {{(pid=70924) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 15:01:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3efaa8e-7138-40be-a271-8a344eac3e48/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:01:02 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 15:01:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Received event <DeviceRemovedEvent: 1690642863.0611238, b3efaa8e-7138-40be-a271-8a344eac3e48 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=70924) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-c476e09b-c59d-40d7-8f91-26480fbaa617 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance b3efaa8e-7138-40be-a271-8a344eac3e48 {{(pid=70924) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 29 15:01:03 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-c476e09b-c59d-40d7-8f91-26480fbaa617 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Successfully detached device vdc from instance b3efaa8e-7138-40be-a271-8a344eac3e48 from the live domain config.
Jul 29 15:01:03 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c476e09b-c59d-40d7-8f91-26480fbaa617 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] calling os-brick to detach iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-c476e09b-c59d-40d7-8f91-26480fbaa617 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, {'target_iqns': ['iqn.2010-10.org.openstack:c517614a-d0b1-4c29-88b3-2a386dd10b24'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rEfqJDsN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 15:01:03 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-c476e09b-c59d-40d7-8f91-26480fbaa617 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 15:01:03 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-c476e09b-c59d-40d7-8f91-26480fbaa617 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-c476e09b-c59d-40d7-8f91-26480fbaa617 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.009s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-c476e09b-c59d-40d7-8f91-26480fbaa617 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c517614a-d0b1-4c29-88b3-2a386dd10b24', 0)] {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[656f4945-acd2-4ce2-ac4a-54d0ecc7ae33]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c517614a-d0b1-4c29-88b3-2a386dd10b24\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2caddd-b1ff-4f0b-b3dd-0b58c3980364]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c517614a-d0b1-4c29-88b3-2a386dd10b24 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-c476e09b-c59d-40d7-8f91-26480fbaa617 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef (non-flash)
Jul 29 15:01:03 user nova-compute[70924]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 (non-flash)
Jul 29 15:01:03 user nova-compute[70924]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f (non-flash)
Jul 29 15:01:03 user nova-compute[70924]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c517614a-d0b1-4c29-88b3-2a386dd10b24 (non-flash)
Jul 29 15:01:03 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-c476e09b-c59d-40d7-8f91-26480fbaa617 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef (non-flash)
Jul 29 15:01:03 user nova-compute[70924]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 (non-flash)
Jul 29 15:01:03 user nova-compute[70924]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f (non-flash)
Jul 29 15:01:03 user nova-compute[70924]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c517614a-d0b1-4c29-88b3-2a386dd10b24 (non-flash)
Jul 29 15:01:03 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-c476e09b-c59d-40d7-8f91-26480fbaa617 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feedc34f7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c517614a-d0b1-4c29-88b3-2a386dd10b24'): ({'sdf'}, set())}) {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-c476e09b-c59d-40d7-8f91-26480fbaa617 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Removing single pathed devices sdf {{(pid=70924) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[65dc8077-97c7-4103-b318-6afd24360547]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG nova.compute.manager [req-ebac4052-861a-44bb-a4f7-0c424527fc6f req-b88704e0-5177-4b83-b088-5e66a4263c29 service nova] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] Received event network-vif-unplugged-078ca632-af45-4d44-8e01-7cef910a77ee {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-ebac4052-861a-44bb-a4f7-0c424527fc6f req-b88704e0-5177-4b83-b088-5e66a4263c29 service nova] Acquiring lock "14f9924f-8d4d-4193-927b-02cfb0f5f57a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-ebac4052-861a-44bb-a4f7-0c424527fc6f req-b88704e0-5177-4b83-b088-5e66a4263c29 service nova] Lock "14f9924f-8d4d-4193-927b-02cfb0f5f57a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-ebac4052-861a-44bb-a4f7-0c424527fc6f req-b88704e0-5177-4b83-b088-5e66a4263c29 service nova] Lock "14f9924f-8d4d-4193-927b-02cfb0f5f57a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG nova.compute.manager [req-ebac4052-861a-44bb-a4f7-0c424527fc6f req-b88704e0-5177-4b83-b088-5e66a4263c29 service nova] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] No waiting events found dispatching network-vif-unplugged-078ca632-af45-4d44-8e01-7cef910a77ee {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG nova.compute.manager [req-ebac4052-861a-44bb-a4f7-0c424527fc6f req-b88704e0-5177-4b83-b088-5e66a4263c29 service nova] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] Received event network-vif-unplugged-078ca632-af45-4d44-8e01-7cef910a77ee for instance with task_state deleting. {{(pid=70924) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6021c02b-1451-4bd1-b9e9-864e92c60699]: (4, ('ok\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-c476e09b-c59d-40d7-8f91-26480fbaa617 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Flushing IO for device /dev/sdf {{(pid=70924) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb904ad-df60-45b2-b770-49fec5720fde]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-c476e09b-c59d-40d7-8f91-26480fbaa617 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=70924) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.050s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff7f564f-780b-4761-bc36-d6de0a2668a7]: (4, ('1', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-c476e09b-c59d-40d7-8f91-26480fbaa617 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-c476e09b-c59d-40d7-8f91-26480fbaa617 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] SCSI volumes sdf have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-c476e09b-c59d-40d7-8f91-26480fbaa617 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c517614a-d0b1-4c29-88b3-2a386dd10b24')] {{(pid=70924) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c517614a-d0b1-4c29-88b3-2a386dd10b24 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c517614a-d0b1-4c29-88b3-2a386dd10b24 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[97445785-cc89-4ec5-9c87-486eea9ff010]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-c476e09b-c59d-40d7-8f91-26480fbaa617 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c517614a-d0b1-4c29-88b3-2a386dd10b24 -p 172.16.0.220:3260 --logout {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c517614a-d0b1-4c29-88b3-2a386dd10b24 -p 172.16.0.220:3260 --logout" returned: 0 in 0.094s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c87c4c4-8b20-4926-b823-f1ea87601ada]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:c517614a-d0b1-4c29-88b3-2a386dd10b24, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:c517614a-d0b1-4c29-88b3-2a386dd10b24, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-c476e09b-c59d-40d7-8f91-26480fbaa617 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:c517614a-d0b1-4c29-88b3-2a386dd10b24, portal: 172.16.0.220,3260]
Jul 29 15:01:03 user nova-compute[70924]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:c517614a-d0b1-4c29-88b3-2a386dd10b24, portal: 172.16.0.220,3260] successful.
Jul 29 15:01:03 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c517614a-d0b1-4c29-88b3-2a386dd10b24 -p 172.16.0.220:3260 --op delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c517614a-d0b1-4c29-88b3-2a386dd10b24 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[060c24f2-2326-4e7e-ab0d-225ff5121f6a]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-c476e09b-c59d-40d7-8f91-26480fbaa617 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-c476e09b-c59d-40d7-8f91-26480fbaa617 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.388s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-c476e09b-c59d-40d7-8f91-26480fbaa617 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] <== disconnect_volume: return (398ms) None {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c476e09b-c59d-40d7-8f91-26480fbaa617 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Disconnected iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 15:01:03 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] Instance destroyed successfully.
Jul 29 15:01:03 user nova-compute[70924]: DEBUG nova.objects.instance [None req-a2a6f9bd-0b75-4b21-af36-ee85db6363e9 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lazy-loading 'resources' on Instance uuid 14f9924f-8d4d-4193-927b-02cfb0f5f57a {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47104e57-c193-4a85-a2cf-677f0debe373/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-a2a6f9bd-0b75-4b21-af36-ee85db6363e9 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:59:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-279085785',display_name='tempest-TestVolumeBootPattern-server-279085785',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-279085785',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:59:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='99a974cbbf734f51897c3e632ae9e45f',ramdisk_id='',reservation_id='r-8w0q9jfv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1030839740',owner_user_name='tempest-TestVolumeBootPattern-1030839740-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:59:32Z,user_data=None,user_id='da204646e8f84693ad470ed1d3eadd7c',uuid=14f9924f-8d4d-4193-927b-02cfb0f5f57a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "078ca632-af45-4d44-8e01-7cef910a77ee", "address": "fa:16:3e:1b:a2:ac", "network": {"id": "c19ed38b-2acd-421a-9e4b-f60df3db2f1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1812407562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a974cbbf734f51897c3e632ae9e45f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap078ca632-af", "ovs_interfaceid": "078ca632-af45-4d44-8e01-7cef910a77ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-a2a6f9bd-0b75-4b21-af36-ee85db6363e9 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Converting VIF {"id": "078ca632-af45-4d44-8e01-7cef910a77ee", "address": "fa:16:3e:1b:a2:ac", "network": {"id": "c19ed38b-2acd-421a-9e4b-f60df3db2f1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1812407562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a974cbbf734f51897c3e632ae9e45f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap078ca632-af", "ovs_interfaceid": "078ca632-af45-4d44-8e01-7cef910a77ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-a2a6f9bd-0b75-4b21-af36-ee85db6363e9 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:a2:ac,bridge_name='br-int',has_traffic_filtering=True,id=078ca632-af45-4d44-8e01-7cef910a77ee,network=Network(c19ed38b-2acd-421a-9e4b-f60df3db2f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap078ca632-af') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG os_vif [None req-a2a6f9bd-0b75-4b21-af36-ee85db6363e9 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:a2:ac,bridge_name='br-int',has_traffic_filtering=True,id=078ca632-af45-4d44-8e01-7cef910a77ee,network=Network(c19ed38b-2acd-421a-9e4b-f60df3db2f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap078ca632-af') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap078ca632-af, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:01:03 user nova-compute[70924]: INFO os_vif [None req-a2a6f9bd-0b75-4b21-af36-ee85db6363e9 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:a2:ac,bridge_name='br-int',has_traffic_filtering=True,id=078ca632-af45-4d44-8e01-7cef910a77ee,network=Network(c19ed38b-2acd-421a-9e4b-f60df3db2f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap078ca632-af')
Jul 29 15:01:03 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2a6f9bd-0b75-4b21-af36-ee85db6363e9 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] calling os-brick to detach iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2a6f9bd-0b75-4b21-af36-ee85db6363e9 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, {'target_iqns': ['iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CzIjaLDt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 15:01:03 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-a2a6f9bd-0b75-4b21-af36-ee85db6363e9 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 15:01:03 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-a2a6f9bd-0b75-4b21-af36-ee85db6363e9 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-a2a6f9bd-0b75-4b21-af36-ee85db6363e9 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2a6f9bd-0b75-4b21-af36-ee85db6363e9 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef', 0)] {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ac2e00-e899-461f-b0a7-beda1d319ace]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[16680b95-998a-4286-a7a6-88bf496bb2d0]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2a6f9bd-0b75-4b21-af36-ee85db6363e9 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef (non-flash)
Jul 29 15:01:03 user nova-compute[70924]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 (non-flash)
Jul 29 15:01:03 user nova-compute[70924]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f (non-flash)
Jul 29 15:01:03 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2a6f9bd-0b75-4b21-af36-ee85db6363e9 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef (non-flash)
Jul 29 15:01:03 user nova-compute[70924]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 (non-flash)
Jul 29 15:01:03 user nova-compute[70924]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f (non-flash)
Jul 29 15:01:03 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2a6f9bd-0b75-4b21-af36-ee85db6363e9 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feedc3b0160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef'): ({'sdc'}, set())}) {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-a2a6f9bd-0b75-4b21-af36-ee85db6363e9 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Removing single pathed devices sdc {{(pid=70924) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47104e57-c193-4a85-a2cf-677f0debe373/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47104e57-c193-4a85-a2cf-677f0debe373/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[19995b80-c0c6-479f-9136-90fa36edecf6]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9979c02c-08d4-42e9-9abb-74b79d33edd6]: (4, ('ok\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-a2a6f9bd-0b75-4b21-af36-ee85db6363e9 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Flushing IO for device /dev/sdc {{(pid=70924) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc5ae0b2-c9e2-40be-8be0-2bb90d6c600b]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-a2a6f9bd-0b75-4b21-af36-ee85db6363e9 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70924) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d44a5f-fc82-47d1-a383-8b8edeba00c8]: (4, ('1', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-a2a6f9bd-0b75-4b21-af36-ee85db6363e9 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 15:01:03 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-a2a6f9bd-0b75-4b21-af36-ee85db6363e9 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] SCSI volumes sdc have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 15:01:04 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2a6f9bd-0b75-4b21-af36-ee85db6363e9 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef')] {{(pid=70924) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 15:01:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:01:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47104e57-c193-4a85-a2cf-677f0debe373/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:01:04 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 15:01:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk.rescue --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:01:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:01:04 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f5f1178-44d5-4bdd-9bf7-c4a88e84e316]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:01:04 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2a6f9bd-0b75-4b21-af36-ee85db6363e9 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:01:04 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:01:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef -p 172.16.0.220:3260 --logout {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:01:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:01:04 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7219ec8-3e03-42c9-92bf-8248c89876be]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:01:04 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2a6f9bd-0b75-4b21-af36-ee85db6363e9 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef, portal: 172.16.0.220,3260]
Jul 29 15:01:04 user nova-compute[70924]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef, portal: 172.16.0.220,3260] successful.
Jul 29 15:01:04 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:01:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef -p 172.16.0.220:3260 --op delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:01:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab9daafc-459b-4a5f-8230-13af56e2d1ef -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:01:04 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[160a64a0-d9c4-4754-a6a9-90d7b45d4a9a]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:01:04 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2a6f9bd-0b75-4b21-af36-ee85db6363e9 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:01:04 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-a2a6f9bd-0b75-4b21-af36-ee85db6363e9 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 15:01:04 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2a6f9bd-0b75-4b21-af36-ee85db6363e9 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] <== disconnect_volume: return (367ms) None {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 15:01:04 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2a6f9bd-0b75-4b21-af36-ee85db6363e9 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] Disconnected iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 15:01:04 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-a2a6f9bd-0b75-4b21-af36-ee85db6363e9 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] Deleting instance files /opt/stack/data/nova/instances/14f9924f-8d4d-4193-927b-02cfb0f5f57a_del
Jul 29 15:01:04 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-a2a6f9bd-0b75-4b21-af36-ee85db6363e9 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] Deletion of /opt/stack/data/nova/instances/14f9924f-8d4d-4193-927b-02cfb0f5f57a_del complete
Jul 29 15:01:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:01:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk.rescue --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:01:04 user nova-compute[70924]: INFO nova.compute.manager [None req-a2a6f9bd-0b75-4b21-af36-ee85db6363e9 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] Took 1.34 seconds to destroy the instance on the hypervisor.
Jul 29 15:01:04 user nova-compute[70924]: DEBUG oslo.service.loopingcall [None req-a2a6f9bd-0b75-4b21-af36-ee85db6363e9 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70924) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 15:01:04 user nova-compute[70924]: DEBUG nova.compute.manager [-] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] Deallocating network for instance {{(pid=70924) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 15:01:04 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] deallocate_for_instance() {{(pid=70924) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 15:01:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk.rescue --force-share --output=json" returned: 0 in 0.157s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:01:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:01:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:01:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:01:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:01:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:01:04 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:01:04 user nova-compute[70924]: DEBUG nova.compute.manager [req-9d83828a-c426-489e-9539-7e71d7430218 req-9e612ece-8111-41a9-b04e-6a2a1fa1d695 service nova] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] Received event network-vif-deleted-078ca632-af45-4d44-8e01-7cef910a77ee {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:01:04 user nova-compute[70924]: INFO nova.compute.manager [req-9d83828a-c426-489e-9539-7e71d7430218 req-9e612ece-8111-41a9-b04e-6a2a1fa1d695 service nova] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] Neutron deleted interface 078ca632-af45-4d44-8e01-7cef910a77ee; detaching it from the instance and deleting it from the info cache
Jul 29 15:01:04 user nova-compute[70924]: DEBUG nova.network.neutron [req-9d83828a-c426-489e-9539-7e71d7430218 req-9e612ece-8111-41a9-b04e-6a2a1fa1d695 service nova] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:01:04 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] Took 0.52 seconds to deallocate network for instance.
Jul 29 15:01:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:01:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:01:04 user nova-compute[70924]: DEBUG nova.compute.manager [req-9d83828a-c426-489e-9539-7e71d7430218 req-9e612ece-8111-41a9-b04e-6a2a1fa1d695 service nova] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] Detach interface failed, port_id=078ca632-af45-4d44-8e01-7cef910a77ee, reason: Instance 14f9924f-8d4d-4193-927b-02cfb0f5f57a could not be found. {{(pid=70924) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 29 15:01:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:01:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79063387-5fb9-4ce2-81c3-f9a094c0fd22/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:01:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79063387-5fb9-4ce2-81c3-f9a094c0fd22/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:01:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79063387-5fb9-4ce2-81c3-f9a094c0fd22/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:01:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79063387-5fb9-4ce2-81c3-f9a094c0fd22/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:01:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1555ef29-8abe-43ca-ad2b-ac2f86180202/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:01:05 user nova-compute[70924]: DEBUG nova.compute.manager [req-10a96ee6-c8af-4a08-9677-70e52882bdea req-d9efc467-4c14-4d40-8599-c7fbdc38705c service nova] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] Received event network-vif-plugged-078ca632-af45-4d44-8e01-7cef910a77ee {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:01:05 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-10a96ee6-c8af-4a08-9677-70e52882bdea req-d9efc467-4c14-4d40-8599-c7fbdc38705c service nova] Acquiring lock "14f9924f-8d4d-4193-927b-02cfb0f5f57a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:01:05 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-10a96ee6-c8af-4a08-9677-70e52882bdea req-d9efc467-4c14-4d40-8599-c7fbdc38705c service nova] Lock "14f9924f-8d4d-4193-927b-02cfb0f5f57a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:01:05 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-10a96ee6-c8af-4a08-9677-70e52882bdea req-d9efc467-4c14-4d40-8599-c7fbdc38705c service nova] Lock "14f9924f-8d4d-4193-927b-02cfb0f5f57a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:01:05 user nova-compute[70924]: DEBUG nova.compute.manager [req-10a96ee6-c8af-4a08-9677-70e52882bdea req-d9efc467-4c14-4d40-8599-c7fbdc38705c service nova] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] No waiting events found dispatching network-vif-plugged-078ca632-af45-4d44-8e01-7cef910a77ee {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:01:05 user nova-compute[70924]: WARNING nova.compute.manager [req-10a96ee6-c8af-4a08-9677-70e52882bdea req-d9efc467-4c14-4d40-8599-c7fbdc38705c service nova] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] Received unexpected event network-vif-plugged-078ca632-af45-4d44-8e01-7cef910a77ee for instance with vm_state active and task_state deleting.
Jul 29 15:01:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1555ef29-8abe-43ca-ad2b-ac2f86180202/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:01:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1555ef29-8abe-43ca-ad2b-ac2f86180202/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:01:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1555ef29-8abe-43ca-ad2b-ac2f86180202/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:01:05 user nova-compute[70924]: INFO nova.compute.manager [None req-a2a6f9bd-0b75-4b21-af36-ee85db6363e9 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] Took 0.80 seconds to detach 1 volumes for instance.
Jul 29 15:01:05 user nova-compute[70924]: DEBUG nova.compute.manager [None req-a2a6f9bd-0b75-4b21-af36-ee85db6363e9 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] Deleting volume: ab9daafc-459b-4a5f-8230-13af56e2d1ef {{(pid=70924) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Jul 29 15:01:06 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:01:06 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:01:06 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Hypervisor/Node resource view: name=user free_ram=7204MB free_disk=25.06802749633789GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70924) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 15:01:06 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:01:06 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:01:06 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a2a6f9bd-0b75-4b21-af36-ee85db6363e9 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:01:06 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance db656346-c4af-43da-9600-fd39f1b9e4dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:01:06 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 9ec07c62-951b-4e3a-bffa-e01dfb4665ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:01:06 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 091e384f-7851-4ac9-b566-990df0497fc5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:01:06 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance f3f7eeda-a001-4c35-abeb-e459d701bd93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:01:06 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 47104e57-c193-4a85-a2cf-677f0debe373 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:01:06 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance b3efaa8e-7138-40be-a271-8a344eac3e48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:01:06 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 5865be57-b5f2-4132-bc71-cc41bfe9f897 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:01:06 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 14f9924f-8d4d-4193-927b-02cfb0f5f57a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:01:06 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 1555ef29-8abe-43ca-ad2b-ac2f86180202 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:01:06 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 79063387-5fb9-4ce2-81c3-f9a094c0fd22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:01:06 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:01:06 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 15:01:06 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 15:01:06 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:01:06 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:01:06 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Compute_service record updated for user:user {{(pid=70924) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 15:01:06 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.518s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:01:06 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a2a6f9bd-0b75-4b21-af36-ee85db6363e9 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.465s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:01:06 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-e8adb481-b79e-48ca-a249-50910a150846 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Acquiring lock "5865be57-b5f2-4132-bc71-cc41bfe9f897" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:01:06 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-e8adb481-b79e-48ca-a249-50910a150846 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lock "5865be57-b5f2-4132-bc71-cc41bfe9f897" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:01:06 user nova-compute[70924]: DEBUG nova.objects.instance [None req-e8adb481-b79e-48ca-a249-50910a150846 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lazy-loading 'flavor' on Instance uuid 5865be57-b5f2-4132-bc71-cc41bfe9f897 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:01:06 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-e8adb481-b79e-48ca-a249-50910a150846 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lock "5865be57-b5f2-4132-bc71-cc41bfe9f897" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:01:06 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-e8adb481-b79e-48ca-a249-50910a150846 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Acquiring lock "5865be57-b5f2-4132-bc71-cc41bfe9f897" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:01:06 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-e8adb481-b79e-48ca-a249-50910a150846 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lock "5865be57-b5f2-4132-bc71-cc41bfe9f897" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:01:06 user nova-compute[70924]: INFO nova.compute.manager [None req-e8adb481-b79e-48ca-a249-50910a150846 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Attaching volume 2cae21de-6018-4d36-9f32-3d6d6d172685 to /dev/vdb
Jul 29 15:01:06 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-a2a6f9bd-0b75-4b21-af36-ee85db6363e9 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:01:06 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-a2a6f9bd-0b75-4b21-af36-ee85db6363e9 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:01:06 user nova-compute[70924]: DEBUG os_brick.utils [None req-e8adb481-b79e-48ca-a249-50910a150846 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 15:01:06 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:01:06 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a2a6f9bd-0b75-4b21-af36-ee85db6363e9 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.392s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:01:06 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:01:06 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2d889e-9203-4776-82e3-d7a471e21242]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f2127c4a30d9\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:01:06 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:01:06 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:01:06 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec857453-78b3-429d-aa6e-d95421f53743]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:01:06 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:01:06 user nova-compute[70924]: INFO nova.scheduler.client.report [None req-a2a6f9bd-0b75-4b21-af36-ee85db6363e9 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Deleted allocations for instance 14f9924f-8d4d-4193-927b-02cfb0f5f57a
Jul 29 15:01:06 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:01:06 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcbc9686-6615-4950-b15e-b250286b6a33]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:01:06 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f51bb3-b055-47a7-8350-2306d2233ec9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:01:06 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-e8adb481-b79e-48ca-a249-50910a150846 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Running cmd (subprocess): nvme version {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:01:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-e8adb481-b79e-48ca-a249-50910a150846 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] 'nvme version' failed. Not Retrying. {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 15:01:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e8adb481-b79e-48ca-a249-50910a150846 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] nvme not present on system {{(pid=70924) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 15:01:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:01:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 15:01:07 user nova-compute[70924]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 15:01:07 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae8645e-26f1-4267-bcec-6a0ff94606ae]: (4, '') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:01:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-e8adb481-b79e-48ca-a249-50910a150846 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70924) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 15:01:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-e8adb481-b79e-48ca-a249-50910a150846 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 15:01:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-e8adb481-b79e-48ca-a249-50910a150846 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] LIGHTOS: no hostnqn found. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 15:01:07 user nova-compute[70924]: DEBUG os_brick.utils [None req-e8adb481-b79e-48ca-a249-50910a150846 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f2127c4a30d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 15:01:07 user nova-compute[70924]: DEBUG nova.virt.block_device [None req-e8adb481-b79e-48ca-a249-50910a150846 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Updating existing volume attachment record: b59474d7-c1d1-45e6-819f-8c928ef1ac9d {{(pid=70924) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 15:01:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a2a6f9bd-0b75-4b21-af36-ee85db6363e9 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "14f9924f-8d4d-4193-927b-02cfb0f5f57a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.206s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:01:07 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:01:07 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Starting heal instance info cache {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 15:01:07 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Didn't find any instances for network info cache update. {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 29 15:01:07 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:01:07 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:01:07 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:01:07 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70924) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 15:01:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:01:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:01:10 user nova-compute[70924]: DEBUG nova.objects.instance [None req-c476e09b-c59d-40d7-8f91-26480fbaa617 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lazy-loading 'flavor' on Instance uuid b3efaa8e-7138-40be-a271-8a344eac3e48 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:01:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-c476e09b-c59d-40d7-8f91-26480fbaa617 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "b3efaa8e-7138-40be-a271-8a344eac3e48" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 7.916s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:01:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-91f9c686-6a5b-4239-8365-0219e8b335b8 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Acquiring lock "b3efaa8e-7138-40be-a271-8a344eac3e48" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:01:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-91f9c686-6a5b-4239-8365-0219e8b335b8 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "b3efaa8e-7138-40be-a271-8a344eac3e48" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:01:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-91f9c686-6a5b-4239-8365-0219e8b335b8 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Acquiring lock "b3efaa8e-7138-40be-a271-8a344eac3e48-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:01:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-91f9c686-6a5b-4239-8365-0219e8b335b8 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "b3efaa8e-7138-40be-a271-8a344eac3e48-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:01:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-91f9c686-6a5b-4239-8365-0219e8b335b8 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "b3efaa8e-7138-40be-a271-8a344eac3e48-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:01:11 user nova-compute[70924]: INFO nova.compute.manager [None req-91f9c686-6a5b-4239-8365-0219e8b335b8 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Terminating instance
Jul 29 15:01:11 user nova-compute[70924]: DEBUG nova.compute.manager [None req-91f9c686-6a5b-4239-8365-0219e8b335b8 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Start destroying the instance on the hypervisor. {{(pid=70924) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 15:01:11 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:01:11 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:01:11 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:01:11 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:01:11 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:01:11 user nova-compute[70924]: DEBUG nova.compute.manager [req-12a98295-0f77-43b1-a630-c6dcac73b343 req-0056336b-9edd-4013-b27a-73afc90b2d0c service nova] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Received event network-vif-unplugged-359ef5f3-1689-4a34-b213-a837a6d5668b {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:01:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-12a98295-0f77-43b1-a630-c6dcac73b343 req-0056336b-9edd-4013-b27a-73afc90b2d0c service nova] Acquiring lock "b3efaa8e-7138-40be-a271-8a344eac3e48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:01:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-12a98295-0f77-43b1-a630-c6dcac73b343 req-0056336b-9edd-4013-b27a-73afc90b2d0c service nova] Lock "b3efaa8e-7138-40be-a271-8a344eac3e48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:01:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-12a98295-0f77-43b1-a630-c6dcac73b343 req-0056336b-9edd-4013-b27a-73afc90b2d0c service nova] Lock "b3efaa8e-7138-40be-a271-8a344eac3e48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:01:11 user nova-compute[70924]: DEBUG nova.compute.manager [req-12a98295-0f77-43b1-a630-c6dcac73b343 req-0056336b-9edd-4013-b27a-73afc90b2d0c service nova] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] No waiting events found dispatching network-vif-unplugged-359ef5f3-1689-4a34-b213-a837a6d5668b {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:01:11 user nova-compute[70924]: DEBUG nova.compute.manager [req-12a98295-0f77-43b1-a630-c6dcac73b343 req-0056336b-9edd-4013-b27a-73afc90b2d0c service nova] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Received event network-vif-unplugged-359ef5f3-1689-4a34-b213-a837a6d5668b for instance with task_state deleting. {{(pid=70924) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 15:01:11 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Instance destroyed successfully.
Jul 29 15:01:11 user nova-compute[70924]: DEBUG nova.objects.instance [None req-91f9c686-6a5b-4239-8365-0219e8b335b8 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lazy-loading 'resources' on Instance uuid b3efaa8e-7138-40be-a271-8a344eac3e48 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:01:11 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-91f9c686-6a5b-4239-8365-0219e8b335b8 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:58:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-151888036',display_name='tempest-AttachVolumeTestJSON-server-151888036',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-151888036',id=35,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOu7s/P/MUQvax9l2hEZsyedKa1s2/6DOUe4Gvh7NV9IPvsrfXmDsBgRPnRO5eFoKleVUb/fil72F9codRnUwvpRBRl48lTdZUBxU2F2SGnvKLPDndPKzwyDV7ormJ2iTg==',key_name='tempest-keypair-2063174849',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:58:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a0388bcf487e492082e85b183f38765c',ramdisk_id='',reservation_id='r-jhw8v6we',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-651630277',owner_user_name='tempest-AttachVolumeTestJSON-651630277-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:58:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='761e4287afb94bf4ad93c09a43bada1f',uuid=b3efaa8e-7138-40be-a271-8a344eac3e48,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "359ef5f3-1689-4a34-b213-a837a6d5668b", "address": "fa:16:3e:9c:88:44", "network": {"id": "46d2cfde-13db-4cf3-af0e-4d6742f37044", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1642265305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0388bcf487e492082e85b183f38765c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap359ef5f3-16", "ovs_interfaceid": "359ef5f3-1689-4a34-b213-a837a6d5668b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 15:01:11 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-91f9c686-6a5b-4239-8365-0219e8b335b8 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Converting VIF {"id": "359ef5f3-1689-4a34-b213-a837a6d5668b", "address": "fa:16:3e:9c:88:44", "network": {"id": "46d2cfde-13db-4cf3-af0e-4d6742f37044", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1642265305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0388bcf487e492082e85b183f38765c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap359ef5f3-16", "ovs_interfaceid": "359ef5f3-1689-4a34-b213-a837a6d5668b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 15:01:11 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-91f9c686-6a5b-4239-8365-0219e8b335b8 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9c:88:44,bridge_name='br-int',has_traffic_filtering=True,id=359ef5f3-1689-4a34-b213-a837a6d5668b,network=Network(46d2cfde-13db-4cf3-af0e-4d6742f37044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap359ef5f3-16') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 15:01:11 user nova-compute[70924]: DEBUG os_vif [None req-91f9c686-6a5b-4239-8365-0219e8b335b8 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:88:44,bridge_name='br-int',has_traffic_filtering=True,id=359ef5f3-1689-4a34-b213-a837a6d5668b,network=Network(46d2cfde-13db-4cf3-af0e-4d6742f37044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap359ef5f3-16') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 15:01:11 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:01:11 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap359ef5f3-16, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:01:11 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:01:11 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:01:11 user nova-compute[70924]: INFO os_vif [None req-91f9c686-6a5b-4239-8365-0219e8b335b8 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:88:44,bridge_name='br-int',has_traffic_filtering=True,id=359ef5f3-1689-4a34-b213-a837a6d5668b,network=Network(46d2cfde-13db-4cf3-af0e-4d6742f37044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap359ef5f3-16')
Jul 29 15:01:12 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-91f9c686-6a5b-4239-8365-0219e8b335b8 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Deleting instance files /opt/stack/data/nova/instances/b3efaa8e-7138-40be-a271-8a344eac3e48_del
Jul 29 15:01:12 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-91f9c686-6a5b-4239-8365-0219e8b335b8 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Deletion of /opt/stack/data/nova/instances/b3efaa8e-7138-40be-a271-8a344eac3e48_del complete
Jul 29 15:01:12 user nova-compute[70924]: INFO nova.compute.manager [None req-91f9c686-6a5b-4239-8365-0219e8b335b8 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Took 0.87 seconds to destroy the instance on the hypervisor.
Jul 29 15:01:12 user nova-compute[70924]: DEBUG oslo.service.loopingcall [None req-91f9c686-6a5b-4239-8365-0219e8b335b8 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70924) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 15:01:12 user nova-compute[70924]: DEBUG nova.compute.manager [-] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Deallocating network for instance {{(pid=70924) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 15:01:12 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] deallocate_for_instance() {{(pid=70924) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 15:01:13 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:01:13 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Took 0.98 seconds to deallocate network for instance.
Jul 29 15:01:13 user nova-compute[70924]: DEBUG nova.compute.manager [req-f749717f-596a-4f0d-be3a-fee9449ffdb8 req-e449b918-a5b8-4291-9753-7845c7f54894 service nova] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Received event network-vif-deleted-359ef5f3-1689-4a34-b213-a837a6d5668b {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:01:13 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-91f9c686-6a5b-4239-8365-0219e8b335b8 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:01:13 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-91f9c686-6a5b-4239-8365-0219e8b335b8 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:01:13 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-91f9c686-6a5b-4239-8365-0219e8b335b8 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:01:13 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-91f9c686-6a5b-4239-8365-0219e8b335b8 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:01:13 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-91f9c686-6a5b-4239-8365-0219e8b335b8 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.349s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:01:13 user nova-compute[70924]: INFO nova.scheduler.client.report [None req-91f9c686-6a5b-4239-8365-0219e8b335b8 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Deleted allocations for instance b3efaa8e-7138-40be-a271-8a344eac3e48
Jul 29 15:01:13 user nova-compute[70924]: DEBUG nova.compute.manager [req-197b362f-ea17-4879-83d8-9f69d2ed0ab7 req-d5f0b16e-370f-493b-b45e-6aae2a1f9f96 service nova] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Received event network-vif-plugged-359ef5f3-1689-4a34-b213-a837a6d5668b {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:01:13 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-197b362f-ea17-4879-83d8-9f69d2ed0ab7 req-d5f0b16e-370f-493b-b45e-6aae2a1f9f96 service nova] Acquiring lock "b3efaa8e-7138-40be-a271-8a344eac3e48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:01:13 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-197b362f-ea17-4879-83d8-9f69d2ed0ab7 req-d5f0b16e-370f-493b-b45e-6aae2a1f9f96 service nova] Lock "b3efaa8e-7138-40be-a271-8a344eac3e48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:01:13 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-197b362f-ea17-4879-83d8-9f69d2ed0ab7 req-d5f0b16e-370f-493b-b45e-6aae2a1f9f96 service nova] Lock "b3efaa8e-7138-40be-a271-8a344eac3e48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:01:13 user nova-compute[70924]: DEBUG nova.compute.manager [req-197b362f-ea17-4879-83d8-9f69d2ed0ab7 req-d5f0b16e-370f-493b-b45e-6aae2a1f9f96 service nova] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] No waiting events found dispatching network-vif-plugged-359ef5f3-1689-4a34-b213-a837a6d5668b {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:01:13 user nova-compute[70924]: WARNING nova.compute.manager [req-197b362f-ea17-4879-83d8-9f69d2ed0ab7 req-d5f0b16e-370f-493b-b45e-6aae2a1f9f96 service nova] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Received unexpected event network-vif-plugged-359ef5f3-1689-4a34-b213-a837a6d5668b for instance with vm_state deleted and task_state None.
Jul 29 15:01:13 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-91f9c686-6a5b-4239-8365-0219e8b335b8 tempest-AttachVolumeTestJSON-651630277 tempest-AttachVolumeTestJSON-651630277-project-member] Lock "b3efaa8e-7138-40be-a271-8a344eac3e48" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.383s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:01:14 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:01:14 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8adb481-b79e-48ca-a249-50910a150846 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Calling os-brick to attach iSCSI Volume {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 15:01:14 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8adb481-b79e-48ca-a249-50910a150846 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2cae21de-6018-4d36-9f32-3d6d6d172685'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VPjOKual', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 15:01:14 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-e8adb481-b79e-48ca-a249-50910a150846 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 15:01:14 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-e8adb481-b79e-48ca-a249-50910a150846 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 15:01:14 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-e8adb481-b79e-48ca-a249-50910a150846 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 15:01:14 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-e8adb481-b79e-48ca-a249-50910a150846 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 15:01:14 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-e8adb481-b79e-48ca-a249-50910a150846 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2cae21de-6018-4d36-9f32-3d6d6d172685" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 15:01:14 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-e8adb481-b79e-48ca-a249-50910a150846 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2cae21de-6018-4d36-9f32-3d6d6d172685" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 15:01:14 user nova-compute[70924]: INFO os_brick.initiator.connectors.iscsi [None req-e8adb481-b79e-48ca-a249-50910a150846 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 15:01:14 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cae21de-6018-4d36-9f32-3d6d6d172685 -p 172.16.0.220:3260 {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:01:14 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cae21de-6018-4d36-9f32-3d6d6d172685 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:01:14 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0c5137-c640-4a19-8771-3feb78e906ab]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:01:14 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8adb481-b79e-48ca-a249-50910a150846 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 15:01:14 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:01:14 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cae21de-6018-4d36-9f32-3d6d6d172685 -p 172.16.0.220:3260 --interface default --op new {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:01:14 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cae21de-6018-4d36-9f32-3d6d6d172685 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:01:14 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d9e9ccf-cd7a-4166-8679-f8850ed109f5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2cae21de-6018-4d36-9f32-3d6d6d172685] added\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:01:14 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8adb481-b79e-48ca-a249-50910a150846 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2cae21de-6018-4d36-9f32-3d6d6d172685] added
Jul 29 15:01:14 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:01:14 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cae21de-6018-4d36-9f32-3d6d6d172685 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:01:14 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cae21de-6018-4d36-9f32-3d6d6d172685 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:01:14 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[4beb2be0-2bda-4f8d-ba75-f29f44b1dad8]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:01:14 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8adb481-b79e-48ca-a249-50910a150846 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:01:14 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cae21de-6018-4d36-9f32-3d6d6d172685 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:01:14 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cae21de-6018-4d36-9f32-3d6d6d172685 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:01:14 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa8f526-275e-4653-a846-5b412f4654f0]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:01:14 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8adb481-b79e-48ca-a249-50910a150846 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:01:14 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cae21de-6018-4d36-9f32-3d6d6d172685 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VPjOKual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:01:14 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cae21de-6018-4d36-9f32-3d6d6d172685 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VPjOKual" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:01:14 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1a5e2e-9eab-46c9-a7c7-0d01d16e2d01]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:01:14 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8adb481-b79e-48ca-a249-50910a150846 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VPjOKual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:01:14 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cae21de-6018-4d36-9f32-3d6d6d172685 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:01:14 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cae21de-6018-4d36-9f32-3d6d6d172685 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:01:14 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53c9148-6b2a-4699-8413-7967f56ec67e]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:01:14 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8adb481-b79e-48ca-a249-50910a150846 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:01:14 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:01:14 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:01:14 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[91144bf4-3d3a-4b2c-b0f2-2a4e5cece282]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:01:14 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8adb481-b79e-48ca-a249-50910a150846 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 (non-flash)
Jul 29 15:01:14 user nova-compute[70924]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f (non-flash)
Jul 29 15:01:14 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 15:01:14 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8adb481-b79e-48ca-a249-50910a150846 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 (non-flash)
Jul 29 15:01:14 user nova-compute[70924]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f (non-flash)
Jul 29 15:01:14 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 15:01:14 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cae21de-6018-4d36-9f32-3d6d6d172685 -p 172.16.0.220:3260 --login {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:01:14 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cae21de-6018-4d36-9f32-3d6d6d172685 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:01:14 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5d8554-8307-44f9-a2c8-ec43a530231b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2cae21de-6018-4d36-9f32-3d6d6d172685, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2cae21de-6018-4d36-9f32-3d6d6d172685, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:01:14 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8adb481-b79e-48ca-a249-50910a150846 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2cae21de-6018-4d36-9f32-3d6d6d172685, portal: 172.16.0.220,3260]
Jul 29 15:01:14 user nova-compute[70924]: Login to [iface: default, target: iqn.2010-10.org.openstack:2cae21de-6018-4d36-9f32-3d6d6d172685, portal: 172.16.0.220,3260] successful.
Jul 29 15:01:14 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:01:14 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cae21de-6018-4d36-9f32-3d6d6d172685 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:01:14 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cae21de-6018-4d36-9f32-3d6d6d172685 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:01:14 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97f1dbb-b315-4a7c-a65a-7b80d3c91981]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:01:14 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8adb481-b79e-48ca-a249-50910a150846 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:01:14 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:01:14 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:01:14 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[deff349b-b780-4977-afdb-b8ffb984d99e]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cae21de-6018-4d36-9f32-3d6d6d172685 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:01:14 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8adb481-b79e-48ca-a249-50910a150846 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 (non-flash)
Jul 29 15:01:14 user nova-compute[70924]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f (non-flash)
Jul 29 15:01:14 user nova-compute[70924]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cae21de-6018-4d36-9f32-3d6d6d172685 (non-flash)
Jul 29 15:01:14 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 15:01:14 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8adb481-b79e-48ca-a249-50910a150846 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 (non-flash)
Jul 29 15:01:14 user nova-compute[70924]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f (non-flash)
Jul 29 15:01:14 user nova-compute[70924]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cae21de-6018-4d36-9f32-3d6d6d172685 (non-flash)
Jul 29 15:01:14 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 15:01:14 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-e8adb481-b79e-48ca-a249-50910a150846 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2cae21de-6018-4d36-9f32-3d6d6d172685" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 15:01:14 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8adb481-b79e-48ca-a249-50910a150846 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Connected to 172.16.0.220:3260 {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 15:01:14 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-e8adb481-b79e-48ca-a249-50910a150846 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] HCTL ('34', '-', '-', 0) found on session 45 with lun 0 {{(pid=70924) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 15:01:14 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-e8adb481-b79e-48ca-a249-50910a150846 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70924) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 15:01:14 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:01:14 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:01:14 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f766d91c-4234-4ba7-be35-c4bb7e75acdb]: (4, ('- - 0', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:01:14 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-e8adb481-b79e-48ca-a249-50910a150846 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 15:01:14 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8adb481-b79e-48ca-a249-50910a150846 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VPjOKual', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 15:01:15 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-e8adb481-b79e-48ca-a249-50910a150846 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 15:01:15 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8adb481-b79e-48ca-a249-50910a150846 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23231316662373034', 'path': '/dev/sdc'} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 15:01:15 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8adb481-b79e-48ca-a249-50910a150846 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231316662373034', 'path': '/dev/sdc'} {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 15:01:15 user nova-compute[70924]: DEBUG nova.objects.instance [None req-e8adb481-b79e-48ca-a249-50910a150846 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lazy-loading 'flavor' on Instance uuid 5865be57-b5f2-4132-bc71-cc41bfe9f897 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:01:15 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-e8adb481-b79e-48ca-a249-50910a150846 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] attach device xml: <disk type="block" device="disk">
Jul 29 15:01:15 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 15:01:15 user nova-compute[70924]:   <source dev="/dev/sdc"/>
Jul 29 15:01:15 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 15:01:15 user nova-compute[70924]:   <serial>2cae21de-6018-4d36-9f32-3d6d6d172685</serial>
Jul 29 15:01:15 user nova-compute[70924]: </disk>
Jul 29 15:01:15 user nova-compute[70924]:  {{(pid=70924) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 29 15:01:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-e8adb481-b79e-48ca-a249-50910a150846 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 15:01:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-e8adb481-b79e-48ca-a249-50910a150846 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 15:01:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-e8adb481-b79e-48ca-a249-50910a150846 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] No VIF found with MAC fa:16:3e:03:b3:5f, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 15:01:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-e8adb481-b79e-48ca-a249-50910a150846 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lock "5865be57-b5f2-4132-bc71-cc41bfe9f897" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.587s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:01:16 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:01:18 user nova-compute[70924]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690642863.6631598, 14f9924f-8d4d-4193-927b-02cfb0f5f57a => Stopped> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 15:01:18 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] VM Stopped (Lifecycle Event)
Jul 29 15:01:18 user nova-compute[70924]: DEBUG nova.compute.manager [None req-12d5c3c3-b3f6-4136-8984-5652f846c030 None None] [instance: 14f9924f-8d4d-4193-927b-02cfb0f5f57a] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:01:19 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:01:19 user nova-compute[70924]: DEBUG nova.compute.manager [req-c932f4bf-82ca-489a-892c-f78ded997a1e req-4b6c33ac-2344-4db7-978a-f8a54f678b72 service nova] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Received event network-changed-6641ec75-757f-44fa-980b-5b0f270432eb {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:01:19 user nova-compute[70924]: DEBUG nova.compute.manager [req-c932f4bf-82ca-489a-892c-f78ded997a1e req-4b6c33ac-2344-4db7-978a-f8a54f678b72 service nova] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Refreshing instance network info cache due to event network-changed-6641ec75-757f-44fa-980b-5b0f270432eb. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 15:01:19 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c932f4bf-82ca-489a-892c-f78ded997a1e req-4b6c33ac-2344-4db7-978a-f8a54f678b72 service nova] Acquiring lock "refresh_cache-5865be57-b5f2-4132-bc71-cc41bfe9f897" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:01:19 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c932f4bf-82ca-489a-892c-f78ded997a1e req-4b6c33ac-2344-4db7-978a-f8a54f678b72 service nova] Acquired lock "refresh_cache-5865be57-b5f2-4132-bc71-cc41bfe9f897" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:01:19 user nova-compute[70924]: DEBUG nova.network.neutron [req-c932f4bf-82ca-489a-892c-f78ded997a1e req-4b6c33ac-2344-4db7-978a-f8a54f678b72 service nova] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Refreshing network info cache for port 6641ec75-757f-44fa-980b-5b0f270432eb {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 15:01:20 user nova-compute[70924]: DEBUG nova.network.neutron [req-c932f4bf-82ca-489a-892c-f78ded997a1e req-4b6c33ac-2344-4db7-978a-f8a54f678b72 service nova] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Updated VIF entry in instance network info cache for port 6641ec75-757f-44fa-980b-5b0f270432eb. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 15:01:20 user nova-compute[70924]: DEBUG nova.network.neutron [req-c932f4bf-82ca-489a-892c-f78ded997a1e req-4b6c33ac-2344-4db7-978a-f8a54f678b72 service nova] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Updating instance_info_cache with network_info: [{"id": "6641ec75-757f-44fa-980b-5b0f270432eb", "address": "fa:16:3e:03:b3:5f", "network": {"id": "21a19801-8526-40a2-9bcb-dda6cfb435fe", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-761511746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a03844d646454b6ea55e1b5625f7909a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6641ec75-75", "ovs_interfaceid": "6641ec75-757f-44fa-980b-5b0f270432eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:01:20 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c932f4bf-82ca-489a-892c-f78ded997a1e req-4b6c33ac-2344-4db7-978a-f8a54f678b72 service nova] Releasing lock "refresh_cache-5865be57-b5f2-4132-bc71-cc41bfe9f897" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:01:21 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2d60f688-24dd-4843-9c91-4885475dd1ac tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Acquiring lock "db656346-c4af-43da-9600-fd39f1b9e4dc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:01:21 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2d60f688-24dd-4843-9c91-4885475dd1ac tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "db656346-c4af-43da-9600-fd39f1b9e4dc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:01:21 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2d60f688-24dd-4843-9c91-4885475dd1ac tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Acquiring lock "db656346-c4af-43da-9600-fd39f1b9e4dc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:01:21 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2d60f688-24dd-4843-9c91-4885475dd1ac tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "db656346-c4af-43da-9600-fd39f1b9e4dc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:01:21 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2d60f688-24dd-4843-9c91-4885475dd1ac tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "db656346-c4af-43da-9600-fd39f1b9e4dc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:01:21 user nova-compute[70924]: INFO nova.compute.manager [None req-2d60f688-24dd-4843-9c91-4885475dd1ac tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Terminating instance
Jul 29 15:01:21 user nova-compute[70924]: DEBUG nova.compute.manager [None req-2d60f688-24dd-4843-9c91-4885475dd1ac tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Start destroying the instance on the hypervisor. {{(pid=70924) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 15:01:21 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:01:21 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:01:21 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:01:21 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:01:21 user nova-compute[70924]: DEBUG nova.compute.manager [req-01796b9b-943d-4c2a-bb56-e0e2dea047c9 req-d12196ed-949b-43b0-b7c1-2d3eb81c3232 service nova] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Received event network-vif-unplugged-bd091ea0-8c42-4140-aad1-617f27d2a469 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:01:21 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-01796b9b-943d-4c2a-bb56-e0e2dea047c9 req-d12196ed-949b-43b0-b7c1-2d3eb81c3232 service nova] Acquiring lock "db656346-c4af-43da-9600-fd39f1b9e4dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:01:21 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-01796b9b-943d-4c2a-bb56-e0e2dea047c9 req-d12196ed-949b-43b0-b7c1-2d3eb81c3232 service nova] Lock "db656346-c4af-43da-9600-fd39f1b9e4dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:01:21 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-01796b9b-943d-4c2a-bb56-e0e2dea047c9 req-d12196ed-949b-43b0-b7c1-2d3eb81c3232 service nova] Lock "db656346-c4af-43da-9600-fd39f1b9e4dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:01:21 user nova-compute[70924]: DEBUG nova.compute.manager [req-01796b9b-943d-4c2a-bb56-e0e2dea047c9 req-d12196ed-949b-43b0-b7c1-2d3eb81c3232 service nova] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] No waiting events found dispatching network-vif-unplugged-bd091ea0-8c42-4140-aad1-617f27d2a469 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:01:21 user nova-compute[70924]: DEBUG nova.compute.manager [req-01796b9b-943d-4c2a-bb56-e0e2dea047c9 req-d12196ed-949b-43b0-b7c1-2d3eb81c3232 service nova] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Received event network-vif-unplugged-bd091ea0-8c42-4140-aad1-617f27d2a469 for instance with task_state deleting. {{(pid=70924) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 15:01:21 user nova-compute[70924]: DEBUG nova.compute.manager [req-01796b9b-943d-4c2a-bb56-e0e2dea047c9 req-d12196ed-949b-43b0-b7c1-2d3eb81c3232 service nova] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Received event network-vif-plugged-bd091ea0-8c42-4140-aad1-617f27d2a469 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:01:21 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-01796b9b-943d-4c2a-bb56-e0e2dea047c9 req-d12196ed-949b-43b0-b7c1-2d3eb81c3232 service nova] Acquiring lock "db656346-c4af-43da-9600-fd39f1b9e4dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:01:21 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-01796b9b-943d-4c2a-bb56-e0e2dea047c9 req-d12196ed-949b-43b0-b7c1-2d3eb81c3232 service nova] Lock "db656346-c4af-43da-9600-fd39f1b9e4dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:01:21 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-01796b9b-943d-4c2a-bb56-e0e2dea047c9 req-d12196ed-949b-43b0-b7c1-2d3eb81c3232 service nova] Lock "db656346-c4af-43da-9600-fd39f1b9e4dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:01:21 user nova-compute[70924]: DEBUG nova.compute.manager [req-01796b9b-943d-4c2a-bb56-e0e2dea047c9 req-d12196ed-949b-43b0-b7c1-2d3eb81c3232 service nova] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] No waiting events found dispatching network-vif-plugged-bd091ea0-8c42-4140-aad1-617f27d2a469 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:01:21 user nova-compute[70924]: WARNING nova.compute.manager [req-01796b9b-943d-4c2a-bb56-e0e2dea047c9 req-d12196ed-949b-43b0-b7c1-2d3eb81c3232 service nova] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Received unexpected event network-vif-plugged-bd091ea0-8c42-4140-aad1-617f27d2a469 for instance with vm_state active and task_state deleting.
Jul 29 15:01:21 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:01:22 user nova-compute[70924]: DEBUG nova.compute.manager [req-4f22e18a-82b9-4175-806e-3b4dfa81655d req-82595a0e-331f-4bcb-bdc1-db127cca0ff5 service nova] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Received event network-changed-6641ec75-757f-44fa-980b-5b0f270432eb {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:01:22 user nova-compute[70924]: DEBUG nova.compute.manager [req-4f22e18a-82b9-4175-806e-3b4dfa81655d req-82595a0e-331f-4bcb-bdc1-db127cca0ff5 service nova] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Refreshing instance network info cache due to event network-changed-6641ec75-757f-44fa-980b-5b0f270432eb. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 15:01:22 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-4f22e18a-82b9-4175-806e-3b4dfa81655d req-82595a0e-331f-4bcb-bdc1-db127cca0ff5 service nova] Acquiring lock "refresh_cache-5865be57-b5f2-4132-bc71-cc41bfe9f897" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:01:22 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-4f22e18a-82b9-4175-806e-3b4dfa81655d req-82595a0e-331f-4bcb-bdc1-db127cca0ff5 service nova] Acquired lock "refresh_cache-5865be57-b5f2-4132-bc71-cc41bfe9f897" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:01:22 user nova-compute[70924]: DEBUG nova.network.neutron [req-4f22e18a-82b9-4175-806e-3b4dfa81655d req-82595a0e-331f-4bcb-bdc1-db127cca0ff5 service nova] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Refreshing network info cache for port 6641ec75-757f-44fa-980b-5b0f270432eb {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 15:01:22 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Instance destroyed successfully.
Jul 29 15:01:22 user nova-compute[70924]: DEBUG nova.objects.instance [None req-2d60f688-24dd-4843-9c91-4885475dd1ac tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lazy-loading 'resources' on Instance uuid db656346-c4af-43da-9600-fd39f1b9e4dc {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:01:22 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-2d60f688-24dd-4843-9c91-4885475dd1ac tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:40:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-35032769',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-35032769',id=1,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:41:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5a9e5c78c1684c359cfab4e32b9c213f',ramdisk_id='',reservation_id='r-3y2md6ak',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2089253815',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:42:50Z,user_data=None,user_id='43582a8a85c54b5e9d16d11b12bf50d4',uuid=db656346-c4af-43da-9600-fd39f1b9e4dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bd091ea0-8c42-4140-aad1-617f27d2a469", "address": "fa:16:3e:53:1d:70", "network": {"id": "d5876e18-e2af-45c2-aab5-2d0d552ebfe4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2035085552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9e5c78c1684c359cfab4e32b9c213f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd091ea0-8c", "ovs_interfaceid": "bd091ea0-8c42-4140-aad1-617f27d2a469", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 15:01:22 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-2d60f688-24dd-4843-9c91-4885475dd1ac tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Converting VIF {"id": "bd091ea0-8c42-4140-aad1-617f27d2a469", "address": "fa:16:3e:53:1d:70", "network": {"id": "d5876e18-e2af-45c2-aab5-2d0d552ebfe4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2035085552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a9e5c78c1684c359cfab4e32b9c213f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd091ea0-8c", "ovs_interfaceid": "bd091ea0-8c42-4140-aad1-617f27d2a469", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 15:01:22 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-2d60f688-24dd-4843-9c91-4885475dd1ac tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:1d:70,bridge_name='br-int',has_traffic_filtering=True,id=bd091ea0-8c42-4140-aad1-617f27d2a469,network=Network(d5876e18-e2af-45c2-aab5-2d0d552ebfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd091ea0-8c') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 15:01:22 user nova-compute[70924]: DEBUG os_vif [None req-2d60f688-24dd-4843-9c91-4885475dd1ac tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:1d:70,bridge_name='br-int',has_traffic_filtering=True,id=bd091ea0-8c42-4140-aad1-617f27d2a469,network=Network(d5876e18-e2af-45c2-aab5-2d0d552ebfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd091ea0-8c') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 15:01:22 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:01:22 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbd091ea0-8c, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:01:22 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:01:22 user nova-compute[70924]: INFO os_vif [None req-2d60f688-24dd-4843-9c91-4885475dd1ac tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:1d:70,bridge_name='br-int',has_traffic_filtering=True,id=bd091ea0-8c42-4140-aad1-617f27d2a469,network=Network(d5876e18-e2af-45c2-aab5-2d0d552ebfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd091ea0-8c')
Jul 29 15:01:22 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-2d60f688-24dd-4843-9c91-4885475dd1ac tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Deleting instance files /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc_del
Jul 29 15:01:22 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-2d60f688-24dd-4843-9c91-4885475dd1ac tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Deletion of /opt/stack/data/nova/instances/db656346-c4af-43da-9600-fd39f1b9e4dc_del complete
Jul 29 15:01:22 user nova-compute[70924]: INFO nova.compute.manager [None req-2d60f688-24dd-4843-9c91-4885475dd1ac tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Took 0.85 seconds to destroy the instance on the hypervisor.
Jul 29 15:01:22 user nova-compute[70924]: DEBUG oslo.service.loopingcall [None req-2d60f688-24dd-4843-9c91-4885475dd1ac tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70924) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 15:01:22 user nova-compute[70924]: DEBUG nova.compute.manager [-] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Deallocating network for instance {{(pid=70924) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 15:01:22 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] deallocate_for_instance() {{(pid=70924) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 15:01:22 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-57d3a721-b3cf-484a-a5f8-fb0fe843f369 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Acquiring lock "5865be57-b5f2-4132-bc71-cc41bfe9f897" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:01:22 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-57d3a721-b3cf-484a-a5f8-fb0fe843f369 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lock "5865be57-b5f2-4132-bc71-cc41bfe9f897" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:01:22 user nova-compute[70924]: INFO nova.compute.manager [None req-57d3a721-b3cf-484a-a5f8-fb0fe843f369 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Rebooting instance
Jul 29 15:01:22 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-57d3a721-b3cf-484a-a5f8-fb0fe843f369 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Acquiring lock "refresh_cache-5865be57-b5f2-4132-bc71-cc41bfe9f897" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:01:22 user nova-compute[70924]: DEBUG nova.network.neutron [req-4f22e18a-82b9-4175-806e-3b4dfa81655d req-82595a0e-331f-4bcb-bdc1-db127cca0ff5 service nova] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Updated VIF entry in instance network info cache for port 6641ec75-757f-44fa-980b-5b0f270432eb. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 15:01:22 user nova-compute[70924]: DEBUG nova.network.neutron [req-4f22e18a-82b9-4175-806e-3b4dfa81655d req-82595a0e-331f-4bcb-bdc1-db127cca0ff5 service nova] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Updating instance_info_cache with network_info: [{"id": "6641ec75-757f-44fa-980b-5b0f270432eb", "address": "fa:16:3e:03:b3:5f", "network": {"id": "21a19801-8526-40a2-9bcb-dda6cfb435fe", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-761511746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a03844d646454b6ea55e1b5625f7909a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6641ec75-75", "ovs_interfaceid": "6641ec75-757f-44fa-980b-5b0f270432eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:01:22 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-4f22e18a-82b9-4175-806e-3b4dfa81655d req-82595a0e-331f-4bcb-bdc1-db127cca0ff5 service nova] Releasing lock "refresh_cache-5865be57-b5f2-4132-bc71-cc41bfe9f897" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:01:22 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-57d3a721-b3cf-484a-a5f8-fb0fe843f369 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Acquired lock "refresh_cache-5865be57-b5f2-4132-bc71-cc41bfe9f897" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:01:22 user nova-compute[70924]: DEBUG nova.network.neutron [None req-57d3a721-b3cf-484a-a5f8-fb0fe843f369 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 15:01:23 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:01:23 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Took 1.10 seconds to deallocate network for instance.
Jul 29 15:01:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2d60f688-24dd-4843-9c91-4885475dd1ac tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:01:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2d60f688-24dd-4843-9c91-4885475dd1ac tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:01:23 user nova-compute[70924]: DEBUG nova.network.neutron [None req-57d3a721-b3cf-484a-a5f8-fb0fe843f369 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Updating instance_info_cache with network_info: [{"id": "6641ec75-757f-44fa-980b-5b0f270432eb", "address": "fa:16:3e:03:b3:5f", "network": {"id": "21a19801-8526-40a2-9bcb-dda6cfb435fe", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-761511746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a03844d646454b6ea55e1b5625f7909a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6641ec75-75", "ovs_interfaceid": "6641ec75-757f-44fa-980b-5b0f270432eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:01:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-57d3a721-b3cf-484a-a5f8-fb0fe843f369 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Releasing lock "refresh_cache-5865be57-b5f2-4132-bc71-cc41bfe9f897" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:01:23 user nova-compute[70924]: DEBUG nova.compute.manager [None req-57d3a721-b3cf-484a-a5f8-fb0fe843f369 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:01:23 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-2d60f688-24dd-4843-9c91-4885475dd1ac tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:01:23 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-2d60f688-24dd-4843-9c91-4885475dd1ac tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:01:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2d60f688-24dd-4843-9c91-4885475dd1ac tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.313s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:01:23 user nova-compute[70924]: INFO nova.scheduler.client.report [None req-2d60f688-24dd-4843-9c91-4885475dd1ac tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Deleted allocations for instance db656346-c4af-43da-9600-fd39f1b9e4dc
Jul 29 15:01:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2d60f688-24dd-4843-9c91-4885475dd1ac tempest-ServerBootFromVolumeStableRescueTest-2089253815 tempest-ServerBootFromVolumeStableRescueTest-2089253815-project-member] Lock "db656346-c4af-43da-9600-fd39f1b9e4dc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.439s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:01:24 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:01:24 user nova-compute[70924]: DEBUG nova.compute.manager [req-bfdeec2d-07f0-4b36-99e6-f7222e01cf7f req-a3bcb24d-282e-4bee-80b2-ec970cd1f774 service nova] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Received event network-vif-deleted-bd091ea0-8c42-4140-aad1-617f27d2a469 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:01:25 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:01:25 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:01:25 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:01:25 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:01:26 user nova-compute[70924]: DEBUG nova.compute.manager [req-41e70804-2e03-47f9-9216-069632945385 req-88d514d0-3a09-41d7-888d-fa8e6ccb39c5 service nova] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Received event network-vif-unplugged-6641ec75-757f-44fa-980b-5b0f270432eb {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:01:26 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-41e70804-2e03-47f9-9216-069632945385 req-88d514d0-3a09-41d7-888d-fa8e6ccb39c5 service nova] Acquiring lock "5865be57-b5f2-4132-bc71-cc41bfe9f897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:01:26 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-41e70804-2e03-47f9-9216-069632945385 req-88d514d0-3a09-41d7-888d-fa8e6ccb39c5 service nova] Lock "5865be57-b5f2-4132-bc71-cc41bfe9f897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:01:26 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-41e70804-2e03-47f9-9216-069632945385 req-88d514d0-3a09-41d7-888d-fa8e6ccb39c5 service nova] Lock "5865be57-b5f2-4132-bc71-cc41bfe9f897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:01:26 user nova-compute[70924]: DEBUG nova.compute.manager [req-41e70804-2e03-47f9-9216-069632945385 req-88d514d0-3a09-41d7-888d-fa8e6ccb39c5 service nova] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] No waiting events found dispatching network-vif-unplugged-6641ec75-757f-44fa-980b-5b0f270432eb {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:01:26 user nova-compute[70924]: WARNING nova.compute.manager [req-41e70804-2e03-47f9-9216-069632945385 req-88d514d0-3a09-41d7-888d-fa8e6ccb39c5 service nova] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Received unexpected event network-vif-unplugged-6641ec75-757f-44fa-980b-5b0f270432eb for instance with vm_state active and task_state reboot_started.
Jul 29 15:01:26 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-57d3a721-b3cf-484a-a5f8-fb0fe843f369 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Instance shutdown successfully.
Jul 29 15:01:26 user nova-compute[70924]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690642871.9523716, b3efaa8e-7138-40be-a271-8a344eac3e48 => Stopped> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 15:01:26 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] VM Stopped (Lifecycle Event)
Jul 29 15:01:26 user nova-compute[70924]: DEBUG nova.compute.manager [None req-f29c658e-ea94-45ec-9b53-7112fc5de290 None None] [instance: b3efaa8e-7138-40be-a271-8a344eac3e48] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:01:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:01:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:01:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:01:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:01:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:01:28 user nova-compute[70924]: DEBUG nova.compute.manager [req-b1c1f5c5-25b7-4668-8bbc-817c1bb2e535 req-23c8163f-65f5-4c87-9ce8-4b2b05774377 service nova] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Received event network-vif-plugged-6641ec75-757f-44fa-980b-5b0f270432eb {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:01:28 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b1c1f5c5-25b7-4668-8bbc-817c1bb2e535 req-23c8163f-65f5-4c87-9ce8-4b2b05774377 service nova] Acquiring lock "5865be57-b5f2-4132-bc71-cc41bfe9f897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:01:28 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b1c1f5c5-25b7-4668-8bbc-817c1bb2e535 req-23c8163f-65f5-4c87-9ce8-4b2b05774377 service nova] Lock "5865be57-b5f2-4132-bc71-cc41bfe9f897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:01:28 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b1c1f5c5-25b7-4668-8bbc-817c1bb2e535 req-23c8163f-65f5-4c87-9ce8-4b2b05774377 service nova] Lock "5865be57-b5f2-4132-bc71-cc41bfe9f897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:01:28 user nova-compute[70924]: DEBUG nova.compute.manager [req-b1c1f5c5-25b7-4668-8bbc-817c1bb2e535 req-23c8163f-65f5-4c87-9ce8-4b2b05774377 service nova] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] No waiting events found dispatching network-vif-plugged-6641ec75-757f-44fa-980b-5b0f270432eb {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:01:28 user nova-compute[70924]: WARNING nova.compute.manager [req-b1c1f5c5-25b7-4668-8bbc-817c1bb2e535 req-23c8163f-65f5-4c87-9ce8-4b2b05774377 service nova] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Received unexpected event network-vif-plugged-6641ec75-757f-44fa-980b-5b0f270432eb for instance with vm_state active and task_state reboot_started.
Jul 29 15:01:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:01:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:01:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:01:29 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:01:30 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Removed pending event for 5865be57-b5f2-4132-bc71-cc41bfe9f897 due to event {{(pid=70924) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 29 15:01:30 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642890.0840154, 5865be57-b5f2-4132-bc71-cc41bfe9f897 => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 15:01:30 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] VM Resumed (Lifecycle Event)
Jul 29 15:01:30 user nova-compute[70924]: DEBUG nova.compute.manager [req-6676db3d-b79a-41d6-a428-15744362dc64 req-721e7ce9-e83a-4c26-b423-a5198ba8800f service nova] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Received event network-vif-plugged-6641ec75-757f-44fa-980b-5b0f270432eb {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:01:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-6676db3d-b79a-41d6-a428-15744362dc64 req-721e7ce9-e83a-4c26-b423-a5198ba8800f service nova] Acquiring lock "5865be57-b5f2-4132-bc71-cc41bfe9f897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:01:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-6676db3d-b79a-41d6-a428-15744362dc64 req-721e7ce9-e83a-4c26-b423-a5198ba8800f service nova] Lock "5865be57-b5f2-4132-bc71-cc41bfe9f897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:01:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-6676db3d-b79a-41d6-a428-15744362dc64 req-721e7ce9-e83a-4c26-b423-a5198ba8800f service nova] Lock "5865be57-b5f2-4132-bc71-cc41bfe9f897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:01:30 user nova-compute[70924]: DEBUG nova.compute.manager [req-6676db3d-b79a-41d6-a428-15744362dc64 req-721e7ce9-e83a-4c26-b423-a5198ba8800f service nova] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] No waiting events found dispatching network-vif-plugged-6641ec75-757f-44fa-980b-5b0f270432eb {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:01:30 user nova-compute[70924]: WARNING nova.compute.manager [req-6676db3d-b79a-41d6-a428-15744362dc64 req-721e7ce9-e83a-4c26-b423-a5198ba8800f service nova] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Received unexpected event network-vif-plugged-6641ec75-757f-44fa-980b-5b0f270432eb for instance with vm_state active and task_state reboot_started.
Jul 29 15:01:30 user nova-compute[70924]: DEBUG nova.compute.manager [req-6676db3d-b79a-41d6-a428-15744362dc64 req-721e7ce9-e83a-4c26-b423-a5198ba8800f service nova] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Received event network-vif-plugged-6641ec75-757f-44fa-980b-5b0f270432eb {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:01:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-6676db3d-b79a-41d6-a428-15744362dc64 req-721e7ce9-e83a-4c26-b423-a5198ba8800f service nova] Acquiring lock "5865be57-b5f2-4132-bc71-cc41bfe9f897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:01:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-6676db3d-b79a-41d6-a428-15744362dc64 req-721e7ce9-e83a-4c26-b423-a5198ba8800f service nova] Lock "5865be57-b5f2-4132-bc71-cc41bfe9f897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:01:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-6676db3d-b79a-41d6-a428-15744362dc64 req-721e7ce9-e83a-4c26-b423-a5198ba8800f service nova] Lock "5865be57-b5f2-4132-bc71-cc41bfe9f897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:01:30 user nova-compute[70924]: DEBUG nova.compute.manager [req-6676db3d-b79a-41d6-a428-15744362dc64 req-721e7ce9-e83a-4c26-b423-a5198ba8800f service nova] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] No waiting events found dispatching network-vif-plugged-6641ec75-757f-44fa-980b-5b0f270432eb {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:01:30 user nova-compute[70924]: WARNING nova.compute.manager [req-6676db3d-b79a-41d6-a428-15744362dc64 req-721e7ce9-e83a-4c26-b423-a5198ba8800f service nova] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Received unexpected event network-vif-plugged-6641ec75-757f-44fa-980b-5b0f270432eb for instance with vm_state active and task_state reboot_started.
Jul 29 15:01:30 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:01:30 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Instance running successfully.
Jul 29 15:01:30 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-57d3a721-b3cf-484a-a5f8-fb0fe843f369 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Instance soft rebooted successfully.
Jul 29 15:01:30 user nova-compute[70924]: DEBUG nova.compute.manager [None req-57d3a721-b3cf-484a-a5f8-fb0fe843f369 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:01:30 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 15:01:30 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] During sync_power_state the instance has a pending task (reboot_started). Skip.
Jul 29 15:01:30 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642890.0853186, 5865be57-b5f2-4132-bc71-cc41bfe9f897 => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 15:01:30 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] VM Started (Lifecycle Event)
Jul 29 15:01:30 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:01:30 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 15:01:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-57d3a721-b3cf-484a-a5f8-fb0fe843f369 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lock "5865be57-b5f2-4132-bc71-cc41bfe9f897" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.663s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:01:32 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:01:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:01:37 user nova-compute[70924]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690642882.1141276, db656346-c4af-43da-9600-fd39f1b9e4dc => Stopped> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 15:01:37 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] VM Stopped (Lifecycle Event)
Jul 29 15:01:37 user nova-compute[70924]: DEBUG nova.compute.manager [None req-44573c98-4f5b-42c3-88c8-2f7d4c7a7a68 None None] [instance: db656346-c4af-43da-9600-fd39f1b9e4dc] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:01:37 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:01:39 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:01:42 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:01:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:01:47 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:01:49 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:01:51 user nova-compute[70924]: INFO nova.compute.manager [None req-3b97d7a0-b302-4952-ac11-b49d1b0c7377 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Unrescuing
Jul 29 15:01:51 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-3b97d7a0-b302-4952-ac11-b49d1b0c7377 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Acquiring lock "refresh_cache-f3f7eeda-a001-4c35-abeb-e459d701bd93" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:01:51 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-3b97d7a0-b302-4952-ac11-b49d1b0c7377 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Acquired lock "refresh_cache-f3f7eeda-a001-4c35-abeb-e459d701bd93" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:01:51 user nova-compute[70924]: DEBUG nova.network.neutron [None req-3b97d7a0-b302-4952-ac11-b49d1b0c7377 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 15:01:52 user nova-compute[70924]: DEBUG nova.network.neutron [None req-3b97d7a0-b302-4952-ac11-b49d1b0c7377 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Updating instance_info_cache with network_info: [{"id": "eafccd28-f902-4bc2-805e-4d2f8bbd4e82", "address": "fa:16:3e:9f:ec:06", "network": {"id": "b2aee530-d195-47bb-b39d-c8bd15b81a08", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-421022738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcf4644e7a24bf68b407be2e3d9732c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeafccd28-f9", "ovs_interfaceid": "eafccd28-f902-4bc2-805e-4d2f8bbd4e82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:01:52 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-3b97d7a0-b302-4952-ac11-b49d1b0c7377 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Releasing lock "refresh_cache-f3f7eeda-a001-4c35-abeb-e459d701bd93" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:01:52 user nova-compute[70924]: DEBUG nova.objects.instance [None req-3b97d7a0-b302-4952-ac11-b49d1b0c7377 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lazy-loading 'flavor' on Instance uuid f3f7eeda-a001-4c35-abeb-e459d701bd93 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:01:52 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:01:52 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:01:52 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:01:52 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:01:52 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:01:52 user nova-compute[70924]: DEBUG nova.compute.manager [req-0f31782e-1c57-4cad-b456-9400bfad69c5 req-7b847953-91af-4c9f-983e-c0380583a786 service nova] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Received event network-vif-unplugged-eafccd28-f902-4bc2-805e-4d2f8bbd4e82 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:01:52 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-0f31782e-1c57-4cad-b456-9400bfad69c5 req-7b847953-91af-4c9f-983e-c0380583a786 service nova] Acquiring lock "f3f7eeda-a001-4c35-abeb-e459d701bd93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:01:52 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-0f31782e-1c57-4cad-b456-9400bfad69c5 req-7b847953-91af-4c9f-983e-c0380583a786 service nova] Lock "f3f7eeda-a001-4c35-abeb-e459d701bd93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:01:52 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-0f31782e-1c57-4cad-b456-9400bfad69c5 req-7b847953-91af-4c9f-983e-c0380583a786 service nova] Lock "f3f7eeda-a001-4c35-abeb-e459d701bd93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:01:52 user nova-compute[70924]: DEBUG nova.compute.manager [req-0f31782e-1c57-4cad-b456-9400bfad69c5 req-7b847953-91af-4c9f-983e-c0380583a786 service nova] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] No waiting events found dispatching network-vif-unplugged-eafccd28-f902-4bc2-805e-4d2f8bbd4e82 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:01:52 user nova-compute[70924]: WARNING nova.compute.manager [req-0f31782e-1c57-4cad-b456-9400bfad69c5 req-7b847953-91af-4c9f-983e-c0380583a786 service nova] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Received unexpected event network-vif-unplugged-eafccd28-f902-4bc2-805e-4d2f8bbd4e82 for instance with vm_state rescued and task_state unrescuing.
Jul 29 15:01:52 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-28a91f4d-5908-463b-b631-e5a519ce5265 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Acquiring lock "1555ef29-8abe-43ca-ad2b-ac2f86180202" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:01:52 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-28a91f4d-5908-463b-b631-e5a519ce5265 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "1555ef29-8abe-43ca-ad2b-ac2f86180202" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:01:52 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-28a91f4d-5908-463b-b631-e5a519ce5265 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Acquiring lock "1555ef29-8abe-43ca-ad2b-ac2f86180202-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:01:52 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-28a91f4d-5908-463b-b631-e5a519ce5265 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "1555ef29-8abe-43ca-ad2b-ac2f86180202-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:01:52 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-28a91f4d-5908-463b-b631-e5a519ce5265 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "1555ef29-8abe-43ca-ad2b-ac2f86180202-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:01:52 user nova-compute[70924]: INFO nova.compute.manager [None req-28a91f4d-5908-463b-b631-e5a519ce5265 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Terminating instance
Jul 29 15:01:52 user nova-compute[70924]: DEBUG nova.compute.manager [None req-28a91f4d-5908-463b-b631-e5a519ce5265 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Start destroying the instance on the hypervisor. {{(pid=70924) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 15:01:52 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:01:52 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:01:52 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Instance destroyed successfully.
Jul 29 15:01:52 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:01:52 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:01:52 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:01:52 user nova-compute[70924]: DEBUG nova.compute.manager [req-201bbc38-bdce-466f-bb7c-d634aa92bdcd req-fe1acae3-157c-4ca2-94ae-940cef0fd10e service nova] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Received event network-vif-unplugged-f34f8730-445d-4711-8db4-3c6455cbd24e {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:01:52 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-201bbc38-bdce-466f-bb7c-d634aa92bdcd req-fe1acae3-157c-4ca2-94ae-940cef0fd10e service nova] Acquiring lock "1555ef29-8abe-43ca-ad2b-ac2f86180202-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:01:52 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-201bbc38-bdce-466f-bb7c-d634aa92bdcd req-fe1acae3-157c-4ca2-94ae-940cef0fd10e service nova] Lock "1555ef29-8abe-43ca-ad2b-ac2f86180202-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:01:52 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-201bbc38-bdce-466f-bb7c-d634aa92bdcd req-fe1acae3-157c-4ca2-94ae-940cef0fd10e service nova] Lock "1555ef29-8abe-43ca-ad2b-ac2f86180202-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:01:52 user nova-compute[70924]: DEBUG nova.compute.manager [req-201bbc38-bdce-466f-bb7c-d634aa92bdcd req-fe1acae3-157c-4ca2-94ae-940cef0fd10e service nova] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] No waiting events found dispatching network-vif-unplugged-f34f8730-445d-4711-8db4-3c6455cbd24e {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:01:52 user nova-compute[70924]: DEBUG nova.compute.manager [req-201bbc38-bdce-466f-bb7c-d634aa92bdcd req-fe1acae3-157c-4ca2-94ae-940cef0fd10e service nova] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Received event network-vif-unplugged-f34f8730-445d-4711-8db4-3c6455cbd24e for instance with task_state deleting. {{(pid=70924) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 15:01:52 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:01:53 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Instance destroyed successfully.
Jul 29 15:01:53 user nova-compute[70924]: DEBUG nova.objects.instance [None req-28a91f4d-5908-463b-b631-e5a519ce5265 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lazy-loading 'resources' on Instance uuid 1555ef29-8abe-43ca-ad2b-ac2f86180202 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:01:53 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-28a91f4d-5908-463b-b631-e5a519ce5265 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-29T14:56:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-294782032',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-294782032',id=32,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7k8yfFGWAhiv9WTAEC+6fczleFZHosFBEhgzN65FlDOxe0bzyOCT08gSIHyZ/TQjIC3xWZ7z6zR+yTrFH/0d4DbX2ns5rROljHoWjhL3MWWhXMwDOcgatQXM+nTcx+Rg==',key_name='tempest-keypair-391897607',keypairs=<?>,launch_index=0,launched_at=2023-07-29T15:00:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6f5f9f30926f47afad3cb4c9e89d55c5',ramdisk_id='',reservation_id='r-daxoh0gf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-130200384',owner_user_name='tempest-AttachVolumeShelveTestJSON-130200384-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T15:00:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c9562451ffa45b2aad975335d83fa8c',uuid=1555ef29-8abe-43ca-ad2b-ac2f86180202,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f34f8730-445d-4711-8db4-3c6455cbd24e", "address": "fa:16:3e:c0:c2:af", "network": {"id": "ff833b6e-b3ce-44ac-88ec-775f193cdfe4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-546934977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f5f9f30926f47afad3cb4c9e89d55c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34f8730-44", "ovs_interfaceid": "f34f8730-445d-4711-8db4-3c6455cbd24e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 15:01:53 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-28a91f4d-5908-463b-b631-e5a519ce5265 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Converting VIF {"id": "f34f8730-445d-4711-8db4-3c6455cbd24e", "address": "fa:16:3e:c0:c2:af", "network": {"id": "ff833b6e-b3ce-44ac-88ec-775f193cdfe4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-546934977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f5f9f30926f47afad3cb4c9e89d55c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34f8730-44", "ovs_interfaceid": "f34f8730-445d-4711-8db4-3c6455cbd24e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 15:01:53 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-28a91f4d-5908-463b-b631-e5a519ce5265 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:c2:af,bridge_name='br-int',has_traffic_filtering=True,id=f34f8730-445d-4711-8db4-3c6455cbd24e,network=Network(ff833b6e-b3ce-44ac-88ec-775f193cdfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf34f8730-44') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 15:01:53 user nova-compute[70924]: DEBUG os_vif [None req-28a91f4d-5908-463b-b631-e5a519ce5265 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:c2:af,bridge_name='br-int',has_traffic_filtering=True,id=f34f8730-445d-4711-8db4-3c6455cbd24e,network=Network(ff833b6e-b3ce-44ac-88ec-775f193cdfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf34f8730-44') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 15:01:53 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:01:53 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf34f8730-44, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:01:53 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:01:53 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:01:53 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:01:53 user nova-compute[70924]: INFO os_vif [None req-28a91f4d-5908-463b-b631-e5a519ce5265 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:c2:af,bridge_name='br-int',has_traffic_filtering=True,id=f34f8730-445d-4711-8db4-3c6455cbd24e,network=Network(ff833b6e-b3ce-44ac-88ec-775f193cdfe4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf34f8730-44')
Jul 29 15:01:53 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-28a91f4d-5908-463b-b631-e5a519ce5265 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Deleting instance files /opt/stack/data/nova/instances/1555ef29-8abe-43ca-ad2b-ac2f86180202_del
Jul 29 15:01:53 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-28a91f4d-5908-463b-b631-e5a519ce5265 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Deletion of /opt/stack/data/nova/instances/1555ef29-8abe-43ca-ad2b-ac2f86180202_del complete
Jul 29 15:01:53 user nova-compute[70924]: INFO nova.compute.manager [None req-28a91f4d-5908-463b-b631-e5a519ce5265 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Took 1.23 seconds to destroy the instance on the hypervisor.
Jul 29 15:01:53 user nova-compute[70924]: DEBUG oslo.service.loopingcall [None req-28a91f4d-5908-463b-b631-e5a519ce5265 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70924) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 15:01:53 user nova-compute[70924]: DEBUG nova.compute.manager [-] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Deallocating network for instance {{(pid=70924) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 15:01:53 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] deallocate_for_instance() {{(pid=70924) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 15:01:54 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:01:54 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:01:54 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:01:54 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:01:54 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:01:54 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:01:54 user nova-compute[70924]: DEBUG nova.compute.manager [req-c53eff05-3879-4a10-b9c3-761073bfe1d0 req-67b6f91b-3a60-4f0e-80a9-638c8c2782d3 service nova] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Received event network-vif-plugged-eafccd28-f902-4bc2-805e-4d2f8bbd4e82 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:01:54 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c53eff05-3879-4a10-b9c3-761073bfe1d0 req-67b6f91b-3a60-4f0e-80a9-638c8c2782d3 service nova] Acquiring lock "f3f7eeda-a001-4c35-abeb-e459d701bd93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:01:54 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c53eff05-3879-4a10-b9c3-761073bfe1d0 req-67b6f91b-3a60-4f0e-80a9-638c8c2782d3 service nova] Lock "f3f7eeda-a001-4c35-abeb-e459d701bd93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:01:54 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c53eff05-3879-4a10-b9c3-761073bfe1d0 req-67b6f91b-3a60-4f0e-80a9-638c8c2782d3 service nova] Lock "f3f7eeda-a001-4c35-abeb-e459d701bd93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:01:54 user nova-compute[70924]: DEBUG nova.compute.manager [req-c53eff05-3879-4a10-b9c3-761073bfe1d0 req-67b6f91b-3a60-4f0e-80a9-638c8c2782d3 service nova] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] No waiting events found dispatching network-vif-plugged-eafccd28-f902-4bc2-805e-4d2f8bbd4e82 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:01:54 user nova-compute[70924]: WARNING nova.compute.manager [req-c53eff05-3879-4a10-b9c3-761073bfe1d0 req-67b6f91b-3a60-4f0e-80a9-638c8c2782d3 service nova] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Received unexpected event network-vif-plugged-eafccd28-f902-4bc2-805e-4d2f8bbd4e82 for instance with vm_state rescued and task_state unrescuing.
Jul 29 15:01:54 user nova-compute[70924]: DEBUG nova.compute.manager [req-c53eff05-3879-4a10-b9c3-761073bfe1d0 req-67b6f91b-3a60-4f0e-80a9-638c8c2782d3 service nova] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Received event network-vif-plugged-eafccd28-f902-4bc2-805e-4d2f8bbd4e82 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:01:54 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c53eff05-3879-4a10-b9c3-761073bfe1d0 req-67b6f91b-3a60-4f0e-80a9-638c8c2782d3 service nova] Acquiring lock "f3f7eeda-a001-4c35-abeb-e459d701bd93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:01:54 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c53eff05-3879-4a10-b9c3-761073bfe1d0 req-67b6f91b-3a60-4f0e-80a9-638c8c2782d3 service nova] Lock "f3f7eeda-a001-4c35-abeb-e459d701bd93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:01:54 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c53eff05-3879-4a10-b9c3-761073bfe1d0 req-67b6f91b-3a60-4f0e-80a9-638c8c2782d3 service nova] Lock "f3f7eeda-a001-4c35-abeb-e459d701bd93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:01:54 user nova-compute[70924]: DEBUG nova.compute.manager [req-c53eff05-3879-4a10-b9c3-761073bfe1d0 req-67b6f91b-3a60-4f0e-80a9-638c8c2782d3 service nova] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] No waiting events found dispatching network-vif-plugged-eafccd28-f902-4bc2-805e-4d2f8bbd4e82 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:01:54 user nova-compute[70924]: WARNING nova.compute.manager [req-c53eff05-3879-4a10-b9c3-761073bfe1d0 req-67b6f91b-3a60-4f0e-80a9-638c8c2782d3 service nova] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Received unexpected event network-vif-plugged-eafccd28-f902-4bc2-805e-4d2f8bbd4e82 for instance with vm_state rescued and task_state unrescuing.
Jul 29 15:01:54 user nova-compute[70924]: DEBUG nova.compute.manager [req-0f19d79a-7775-4cc4-971c-12806523d84f req-5515fe46-97e1-4bb9-b641-93041513ff4e service nova] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Received event network-vif-plugged-f34f8730-445d-4711-8db4-3c6455cbd24e {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:01:54 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-0f19d79a-7775-4cc4-971c-12806523d84f req-5515fe46-97e1-4bb9-b641-93041513ff4e service nova] Acquiring lock "1555ef29-8abe-43ca-ad2b-ac2f86180202-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:01:54 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-0f19d79a-7775-4cc4-971c-12806523d84f req-5515fe46-97e1-4bb9-b641-93041513ff4e service nova] Lock "1555ef29-8abe-43ca-ad2b-ac2f86180202-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:01:54 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-0f19d79a-7775-4cc4-971c-12806523d84f req-5515fe46-97e1-4bb9-b641-93041513ff4e service nova] Lock "1555ef29-8abe-43ca-ad2b-ac2f86180202-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:01:54 user nova-compute[70924]: DEBUG nova.compute.manager [req-0f19d79a-7775-4cc4-971c-12806523d84f req-5515fe46-97e1-4bb9-b641-93041513ff4e service nova] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] No waiting events found dispatching network-vif-plugged-f34f8730-445d-4711-8db4-3c6455cbd24e {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:01:54 user nova-compute[70924]: WARNING nova.compute.manager [req-0f19d79a-7775-4cc4-971c-12806523d84f req-5515fe46-97e1-4bb9-b641-93041513ff4e service nova] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Received unexpected event network-vif-plugged-f34f8730-445d-4711-8db4-3c6455cbd24e for instance with vm_state active and task_state deleting.
Jul 29 15:01:55 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:01:55 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Took 1.34 seconds to deallocate network for instance.
Jul 29 15:01:55 user nova-compute[70924]: DEBUG nova.compute.manager [req-7db22cb0-dfc2-4f9c-a8ae-e626e5298385 req-809f8de2-a580-4e05-94fd-05f12f89fe2e service nova] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Received event network-vif-deleted-f34f8730-445d-4711-8db4-3c6455cbd24e {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:01:55 user nova-compute[70924]: INFO nova.compute.manager [req-7db22cb0-dfc2-4f9c-a8ae-e626e5298385 req-809f8de2-a580-4e05-94fd-05f12f89fe2e service nova] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Neutron deleted interface f34f8730-445d-4711-8db4-3c6455cbd24e; detaching it from the instance and deleting it from the info cache
Jul 29 15:01:55 user nova-compute[70924]: DEBUG nova.network.neutron [req-7db22cb0-dfc2-4f9c-a8ae-e626e5298385 req-809f8de2-a580-4e05-94fd-05f12f89fe2e service nova] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:01:55 user nova-compute[70924]: DEBUG nova.compute.manager [req-7db22cb0-dfc2-4f9c-a8ae-e626e5298385 req-809f8de2-a580-4e05-94fd-05f12f89fe2e service nova] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Detach interface failed, port_id=f34f8730-445d-4711-8db4-3c6455cbd24e, reason: Instance 1555ef29-8abe-43ca-ad2b-ac2f86180202 could not be found. {{(pid=70924) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 29 15:01:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-28a91f4d-5908-463b-b631-e5a519ce5265 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:01:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-28a91f4d-5908-463b-b631-e5a519ce5265 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:01:55 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-28a91f4d-5908-463b-b631-e5a519ce5265 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:01:55 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-28a91f4d-5908-463b-b631-e5a519ce5265 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:01:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-28a91f4d-5908-463b-b631-e5a519ce5265 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.357s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:01:55 user nova-compute[70924]: INFO nova.scheduler.client.report [None req-28a91f4d-5908-463b-b631-e5a519ce5265 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Deleted allocations for instance 1555ef29-8abe-43ca-ad2b-ac2f86180202
Jul 29 15:01:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-28a91f4d-5908-463b-b631-e5a519ce5265 tempest-AttachVolumeShelveTestJSON-130200384 tempest-AttachVolumeShelveTestJSON-130200384-project-member] Lock "1555ef29-8abe-43ca-ad2b-ac2f86180202" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.168s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:01:56 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Removed pending event for f3f7eeda-a001-4c35-abeb-e459d701bd93 due to event {{(pid=70924) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 29 15:01:56 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642916.5822415, f3f7eeda-a001-4c35-abeb-e459d701bd93 => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 15:01:56 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] VM Resumed (Lifecycle Event)
Jul 29 15:01:56 user nova-compute[70924]: DEBUG nova.compute.manager [None req-3b97d7a0-b302-4952-ac11-b49d1b0c7377 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:01:56 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:01:56 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 15:01:56 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 29 15:01:56 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642916.5865402, f3f7eeda-a001-4c35-abeb-e459d701bd93 => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 15:01:56 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] VM Started (Lifecycle Event)
Jul 29 15:01:56 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:01:56 user nova-compute[70924]: DEBUG nova.compute.manager [req-2d25fd80-ad03-4530-87f6-e245ad54ff3a req-fe155c78-b840-456a-a751-14d40c5efa37 service nova] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Received event network-vif-plugged-eafccd28-f902-4bc2-805e-4d2f8bbd4e82 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:01:56 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-2d25fd80-ad03-4530-87f6-e245ad54ff3a req-fe155c78-b840-456a-a751-14d40c5efa37 service nova] Acquiring lock "f3f7eeda-a001-4c35-abeb-e459d701bd93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:01:56 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-2d25fd80-ad03-4530-87f6-e245ad54ff3a req-fe155c78-b840-456a-a751-14d40c5efa37 service nova] Lock "f3f7eeda-a001-4c35-abeb-e459d701bd93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:01:56 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-2d25fd80-ad03-4530-87f6-e245ad54ff3a req-fe155c78-b840-456a-a751-14d40c5efa37 service nova] Lock "f3f7eeda-a001-4c35-abeb-e459d701bd93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:01:56 user nova-compute[70924]: DEBUG nova.compute.manager [req-2d25fd80-ad03-4530-87f6-e245ad54ff3a req-fe155c78-b840-456a-a751-14d40c5efa37 service nova] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] No waiting events found dispatching network-vif-plugged-eafccd28-f902-4bc2-805e-4d2f8bbd4e82 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:01:56 user nova-compute[70924]: WARNING nova.compute.manager [req-2d25fd80-ad03-4530-87f6-e245ad54ff3a req-fe155c78-b840-456a-a751-14d40c5efa37 service nova] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Received unexpected event network-vif-plugged-eafccd28-f902-4bc2-805e-4d2f8bbd4e82 for instance with vm_state rescued and task_state unrescuing.
Jul 29 15:01:56 user nova-compute[70924]: DEBUG nova.compute.manager [req-2d25fd80-ad03-4530-87f6-e245ad54ff3a req-fe155c78-b840-456a-a751-14d40c5efa37 service nova] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Received event network-changed-0166d121-c15e-4189-a56c-d252e9e3de80 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:01:56 user nova-compute[70924]: DEBUG nova.compute.manager [req-2d25fd80-ad03-4530-87f6-e245ad54ff3a req-fe155c78-b840-456a-a751-14d40c5efa37 service nova] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Refreshing instance network info cache due to event network-changed-0166d121-c15e-4189-a56c-d252e9e3de80. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 15:01:56 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-2d25fd80-ad03-4530-87f6-e245ad54ff3a req-fe155c78-b840-456a-a751-14d40c5efa37 service nova] Acquiring lock "refresh_cache-79063387-5fb9-4ce2-81c3-f9a094c0fd22" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:01:56 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-2d25fd80-ad03-4530-87f6-e245ad54ff3a req-fe155c78-b840-456a-a751-14d40c5efa37 service nova] Acquired lock "refresh_cache-79063387-5fb9-4ce2-81c3-f9a094c0fd22" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:01:56 user nova-compute[70924]: DEBUG nova.network.neutron [req-2d25fd80-ad03-4530-87f6-e245ad54ff3a req-fe155c78-b840-456a-a751-14d40c5efa37 service nova] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Refreshing network info cache for port 0166d121-c15e-4189-a56c-d252e9e3de80 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 15:01:56 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 15:01:57 user nova-compute[70924]: DEBUG nova.network.neutron [req-2d25fd80-ad03-4530-87f6-e245ad54ff3a req-fe155c78-b840-456a-a751-14d40c5efa37 service nova] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Updated VIF entry in instance network info cache for port 0166d121-c15e-4189-a56c-d252e9e3de80. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 15:01:57 user nova-compute[70924]: DEBUG nova.network.neutron [req-2d25fd80-ad03-4530-87f6-e245ad54ff3a req-fe155c78-b840-456a-a751-14d40c5efa37 service nova] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Updating instance_info_cache with network_info: [{"id": "0166d121-c15e-4189-a56c-d252e9e3de80", "address": "fa:16:3e:5e:ce:a8", "network": {"id": "a901bee5-6b26-45c7-8f4a-69ffb0b46b73", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1220595772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b6a612c609a43ba81cb1636c323b0d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0166d121-c1", "ovs_interfaceid": "0166d121-c15e-4189-a56c-d252e9e3de80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:01:57 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-2d25fd80-ad03-4530-87f6-e245ad54ff3a req-fe155c78-b840-456a-a751-14d40c5efa37 service nova] Releasing lock "refresh_cache-79063387-5fb9-4ce2-81c3-f9a094c0fd22" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:01:57 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:01:57 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Cleaning up deleted instances {{(pid=70924) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 29 15:01:57 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] There are 0 instances to clean {{(pid=70924) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 29 15:01:58 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:01:58 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:01:58 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:01:58 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:01:59 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:02:00 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-13cefc23-44f9-4084-a6bc-846884a5a7dd tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Acquiring lock "79063387-5fb9-4ce2-81c3-f9a094c0fd22" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:02:00 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-13cefc23-44f9-4084-a6bc-846884a5a7dd tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Lock "79063387-5fb9-4ce2-81c3-f9a094c0fd22" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:02:00 user nova-compute[70924]: DEBUG nova.objects.instance [None req-13cefc23-44f9-4084-a6bc-846884a5a7dd tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Lazy-loading 'flavor' on Instance uuid 79063387-5fb9-4ce2-81c3-f9a094c0fd22 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:02:00 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-13cefc23-44f9-4084-a6bc-846884a5a7dd tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Lock "79063387-5fb9-4ce2-81c3-f9a094c0fd22" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:02:00 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-13cefc23-44f9-4084-a6bc-846884a5a7dd tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Acquiring lock "79063387-5fb9-4ce2-81c3-f9a094c0fd22" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:02:00 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-13cefc23-44f9-4084-a6bc-846884a5a7dd tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Lock "79063387-5fb9-4ce2-81c3-f9a094c0fd22" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:02:00 user nova-compute[70924]: INFO nova.compute.manager [None req-13cefc23-44f9-4084-a6bc-846884a5a7dd tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Attaching volume bd55d15e-2266-4d92-b3e0-d89b0174e81f to /dev/vdb
Jul 29 15:02:00 user nova-compute[70924]: DEBUG os_brick.utils [None req-13cefc23-44f9-4084-a6bc-846884a5a7dd tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 15:02:00 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:02:01 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:02:01 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[077b289b-7c49-476a-a61d-529053372ee5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f2127c4a30d9\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:02:01 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:02:01 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:02:01 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb8b82e-9fcf-44cc-b91c-58a8d1d2cad8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:02:01 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:02:01 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:02:01 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab26d6b-2f1a-41a3-8a25-f38398ebeb46]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:02:01 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff8db60-9542-468b-9979-4bf8e5756cc9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:02:01 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-13cefc23-44f9-4084-a6bc-846884a5a7dd tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Running cmd (subprocess): nvme version {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:02:01 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-13cefc23-44f9-4084-a6bc-846884a5a7dd tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] 'nvme version' failed. Not Retrying. {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 15:02:01 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.nvmeof [None req-13cefc23-44f9-4084-a6bc-846884a5a7dd tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] nvme not present on system {{(pid=70924) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 15:02:01 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:02:01 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 15:02:01 user nova-compute[70924]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 15:02:01 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e674bf-019d-49a7-8ed7-daa0ec207946]: (4, '') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:02:01 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-13cefc23-44f9-4084-a6bc-846884a5a7dd tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70924) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 15:02:01 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-13cefc23-44f9-4084-a6bc-846884a5a7dd tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 15:02:01 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-13cefc23-44f9-4084-a6bc-846884a5a7dd tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] LIGHTOS: no hostnqn found. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 15:02:01 user nova-compute[70924]: DEBUG os_brick.utils [None req-13cefc23-44f9-4084-a6bc-846884a5a7dd tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f2127c4a30d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 15:02:01 user nova-compute[70924]: DEBUG nova.virt.block_device [None req-13cefc23-44f9-4084-a6bc-846884a5a7dd tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Updating existing volume attachment record: 9297ddb7-63e8-410f-b8ab-514928fd3416 {{(pid=70924) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 15:02:01 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:02:02 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:02:03 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:02:03 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:02:03 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:02:03 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:02:03 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:02:03 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Auditing locally available compute resources for user (node: user) {{(pid=70924) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 15:02:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f7eeda-a001-4c35-abeb-e459d701bd93/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:02:03 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:02:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f7eeda-a001-4c35-abeb-e459d701bd93/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:02:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f7eeda-a001-4c35-abeb-e459d701bd93/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:02:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f7eeda-a001-4c35-abeb-e459d701bd93/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:02:03 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 15:02:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5865be57-b5f2-4132-bc71-cc41bfe9f897/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:02:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5865be57-b5f2-4132-bc71-cc41bfe9f897/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:02:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5865be57-b5f2-4132-bc71-cc41bfe9f897/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:02:04 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:02:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5865be57-b5f2-4132-bc71-cc41bfe9f897/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:02:04 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 15:02:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:02:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:02:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:02:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:02:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47104e57-c193-4a85-a2cf-677f0debe373/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:02:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47104e57-c193-4a85-a2cf-677f0debe373/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:02:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47104e57-c193-4a85-a2cf-677f0debe373/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:02:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47104e57-c193-4a85-a2cf-677f0debe373/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:02:04 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 15:02:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk.rescue --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:02:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:02:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk.rescue --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:02:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk.rescue --force-share --output=json" returned: 0 in 0.160s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:02:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:02:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:02:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:02:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:02:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:02:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:02:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:02:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:02:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79063387-5fb9-4ce2-81c3-f9a094c0fd22/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:02:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79063387-5fb9-4ce2-81c3-f9a094c0fd22/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:02:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79063387-5fb9-4ce2-81c3-f9a094c0fd22/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:02:06 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79063387-5fb9-4ce2-81c3-f9a094c0fd22/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:02:06 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:02:06 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:02:06 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Hypervisor/Node resource view: name=user free_ram=7823MB free_disk=25.21741485595703GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70924) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 15:02:06 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:02:06 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:02:06 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 9ec07c62-951b-4e3a-bffa-e01dfb4665ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:02:06 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 091e384f-7851-4ac9-b566-990df0497fc5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:02:06 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance f3f7eeda-a001-4c35-abeb-e459d701bd93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:02:06 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 47104e57-c193-4a85-a2cf-677f0debe373 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:02:06 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 5865be57-b5f2-4132-bc71-cc41bfe9f897 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:02:06 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 79063387-5fb9-4ce2-81c3-f9a094c0fd22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:02:06 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:02:06 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 15:02:06 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 15:02:06 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:02:06 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:02:06 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Compute_service record updated for user:user {{(pid=70924) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 15:02:06 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.420s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:02:06 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:02:06 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Cleaning up deleted instances with incomplete migration  {{(pid=70924) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 29 15:02:08 user nova-compute[70924]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690642913.6311746, 1555ef29-8abe-43ca-ad2b-ac2f86180202 => Stopped> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 15:02:08 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] VM Stopped (Lifecycle Event)
Jul 29 15:02:08 user nova-compute[70924]: DEBUG nova.compute.manager [None req-dd28d7d6-966d-452e-816c-26d00fde85fa None None] [instance: 1555ef29-8abe-43ca-ad2b-ac2f86180202] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:02:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:02:08 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:02:08 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Starting heal instance info cache {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 15:02:08 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Rebuilding the list of instances to heal {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 29 15:02:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "refresh_cache-9ec07c62-951b-4e3a-bffa-e01dfb4665ec" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:02:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquired lock "refresh_cache-9ec07c62-951b-4e3a-bffa-e01dfb4665ec" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:02:09 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Forcefully refreshing network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 29 15:02:09 user nova-compute[70924]: DEBUG nova.objects.instance [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lazy-loading 'info_cache' on Instance uuid 9ec07c62-951b-4e3a-bffa-e01dfb4665ec {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:02:09 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13cefc23-44f9-4084-a6bc-846884a5a7dd tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Calling os-brick to attach iSCSI Volume {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 15:02:09 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-13cefc23-44f9-4084-a6bc-846884a5a7dd tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bd55d15e-2266-4d92-b3e0-d89b0174e81f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EmMwnZRH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 15:02:09 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-13cefc23-44f9-4084-a6bc-846884a5a7dd tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 15:02:09 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-13cefc23-44f9-4084-a6bc-846884a5a7dd tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 15:02:09 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-13cefc23-44f9-4084-a6bc-846884a5a7dd tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 15:02:09 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-13cefc23-44f9-4084-a6bc-846884a5a7dd tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 15:02:09 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-13cefc23-44f9-4084-a6bc-846884a5a7dd tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd55d15e-2266-4d92-b3e0-d89b0174e81f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 15:02:09 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-13cefc23-44f9-4084-a6bc-846884a5a7dd tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd55d15e-2266-4d92-b3e0-d89b0174e81f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 15:02:09 user nova-compute[70924]: INFO os_brick.initiator.connectors.iscsi [None req-13cefc23-44f9-4084-a6bc-846884a5a7dd tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 15:02:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd55d15e-2266-4d92-b3e0-d89b0174e81f -p 172.16.0.220:3260 {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:02:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd55d15e-2266-4d92-b3e0-d89b0174e81f -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:02:09 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5994268-cb63-4fe9-914b-9ca1f5ad4203]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:02:09 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-13cefc23-44f9-4084-a6bc-846884a5a7dd tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 15:02:09 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:02:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd55d15e-2266-4d92-b3e0-d89b0174e81f -p 172.16.0.220:3260 --interface default --op new {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:02:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd55d15e-2266-4d92-b3e0-d89b0174e81f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:02:09 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c6a2ab-22f1-4957-854b-a760e5f61717]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bd55d15e-2266-4d92-b3e0-d89b0174e81f] added\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:02:09 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-13cefc23-44f9-4084-a6bc-846884a5a7dd tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bd55d15e-2266-4d92-b3e0-d89b0174e81f] added
Jul 29 15:02:09 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:02:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd55d15e-2266-4d92-b3e0-d89b0174e81f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:02:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd55d15e-2266-4d92-b3e0-d89b0174e81f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:02:09 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc64538-e428-4db9-bfcd-fc5127e71818]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:02:09 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-13cefc23-44f9-4084-a6bc-846884a5a7dd tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:02:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd55d15e-2266-4d92-b3e0-d89b0174e81f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:02:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd55d15e-2266-4d92-b3e0-d89b0174e81f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:02:09 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6b9ee5-5087-4550-9d07-98f72d1acb0d]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:02:09 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-13cefc23-44f9-4084-a6bc-846884a5a7dd tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:02:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd55d15e-2266-4d92-b3e0-d89b0174e81f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EmMwnZRH {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:02:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd55d15e-2266-4d92-b3e0-d89b0174e81f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EmMwnZRH" returned: 0 in 0.023s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:02:09 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1560afda-72f4-4d41-b450-45d9d8a8efa7]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:02:09 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-13cefc23-44f9-4084-a6bc-846884a5a7dd tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EmMwnZRH'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:02:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd55d15e-2266-4d92-b3e0-d89b0174e81f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:02:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd55d15e-2266-4d92-b3e0-d89b0174e81f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:02:09 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3aa7d32-4ea7-4b32-bdce-e3dc90f6f742]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:02:09 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-13cefc23-44f9-4084-a6bc-846884a5a7dd tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:02:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:02:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:02:09 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[23eb70b6-392b-4934-81e1-9a9ff38fa5d9]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cae21de-6018-4d36-9f32-3d6d6d172685 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:02:09 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-13cefc23-44f9-4084-a6bc-846884a5a7dd tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 (non-flash)
Jul 29 15:02:09 user nova-compute[70924]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f (non-flash)
Jul 29 15:02:09 user nova-compute[70924]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cae21de-6018-4d36-9f32-3d6d6d172685 (non-flash)
Jul 29 15:02:09 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 15:02:09 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-13cefc23-44f9-4084-a6bc-846884a5a7dd tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 (non-flash)
Jul 29 15:02:09 user nova-compute[70924]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f (non-flash)
Jul 29 15:02:09 user nova-compute[70924]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cae21de-6018-4d36-9f32-3d6d6d172685 (non-flash)
Jul 29 15:02:09 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 15:02:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd55d15e-2266-4d92-b3e0-d89b0174e81f -p 172.16.0.220:3260 --login {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:02:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd55d15e-2266-4d92-b3e0-d89b0174e81f -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:02:09 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[254c0185-e862-4603-a12a-6eaa7d33e581]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bd55d15e-2266-4d92-b3e0-d89b0174e81f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bd55d15e-2266-4d92-b3e0-d89b0174e81f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:02:09 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-13cefc23-44f9-4084-a6bc-846884a5a7dd tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bd55d15e-2266-4d92-b3e0-d89b0174e81f, portal: 172.16.0.220,3260]
Jul 29 15:02:09 user nova-compute[70924]: Login to [iface: default, target: iqn.2010-10.org.openstack:bd55d15e-2266-4d92-b3e0-d89b0174e81f, portal: 172.16.0.220,3260] successful.
Jul 29 15:02:09 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:02:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd55d15e-2266-4d92-b3e0-d89b0174e81f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:02:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd55d15e-2266-4d92-b3e0-d89b0174e81f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:02:09 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e216e6-a4dd-40a2-8a41-22a571b26367]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:02:09 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-13cefc23-44f9-4084-a6bc-846884a5a7dd tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:02:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:02:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:02:09 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2bf3a14-25f3-4078-bcaa-012cf2a91f43]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cae21de-6018-4d36-9f32-3d6d6d172685 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd55d15e-2266-4d92-b3e0-d89b0174e81f (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:02:09 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-13cefc23-44f9-4084-a6bc-846884a5a7dd tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 (non-flash)
Jul 29 15:02:09 user nova-compute[70924]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f (non-flash)
Jul 29 15:02:09 user nova-compute[70924]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cae21de-6018-4d36-9f32-3d6d6d172685 (non-flash)
Jul 29 15:02:09 user nova-compute[70924]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd55d15e-2266-4d92-b3e0-d89b0174e81f (non-flash)
Jul 29 15:02:09 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 15:02:09 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-13cefc23-44f9-4084-a6bc-846884a5a7dd tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 (non-flash)
Jul 29 15:02:09 user nova-compute[70924]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f (non-flash)
Jul 29 15:02:09 user nova-compute[70924]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cae21de-6018-4d36-9f32-3d6d6d172685 (non-flash)
Jul 29 15:02:09 user nova-compute[70924]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd55d15e-2266-4d92-b3e0-d89b0174e81f (non-flash)
Jul 29 15:02:09 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 15:02:09 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-13cefc23-44f9-4084-a6bc-846884a5a7dd tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd55d15e-2266-4d92-b3e0-d89b0174e81f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.358s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 15:02:09 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-13cefc23-44f9-4084-a6bc-846884a5a7dd tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Connected to 172.16.0.220:3260 {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 15:02:09 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-13cefc23-44f9-4084-a6bc-846884a5a7dd tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] HCTL ('36', '-', '-', 0) found on session 46 with lun 0 {{(pid=70924) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 15:02:09 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-13cefc23-44f9-4084-a6bc-846884a5a7dd tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70924) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 15:02:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:02:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.024s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:02:09 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4e2b5e-8671-4308-bc09-0ea1e7435873]: (4, ('- - 0', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:02:09 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-13cefc23-44f9-4084-a6bc-846884a5a7dd tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Searching for a device in session 46 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 15:02:09 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-13cefc23-44f9-4084-a6bc-846884a5a7dd tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EmMwnZRH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 15:02:09 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Updating instance_info_cache with network_info: [{"id": "cb01658e-4dd9-426e-9b45-340ea19db056", "address": "fa:16:3e:75:a4:24", "network": {"id": "b2aee530-d195-47bb-b39d-c8bd15b81a08", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-421022738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcf4644e7a24bf68b407be2e3d9732c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb01658e-4d", "ovs_interfaceid": "cb01658e-4dd9-426e-9b45-340ea19db056", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:02:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Releasing lock "refresh_cache-9ec07c62-951b-4e3a-bffa-e01dfb4665ec" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:02:09 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Updated the network info_cache for instance {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 29 15:02:09 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:02:09 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:02:09 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70924) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 15:02:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Acquiring lock "e905081f-dfff-41ab-88b3-8cd91d01671d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:02:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "e905081f-dfff-41ab-88b3-8cd91d01671d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:02:09 user nova-compute[70924]: DEBUG nova.compute.manager [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] Starting instance... {{(pid=70924) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 15:02:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:02:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:02:10 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70924) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 15:02:10 user nova-compute[70924]: INFO nova.compute.claims [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] Claim successful on node user
Jul 29 15:02:10 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:02:10 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:02:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.382s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:02:10 user nova-compute[70924]: DEBUG nova.compute.manager [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] Start building networks asynchronously for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 15:02:10 user nova-compute[70924]: DEBUG nova.compute.manager [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] Allocating IP information in the background. {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 15:02:10 user nova-compute[70924]: DEBUG nova.network.neutron [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] allocate_for_instance() {{(pid=70924) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 15:02:10 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 15:02:10 user nova-compute[70924]: DEBUG nova.compute.manager [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] Start building block device mappings for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 15:02:10 user nova-compute[70924]: INFO nova.virt.block_device [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] Booting with volume acf7212b-b549-46f5-9100-fd4ca336173a at /dev/vda
Jul 29 15:02:10 user nova-compute[70924]: DEBUG nova.policy [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'da204646e8f84693ad470ed1d3eadd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a974cbbf734f51897c3e632ae9e45f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70924) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 15:02:10 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-13cefc23-44f9-4084-a6bc-846884a5a7dd tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.404s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 15:02:10 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-13cefc23-44f9-4084-a6bc-846884a5a7dd tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] <== connect_volume: return (1407ms) {'type': 'block', 'scsi_wwn': '26462373935653530', 'path': '/dev/sde'} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 15:02:10 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13cefc23-44f9-4084-a6bc-846884a5a7dd tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462373935653530', 'path': '/dev/sde'} {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 15:02:10 user nova-compute[70924]: DEBUG nova.objects.instance [None req-13cefc23-44f9-4084-a6bc-846884a5a7dd tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Lazy-loading 'flavor' on Instance uuid 79063387-5fb9-4ce2-81c3-f9a094c0fd22 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:02:10 user nova-compute[70924]: DEBUG os_brick.utils [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 15:02:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:02:10 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-13cefc23-44f9-4084-a6bc-846884a5a7dd tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] attach device xml: <disk type="block" device="disk">
Jul 29 15:02:10 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 15:02:10 user nova-compute[70924]:   <source dev="/dev/sde"/>
Jul 29 15:02:10 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 15:02:10 user nova-compute[70924]:   <serial>bd55d15e-2266-4d92-b3e0-d89b0174e81f</serial>
Jul 29 15:02:10 user nova-compute[70924]: </disk>
Jul 29 15:02:10 user nova-compute[70924]:  {{(pid=70924) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 29 15:02:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.026s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:02:10 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d997e1-f47c-4c0d-a863-ef0c8265d10b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f2127c4a30d9\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:02:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:02:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:02:10 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2758a955-d466-4629-a8c7-fbd90cc66bb2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:02:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:02:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:02:10 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f314fcc-5b71-47b3-9de7-92e1c7ce9693]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:02:10 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e20c367-357a-478a-84e1-9e07350fd0c2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:02:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Running cmd (subprocess): nvme version {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:02:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] 'nvme version' failed. Not Retrying. {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 15:02:10 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] nvme not present on system {{(pid=70924) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 15:02:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:02:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 15:02:10 user nova-compute[70924]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 15:02:10 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5633b7-c6d1-4691-a520-4010a687ea3b]: (4, '') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:02:10 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70924) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 15:02:10 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 15:02:10 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] LIGHTOS: no hostnqn found. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 15:02:10 user nova-compute[70924]: DEBUG os_brick.utils [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] <== get_connector_properties: return (169ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f2127c4a30d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 15:02:10 user nova-compute[70924]: DEBUG nova.virt.block_device [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] Updating existing volume attachment record: eb247595-8cd8-4d35-8874-19b588acd96f {{(pid=70924) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 15:02:11 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-13cefc23-44f9-4084-a6bc-846884a5a7dd tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 15:02:11 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-13cefc23-44f9-4084-a6bc-846884a5a7dd tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 15:02:11 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-13cefc23-44f9-4084-a6bc-846884a5a7dd tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] No VIF found with MAC fa:16:3e:5e:ce:a8, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 15:02:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-13cefc23-44f9-4084-a6bc-846884a5a7dd tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Lock "79063387-5fb9-4ce2-81c3-f9a094c0fd22" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.316s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:02:11 user nova-compute[70924]: DEBUG nova.network.neutron [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] Successfully created port: 6e00390b-efbf-4b94-9709-d1427afd0854 {{(pid=70924) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 15:02:12 user nova-compute[70924]: DEBUG nova.network.neutron [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] Successfully updated port: 6e00390b-efbf-4b94-9709-d1427afd0854 {{(pid=70924) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 15:02:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Acquiring lock "refresh_cache-e905081f-dfff-41ab-88b3-8cd91d01671d" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:02:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Acquired lock "refresh_cache-e905081f-dfff-41ab-88b3-8cd91d01671d" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:02:12 user nova-compute[70924]: DEBUG nova.network.neutron [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 15:02:12 user nova-compute[70924]: DEBUG nova.network.neutron [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] Instance cache missing network info. {{(pid=70924) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 15:02:12 user nova-compute[70924]: DEBUG nova.compute.manager [req-83aec273-38f9-4176-84d6-42b0596751ab req-021f76bb-6cd8-4ea6-8a37-df59132d3745 service nova] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] Received event network-changed-6e00390b-efbf-4b94-9709-d1427afd0854 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:02:12 user nova-compute[70924]: DEBUG nova.compute.manager [req-83aec273-38f9-4176-84d6-42b0596751ab req-021f76bb-6cd8-4ea6-8a37-df59132d3745 service nova] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] Refreshing instance network info cache due to event network-changed-6e00390b-efbf-4b94-9709-d1427afd0854. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 15:02:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-83aec273-38f9-4176-84d6-42b0596751ab req-021f76bb-6cd8-4ea6-8a37-df59132d3745 service nova] Acquiring lock "refresh_cache-e905081f-dfff-41ab-88b3-8cd91d01671d" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:02:12 user nova-compute[70924]: DEBUG nova.network.neutron [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] Updating instance_info_cache with network_info: [{"id": "6e00390b-efbf-4b94-9709-d1427afd0854", "address": "fa:16:3e:76:51:ad", "network": {"id": "c19ed38b-2acd-421a-9e4b-f60df3db2f1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1812407562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a974cbbf734f51897c3e632ae9e45f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e00390b-ef", "ovs_interfaceid": "6e00390b-efbf-4b94-9709-d1427afd0854", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:02:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Releasing lock "refresh_cache-e905081f-dfff-41ab-88b3-8cd91d01671d" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:02:12 user nova-compute[70924]: DEBUG nova.compute.manager [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] Instance network_info: |[{"id": "6e00390b-efbf-4b94-9709-d1427afd0854", "address": "fa:16:3e:76:51:ad", "network": {"id": "c19ed38b-2acd-421a-9e4b-f60df3db2f1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1812407562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a974cbbf734f51897c3e632ae9e45f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e00390b-ef", "ovs_interfaceid": "6e00390b-efbf-4b94-9709-d1427afd0854", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 15:02:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-83aec273-38f9-4176-84d6-42b0596751ab req-021f76bb-6cd8-4ea6-8a37-df59132d3745 service nova] Acquired lock "refresh_cache-e905081f-dfff-41ab-88b3-8cd91d01671d" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:02:12 user nova-compute[70924]: DEBUG nova.network.neutron [req-83aec273-38f9-4176-84d6-42b0596751ab req-021f76bb-6cd8-4ea6-8a37-df59132d3745 service nova] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] Refreshing network info cache for port 6e00390b-efbf-4b94-9709-d1427afd0854 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 15:02:13 user nova-compute[70924]: DEBUG nova.network.neutron [req-83aec273-38f9-4176-84d6-42b0596751ab req-021f76bb-6cd8-4ea6-8a37-df59132d3745 service nova] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] Updated VIF entry in instance network info cache for port 6e00390b-efbf-4b94-9709-d1427afd0854. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 15:02:13 user nova-compute[70924]: DEBUG nova.network.neutron [req-83aec273-38f9-4176-84d6-42b0596751ab req-021f76bb-6cd8-4ea6-8a37-df59132d3745 service nova] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] Updating instance_info_cache with network_info: [{"id": "6e00390b-efbf-4b94-9709-d1427afd0854", "address": "fa:16:3e:76:51:ad", "network": {"id": "c19ed38b-2acd-421a-9e4b-f60df3db2f1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1812407562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a974cbbf734f51897c3e632ae9e45f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e00390b-ef", "ovs_interfaceid": "6e00390b-efbf-4b94-9709-d1427afd0854", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:02:13 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-83aec273-38f9-4176-84d6-42b0596751ab req-021f76bb-6cd8-4ea6-8a37-df59132d3745 service nova] Releasing lock "refresh_cache-e905081f-dfff-41ab-88b3-8cd91d01671d" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:02:13 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-34c06385-600c-4d4c-b11d-e752d3499f5a tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Acquiring lock "79063387-5fb9-4ce2-81c3-f9a094c0fd22" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:02:13 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-34c06385-600c-4d4c-b11d-e752d3499f5a tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Lock "79063387-5fb9-4ce2-81c3-f9a094c0fd22" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:02:13 user nova-compute[70924]: INFO nova.compute.manager [None req-34c06385-600c-4d4c-b11d-e752d3499f5a tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Detaching volume bd55d15e-2266-4d92-b3e0-d89b0174e81f
Jul 29 15:02:13 user nova-compute[70924]: INFO nova.virt.block_device [None req-34c06385-600c-4d4c-b11d-e752d3499f5a tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Attempting to driver detach volume bd55d15e-2266-4d92-b3e0-d89b0174e81f from mountpoint /dev/vdb
Jul 29 15:02:13 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-34c06385-600c-4d4c-b11d-e752d3499f5a tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Attempting to detach device vdb from instance 79063387-5fb9-4ce2-81c3-f9a094c0fd22 from the persistent domain config. {{(pid=70924) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 29 15:02:13 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-34c06385-600c-4d4c-b11d-e752d3499f5a tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 15:02:13 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 15:02:13 user nova-compute[70924]:   <source dev="/dev/sde"/>
Jul 29 15:02:13 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 15:02:13 user nova-compute[70924]:   <serial>bd55d15e-2266-4d92-b3e0-d89b0174e81f</serial>
Jul 29 15:02:13 user nova-compute[70924]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 15:02:13 user nova-compute[70924]: </disk>
Jul 29 15:02:13 user nova-compute[70924]:  {{(pid=70924) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 15:02:13 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-34c06385-600c-4d4c-b11d-e752d3499f5a tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Successfully detached device vdb from instance 79063387-5fb9-4ce2-81c3-f9a094c0fd22 from the persistent domain config.
Jul 29 15:02:13 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-34c06385-600c-4d4c-b11d-e752d3499f5a tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 79063387-5fb9-4ce2-81c3-f9a094c0fd22 from the live domain config. {{(pid=70924) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 29 15:02:13 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-34c06385-600c-4d4c-b11d-e752d3499f5a tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 15:02:13 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 15:02:13 user nova-compute[70924]:   <source dev="/dev/sde"/>
Jul 29 15:02:13 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 15:02:13 user nova-compute[70924]:   <serial>bd55d15e-2266-4d92-b3e0-d89b0174e81f</serial>
Jul 29 15:02:13 user nova-compute[70924]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 15:02:13 user nova-compute[70924]: </disk>
Jul 29 15:02:13 user nova-compute[70924]:  {{(pid=70924) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 15:02:13 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:02:13 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Received event <DeviceRemovedEvent: 1690642933.8015192, 79063387-5fb9-4ce2-81c3-f9a094c0fd22 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70924) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 29 15:02:13 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-34c06385-600c-4d4c-b11d-e752d3499f5a tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 79063387-5fb9-4ce2-81c3-f9a094c0fd22 {{(pid=70924) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 29 15:02:13 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-34c06385-600c-4d4c-b11d-e752d3499f5a tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Successfully detached device vdb from instance 79063387-5fb9-4ce2-81c3-f9a094c0fd22 from the live domain config.
Jul 29 15:02:13 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34c06385-600c-4d4c-b11d-e752d3499f5a tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] calling os-brick to detach iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 15:02:13 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-34c06385-600c-4d4c-b11d-e752d3499f5a tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, {'target_iqns': ['iqn.2010-10.org.openstack:bd55d15e-2266-4d92-b3e0-d89b0174e81f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EmMwnZRH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 15:02:13 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-34c06385-600c-4d4c-b11d-e752d3499f5a tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 15:02:13 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-34c06385-600c-4d4c-b11d-e752d3499f5a tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 15:02:13 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-34c06385-600c-4d4c-b11d-e752d3499f5a tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 15:02:13 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-34c06385-600c-4d4c-b11d-e752d3499f5a tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd55d15e-2266-4d92-b3e0-d89b0174e81f', 0)] {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 15:02:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:02:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:02:13 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[69bf787d-4f0d-4e1b-a28e-e4ccb42575ae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2cae21de-6018-4d36-9f32-3d6d6d172685\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd55d15e-2266-4d92-b3e0-d89b0174e81f\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:02:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:02:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:02:13 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c52707-93bd-4a58-b4d9-f7f553fac7c3]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cae21de-6018-4d36-9f32-3d6d6d172685 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd55d15e-2266-4d92-b3e0-d89b0174e81f (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:02:13 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-34c06385-600c-4d4c-b11d-e752d3499f5a tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 (non-flash)
Jul 29 15:02:13 user nova-compute[70924]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f (non-flash)
Jul 29 15:02:13 user nova-compute[70924]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cae21de-6018-4d36-9f32-3d6d6d172685 (non-flash)
Jul 29 15:02:13 user nova-compute[70924]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd55d15e-2266-4d92-b3e0-d89b0174e81f (non-flash)
Jul 29 15:02:13 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 15:02:13 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-34c06385-600c-4d4c-b11d-e752d3499f5a tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 (non-flash)
Jul 29 15:02:13 user nova-compute[70924]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f (non-flash)
Jul 29 15:02:13 user nova-compute[70924]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cae21de-6018-4d36-9f32-3d6d6d172685 (non-flash)
Jul 29 15:02:13 user nova-compute[70924]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd55d15e-2266-4d92-b3e0-d89b0174e81f (non-flash)
Jul 29 15:02:13 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 15:02:13 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-34c06385-600c-4d4c-b11d-e752d3499f5a tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feecc669fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd55d15e-2266-4d92-b3e0-d89b0174e81f'): ({'sde'}, set())}) {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 15:02:13 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-34c06385-600c-4d4c-b11d-e752d3499f5a tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Removing single pathed devices sde {{(pid=70924) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 15:02:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:02:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:02:13 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b7c0f2-fc29-433f-8fe2-233d88220b22]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:02:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:02:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:02:13 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[4998c75f-aa45-436f-b94d-2980af885949]: (4, ('ok\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:02:13 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-34c06385-600c-4d4c-b11d-e752d3499f5a tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Flushing IO for device /dev/sde {{(pid=70924) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 15:02:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:02:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:02:13 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e0649d-1e35-4f61-8fb8-7b0af2b53c89]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:02:13 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-34c06385-600c-4d4c-b11d-e752d3499f5a tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70924) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 15:02:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:02:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.035s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:02:13 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[743b6b49-3595-4077-91e2-3f0da9910e82]: (4, ('1', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:02:13 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-34c06385-600c-4d4c-b11d-e752d3499f5a tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 15:02:13 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-34c06385-600c-4d4c-b11d-e752d3499f5a tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] SCSI volumes sde have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 15:02:13 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-34c06385-600c-4d4c-b11d-e752d3499f5a tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd55d15e-2266-4d92-b3e0-d89b0174e81f')] {{(pid=70924) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 15:02:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd55d15e-2266-4d92-b3e0-d89b0174e81f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:02:14 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd55d15e-2266-4d92-b3e0-d89b0174e81f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:02:14 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e1336f-a375-417b-b307-dbc0efdfd07e]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:02:14 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-34c06385-600c-4d4c-b11d-e752d3499f5a tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:02:14 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd55d15e-2266-4d92-b3e0-d89b0174e81f -p 172.16.0.220:3260 --logout {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:02:14 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd55d15e-2266-4d92-b3e0-d89b0174e81f -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:02:14 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[220fa003-7e7b-41ea-83d1-ae9485a55c05]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:bd55d15e-2266-4d92-b3e0-d89b0174e81f, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:bd55d15e-2266-4d92-b3e0-d89b0174e81f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:02:14 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-34c06385-600c-4d4c-b11d-e752d3499f5a tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:bd55d15e-2266-4d92-b3e0-d89b0174e81f, portal: 172.16.0.220,3260]
Jul 29 15:02:14 user nova-compute[70924]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:bd55d15e-2266-4d92-b3e0-d89b0174e81f, portal: 172.16.0.220,3260] successful.
Jul 29 15:02:14 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:02:14 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd55d15e-2266-4d92-b3e0-d89b0174e81f -p 172.16.0.220:3260 --op delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:02:14 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:02:14 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd55d15e-2266-4d92-b3e0-d89b0174e81f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:02:14 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a497dad-6e86-4c4b-8bf4-2c8e5969ae40]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:02:14 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-34c06385-600c-4d4c-b11d-e752d3499f5a tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:02:14 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-34c06385-600c-4d4c-b11d-e752d3499f5a tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 15:02:14 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-34c06385-600c-4d4c-b11d-e752d3499f5a tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] <== disconnect_volume: return (290ms) None {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 15:02:14 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34c06385-600c-4d4c-b11d-e752d3499f5a tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Disconnected iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 15:02:14 user nova-compute[70924]: DEBUG nova.objects.instance [None req-34c06385-600c-4d4c-b11d-e752d3499f5a tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Lazy-loading 'flavor' on Instance uuid 79063387-5fb9-4ce2-81c3-f9a094c0fd22 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:02:14 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-34c06385-600c-4d4c-b11d-e752d3499f5a tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Lock "79063387-5fb9-4ce2-81c3-f9a094c0fd22" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.649s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:02:14 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG nova.compute.manager [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] Start spawning the instance on the hypervisor. {{(pid=70924) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] Creating instance directory {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 15:02:18 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] Creating image(s)
Jul 29 15:02:18 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] Did not create local disks {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] Ensure instance console log exists: /opt/stack/data/nova/instances/e905081f-dfff-41ab-88b3-8cd91d01671d/console.log {{(pid=70924) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] Start _get_guest_xml network_info=[{"id": "6e00390b-efbf-4b94-9709-d1427afd0854", "address": "fa:16:3e:76:51:ad", "network": {"id": "c19ed38b-2acd-421a-9e4b-f60df3db2f1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1812407562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a974cbbf734f51897c3e632ae9e45f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e00390b-ef", "ovs_interfaceid": "6e00390b-efbf-4b94-9709-d1427afd0854", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:acf7212b-b549-46f5-9100-fd4ca336173a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RuNZCaGw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e905081f-dfff-41ab-88b3-8cd91d01671d', 'attached_at': '', 'detached_at': '', 'volume_id': 'acf7212b-b549-46f5-9100-fd4ca336173a', 'serial': 'acf7212b-b549-46f5-9100-fd4ca336173a'}, 'attachment_id': 'eb247595-8cd8-4d35-8874-19b588acd96f', 'volume_type': None} {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 15:02:18 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:02:18 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:02:18 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] CPU controller missing on host. {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] CPU controller found on host. {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70924) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T14:36:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Flavor limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Image limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Flavor pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Image pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Got 1 possible topologies {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] Calling os-brick to attach iSCSI Volume {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:acf7212b-b549-46f5-9100-fd4ca336173a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RuNZCaGw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 15:02:18 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 15:02:18 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 15:02:18 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 15:02:18 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:acf7212b-b549-46f5-9100-fd4ca336173a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:acf7212b-b549-46f5-9100-fd4ca336173a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 15:02:18 user nova-compute[70924]: INFO os_brick.initiator.connectors.iscsi [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 15:02:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acf7212b-b549-46f5-9100-fd4ca336173a -p 172.16.0.220:3260 {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acf7212b-b549-46f5-9100-fd4ca336173a -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2b6022-b27c-4f81-a8a6-f6fc1e194f5a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 15:02:18 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acf7212b-b549-46f5-9100-fd4ca336173a -p 172.16.0.220:3260 --interface default --op new {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acf7212b-b549-46f5-9100-fd4ca336173a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c91757-e426-45fa-b565-51b6b8ddd601]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:acf7212b-b549-46f5-9100-fd4ca336173a] added\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:acf7212b-b549-46f5-9100-fd4ca336173a] added
Jul 29 15:02:18 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acf7212b-b549-46f5-9100-fd4ca336173a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acf7212b-b549-46f5-9100-fd4ca336173a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a25ecc4-eaef-4362-a29d-3ba38a5d65c4]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acf7212b-b549-46f5-9100-fd4ca336173a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acf7212b-b549-46f5-9100-fd4ca336173a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d1efd5-124e-436a-ad3f-2c3490e99809]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acf7212b-b549-46f5-9100-fd4ca336173a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RuNZCaGw {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acf7212b-b549-46f5-9100-fd4ca336173a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RuNZCaGw" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af500d2-4e5e-4688-bded-fca23fed3a82]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RuNZCaGw'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acf7212b-b549-46f5-9100-fd4ca336173a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acf7212b-b549-46f5-9100-fd4ca336173a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[748caa4f-7721-4f18-8ba3-2bfec1ec69a0]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac02961-a188-4db9-9c68-ee2b9d349af4]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cae21de-6018-4d36-9f32-3d6d6d172685 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 (non-flash)
Jul 29 15:02:18 user nova-compute[70924]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f (non-flash)
Jul 29 15:02:18 user nova-compute[70924]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cae21de-6018-4d36-9f32-3d6d6d172685 (non-flash)
Jul 29 15:02:18 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 (non-flash)
Jul 29 15:02:18 user nova-compute[70924]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f (non-flash)
Jul 29 15:02:18 user nova-compute[70924]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cae21de-6018-4d36-9f32-3d6d6d172685 (non-flash)
Jul 29 15:02:18 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acf7212b-b549-46f5-9100-fd4ca336173a -p 172.16.0.220:3260 --login {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acf7212b-b549-46f5-9100-fd4ca336173a -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac98b7d3-6c68-4075-afbb-d3cccc8c9c34]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:acf7212b-b549-46f5-9100-fd4ca336173a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:acf7212b-b549-46f5-9100-fd4ca336173a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:acf7212b-b549-46f5-9100-fd4ca336173a, portal: 172.16.0.220,3260]
Jul 29 15:02:18 user nova-compute[70924]: Login to [iface: default, target: iqn.2010-10.org.openstack:acf7212b-b549-46f5-9100-fd4ca336173a, portal: 172.16.0.220,3260] successful.
Jul 29 15:02:18 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acf7212b-b549-46f5-9100-fd4ca336173a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acf7212b-b549-46f5-9100-fd4ca336173a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9be057-f168-43cd-b301-0799e2302337]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[48dd294c-727d-44a7-9e46-7d74985680d7]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cae21de-6018-4d36-9f32-3d6d6d172685 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acf7212b-b549-46f5-9100-fd4ca336173a (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 (non-flash)
Jul 29 15:02:18 user nova-compute[70924]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f (non-flash)
Jul 29 15:02:18 user nova-compute[70924]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cae21de-6018-4d36-9f32-3d6d6d172685 (non-flash)
Jul 29 15:02:18 user nova-compute[70924]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acf7212b-b549-46f5-9100-fd4ca336173a (non-flash)
Jul 29 15:02:18 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 (non-flash)
Jul 29 15:02:18 user nova-compute[70924]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f (non-flash)
Jul 29 15:02:18 user nova-compute[70924]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cae21de-6018-4d36-9f32-3d6d6d172685 (non-flash)
Jul 29 15:02:18 user nova-compute[70924]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acf7212b-b549-46f5-9100-fd4ca336173a (non-flash)
Jul 29 15:02:18 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:acf7212b-b549-46f5-9100-fd4ca336173a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Connected to 172.16.0.220:3260 {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] HCTL ('36', '-', '-', 0) found on session 47 with lun 0 {{(pid=70924) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70924) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7b473d-a890-4c98-981b-6c7da2b2daeb]: (4, ('- - 0', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:02:18 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Searching for a device in session 47 and hctl ['36', '*', '*', 0] yield: None {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 15:02:19 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:02:19 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:02:19 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Searching for a device in session 47 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 15:02:19 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RuNZCaGw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 15:02:19 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 15:02:19 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '23661363063663234', 'path': '/dev/sde'} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 15:02:19 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661363063663234', 'path': '/dev/sde'} {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 15:02:19 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T15:02:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-669052453',display_name='tempest-TestVolumeBootPattern-volume-backed-server-669052453',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-669052453',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOsLqIdnBbcW149s2Cgb3NiPTizk+X228iVG4DiQuLfIGCV5bXm09FSe2PTjgun4AgNlorX3vx8DALtaGfPo4uqusBo7yXutwGgEKJk2VxSN0T5dbWj+E7cSXaa27WUaIg==',key_name='tempest-keypair-786800977',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99a974cbbf734f51897c3e632ae9e45f',ramdisk_id='',reservation_id='r-0fa1ijy8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1030839740',owner_user_name='tempest-TestVolumeBootPattern-1030839740-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T15:02:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='da204646e8f84693ad470ed1d3eadd7c',uuid=e905081f-dfff-41ab-88b3-8cd91d01671d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e00390b-efbf-4b94-9709-d1427afd0854", "address": "fa:16:3e:76:51:ad", "network": {"id": "c19ed38b-2acd-421a-9e4b-f60df3db2f1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1812407562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a974cbbf734f51897c3e632ae9e45f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e00390b-ef", "ovs_interfaceid": "6e00390b-efbf-4b94-9709-d1427afd0854", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 15:02:19 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Converting VIF {"id": "6e00390b-efbf-4b94-9709-d1427afd0854", "address": "fa:16:3e:76:51:ad", "network": {"id": "c19ed38b-2acd-421a-9e4b-f60df3db2f1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1812407562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a974cbbf734f51897c3e632ae9e45f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e00390b-ef", "ovs_interfaceid": "6e00390b-efbf-4b94-9709-d1427afd0854", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 15:02:19 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:51:ad,bridge_name='br-int',has_traffic_filtering=True,id=6e00390b-efbf-4b94-9709-d1427afd0854,network=Network(c19ed38b-2acd-421a-9e4b-f60df3db2f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e00390b-ef') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 15:02:19 user nova-compute[70924]: DEBUG nova.objects.instance [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lazy-loading 'pci_devices' on Instance uuid e905081f-dfff-41ab-88b3-8cd91d01671d {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:02:19 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] End _get_guest_xml xml=<domain type="kvm">
Jul 29 15:02:19 user nova-compute[70924]:   <uuid>e905081f-dfff-41ab-88b3-8cd91d01671d</uuid>
Jul 29 15:02:19 user nova-compute[70924]:   <name>instance-00000028</name>
Jul 29 15:02:19 user nova-compute[70924]:   <memory>524288</memory>
Jul 29 15:02:19 user nova-compute[70924]:   <vcpu>1</vcpu>
Jul 29 15:02:19 user nova-compute[70924]:   <metadata>
Jul 29 15:02:19 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 15:02:19 user nova-compute[70924]:       <nova:package version="0.0.0"/>
Jul 29 15:02:19 user nova-compute[70924]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-669052453</nova:name>
Jul 29 15:02:19 user nova-compute[70924]:       <nova:creationTime>2023-07-29 15:02:18</nova:creationTime>
Jul 29 15:02:19 user nova-compute[70924]:       <nova:flavor name="m1.tiny">
Jul 29 15:02:19 user nova-compute[70924]:         <nova:memory>512</nova:memory>
Jul 29 15:02:19 user nova-compute[70924]:         <nova:disk>1</nova:disk>
Jul 29 15:02:19 user nova-compute[70924]:         <nova:swap>0</nova:swap>
Jul 29 15:02:19 user nova-compute[70924]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 15:02:19 user nova-compute[70924]:         <nova:vcpus>1</nova:vcpus>
Jul 29 15:02:19 user nova-compute[70924]:       </nova:flavor>
Jul 29 15:02:19 user nova-compute[70924]:       <nova:owner>
Jul 29 15:02:19 user nova-compute[70924]:         <nova:user uuid="da204646e8f84693ad470ed1d3eadd7c">tempest-TestVolumeBootPattern-1030839740-project-member</nova:user>
Jul 29 15:02:19 user nova-compute[70924]:         <nova:project uuid="99a974cbbf734f51897c3e632ae9e45f">tempest-TestVolumeBootPattern-1030839740</nova:project>
Jul 29 15:02:19 user nova-compute[70924]:       </nova:owner>
Jul 29 15:02:19 user nova-compute[70924]:       <nova:ports>
Jul 29 15:02:19 user nova-compute[70924]:         <nova:port uuid="6e00390b-efbf-4b94-9709-d1427afd0854">
Jul 29 15:02:19 user nova-compute[70924]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 29 15:02:19 user nova-compute[70924]:         </nova:port>
Jul 29 15:02:19 user nova-compute[70924]:       </nova:ports>
Jul 29 15:02:19 user nova-compute[70924]:     </nova:instance>
Jul 29 15:02:19 user nova-compute[70924]:   </metadata>
Jul 29 15:02:19 user nova-compute[70924]:   <sysinfo type="smbios">
Jul 29 15:02:19 user nova-compute[70924]:     <system>
Jul 29 15:02:19 user nova-compute[70924]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 15:02:19 user nova-compute[70924]:       <entry name="product">OpenStack Nova</entry>
Jul 29 15:02:19 user nova-compute[70924]:       <entry name="version">0.0.0</entry>
Jul 29 15:02:19 user nova-compute[70924]:       <entry name="serial">e905081f-dfff-41ab-88b3-8cd91d01671d</entry>
Jul 29 15:02:19 user nova-compute[70924]:       <entry name="uuid">e905081f-dfff-41ab-88b3-8cd91d01671d</entry>
Jul 29 15:02:19 user nova-compute[70924]:       <entry name="family">Virtual Machine</entry>
Jul 29 15:02:19 user nova-compute[70924]:     </system>
Jul 29 15:02:19 user nova-compute[70924]:   </sysinfo>
Jul 29 15:02:19 user nova-compute[70924]:   <os>
Jul 29 15:02:19 user nova-compute[70924]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 15:02:19 user nova-compute[70924]:     <boot dev="hd"/>
Jul 29 15:02:19 user nova-compute[70924]:     <smbios mode="sysinfo"/>
Jul 29 15:02:19 user nova-compute[70924]:   </os>
Jul 29 15:02:19 user nova-compute[70924]:   <features>
Jul 29 15:02:19 user nova-compute[70924]:     <acpi/>
Jul 29 15:02:19 user nova-compute[70924]:     <apic/>
Jul 29 15:02:19 user nova-compute[70924]:     <vmcoreinfo/>
Jul 29 15:02:19 user nova-compute[70924]:   </features>
Jul 29 15:02:19 user nova-compute[70924]:   <clock offset="utc">
Jul 29 15:02:19 user nova-compute[70924]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 15:02:19 user nova-compute[70924]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 15:02:19 user nova-compute[70924]:     <timer name="hpet" present="no"/>
Jul 29 15:02:19 user nova-compute[70924]:   </clock>
Jul 29 15:02:19 user nova-compute[70924]:   <cpu mode="custom" match="exact">
Jul 29 15:02:19 user nova-compute[70924]:     <model>Nehalem</model>
Jul 29 15:02:19 user nova-compute[70924]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 15:02:19 user nova-compute[70924]:   </cpu>
Jul 29 15:02:19 user nova-compute[70924]:   <devices>
Jul 29 15:02:19 user nova-compute[70924]:     <disk type="block" device="disk">
Jul 29 15:02:19 user nova-compute[70924]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 15:02:19 user nova-compute[70924]:       <source dev="/dev/sde"/>
Jul 29 15:02:19 user nova-compute[70924]:       <target dev="vda" bus="virtio"/>
Jul 29 15:02:19 user nova-compute[70924]:       <serial>acf7212b-b549-46f5-9100-fd4ca336173a</serial>
Jul 29 15:02:19 user nova-compute[70924]:     </disk>
Jul 29 15:02:19 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 15:02:19 user nova-compute[70924]:       <mac address="fa:16:3e:76:51:ad"/>
Jul 29 15:02:19 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 15:02:19 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 15:02:19 user nova-compute[70924]:       <target dev="tap6e00390b-ef"/>
Jul 29 15:02:19 user nova-compute[70924]:     </interface>
Jul 29 15:02:19 user nova-compute[70924]:     <serial type="pty">
Jul 29 15:02:19 user nova-compute[70924]:       <log file="/opt/stack/data/nova/instances/e905081f-dfff-41ab-88b3-8cd91d01671d/console.log" append="off"/>
Jul 29 15:02:19 user nova-compute[70924]:     </serial>
Jul 29 15:02:19 user nova-compute[70924]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 15:02:19 user nova-compute[70924]:     <video>
Jul 29 15:02:19 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 15:02:19 user nova-compute[70924]:     </video>
Jul 29 15:02:19 user nova-compute[70924]:     <rng model="virtio">
Jul 29 15:02:19 user nova-compute[70924]:       <backend model="random">/dev/urandom</backend>
Jul 29 15:02:19 user nova-compute[70924]:     </rng>
Jul 29 15:02:19 user nova-compute[70924]:     <controller type="usb" index="0" model="none"/>
Jul 29 15:02:19 user nova-compute[70924]:     <memballoon model="virtio">
Jul 29 15:02:19 user nova-compute[70924]:       <stats period="10"/>
Jul 29 15:02:19 user nova-compute[70924]:     </memballoon>
Jul 29 15:02:19 user nova-compute[70924]:   </devices>
Jul 29 15:02:19 user nova-compute[70924]: </domain>
Jul 29 15:02:19 user nova-compute[70924]:  {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 15:02:19 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T15:02:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-669052453',display_name='tempest-TestVolumeBootPattern-volume-backed-server-669052453',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-669052453',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOsLqIdnBbcW149s2Cgb3NiPTizk+X228iVG4DiQuLfIGCV5bXm09FSe2PTjgun4AgNlorX3vx8DALtaGfPo4uqusBo7yXutwGgEKJk2VxSN0T5dbWj+E7cSXaa27WUaIg==',key_name='tempest-keypair-786800977',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99a974cbbf734f51897c3e632ae9e45f',ramdisk_id='',reservation_id='r-0fa1ijy8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1030839740',owner_user_name='tempest-TestVolumeBootPattern-1030839740-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T15:02:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='da204646e8f84693ad470ed1d3eadd7c',uuid=e905081f-dfff-41ab-88b3-8cd91d01671d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e00390b-efbf-4b94-9709-d1427afd0854", "address": "fa:16:3e:76:51:ad", "network": {"id": "c19ed38b-2acd-421a-9e4b-f60df3db2f1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1812407562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a974cbbf734f51897c3e632ae9e45f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e00390b-ef", "ovs_interfaceid": "6e00390b-efbf-4b94-9709-d1427afd0854", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 15:02:19 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Converting VIF {"id": "6e00390b-efbf-4b94-9709-d1427afd0854", "address": "fa:16:3e:76:51:ad", "network": {"id": "c19ed38b-2acd-421a-9e4b-f60df3db2f1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1812407562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a974cbbf734f51897c3e632ae9e45f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e00390b-ef", "ovs_interfaceid": "6e00390b-efbf-4b94-9709-d1427afd0854", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 15:02:19 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:51:ad,bridge_name='br-int',has_traffic_filtering=True,id=6e00390b-efbf-4b94-9709-d1427afd0854,network=Network(c19ed38b-2acd-421a-9e4b-f60df3db2f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e00390b-ef') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 15:02:19 user nova-compute[70924]: DEBUG os_vif [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:51:ad,bridge_name='br-int',has_traffic_filtering=True,id=6e00390b-efbf-4b94-9709-d1427afd0854,network=Network(c19ed38b-2acd-421a-9e4b-f60df3db2f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e00390b-ef') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 15:02:19 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:02:19 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:02:19 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 15:02:19 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:02:19 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6e00390b-ef, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:02:19 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6e00390b-ef, col_values=(('external_ids', {'iface-id': '6e00390b-efbf-4b94-9709-d1427afd0854', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:51:ad', 'vm-uuid': 'e905081f-dfff-41ab-88b3-8cd91d01671d'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:02:19 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:02:20 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:02:20 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:02:20 user nova-compute[70924]: INFO os_vif [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:51:ad,bridge_name='br-int',has_traffic_filtering=True,id=6e00390b-efbf-4b94-9709-d1427afd0854,network=Network(c19ed38b-2acd-421a-9e4b-f60df3db2f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e00390b-ef')
Jul 29 15:02:20 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 15:02:20 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] No VIF found with MAC fa:16:3e:76:51:ad, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 15:02:21 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:02:21 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:02:21 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:02:21 user nova-compute[70924]: DEBUG nova.compute.manager [req-d120e3a5-b982-409e-ac48-95a1d65f278d req-388d9f61-06e9-4038-8c49-f3f8166333d1 service nova] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] Received event network-vif-plugged-6e00390b-efbf-4b94-9709-d1427afd0854 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:02:21 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-d120e3a5-b982-409e-ac48-95a1d65f278d req-388d9f61-06e9-4038-8c49-f3f8166333d1 service nova] Acquiring lock "e905081f-dfff-41ab-88b3-8cd91d01671d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:02:21 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-d120e3a5-b982-409e-ac48-95a1d65f278d req-388d9f61-06e9-4038-8c49-f3f8166333d1 service nova] Lock "e905081f-dfff-41ab-88b3-8cd91d01671d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:02:21 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-d120e3a5-b982-409e-ac48-95a1d65f278d req-388d9f61-06e9-4038-8c49-f3f8166333d1 service nova] Lock "e905081f-dfff-41ab-88b3-8cd91d01671d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:02:21 user nova-compute[70924]: DEBUG nova.compute.manager [req-d120e3a5-b982-409e-ac48-95a1d65f278d req-388d9f61-06e9-4038-8c49-f3f8166333d1 service nova] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] No waiting events found dispatching network-vif-plugged-6e00390b-efbf-4b94-9709-d1427afd0854 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:02:21 user nova-compute[70924]: WARNING nova.compute.manager [req-d120e3a5-b982-409e-ac48-95a1d65f278d req-388d9f61-06e9-4038-8c49-f3f8166333d1 service nova] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] Received unexpected event network-vif-plugged-6e00390b-efbf-4b94-9709-d1427afd0854 for instance with vm_state building and task_state spawning.
Jul 29 15:02:21 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:02:21 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:02:21 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:02:21 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:02:23 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642943.3848865, e905081f-dfff-41ab-88b3-8cd91d01671d => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 15:02:23 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] VM Resumed (Lifecycle Event)
Jul 29 15:02:23 user nova-compute[70924]: DEBUG nova.compute.manager [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] Instance event wait completed in 0 seconds for  {{(pid=70924) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 15:02:23 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] Guest created on hypervisor {{(pid=70924) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 15:02:23 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] Instance spawned successfully.
Jul 29 15:02:23 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 15:02:23 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:02:23 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 15:02:23 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] Found default for hw_cdrom_bus of ide {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:02:23 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] Found default for hw_disk_bus of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:02:23 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] Found default for hw_input_bus of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:02:23 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] Found default for hw_pointer_model of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:02:23 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] Found default for hw_video_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:02:23 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] Found default for hw_vif_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:02:23 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 15:02:23 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690642943.3860238, e905081f-dfff-41ab-88b3-8cd91d01671d => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 15:02:23 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] VM Started (Lifecycle Event)
Jul 29 15:02:23 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:02:23 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 15:02:23 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 15:02:23 user nova-compute[70924]: INFO nova.compute.manager [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] Took 5.03 seconds to spawn the instance on the hypervisor.
Jul 29 15:02:23 user nova-compute[70924]: DEBUG nova.compute.manager [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:02:23 user nova-compute[70924]: INFO nova.compute.manager [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] Took 13.65 seconds to build instance.
Jul 29 15:02:23 user nova-compute[70924]: DEBUG nova.compute.manager [req-7782c2f7-b8ba-451a-8579-1a11ef3c85c2 req-cbc0a2f8-da29-4b7f-8bea-762a4693b75b service nova] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] Received event network-vif-plugged-6e00390b-efbf-4b94-9709-d1427afd0854 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:02:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-7782c2f7-b8ba-451a-8579-1a11ef3c85c2 req-cbc0a2f8-da29-4b7f-8bea-762a4693b75b service nova] Acquiring lock "e905081f-dfff-41ab-88b3-8cd91d01671d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:02:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-7782c2f7-b8ba-451a-8579-1a11ef3c85c2 req-cbc0a2f8-da29-4b7f-8bea-762a4693b75b service nova] Lock "e905081f-dfff-41ab-88b3-8cd91d01671d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:02:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-7782c2f7-b8ba-451a-8579-1a11ef3c85c2 req-cbc0a2f8-da29-4b7f-8bea-762a4693b75b service nova] Lock "e905081f-dfff-41ab-88b3-8cd91d01671d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:02:23 user nova-compute[70924]: DEBUG nova.compute.manager [req-7782c2f7-b8ba-451a-8579-1a11ef3c85c2 req-cbc0a2f8-da29-4b7f-8bea-762a4693b75b service nova] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] No waiting events found dispatching network-vif-plugged-6e00390b-efbf-4b94-9709-d1427afd0854 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:02:23 user nova-compute[70924]: WARNING nova.compute.manager [req-7782c2f7-b8ba-451a-8579-1a11ef3c85c2 req-cbc0a2f8-da29-4b7f-8bea-762a4693b75b service nova] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] Received unexpected event network-vif-plugged-6e00390b-efbf-4b94-9709-d1427afd0854 for instance with vm_state active and task_state None.
Jul 29 15:02:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5eda0249-6ffb-4362-a32c-9d44b2018aa8 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "e905081f-dfff-41ab-88b3-8cd91d01671d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.772s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:02:24 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:02:24 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:02:29 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:02:29 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:02:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:02:35 user nova-compute[70924]: DEBUG nova.compute.manager [req-4848cf33-9000-4927-b7d7-e2a09584f6ca req-8fdb29e3-1eca-401f-b428-bc997f4d6080 service nova] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] Received event network-changed-b952c385-68ec-4618-9d28-de94c56d27d9 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:02:35 user nova-compute[70924]: DEBUG nova.compute.manager [req-4848cf33-9000-4927-b7d7-e2a09584f6ca req-8fdb29e3-1eca-401f-b428-bc997f4d6080 service nova] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] Refreshing instance network info cache due to event network-changed-b952c385-68ec-4618-9d28-de94c56d27d9. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 15:02:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-4848cf33-9000-4927-b7d7-e2a09584f6ca req-8fdb29e3-1eca-401f-b428-bc997f4d6080 service nova] Acquiring lock "refresh_cache-1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:02:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-4848cf33-9000-4927-b7d7-e2a09584f6ca req-8fdb29e3-1eca-401f-b428-bc997f4d6080 service nova] Acquired lock "refresh_cache-1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:02:35 user nova-compute[70924]: DEBUG nova.network.neutron [req-4848cf33-9000-4927-b7d7-e2a09584f6ca req-8fdb29e3-1eca-401f-b428-bc997f4d6080 service nova] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] Refreshing network info cache for port b952c385-68ec-4618-9d28-de94c56d27d9 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 15:02:36 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ee6b0c0d-9b94-4428-b67f-17412a24f0ae tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Acquiring lock "1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:02:36 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ee6b0c0d-9b94-4428-b67f-17412a24f0ae tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:02:36 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ee6b0c0d-9b94-4428-b67f-17412a24f0ae tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Acquiring lock "1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:02:36 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ee6b0c0d-9b94-4428-b67f-17412a24f0ae tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:02:36 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ee6b0c0d-9b94-4428-b67f-17412a24f0ae tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:02:36 user nova-compute[70924]: INFO nova.compute.manager [None req-ee6b0c0d-9b94-4428-b67f-17412a24f0ae tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] Terminating instance
Jul 29 15:02:36 user nova-compute[70924]: DEBUG nova.compute.manager [None req-ee6b0c0d-9b94-4428-b67f-17412a24f0ae tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] Start destroying the instance on the hypervisor. {{(pid=70924) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 15:02:36 user nova-compute[70924]: DEBUG nova.network.neutron [req-4848cf33-9000-4927-b7d7-e2a09584f6ca req-8fdb29e3-1eca-401f-b428-bc997f4d6080 service nova] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] Updated VIF entry in instance network info cache for port b952c385-68ec-4618-9d28-de94c56d27d9. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 15:02:36 user nova-compute[70924]: DEBUG nova.network.neutron [req-4848cf33-9000-4927-b7d7-e2a09584f6ca req-8fdb29e3-1eca-401f-b428-bc997f4d6080 service nova] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] Updating instance_info_cache with network_info: [{"id": "b952c385-68ec-4618-9d28-de94c56d27d9", "address": "fa:16:3e:98:e1:17", "network": {"id": "f80826fa-fada-45b9-b969-fd539fd34fd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-465377443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9aadc9385b3b46eebc6e0d81814521af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb952c385-68", "ovs_interfaceid": "b952c385-68ec-4618-9d28-de94c56d27d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:02:36 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-4848cf33-9000-4927-b7d7-e2a09584f6ca req-8fdb29e3-1eca-401f-b428-bc997f4d6080 service nova] Releasing lock "refresh_cache-1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:02:36 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:02:36 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:02:36 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:02:37 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:02:37 user nova-compute[70924]: DEBUG nova.compute.manager [req-0e27b880-10e1-4237-9fcf-7d0a18872101 req-aaa93435-c7b1-413c-ab29-d40a6ba3f7d5 service nova] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] Received event network-vif-unplugged-b952c385-68ec-4618-9d28-de94c56d27d9 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:02:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-0e27b880-10e1-4237-9fcf-7d0a18872101 req-aaa93435-c7b1-413c-ab29-d40a6ba3f7d5 service nova] Acquiring lock "1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:02:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-0e27b880-10e1-4237-9fcf-7d0a18872101 req-aaa93435-c7b1-413c-ab29-d40a6ba3f7d5 service nova] Lock "1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:02:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-0e27b880-10e1-4237-9fcf-7d0a18872101 req-aaa93435-c7b1-413c-ab29-d40a6ba3f7d5 service nova] Lock "1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:02:37 user nova-compute[70924]: DEBUG nova.compute.manager [req-0e27b880-10e1-4237-9fcf-7d0a18872101 req-aaa93435-c7b1-413c-ab29-d40a6ba3f7d5 service nova] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] No waiting events found dispatching network-vif-unplugged-b952c385-68ec-4618-9d28-de94c56d27d9 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:02:37 user nova-compute[70924]: DEBUG nova.compute.manager [req-0e27b880-10e1-4237-9fcf-7d0a18872101 req-aaa93435-c7b1-413c-ab29-d40a6ba3f7d5 service nova] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] Received event network-vif-unplugged-b952c385-68ec-4618-9d28-de94c56d27d9 for instance with task_state deleting. {{(pid=70924) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 15:02:37 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] Instance destroyed successfully.
Jul 29 15:02:37 user nova-compute[70924]: DEBUG nova.objects.instance [None req-ee6b0c0d-9b94-4428-b67f-17412a24f0ae tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lazy-loading 'resources' on Instance uuid 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:02:37 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-ee6b0c0d-9b94-4428-b67f-17412a24f0ae tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T15:00:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-691515032',display_name='tempest-AttachVolumeNegativeTest-server-691515032',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-691515032',id=39,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKcNThJfGgCC0X/qLoz3jQvWXwel/9sE1MjOrF+HqDzAWn0RGOThbp2zXruoqrRm110J21yfgdgrM0ukUEskJEHR9KQRzkyrIqSa1RVWOLrGeRKx3dBgrZ8At/D3U5mH0A==',key_name='tempest-keypair-368297878',keypairs=<?>,launch_index=0,launched_at=2023-07-29T15:00:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9aadc9385b3b46eebc6e0d81814521af',ramdisk_id='',reservation_id='r-y9qzxt1r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-972203101',owner_user_name='tempest-AttachVolumeNegativeTest-972203101-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T15:00:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='12cb8299e4d24946bc41a86493f4b426',uuid=1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b952c385-68ec-4618-9d28-de94c56d27d9", "address": "fa:16:3e:98:e1:17", "network": {"id": "f80826fa-fada-45b9-b969-fd539fd34fd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-465377443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9aadc9385b3b46eebc6e0d81814521af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb952c385-68", "ovs_interfaceid": "b952c385-68ec-4618-9d28-de94c56d27d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 15:02:37 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-ee6b0c0d-9b94-4428-b67f-17412a24f0ae tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Converting VIF {"id": "b952c385-68ec-4618-9d28-de94c56d27d9", "address": "fa:16:3e:98:e1:17", "network": {"id": "f80826fa-fada-45b9-b969-fd539fd34fd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-465377443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9aadc9385b3b46eebc6e0d81814521af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb952c385-68", "ovs_interfaceid": "b952c385-68ec-4618-9d28-de94c56d27d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 15:02:37 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-ee6b0c0d-9b94-4428-b67f-17412a24f0ae tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:e1:17,bridge_name='br-int',has_traffic_filtering=True,id=b952c385-68ec-4618-9d28-de94c56d27d9,network=Network(f80826fa-fada-45b9-b969-fd539fd34fd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb952c385-68') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 15:02:37 user nova-compute[70924]: DEBUG os_vif [None req-ee6b0c0d-9b94-4428-b67f-17412a24f0ae tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:e1:17,bridge_name='br-int',has_traffic_filtering=True,id=b952c385-68ec-4618-9d28-de94c56d27d9,network=Network(f80826fa-fada-45b9-b969-fd539fd34fd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb952c385-68') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 15:02:37 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:02:37 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb952c385-68, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:02:37 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:02:37 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:02:37 user nova-compute[70924]: INFO os_vif [None req-ee6b0c0d-9b94-4428-b67f-17412a24f0ae tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:e1:17,bridge_name='br-int',has_traffic_filtering=True,id=b952c385-68ec-4618-9d28-de94c56d27d9,network=Network(f80826fa-fada-45b9-b969-fd539fd34fd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb952c385-68')
Jul 29 15:02:37 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-ee6b0c0d-9b94-4428-b67f-17412a24f0ae tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] Deleting instance files /opt/stack/data/nova/instances/1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a_del
Jul 29 15:02:37 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-ee6b0c0d-9b94-4428-b67f-17412a24f0ae tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] Deletion of /opt/stack/data/nova/instances/1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a_del complete
Jul 29 15:02:37 user nova-compute[70924]: INFO nova.compute.manager [None req-ee6b0c0d-9b94-4428-b67f-17412a24f0ae tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] Took 1.07 seconds to destroy the instance on the hypervisor.
Jul 29 15:02:37 user nova-compute[70924]: DEBUG oslo.service.loopingcall [None req-ee6b0c0d-9b94-4428-b67f-17412a24f0ae tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70924) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 15:02:37 user nova-compute[70924]: DEBUG nova.compute.manager [-] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] Deallocating network for instance {{(pid=70924) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 15:02:37 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] deallocate_for_instance() {{(pid=70924) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 15:02:38 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:02:38 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] Took 0.74 seconds to deallocate network for instance.
Jul 29 15:02:38 user nova-compute[70924]: DEBUG nova.compute.manager [req-d6745354-7a41-4198-bdb7-013cb20d6c57 req-ac0b6653-8fcf-4f94-b8a5-3641ebe2e65d service nova] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] Received event network-vif-deleted-b952c385-68ec-4618-9d28-de94c56d27d9 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:02:38 user nova-compute[70924]: INFO nova.compute.manager [req-d6745354-7a41-4198-bdb7-013cb20d6c57 req-ac0b6653-8fcf-4f94-b8a5-3641ebe2e65d service nova] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] Neutron deleted interface b952c385-68ec-4618-9d28-de94c56d27d9; detaching it from the instance and deleting it from the info cache
Jul 29 15:02:38 user nova-compute[70924]: DEBUG nova.network.neutron [req-d6745354-7a41-4198-bdb7-013cb20d6c57 req-ac0b6653-8fcf-4f94-b8a5-3641ebe2e65d service nova] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:02:38 user nova-compute[70924]: DEBUG nova.compute.manager [req-d6745354-7a41-4198-bdb7-013cb20d6c57 req-ac0b6653-8fcf-4f94-b8a5-3641ebe2e65d service nova] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] Detach interface failed, port_id=b952c385-68ec-4618-9d28-de94c56d27d9, reason: Instance 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a could not be found. {{(pid=70924) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 29 15:02:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ee6b0c0d-9b94-4428-b67f-17412a24f0ae tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:02:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ee6b0c0d-9b94-4428-b67f-17412a24f0ae tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:02:38 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-ee6b0c0d-9b94-4428-b67f-17412a24f0ae tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Refreshing inventories for resource provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 29 15:02:38 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-ee6b0c0d-9b94-4428-b67f-17412a24f0ae tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Updating ProviderTree inventory for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 29 15:02:38 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-ee6b0c0d-9b94-4428-b67f-17412a24f0ae tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Updating inventory in ProviderTree for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 29 15:02:38 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-ee6b0c0d-9b94-4428-b67f-17412a24f0ae tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Refreshing aggregate associations for resource provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832, aggregates: None {{(pid=70924) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 29 15:02:38 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-ee6b0c0d-9b94-4428-b67f-17412a24f0ae tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Refreshing trait associations for resource provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832, traits: COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=70924) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 29 15:02:38 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-ee6b0c0d-9b94-4428-b67f-17412a24f0ae tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:02:38 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-ee6b0c0d-9b94-4428-b67f-17412a24f0ae tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:02:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ee6b0c0d-9b94-4428-b67f-17412a24f0ae tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.680s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:02:38 user nova-compute[70924]: INFO nova.scheduler.client.report [None req-ee6b0c0d-9b94-4428-b67f-17412a24f0ae tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Deleted allocations for instance 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a
Jul 29 15:02:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ee6b0c0d-9b94-4428-b67f-17412a24f0ae tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.686s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:02:39 user nova-compute[70924]: DEBUG nova.compute.manager [req-41a37288-5091-4060-a87d-26b94fa2b4a6 req-38a68e20-e15f-402f-9d38-a52e7eea6e61 service nova] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] Received event network-vif-plugged-b952c385-68ec-4618-9d28-de94c56d27d9 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:02:39 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-41a37288-5091-4060-a87d-26b94fa2b4a6 req-38a68e20-e15f-402f-9d38-a52e7eea6e61 service nova] Acquiring lock "1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:02:39 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-41a37288-5091-4060-a87d-26b94fa2b4a6 req-38a68e20-e15f-402f-9d38-a52e7eea6e61 service nova] Lock "1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:02:39 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-41a37288-5091-4060-a87d-26b94fa2b4a6 req-38a68e20-e15f-402f-9d38-a52e7eea6e61 service nova] Lock "1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:02:39 user nova-compute[70924]: DEBUG nova.compute.manager [req-41a37288-5091-4060-a87d-26b94fa2b4a6 req-38a68e20-e15f-402f-9d38-a52e7eea6e61 service nova] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] No waiting events found dispatching network-vif-plugged-b952c385-68ec-4618-9d28-de94c56d27d9 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:02:39 user nova-compute[70924]: WARNING nova.compute.manager [req-41a37288-5091-4060-a87d-26b94fa2b4a6 req-38a68e20-e15f-402f-9d38-a52e7eea6e61 service nova] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] Received unexpected event network-vif-plugged-b952c385-68ec-4618-9d28-de94c56d27d9 for instance with vm_state deleted and task_state None.
Jul 29 15:02:39 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:02:42 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:02:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:02:47 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:02:49 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:02:52 user nova-compute[70924]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690642957.2483695, 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a => Stopped> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 15:02:52 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] VM Stopped (Lifecycle Event)
Jul 29 15:02:52 user nova-compute[70924]: DEBUG nova.compute.manager [None req-2d7ce96a-2d46-408a-bd01-3461384c19a6 None None] [instance: 1940c5ef-8d9a-4a86-9912-f2f42aa4ad0a] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:02:52 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:02:54 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:02:55 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:02:57 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:02:57 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:02:59 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:02:59 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:03:01 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:03:02 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:03:02 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:03:03 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:03:04 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:03:04 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:03:04 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:03:04 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:03:04 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Auditing locally available compute resources for user (node: user) {{(pid=70924) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 15:03:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f7eeda-a001-4c35-abeb-e459d701bd93/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:03:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f7eeda-a001-4c35-abeb-e459d701bd93/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:03:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f7eeda-a001-4c35-abeb-e459d701bd93/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:03:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f7eeda-a001-4c35-abeb-e459d701bd93/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:03:04 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 15:03:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5865be57-b5f2-4132-bc71-cc41bfe9f897/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:03:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5865be57-b5f2-4132-bc71-cc41bfe9f897/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:03:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5865be57-b5f2-4132-bc71-cc41bfe9f897/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:03:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5865be57-b5f2-4132-bc71-cc41bfe9f897/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:03:05 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 15:03:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47104e57-c193-4a85-a2cf-677f0debe373/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:03:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47104e57-c193-4a85-a2cf-677f0debe373/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:03:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47104e57-c193-4a85-a2cf-677f0debe373/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:03:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47104e57-c193-4a85-a2cf-677f0debe373/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:03:05 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 15:03:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk.rescue --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:03:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk.rescue --force-share --output=json" returned: 0 in 0.163s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:03:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk.rescue --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:03:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk.rescue --force-share --output=json" returned: 0 in 0.149s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:03:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:03:06 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:03:06 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:03:06 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:03:06 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:03:06 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:03:06 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:03:06 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:03:06 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79063387-5fb9-4ce2-81c3-f9a094c0fd22/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:03:06 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79063387-5fb9-4ce2-81c3-f9a094c0fd22/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:03:06 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79063387-5fb9-4ce2-81c3-f9a094c0fd22/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:03:06 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79063387-5fb9-4ce2-81c3-f9a094c0fd22/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:03:06 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 15:03:07 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:03:07 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:03:07 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:03:07 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Hypervisor/Node resource view: name=user free_ram=7705MB free_disk=25.230796813964844GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70924) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 15:03:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:03:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:03:07 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 9ec07c62-951b-4e3a-bffa-e01dfb4665ec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:03:07 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 091e384f-7851-4ac9-b566-990df0497fc5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:03:07 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance f3f7eeda-a001-4c35-abeb-e459d701bd93 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:03:07 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 47104e57-c193-4a85-a2cf-677f0debe373 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:03:07 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 5865be57-b5f2-4132-bc71-cc41bfe9f897 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:03:07 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 79063387-5fb9-4ce2-81c3-f9a094c0fd22 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:03:07 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance e905081f-dfff-41ab-88b3-8cd91d01671d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:03:07 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 15:03:07 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 15:03:07 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:03:07 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:03:07 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Compute_service record updated for user:user {{(pid=70924) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 15:03:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.383s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:03:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1c00eeaf-66e4-47fe-9b32-9c5688f01767 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Acquiring lock "79063387-5fb9-4ce2-81c3-f9a094c0fd22" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:03:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1c00eeaf-66e4-47fe-9b32-9c5688f01767 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Lock "79063387-5fb9-4ce2-81c3-f9a094c0fd22" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:03:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1c00eeaf-66e4-47fe-9b32-9c5688f01767 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Acquiring lock "79063387-5fb9-4ce2-81c3-f9a094c0fd22-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:03:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1c00eeaf-66e4-47fe-9b32-9c5688f01767 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Lock "79063387-5fb9-4ce2-81c3-f9a094c0fd22-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:03:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1c00eeaf-66e4-47fe-9b32-9c5688f01767 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Lock "79063387-5fb9-4ce2-81c3-f9a094c0fd22-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:03:08 user nova-compute[70924]: INFO nova.compute.manager [None req-1c00eeaf-66e4-47fe-9b32-9c5688f01767 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Terminating instance
Jul 29 15:03:08 user nova-compute[70924]: DEBUG nova.compute.manager [None req-1c00eeaf-66e4-47fe-9b32-9c5688f01767 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Start destroying the instance on the hypervisor. {{(pid=70924) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 15:03:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:03:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:03:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:03:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:03:08 user nova-compute[70924]: DEBUG nova.compute.manager [req-45dc29d8-9d9a-40f6-ad01-42f3ac9ccf42 req-94254e49-6131-4eee-ba41-bd995b2ffd3c service nova] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Received event network-vif-unplugged-0166d121-c15e-4189-a56c-d252e9e3de80 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:03:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-45dc29d8-9d9a-40f6-ad01-42f3ac9ccf42 req-94254e49-6131-4eee-ba41-bd995b2ffd3c service nova] Acquiring lock "79063387-5fb9-4ce2-81c3-f9a094c0fd22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:03:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-45dc29d8-9d9a-40f6-ad01-42f3ac9ccf42 req-94254e49-6131-4eee-ba41-bd995b2ffd3c service nova] Lock "79063387-5fb9-4ce2-81c3-f9a094c0fd22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:03:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-45dc29d8-9d9a-40f6-ad01-42f3ac9ccf42 req-94254e49-6131-4eee-ba41-bd995b2ffd3c service nova] Lock "79063387-5fb9-4ce2-81c3-f9a094c0fd22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:03:08 user nova-compute[70924]: DEBUG nova.compute.manager [req-45dc29d8-9d9a-40f6-ad01-42f3ac9ccf42 req-94254e49-6131-4eee-ba41-bd995b2ffd3c service nova] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] No waiting events found dispatching network-vif-unplugged-0166d121-c15e-4189-a56c-d252e9e3de80 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:03:08 user nova-compute[70924]: DEBUG nova.compute.manager [req-45dc29d8-9d9a-40f6-ad01-42f3ac9ccf42 req-94254e49-6131-4eee-ba41-bd995b2ffd3c service nova] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Received event network-vif-unplugged-0166d121-c15e-4189-a56c-d252e9e3de80 for instance with task_state deleting. {{(pid=70924) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 15:03:08 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:03:08 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Starting heal instance info cache {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 15:03:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:03:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:03:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "refresh_cache-091e384f-7851-4ac9-b566-990df0497fc5" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:03:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquired lock "refresh_cache-091e384f-7851-4ac9-b566-990df0497fc5" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:03:08 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Forcefully refreshing network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 29 15:03:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:03:08 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Instance destroyed successfully.
Jul 29 15:03:08 user nova-compute[70924]: DEBUG nova.objects.instance [None req-1c00eeaf-66e4-47fe-9b32-9c5688f01767 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Lazy-loading 'resources' on Instance uuid 79063387-5fb9-4ce2-81c3-f9a094c0fd22 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:03:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:03:08 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-1c00eeaf-66e4-47fe-9b32-9c5688f01767 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T15:00:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1634106950',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1634106950',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1634106',id=38,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQormZKeP+C/l2PclvQj9tkdDdTNQ3qcBDksLlDKhZM4wmtbwYYkRoO6FUrYoFKsTk7g7auFc6hu0KvtISW8cnrZ8AzJn2aw4m356dNYYx+cdqBBMT+YVuL83hmybO+1Q==',key_name='tempest-keypair-166337349',keypairs=<?>,launch_index=0,launched_at=2023-07-29T15:00:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4b6a612c609a43ba81cb1636c323b0d4',ramdisk_id='',reservation_id='r-6gpkrrsa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1572725490',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T15:00:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='698114cda101425195dae0e5b9445c09',uuid=79063387-5fb9-4ce2-81c3-f9a094c0fd22,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0166d121-c15e-4189-a56c-d252e9e3de80", "address": "fa:16:3e:5e:ce:a8", "network": {"id": "a901bee5-6b26-45c7-8f4a-69ffb0b46b73", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1220595772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b6a612c609a43ba81cb1636c323b0d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0166d121-c1", "ovs_interfaceid": "0166d121-c15e-4189-a56c-d252e9e3de80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 15:03:08 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-1c00eeaf-66e4-47fe-9b32-9c5688f01767 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Converting VIF {"id": "0166d121-c15e-4189-a56c-d252e9e3de80", "address": "fa:16:3e:5e:ce:a8", "network": {"id": "a901bee5-6b26-45c7-8f4a-69ffb0b46b73", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1220595772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b6a612c609a43ba81cb1636c323b0d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0166d121-c1", "ovs_interfaceid": "0166d121-c15e-4189-a56c-d252e9e3de80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 15:03:08 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-1c00eeaf-66e4-47fe-9b32-9c5688f01767 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:ce:a8,bridge_name='br-int',has_traffic_filtering=True,id=0166d121-c15e-4189-a56c-d252e9e3de80,network=Network(a901bee5-6b26-45c7-8f4a-69ffb0b46b73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0166d121-c1') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 15:03:08 user nova-compute[70924]: DEBUG os_vif [None req-1c00eeaf-66e4-47fe-9b32-9c5688f01767 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:ce:a8,bridge_name='br-int',has_traffic_filtering=True,id=0166d121-c15e-4189-a56c-d252e9e3de80,network=Network(a901bee5-6b26-45c7-8f4a-69ffb0b46b73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0166d121-c1') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 15:03:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:03:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0166d121-c1, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:03:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:03:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:03:08 user nova-compute[70924]: INFO os_vif [None req-1c00eeaf-66e4-47fe-9b32-9c5688f01767 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:ce:a8,bridge_name='br-int',has_traffic_filtering=True,id=0166d121-c15e-4189-a56c-d252e9e3de80,network=Network(a901bee5-6b26-45c7-8f4a-69ffb0b46b73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0166d121-c1')
Jul 29 15:03:08 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-1c00eeaf-66e4-47fe-9b32-9c5688f01767 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Deleting instance files /opt/stack/data/nova/instances/79063387-5fb9-4ce2-81c3-f9a094c0fd22_del
Jul 29 15:03:08 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-1c00eeaf-66e4-47fe-9b32-9c5688f01767 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Deletion of /opt/stack/data/nova/instances/79063387-5fb9-4ce2-81c3-f9a094c0fd22_del complete
Jul 29 15:03:09 user nova-compute[70924]: INFO nova.compute.manager [None req-1c00eeaf-66e4-47fe-9b32-9c5688f01767 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Took 1.14 seconds to destroy the instance on the hypervisor.
Jul 29 15:03:09 user nova-compute[70924]: DEBUG oslo.service.loopingcall [None req-1c00eeaf-66e4-47fe-9b32-9c5688f01767 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70924) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 15:03:09 user nova-compute[70924]: DEBUG nova.compute.manager [-] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Deallocating network for instance {{(pid=70924) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 15:03:09 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] deallocate_for_instance() {{(pid=70924) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 15:03:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:03:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:03:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:03:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:03:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:03:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:03:10 user nova-compute[70924]: DEBUG nova.compute.manager [req-b328391a-dd2e-4700-92f4-4f247fbf49aa req-6c5c6791-f2ab-4e37-9a4b-49309bf16b62 service nova] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Received event network-vif-plugged-0166d121-c15e-4189-a56c-d252e9e3de80 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:03:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b328391a-dd2e-4700-92f4-4f247fbf49aa req-6c5c6791-f2ab-4e37-9a4b-49309bf16b62 service nova] Acquiring lock "79063387-5fb9-4ce2-81c3-f9a094c0fd22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:03:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b328391a-dd2e-4700-92f4-4f247fbf49aa req-6c5c6791-f2ab-4e37-9a4b-49309bf16b62 service nova] Lock "79063387-5fb9-4ce2-81c3-f9a094c0fd22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:03:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b328391a-dd2e-4700-92f4-4f247fbf49aa req-6c5c6791-f2ab-4e37-9a4b-49309bf16b62 service nova] Lock "79063387-5fb9-4ce2-81c3-f9a094c0fd22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:03:10 user nova-compute[70924]: DEBUG nova.compute.manager [req-b328391a-dd2e-4700-92f4-4f247fbf49aa req-6c5c6791-f2ab-4e37-9a4b-49309bf16b62 service nova] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] No waiting events found dispatching network-vif-plugged-0166d121-c15e-4189-a56c-d252e9e3de80 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:03:10 user nova-compute[70924]: WARNING nova.compute.manager [req-b328391a-dd2e-4700-92f4-4f247fbf49aa req-6c5c6791-f2ab-4e37-9a4b-49309bf16b62 service nova] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Received unexpected event network-vif-plugged-0166d121-c15e-4189-a56c-d252e9e3de80 for instance with vm_state active and task_state deleting.
Jul 29 15:03:10 user nova-compute[70924]: DEBUG nova.compute.manager [req-b328391a-dd2e-4700-92f4-4f247fbf49aa req-6c5c6791-f2ab-4e37-9a4b-49309bf16b62 service nova] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Received event network-vif-plugged-0166d121-c15e-4189-a56c-d252e9e3de80 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:03:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b328391a-dd2e-4700-92f4-4f247fbf49aa req-6c5c6791-f2ab-4e37-9a4b-49309bf16b62 service nova] Acquiring lock "79063387-5fb9-4ce2-81c3-f9a094c0fd22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:03:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b328391a-dd2e-4700-92f4-4f247fbf49aa req-6c5c6791-f2ab-4e37-9a4b-49309bf16b62 service nova] Lock "79063387-5fb9-4ce2-81c3-f9a094c0fd22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:03:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b328391a-dd2e-4700-92f4-4f247fbf49aa req-6c5c6791-f2ab-4e37-9a4b-49309bf16b62 service nova] Lock "79063387-5fb9-4ce2-81c3-f9a094c0fd22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:03:10 user nova-compute[70924]: DEBUG nova.compute.manager [req-b328391a-dd2e-4700-92f4-4f247fbf49aa req-6c5c6791-f2ab-4e37-9a4b-49309bf16b62 service nova] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] No waiting events found dispatching network-vif-plugged-0166d121-c15e-4189-a56c-d252e9e3de80 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:03:10 user nova-compute[70924]: WARNING nova.compute.manager [req-b328391a-dd2e-4700-92f4-4f247fbf49aa req-6c5c6791-f2ab-4e37-9a4b-49309bf16b62 service nova] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Received unexpected event network-vif-plugged-0166d121-c15e-4189-a56c-d252e9e3de80 for instance with vm_state active and task_state deleting.
Jul 29 15:03:10 user nova-compute[70924]: DEBUG nova.compute.manager [req-b328391a-dd2e-4700-92f4-4f247fbf49aa req-6c5c6791-f2ab-4e37-9a4b-49309bf16b62 service nova] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Received event network-vif-plugged-0166d121-c15e-4189-a56c-d252e9e3de80 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:03:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b328391a-dd2e-4700-92f4-4f247fbf49aa req-6c5c6791-f2ab-4e37-9a4b-49309bf16b62 service nova] Acquiring lock "79063387-5fb9-4ce2-81c3-f9a094c0fd22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:03:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b328391a-dd2e-4700-92f4-4f247fbf49aa req-6c5c6791-f2ab-4e37-9a4b-49309bf16b62 service nova] Lock "79063387-5fb9-4ce2-81c3-f9a094c0fd22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:03:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b328391a-dd2e-4700-92f4-4f247fbf49aa req-6c5c6791-f2ab-4e37-9a4b-49309bf16b62 service nova] Lock "79063387-5fb9-4ce2-81c3-f9a094c0fd22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:03:10 user nova-compute[70924]: DEBUG nova.compute.manager [req-b328391a-dd2e-4700-92f4-4f247fbf49aa req-6c5c6791-f2ab-4e37-9a4b-49309bf16b62 service nova] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] No waiting events found dispatching network-vif-plugged-0166d121-c15e-4189-a56c-d252e9e3de80 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:03:10 user nova-compute[70924]: WARNING nova.compute.manager [req-b328391a-dd2e-4700-92f4-4f247fbf49aa req-6c5c6791-f2ab-4e37-9a4b-49309bf16b62 service nova] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Received unexpected event network-vif-plugged-0166d121-c15e-4189-a56c-d252e9e3de80 for instance with vm_state active and task_state deleting.
Jul 29 15:03:10 user nova-compute[70924]: DEBUG nova.compute.manager [req-b328391a-dd2e-4700-92f4-4f247fbf49aa req-6c5c6791-f2ab-4e37-9a4b-49309bf16b62 service nova] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Received event network-vif-unplugged-0166d121-c15e-4189-a56c-d252e9e3de80 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:03:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b328391a-dd2e-4700-92f4-4f247fbf49aa req-6c5c6791-f2ab-4e37-9a4b-49309bf16b62 service nova] Acquiring lock "79063387-5fb9-4ce2-81c3-f9a094c0fd22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:03:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b328391a-dd2e-4700-92f4-4f247fbf49aa req-6c5c6791-f2ab-4e37-9a4b-49309bf16b62 service nova] Lock "79063387-5fb9-4ce2-81c3-f9a094c0fd22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:03:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b328391a-dd2e-4700-92f4-4f247fbf49aa req-6c5c6791-f2ab-4e37-9a4b-49309bf16b62 service nova] Lock "79063387-5fb9-4ce2-81c3-f9a094c0fd22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:03:10 user nova-compute[70924]: DEBUG nova.compute.manager [req-b328391a-dd2e-4700-92f4-4f247fbf49aa req-6c5c6791-f2ab-4e37-9a4b-49309bf16b62 service nova] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] No waiting events found dispatching network-vif-unplugged-0166d121-c15e-4189-a56c-d252e9e3de80 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:03:10 user nova-compute[70924]: DEBUG nova.compute.manager [req-b328391a-dd2e-4700-92f4-4f247fbf49aa req-6c5c6791-f2ab-4e37-9a4b-49309bf16b62 service nova] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Received event network-vif-unplugged-0166d121-c15e-4189-a56c-d252e9e3de80 for instance with task_state deleting. {{(pid=70924) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 15:03:10 user nova-compute[70924]: DEBUG nova.compute.manager [req-b328391a-dd2e-4700-92f4-4f247fbf49aa req-6c5c6791-f2ab-4e37-9a4b-49309bf16b62 service nova] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Received event network-vif-plugged-0166d121-c15e-4189-a56c-d252e9e3de80 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:03:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b328391a-dd2e-4700-92f4-4f247fbf49aa req-6c5c6791-f2ab-4e37-9a4b-49309bf16b62 service nova] Acquiring lock "79063387-5fb9-4ce2-81c3-f9a094c0fd22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:03:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b328391a-dd2e-4700-92f4-4f247fbf49aa req-6c5c6791-f2ab-4e37-9a4b-49309bf16b62 service nova] Lock "79063387-5fb9-4ce2-81c3-f9a094c0fd22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:03:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b328391a-dd2e-4700-92f4-4f247fbf49aa req-6c5c6791-f2ab-4e37-9a4b-49309bf16b62 service nova] Lock "79063387-5fb9-4ce2-81c3-f9a094c0fd22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:03:10 user nova-compute[70924]: DEBUG nova.compute.manager [req-b328391a-dd2e-4700-92f4-4f247fbf49aa req-6c5c6791-f2ab-4e37-9a4b-49309bf16b62 service nova] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] No waiting events found dispatching network-vif-plugged-0166d121-c15e-4189-a56c-d252e9e3de80 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:03:10 user nova-compute[70924]: WARNING nova.compute.manager [req-b328391a-dd2e-4700-92f4-4f247fbf49aa req-6c5c6791-f2ab-4e37-9a4b-49309bf16b62 service nova] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Received unexpected event network-vif-plugged-0166d121-c15e-4189-a56c-d252e9e3de80 for instance with vm_state active and task_state deleting.
Jul 29 15:03:10 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Updating instance_info_cache with network_info: [{"id": "1da26b57-ec30-415a-8a43-fe0e662667e1", "address": "fa:16:3e:7c:7f:15", "network": {"id": "b2aee530-d195-47bb-b39d-c8bd15b81a08", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-421022738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcf4644e7a24bf68b407be2e3d9732c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1da26b57-ec", "ovs_interfaceid": "1da26b57-ec30-415a-8a43-fe0e662667e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:03:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Releasing lock "refresh_cache-091e384f-7851-4ac9-b566-990df0497fc5" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:03:10 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Updated the network info_cache for instance {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 29 15:03:10 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:03:10 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:03:10 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70924) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 15:03:10 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:03:10 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Took 1.75 seconds to deallocate network for instance.
Jul 29 15:03:10 user nova-compute[70924]: DEBUG nova.compute.manager [req-b6eafaed-0a79-48e4-9554-0fbde69d5a6b req-9560af97-edf4-4d29-ab0d-4ada7accf193 service nova] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Received event network-vif-deleted-0166d121-c15e-4189-a56c-d252e9e3de80 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:03:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1c00eeaf-66e4-47fe-9b32-9c5688f01767 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:03:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1c00eeaf-66e4-47fe-9b32-9c5688f01767 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:03:11 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-1c00eeaf-66e4-47fe-9b32-9c5688f01767 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:03:11 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-1c00eeaf-66e4-47fe-9b32-9c5688f01767 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:03:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1c00eeaf-66e4-47fe-9b32-9c5688f01767 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.247s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:03:11 user nova-compute[70924]: INFO nova.scheduler.client.report [None req-1c00eeaf-66e4-47fe-9b32-9c5688f01767 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Deleted allocations for instance 79063387-5fb9-4ce2-81c3-f9a094c0fd22
Jul 29 15:03:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1c00eeaf-66e4-47fe-9b32-9c5688f01767 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490 tempest-TestServerVolumeAttachScenarioOldVersion-1572725490-project-member] Lock "79063387-5fb9-4ce2-81c3-f9a094c0fd22" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.322s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:03:11 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:03:13 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:03:14 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:03:15 user nova-compute[70924]: DEBUG nova.compute.manager [req-ffda5fa0-584c-4ac6-9d15-171d9db99ce5 req-38875736-a373-4c85-a38d-cdf05595fa85 service nova] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Received event network-changed-6641ec75-757f-44fa-980b-5b0f270432eb {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:03:15 user nova-compute[70924]: DEBUG nova.compute.manager [req-ffda5fa0-584c-4ac6-9d15-171d9db99ce5 req-38875736-a373-4c85-a38d-cdf05595fa85 service nova] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Refreshing instance network info cache due to event network-changed-6641ec75-757f-44fa-980b-5b0f270432eb. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 15:03:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-ffda5fa0-584c-4ac6-9d15-171d9db99ce5 req-38875736-a373-4c85-a38d-cdf05595fa85 service nova] Acquiring lock "refresh_cache-5865be57-b5f2-4132-bc71-cc41bfe9f897" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:03:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-ffda5fa0-584c-4ac6-9d15-171d9db99ce5 req-38875736-a373-4c85-a38d-cdf05595fa85 service nova] Acquired lock "refresh_cache-5865be57-b5f2-4132-bc71-cc41bfe9f897" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:03:15 user nova-compute[70924]: DEBUG nova.network.neutron [req-ffda5fa0-584c-4ac6-9d15-171d9db99ce5 req-38875736-a373-4c85-a38d-cdf05595fa85 service nova] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Refreshing network info cache for port 6641ec75-757f-44fa-980b-5b0f270432eb {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 15:03:15 user nova-compute[70924]: DEBUG nova.network.neutron [req-ffda5fa0-584c-4ac6-9d15-171d9db99ce5 req-38875736-a373-4c85-a38d-cdf05595fa85 service nova] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Updated VIF entry in instance network info cache for port 6641ec75-757f-44fa-980b-5b0f270432eb. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 15:03:15 user nova-compute[70924]: DEBUG nova.network.neutron [req-ffda5fa0-584c-4ac6-9d15-171d9db99ce5 req-38875736-a373-4c85-a38d-cdf05595fa85 service nova] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Updating instance_info_cache with network_info: [{"id": "6641ec75-757f-44fa-980b-5b0f270432eb", "address": "fa:16:3e:03:b3:5f", "network": {"id": "21a19801-8526-40a2-9bcb-dda6cfb435fe", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-761511746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a03844d646454b6ea55e1b5625f7909a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6641ec75-75", "ovs_interfaceid": "6641ec75-757f-44fa-980b-5b0f270432eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:03:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-ffda5fa0-584c-4ac6-9d15-171d9db99ce5 req-38875736-a373-4c85-a38d-cdf05595fa85 service nova] Releasing lock "refresh_cache-5865be57-b5f2-4132-bc71-cc41bfe9f897" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:03:16 user nova-compute[70924]: DEBUG nova.compute.manager [req-4023a396-75ce-4e97-b1a9-51476cb9b689 req-429dd83f-1176-4fc9-a46d-02a2a71986a9 service nova] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Received event network-changed-6641ec75-757f-44fa-980b-5b0f270432eb {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:03:16 user nova-compute[70924]: DEBUG nova.compute.manager [req-4023a396-75ce-4e97-b1a9-51476cb9b689 req-429dd83f-1176-4fc9-a46d-02a2a71986a9 service nova] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Refreshing instance network info cache due to event network-changed-6641ec75-757f-44fa-980b-5b0f270432eb. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 15:03:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-4023a396-75ce-4e97-b1a9-51476cb9b689 req-429dd83f-1176-4fc9-a46d-02a2a71986a9 service nova] Acquiring lock "refresh_cache-5865be57-b5f2-4132-bc71-cc41bfe9f897" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:03:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-4023a396-75ce-4e97-b1a9-51476cb9b689 req-429dd83f-1176-4fc9-a46d-02a2a71986a9 service nova] Acquired lock "refresh_cache-5865be57-b5f2-4132-bc71-cc41bfe9f897" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:03:16 user nova-compute[70924]: DEBUG nova.network.neutron [req-4023a396-75ce-4e97-b1a9-51476cb9b689 req-429dd83f-1176-4fc9-a46d-02a2a71986a9 service nova] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Refreshing network info cache for port 6641ec75-757f-44fa-980b-5b0f270432eb {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 15:03:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0dba08bb-de47-4207-8406-c5f11bafdf05 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Acquiring lock "5865be57-b5f2-4132-bc71-cc41bfe9f897" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:03:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0dba08bb-de47-4207-8406-c5f11bafdf05 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lock "5865be57-b5f2-4132-bc71-cc41bfe9f897" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:03:16 user nova-compute[70924]: INFO nova.compute.manager [None req-0dba08bb-de47-4207-8406-c5f11bafdf05 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Detaching volume 2cae21de-6018-4d36-9f32-3d6d6d172685
Jul 29 15:03:16 user nova-compute[70924]: INFO nova.virt.block_device [None req-0dba08bb-de47-4207-8406-c5f11bafdf05 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Attempting to driver detach volume 2cae21de-6018-4d36-9f32-3d6d6d172685 from mountpoint /dev/vdb
Jul 29 15:03:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0dba08bb-de47-4207-8406-c5f11bafdf05 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Attempting to detach device vdb from instance 5865be57-b5f2-4132-bc71-cc41bfe9f897 from the persistent domain config. {{(pid=70924) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 29 15:03:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-0dba08bb-de47-4207-8406-c5f11bafdf05 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 15:03:16 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 15:03:16 user nova-compute[70924]:   <source dev="/dev/sdc"/>
Jul 29 15:03:16 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 15:03:16 user nova-compute[70924]:   <serial>2cae21de-6018-4d36-9f32-3d6d6d172685</serial>
Jul 29 15:03:16 user nova-compute[70924]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 15:03:16 user nova-compute[70924]: </disk>
Jul 29 15:03:16 user nova-compute[70924]:  {{(pid=70924) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 15:03:16 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-0dba08bb-de47-4207-8406-c5f11bafdf05 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Successfully detached device vdb from instance 5865be57-b5f2-4132-bc71-cc41bfe9f897 from the persistent domain config.
Jul 29 15:03:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0dba08bb-de47-4207-8406-c5f11bafdf05 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5865be57-b5f2-4132-bc71-cc41bfe9f897 from the live domain config. {{(pid=70924) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 29 15:03:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-0dba08bb-de47-4207-8406-c5f11bafdf05 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 15:03:16 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 15:03:16 user nova-compute[70924]:   <source dev="/dev/sdc"/>
Jul 29 15:03:16 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 15:03:16 user nova-compute[70924]:   <serial>2cae21de-6018-4d36-9f32-3d6d6d172685</serial>
Jul 29 15:03:16 user nova-compute[70924]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 15:03:16 user nova-compute[70924]: </disk>
Jul 29 15:03:16 user nova-compute[70924]:  {{(pid=70924) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 15:03:16 user nova-compute[70924]: DEBUG nova.network.neutron [req-4023a396-75ce-4e97-b1a9-51476cb9b689 req-429dd83f-1176-4fc9-a46d-02a2a71986a9 service nova] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Updated VIF entry in instance network info cache for port 6641ec75-757f-44fa-980b-5b0f270432eb. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 15:03:16 user nova-compute[70924]: DEBUG nova.network.neutron [req-4023a396-75ce-4e97-b1a9-51476cb9b689 req-429dd83f-1176-4fc9-a46d-02a2a71986a9 service nova] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Updating instance_info_cache with network_info: [{"id": "6641ec75-757f-44fa-980b-5b0f270432eb", "address": "fa:16:3e:03:b3:5f", "network": {"id": "21a19801-8526-40a2-9bcb-dda6cfb435fe", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-761511746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a03844d646454b6ea55e1b5625f7909a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6641ec75-75", "ovs_interfaceid": "6641ec75-757f-44fa-980b-5b0f270432eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:03:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-4023a396-75ce-4e97-b1a9-51476cb9b689 req-429dd83f-1176-4fc9-a46d-02a2a71986a9 service nova] Releasing lock "refresh_cache-5865be57-b5f2-4132-bc71-cc41bfe9f897" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:03:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Received event <DeviceRemovedEvent: 1690642996.9572163, 5865be57-b5f2-4132-bc71-cc41bfe9f897 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70924) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 29 15:03:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0dba08bb-de47-4207-8406-c5f11bafdf05 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5865be57-b5f2-4132-bc71-cc41bfe9f897 {{(pid=70924) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 29 15:03:16 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-0dba08bb-de47-4207-8406-c5f11bafdf05 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Successfully detached device vdb from instance 5865be57-b5f2-4132-bc71-cc41bfe9f897 from the live domain config.
Jul 29 15:03:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dba08bb-de47-4207-8406-c5f11bafdf05 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] calling os-brick to detach iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 15:03:16 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dba08bb-de47-4207-8406-c5f11bafdf05 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, {'target_iqns': ['iqn.2010-10.org.openstack:2cae21de-6018-4d36-9f32-3d6d6d172685'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VPjOKual', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 15:03:16 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-0dba08bb-de47-4207-8406-c5f11bafdf05 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 15:03:16 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-0dba08bb-de47-4207-8406-c5f11bafdf05 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 15:03:16 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-0dba08bb-de47-4207-8406-c5f11bafdf05 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 15:03:16 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dba08bb-de47-4207-8406-c5f11bafdf05 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2cae21de-6018-4d36-9f32-3d6d6d172685', 0)] {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 15:03:16 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:03:16 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:03:16 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfcdc80f-4be4-451e-8fe2-2592870905b0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2cae21de-6018-4d36-9f32-3d6d6d172685\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acf7212b-b549-46f5-9100-fd4ca336173a\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:03:17 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:03:17 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:03:17 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[214c0cec-13f1-442b-b7d2-099ff1c54537]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cae21de-6018-4d36-9f32-3d6d6d172685 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acf7212b-b549-46f5-9100-fd4ca336173a (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:03:17 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dba08bb-de47-4207-8406-c5f11bafdf05 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 (non-flash)
Jul 29 15:03:17 user nova-compute[70924]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f (non-flash)
Jul 29 15:03:17 user nova-compute[70924]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cae21de-6018-4d36-9f32-3d6d6d172685 (non-flash)
Jul 29 15:03:17 user nova-compute[70924]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acf7212b-b549-46f5-9100-fd4ca336173a (non-flash)
Jul 29 15:03:17 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 15:03:17 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dba08bb-de47-4207-8406-c5f11bafdf05 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 (non-flash)
Jul 29 15:03:17 user nova-compute[70924]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f (non-flash)
Jul 29 15:03:17 user nova-compute[70924]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cae21de-6018-4d36-9f32-3d6d6d172685 (non-flash)
Jul 29 15:03:17 user nova-compute[70924]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acf7212b-b549-46f5-9100-fd4ca336173a (non-flash)
Jul 29 15:03:17 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 15:03:17 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dba08bb-de47-4207-8406-c5f11bafdf05 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feecc68fd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2cae21de-6018-4d36-9f32-3d6d6d172685'): ({'sdc'}, set())}) {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 15:03:17 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-0dba08bb-de47-4207-8406-c5f11bafdf05 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Removing single pathed devices sdc {{(pid=70924) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 15:03:17 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:03:17 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:03:17 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1d5b49-587e-439d-8eb1-7298209f3c1e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:03:17 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:03:17 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:03:17 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f16cbc4-6256-496c-97f4-a227704aa665]: (4, ('ok\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:03:17 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-0dba08bb-de47-4207-8406-c5f11bafdf05 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Flushing IO for device /dev/sdc {{(pid=70924) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 15:03:17 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:03:17 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:03:17 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d818bbc0-ae5c-4209-a0ac-c95e6eac0948]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:03:17 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-0dba08bb-de47-4207-8406-c5f11bafdf05 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70924) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 15:03:17 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:03:17 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.034s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:03:17 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0704be23-5aa7-4e61-a5f2-2bb54abdcaec]: (4, ('1', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:03:17 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-0dba08bb-de47-4207-8406-c5f11bafdf05 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 15:03:17 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-0dba08bb-de47-4207-8406-c5f11bafdf05 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] SCSI volumes sdc have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 15:03:17 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dba08bb-de47-4207-8406-c5f11bafdf05 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2cae21de-6018-4d36-9f32-3d6d6d172685')] {{(pid=70924) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 15:03:17 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cae21de-6018-4d36-9f32-3d6d6d172685 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:03:17 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cae21de-6018-4d36-9f32-3d6d6d172685 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:03:17 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1153a5e3-0c8c-4c22-87be-634a433bb4dd]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:03:17 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dba08bb-de47-4207-8406-c5f11bafdf05 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:03:17 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cae21de-6018-4d36-9f32-3d6d6d172685 -p 172.16.0.220:3260 --logout {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:03:17 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cae21de-6018-4d36-9f32-3d6d6d172685 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:03:17 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f404630d-6376-4348-88b9-b0309c1507e9]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:2cae21de-6018-4d36-9f32-3d6d6d172685, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:2cae21de-6018-4d36-9f32-3d6d6d172685, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:03:17 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dba08bb-de47-4207-8406-c5f11bafdf05 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:2cae21de-6018-4d36-9f32-3d6d6d172685, portal: 172.16.0.220,3260]
Jul 29 15:03:17 user nova-compute[70924]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:2cae21de-6018-4d36-9f32-3d6d6d172685, portal: 172.16.0.220,3260] successful.
Jul 29 15:03:17 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:03:17 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cae21de-6018-4d36-9f32-3d6d6d172685 -p 172.16.0.220:3260 --op delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:03:17 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cae21de-6018-4d36-9f32-3d6d6d172685 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:03:17 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c3ca210-1ab3-4237-9a8e-9a12f4d774dc]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:03:17 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dba08bb-de47-4207-8406-c5f11bafdf05 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:03:17 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-0dba08bb-de47-4207-8406-c5f11bafdf05 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 15:03:17 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dba08bb-de47-4207-8406-c5f11bafdf05 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] <== disconnect_volume: return (299ms) None {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 15:03:17 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dba08bb-de47-4207-8406-c5f11bafdf05 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Disconnected iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 15:03:18 user nova-compute[70924]: DEBUG nova.objects.instance [None req-0dba08bb-de47-4207-8406-c5f11bafdf05 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lazy-loading 'flavor' on Instance uuid 5865be57-b5f2-4132-bc71-cc41bfe9f897 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:03:18 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0dba08bb-de47-4207-8406-c5f11bafdf05 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lock "5865be57-b5f2-4132-bc71-cc41bfe9f897" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.447s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:03:18 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:03:23 user nova-compute[70924]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690642988.8728058, 79063387-5fb9-4ce2-81c3-f9a094c0fd22 => Stopped> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 15:03:23 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] VM Stopped (Lifecycle Event)
Jul 29 15:03:23 user nova-compute[70924]: DEBUG nova.compute.manager [None req-017c9f36-f944-473a-bf74-fcf01ccaa765 None None] [instance: 79063387-5fb9-4ce2-81c3-f9a094c0fd22] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:03:23 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:03:23 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:03:23 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70924) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 29 15:03:23 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70924) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 15:03:23 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70924) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 15:03:23 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:03:27 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9bb4541b-866b-4883-8b01-65427c2d338d tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Acquiring lock "47104e57-c193-4a85-a2cf-677f0debe373" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:03:27 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9bb4541b-866b-4883-8b01-65427c2d338d tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "47104e57-c193-4a85-a2cf-677f0debe373" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:03:27 user nova-compute[70924]: INFO nova.compute.manager [None req-9bb4541b-866b-4883-8b01-65427c2d338d tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] Detaching volume 19aec498-852a-41ef-b0eb-8b9f3dc2318f
Jul 29 15:03:27 user nova-compute[70924]: INFO nova.virt.block_device [None req-9bb4541b-866b-4883-8b01-65427c2d338d tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] Attempting to driver detach volume 19aec498-852a-41ef-b0eb-8b9f3dc2318f from mountpoint /dev/vdb
Jul 29 15:03:27 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-9bb4541b-866b-4883-8b01-65427c2d338d tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Attempting to detach device vdb from instance 47104e57-c193-4a85-a2cf-677f0debe373 from the persistent domain config. {{(pid=70924) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 29 15:03:27 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-9bb4541b-866b-4883-8b01-65427c2d338d tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 15:03:27 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 15:03:27 user nova-compute[70924]:   <source dev="/dev/sdb"/>
Jul 29 15:03:27 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 15:03:27 user nova-compute[70924]:   <serial>19aec498-852a-41ef-b0eb-8b9f3dc2318f</serial>
Jul 29 15:03:27 user nova-compute[70924]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 15:03:27 user nova-compute[70924]: </disk>
Jul 29 15:03:27 user nova-compute[70924]:  {{(pid=70924) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 15:03:27 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-9bb4541b-866b-4883-8b01-65427c2d338d tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Successfully detached device vdb from instance 47104e57-c193-4a85-a2cf-677f0debe373 from the persistent domain config.
Jul 29 15:03:27 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-9bb4541b-866b-4883-8b01-65427c2d338d tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 47104e57-c193-4a85-a2cf-677f0debe373 from the live domain config. {{(pid=70924) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 29 15:03:27 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-9bb4541b-866b-4883-8b01-65427c2d338d tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 15:03:27 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 15:03:27 user nova-compute[70924]:   <source dev="/dev/sdb"/>
Jul 29 15:03:27 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 15:03:27 user nova-compute[70924]:   <serial>19aec498-852a-41ef-b0eb-8b9f3dc2318f</serial>
Jul 29 15:03:27 user nova-compute[70924]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 15:03:27 user nova-compute[70924]: </disk>
Jul 29 15:03:27 user nova-compute[70924]:  {{(pid=70924) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 15:03:28 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Received event <DeviceRemovedEvent: 1690643008.332758, 47104e57-c193-4a85-a2cf-677f0debe373 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70924) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 29 15:03:28 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-9bb4541b-866b-4883-8b01-65427c2d338d tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 47104e57-c193-4a85-a2cf-677f0debe373 {{(pid=70924) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 29 15:03:28 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-9bb4541b-866b-4883-8b01-65427c2d338d tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Successfully detached device vdb from instance 47104e57-c193-4a85-a2cf-677f0debe373 from the live domain config.
Jul 29 15:03:28 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9bb4541b-866b-4883-8b01-65427c2d338d tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] calling os-brick to detach iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 15:03:28 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb4541b-866b-4883-8b01-65427c2d338d tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, {'target_iqns': ['iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'misYeogz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 15:03:28 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-9bb4541b-866b-4883-8b01-65427c2d338d tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 15:03:28 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-9bb4541b-866b-4883-8b01-65427c2d338d tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 15:03:28 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-9bb4541b-866b-4883-8b01-65427c2d338d tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 15:03:28 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb4541b-866b-4883-8b01-65427c2d338d tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f', 0)] {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 15:03:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:03:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:03:28 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3da7fa-c5da-4ea0-9ca5-c8eb74f24fe9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acf7212b-b549-46f5-9100-fd4ca336173a\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:03:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:03:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:03:28 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1284312-f69e-4105-a97e-0e48e3082ca9]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acf7212b-b549-46f5-9100-fd4ca336173a (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:03:28 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb4541b-866b-4883-8b01-65427c2d338d tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 (non-flash)
Jul 29 15:03:28 user nova-compute[70924]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f (non-flash)
Jul 29 15:03:28 user nova-compute[70924]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acf7212b-b549-46f5-9100-fd4ca336173a (non-flash)
Jul 29 15:03:28 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 15:03:28 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb4541b-866b-4883-8b01-65427c2d338d tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 (non-flash)
Jul 29 15:03:28 user nova-compute[70924]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f (non-flash)
Jul 29 15:03:28 user nova-compute[70924]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acf7212b-b549-46f5-9100-fd4ca336173a (non-flash)
Jul 29 15:03:28 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 15:03:28 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb4541b-866b-4883-8b01-65427c2d338d tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feedc69fd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f'): ({'sdb'}, set())}) {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 15:03:28 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-9bb4541b-866b-4883-8b01-65427c2d338d tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Removing single pathed devices sdb {{(pid=70924) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 15:03:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:03:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:03:28 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24efaa9-3d70-4962-954e-d69d2b35e887]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:03:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:03:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:03:28 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad63bdab-8287-4c9d-a900-ba77e2bdc8a6]: (4, ('ok\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:03:28 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-9bb4541b-866b-4883-8b01-65427c2d338d tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Flushing IO for device /dev/sdb {{(pid=70924) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 15:03:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:03:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:03:28 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ca27f0-00f9-48da-b60a-5cd5d6343143]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:03:28 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-9bb4541b-866b-4883-8b01-65427c2d338d tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70924) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 15:03:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:03:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:03:28 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5856d858-4207-4d8b-870b-7752c59c1793]: (4, ('1', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:03:28 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-9bb4541b-866b-4883-8b01-65427c2d338d tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 15:03:28 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-9bb4541b-866b-4883-8b01-65427c2d338d tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] SCSI volumes sdb have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 15:03:28 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb4541b-866b-4883-8b01-65427c2d338d tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f')] {{(pid=70924) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 15:03:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:03:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:03:28 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d928b0bc-9941-48d3-8da3-c584e67df041]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:03:28 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb4541b-866b-4883-8b01-65427c2d338d tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:03:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f -p 172.16.0.220:3260 --logout {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:03:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:03:28 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13d57d2-ef0c-48b8-a016-4860d0067a92]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:03:28 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb4541b-866b-4883-8b01-65427c2d338d tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f, portal: 172.16.0.220,3260]
Jul 29 15:03:28 user nova-compute[70924]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f, portal: 172.16.0.220,3260] successful.
Jul 29 15:03:28 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:03:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f -p 172.16.0.220:3260 --op delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:03:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19aec498-852a-41ef-b0eb-8b9f3dc2318f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:03:28 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ee7bde-cf72-40e0-a5eb-4b768e2fd010]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:03:28 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb4541b-866b-4883-8b01-65427c2d338d tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:03:28 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-9bb4541b-866b-4883-8b01-65427c2d338d tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 15:03:28 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb4541b-866b-4883-8b01-65427c2d338d tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] <== disconnect_volume: return (312ms) None {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 15:03:28 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9bb4541b-866b-4883-8b01-65427c2d338d tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] Disconnected iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 15:03:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:03:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:03:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70924) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 29 15:03:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70924) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 15:03:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70924) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 15:03:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:03:31 user nova-compute[70924]: DEBUG nova.objects.instance [None req-9bb4541b-866b-4883-8b01-65427c2d338d tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lazy-loading 'flavor' on Instance uuid 47104e57-c193-4a85-a2cf-677f0debe373 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:03:31 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9bb4541b-866b-4883-8b01-65427c2d338d tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "47104e57-c193-4a85-a2cf-677f0debe373" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.029s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:03:33 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:03:38 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:03:38 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:03:38 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70924) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 29 15:03:38 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70924) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 15:03:38 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70924) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 15:03:38 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:03:43 user nova-compute[70924]: DEBUG nova.compute.manager [req-ee90b1a1-f31b-4047-bb86-acdcfc9c7211 req-bd2c0a88-3a6c-460f-b3e0-e365e4170d6b service nova] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Received event network-changed-eafccd28-f902-4bc2-805e-4d2f8bbd4e82 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:03:43 user nova-compute[70924]: DEBUG nova.compute.manager [req-ee90b1a1-f31b-4047-bb86-acdcfc9c7211 req-bd2c0a88-3a6c-460f-b3e0-e365e4170d6b service nova] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Refreshing instance network info cache due to event network-changed-eafccd28-f902-4bc2-805e-4d2f8bbd4e82. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 15:03:43 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-ee90b1a1-f31b-4047-bb86-acdcfc9c7211 req-bd2c0a88-3a6c-460f-b3e0-e365e4170d6b service nova] Acquiring lock "refresh_cache-f3f7eeda-a001-4c35-abeb-e459d701bd93" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:03:43 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-ee90b1a1-f31b-4047-bb86-acdcfc9c7211 req-bd2c0a88-3a6c-460f-b3e0-e365e4170d6b service nova] Acquired lock "refresh_cache-f3f7eeda-a001-4c35-abeb-e459d701bd93" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:03:43 user nova-compute[70924]: DEBUG nova.network.neutron [req-ee90b1a1-f31b-4047-bb86-acdcfc9c7211 req-bd2c0a88-3a6c-460f-b3e0-e365e4170d6b service nova] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Refreshing network info cache for port eafccd28-f902-4bc2-805e-4d2f8bbd4e82 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 15:03:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:03:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0ac6ad93-ee70-412f-8d46-0401610e247c tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Acquiring lock "f3f7eeda-a001-4c35-abeb-e459d701bd93" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:03:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0ac6ad93-ee70-412f-8d46-0401610e247c tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "f3f7eeda-a001-4c35-abeb-e459d701bd93" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:03:44 user nova-compute[70924]: INFO nova.compute.manager [None req-0ac6ad93-ee70-412f-8d46-0401610e247c tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Detaching volume 5d7f71e8-1d8c-4745-85b9-9685f0bfd592
Jul 29 15:03:44 user nova-compute[70924]: DEBUG nova.network.neutron [req-ee90b1a1-f31b-4047-bb86-acdcfc9c7211 req-bd2c0a88-3a6c-460f-b3e0-e365e4170d6b service nova] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Updated VIF entry in instance network info cache for port eafccd28-f902-4bc2-805e-4d2f8bbd4e82. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 15:03:44 user nova-compute[70924]: DEBUG nova.network.neutron [req-ee90b1a1-f31b-4047-bb86-acdcfc9c7211 req-bd2c0a88-3a6c-460f-b3e0-e365e4170d6b service nova] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Updating instance_info_cache with network_info: [{"id": "eafccd28-f902-4bc2-805e-4d2f8bbd4e82", "address": "fa:16:3e:9f:ec:06", "network": {"id": "b2aee530-d195-47bb-b39d-c8bd15b81a08", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-421022738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcf4644e7a24bf68b407be2e3d9732c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeafccd28-f9", "ovs_interfaceid": "eafccd28-f902-4bc2-805e-4d2f8bbd4e82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:03:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-ee90b1a1-f31b-4047-bb86-acdcfc9c7211 req-bd2c0a88-3a6c-460f-b3e0-e365e4170d6b service nova] Releasing lock "refresh_cache-f3f7eeda-a001-4c35-abeb-e459d701bd93" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:03:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:03:44 user nova-compute[70924]: INFO nova.virt.block_device [None req-0ac6ad93-ee70-412f-8d46-0401610e247c tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Attempting to driver detach volume 5d7f71e8-1d8c-4745-85b9-9685f0bfd592 from mountpoint /dev/vdb
Jul 29 15:03:44 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0ac6ad93-ee70-412f-8d46-0401610e247c tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Attempting to detach device vdb from instance f3f7eeda-a001-4c35-abeb-e459d701bd93 from the persistent domain config. {{(pid=70924) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 29 15:03:44 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-0ac6ad93-ee70-412f-8d46-0401610e247c tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 15:03:44 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 15:03:44 user nova-compute[70924]:   <source dev="/dev/sdd"/>
Jul 29 15:03:44 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 15:03:44 user nova-compute[70924]:   <serial>5d7f71e8-1d8c-4745-85b9-9685f0bfd592</serial>
Jul 29 15:03:44 user nova-compute[70924]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 15:03:44 user nova-compute[70924]: </disk>
Jul 29 15:03:44 user nova-compute[70924]:  {{(pid=70924) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 15:03:44 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-0ac6ad93-ee70-412f-8d46-0401610e247c tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Successfully detached device vdb from instance f3f7eeda-a001-4c35-abeb-e459d701bd93 from the persistent domain config.
Jul 29 15:03:44 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0ac6ad93-ee70-412f-8d46-0401610e247c tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f3f7eeda-a001-4c35-abeb-e459d701bd93 from the live domain config. {{(pid=70924) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 29 15:03:44 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-0ac6ad93-ee70-412f-8d46-0401610e247c tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 15:03:44 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 15:03:44 user nova-compute[70924]:   <source dev="/dev/sdd"/>
Jul 29 15:03:44 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 15:03:44 user nova-compute[70924]:   <serial>5d7f71e8-1d8c-4745-85b9-9685f0bfd592</serial>
Jul 29 15:03:44 user nova-compute[70924]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 15:03:44 user nova-compute[70924]: </disk>
Jul 29 15:03:44 user nova-compute[70924]:  {{(pid=70924) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 15:03:44 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Received event <DeviceRemovedEvent: 1690643024.6489162, f3f7eeda-a001-4c35-abeb-e459d701bd93 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70924) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 29 15:03:44 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0ac6ad93-ee70-412f-8d46-0401610e247c tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f3f7eeda-a001-4c35-abeb-e459d701bd93 {{(pid=70924) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 29 15:03:44 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-0ac6ad93-ee70-412f-8d46-0401610e247c tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Successfully detached device vdb from instance f3f7eeda-a001-4c35-abeb-e459d701bd93 from the live domain config.
Jul 29 15:03:44 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ac6ad93-ee70-412f-8d46-0401610e247c tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] calling os-brick to detach iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 15:03:44 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac6ad93-ee70-412f-8d46-0401610e247c tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, {'target_iqns': ['iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IpOBjLvQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 15:03:44 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-0ac6ad93-ee70-412f-8d46-0401610e247c tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 15:03:44 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-0ac6ad93-ee70-412f-8d46-0401610e247c tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 15:03:44 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-0ac6ad93-ee70-412f-8d46-0401610e247c tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 15:03:44 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac6ad93-ee70-412f-8d46-0401610e247c tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592', 0)] {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 15:03:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:03:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:03:44 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80aa363-913f-4c29-bda4-edfb19b72c4b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acf7212b-b549-46f5-9100-fd4ca336173a\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:03:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:03:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:03:44 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[768669df-4171-4c31-b966-4ad1e177d14b]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acf7212b-b549-46f5-9100-fd4ca336173a (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:03:44 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac6ad93-ee70-412f-8d46-0401610e247c tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 (non-flash)
Jul 29 15:03:44 user nova-compute[70924]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acf7212b-b549-46f5-9100-fd4ca336173a (non-flash)
Jul 29 15:03:44 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 15:03:44 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac6ad93-ee70-412f-8d46-0401610e247c tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 (non-flash)
Jul 29 15:03:44 user nova-compute[70924]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acf7212b-b549-46f5-9100-fd4ca336173a (non-flash)
Jul 29 15:03:44 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 15:03:44 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac6ad93-ee70-412f-8d46-0401610e247c tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feecc5ebc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592'): ({'sdd'}, set())}) {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 15:03:44 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-0ac6ad93-ee70-412f-8d46-0401610e247c tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Removing single pathed devices sdd {{(pid=70924) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 15:03:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:03:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:03:44 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3024048-c9bc-4426-bf9b-21928cde0b2d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:03:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:03:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:03:44 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b65b375-933e-45b3-8fd6-b32f3ebc95e8]: (4, ('ok\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:03:44 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-0ac6ad93-ee70-412f-8d46-0401610e247c tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Flushing IO for device /dev/sdd {{(pid=70924) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 15:03:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:03:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:03:44 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec4fae8-8da2-4087-8746-c31d64634268]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:03:44 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-0ac6ad93-ee70-412f-8d46-0401610e247c tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70924) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 15:03:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:03:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:03:44 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f6a48d-afb7-4c0c-90e7-fbafcbebafcd]: (4, ('1', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:03:44 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-0ac6ad93-ee70-412f-8d46-0401610e247c tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 15:03:44 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-0ac6ad93-ee70-412f-8d46-0401610e247c tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] SCSI volumes sdd have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 15:03:44 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac6ad93-ee70-412f-8d46-0401610e247c tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592')] {{(pid=70924) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 15:03:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:03:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:03:44 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8bda546-c6b0-4cba-948b-42093b497963]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:03:44 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac6ad93-ee70-412f-8d46-0401610e247c tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:03:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 -p 172.16.0.220:3260 --logout {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:03:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:03:44 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[610f84a4-0d41-4c9f-94a6-a883c33c770b]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:03:44 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac6ad93-ee70-412f-8d46-0401610e247c tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592, portal: 172.16.0.220,3260]
Jul 29 15:03:44 user nova-compute[70924]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592, portal: 172.16.0.220,3260] successful.
Jul 29 15:03:44 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:03:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 -p 172.16.0.220:3260 --op delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:03:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d7f71e8-1d8c-4745-85b9-9685f0bfd592 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:03:44 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[544e2524-1fdf-4b1a-8d91-fe35fd0f6f60]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:03:44 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac6ad93-ee70-412f-8d46-0401610e247c tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:03:44 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-0ac6ad93-ee70-412f-8d46-0401610e247c tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 15:03:44 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ac6ad93-ee70-412f-8d46-0401610e247c tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] <== disconnect_volume: return (299ms) None {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 15:03:44 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ac6ad93-ee70-412f-8d46-0401610e247c tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Disconnected iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 15:03:45 user nova-compute[70924]: DEBUG nova.compute.manager [req-29b1c673-1c78-4d17-9153-b9a2e71b5d92 req-54b32768-9641-4344-87f5-51520fd80e3a service nova] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Received event network-changed-eafccd28-f902-4bc2-805e-4d2f8bbd4e82 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:03:45 user nova-compute[70924]: DEBUG nova.compute.manager [req-29b1c673-1c78-4d17-9153-b9a2e71b5d92 req-54b32768-9641-4344-87f5-51520fd80e3a service nova] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Refreshing instance network info cache due to event network-changed-eafccd28-f902-4bc2-805e-4d2f8bbd4e82. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 15:03:45 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-29b1c673-1c78-4d17-9153-b9a2e71b5d92 req-54b32768-9641-4344-87f5-51520fd80e3a service nova] Acquiring lock "refresh_cache-f3f7eeda-a001-4c35-abeb-e459d701bd93" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:03:45 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-29b1c673-1c78-4d17-9153-b9a2e71b5d92 req-54b32768-9641-4344-87f5-51520fd80e3a service nova] Acquired lock "refresh_cache-f3f7eeda-a001-4c35-abeb-e459d701bd93" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:03:45 user nova-compute[70924]: DEBUG nova.network.neutron [req-29b1c673-1c78-4d17-9153-b9a2e71b5d92 req-54b32768-9641-4344-87f5-51520fd80e3a service nova] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Refreshing network info cache for port eafccd28-f902-4bc2-805e-4d2f8bbd4e82 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 15:03:45 user nova-compute[70924]: DEBUG nova.objects.instance [None req-0ac6ad93-ee70-412f-8d46-0401610e247c tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lazy-loading 'flavor' on Instance uuid f3f7eeda-a001-4c35-abeb-e459d701bd93 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:03:45 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0ac6ad93-ee70-412f-8d46-0401610e247c tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "f3f7eeda-a001-4c35-abeb-e459d701bd93" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.766s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:03:46 user nova-compute[70924]: DEBUG nova.network.neutron [req-29b1c673-1c78-4d17-9153-b9a2e71b5d92 req-54b32768-9641-4344-87f5-51520fd80e3a service nova] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Updated VIF entry in instance network info cache for port eafccd28-f902-4bc2-805e-4d2f8bbd4e82. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 15:03:46 user nova-compute[70924]: DEBUG nova.network.neutron [req-29b1c673-1c78-4d17-9153-b9a2e71b5d92 req-54b32768-9641-4344-87f5-51520fd80e3a service nova] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Updating instance_info_cache with network_info: [{"id": "eafccd28-f902-4bc2-805e-4d2f8bbd4e82", "address": "fa:16:3e:9f:ec:06", "network": {"id": "b2aee530-d195-47bb-b39d-c8bd15b81a08", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-421022738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcf4644e7a24bf68b407be2e3d9732c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeafccd28-f9", "ovs_interfaceid": "eafccd28-f902-4bc2-805e-4d2f8bbd4e82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:03:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-29b1c673-1c78-4d17-9153-b9a2e71b5d92 req-54b32768-9641-4344-87f5-51520fd80e3a service nova] Releasing lock "refresh_cache-f3f7eeda-a001-4c35-abeb-e459d701bd93" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:03:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:03:49 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:03:53 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:03:58 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:03:58 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:03:59 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:04:00 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:04:01 user nova-compute[70924]: DEBUG nova.compute.manager [req-b3449cf6-b95f-488a-910a-f8dafa130361 req-22febc15-cce7-4fc7-aef4-754a09d1c381 service nova] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] Received event network-changed-6e00390b-efbf-4b94-9709-d1427afd0854 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:04:01 user nova-compute[70924]: DEBUG nova.compute.manager [req-b3449cf6-b95f-488a-910a-f8dafa130361 req-22febc15-cce7-4fc7-aef4-754a09d1c381 service nova] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] Refreshing instance network info cache due to event network-changed-6e00390b-efbf-4b94-9709-d1427afd0854. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 15:04:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b3449cf6-b95f-488a-910a-f8dafa130361 req-22febc15-cce7-4fc7-aef4-754a09d1c381 service nova] Acquiring lock "refresh_cache-e905081f-dfff-41ab-88b3-8cd91d01671d" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:04:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b3449cf6-b95f-488a-910a-f8dafa130361 req-22febc15-cce7-4fc7-aef4-754a09d1c381 service nova] Acquired lock "refresh_cache-e905081f-dfff-41ab-88b3-8cd91d01671d" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:04:01 user nova-compute[70924]: DEBUG nova.network.neutron [req-b3449cf6-b95f-488a-910a-f8dafa130361 req-22febc15-cce7-4fc7-aef4-754a09d1c381 service nova] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] Refreshing network info cache for port 6e00390b-efbf-4b94-9709-d1427afd0854 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 15:04:02 user nova-compute[70924]: DEBUG nova.network.neutron [req-b3449cf6-b95f-488a-910a-f8dafa130361 req-22febc15-cce7-4fc7-aef4-754a09d1c381 service nova] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] Updated VIF entry in instance network info cache for port 6e00390b-efbf-4b94-9709-d1427afd0854. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 15:04:02 user nova-compute[70924]: DEBUG nova.network.neutron [req-b3449cf6-b95f-488a-910a-f8dafa130361 req-22febc15-cce7-4fc7-aef4-754a09d1c381 service nova] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] Updating instance_info_cache with network_info: [{"id": "6e00390b-efbf-4b94-9709-d1427afd0854", "address": "fa:16:3e:76:51:ad", "network": {"id": "c19ed38b-2acd-421a-9e4b-f60df3db2f1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1812407562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a974cbbf734f51897c3e632ae9e45f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e00390b-ef", "ovs_interfaceid": "6e00390b-efbf-4b94-9709-d1427afd0854", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:04:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b3449cf6-b95f-488a-910a-f8dafa130361 req-22febc15-cce7-4fc7-aef4-754a09d1c381 service nova] Releasing lock "refresh_cache-e905081f-dfff-41ab-88b3-8cd91d01671d" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:04:02 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:04:03 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:04:03 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:04:04 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:04:05 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:04:05 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:04:06 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:04:06 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70924) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 15:04:06 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:04:06 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:04:06 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:04:06 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:04:06 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Auditing locally available compute resources for user (node: user) {{(pid=70924) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 15:04:06 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f7eeda-a001-4c35-abeb-e459d701bd93/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:04:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:04:06 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f7eeda-a001-4c35-abeb-e459d701bd93/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:04:06 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f7eeda-a001-4c35-abeb-e459d701bd93/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:04:06 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f7eeda-a001-4c35-abeb-e459d701bd93/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:04:06 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5865be57-b5f2-4132-bc71-cc41bfe9f897/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:04:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5865be57-b5f2-4132-bc71-cc41bfe9f897/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:04:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5865be57-b5f2-4132-bc71-cc41bfe9f897/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:04:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5865be57-b5f2-4132-bc71-cc41bfe9f897/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:04:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47104e57-c193-4a85-a2cf-677f0debe373/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:04:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47104e57-c193-4a85-a2cf-677f0debe373/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:04:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47104e57-c193-4a85-a2cf-677f0debe373/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:04:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47104e57-c193-4a85-a2cf-677f0debe373/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:04:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk.rescue --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:04:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:04:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk.rescue --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:04:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk.rescue --force-share --output=json" returned: 0 in 0.166s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:04:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:04:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:04:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:04:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:04:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:04:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:04:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:04:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:04:08 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 15:04:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:04:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:04:09 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:04:09 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:04:09 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Hypervisor/Node resource view: name=user free_ram=7985MB free_disk=25.244091033935547GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70924) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 15:04:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:04:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:04:09 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 9ec07c62-951b-4e3a-bffa-e01dfb4665ec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:04:09 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 091e384f-7851-4ac9-b566-990df0497fc5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:04:09 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance f3f7eeda-a001-4c35-abeb-e459d701bd93 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:04:09 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 47104e57-c193-4a85-a2cf-677f0debe373 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:04:09 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 5865be57-b5f2-4132-bc71-cc41bfe9f897 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:04:09 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance e905081f-dfff-41ab-88b3-8cd91d01671d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:04:09 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 15:04:09 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 15:04:09 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:04:09 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:04:09 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Compute_service record updated for user:user {{(pid=70924) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 15:04:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.384s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:04:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Acquiring lock "1d0e4888-6f19-4515-80f6-e3b03427acce" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:04:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "1d0e4888-6f19-4515-80f6-e3b03427acce" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:04:10 user nova-compute[70924]: DEBUG nova.compute.manager [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] Starting instance... {{(pid=70924) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 15:04:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:04:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:04:10 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70924) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 15:04:10 user nova-compute[70924]: INFO nova.compute.claims [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] Claim successful on node user
Jul 29 15:04:10 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:04:11 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:04:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.386s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:04:11 user nova-compute[70924]: DEBUG nova.compute.manager [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] Start building networks asynchronously for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 15:04:11 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 15:04:11 user nova-compute[70924]: DEBUG nova.compute.manager [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] Allocating IP information in the background. {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 15:04:11 user nova-compute[70924]: DEBUG nova.network.neutron [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] allocate_for_instance() {{(pid=70924) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 15:04:11 user nova-compute[70924]: DEBUG nova.compute.manager [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] Start building block device mappings for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 15:04:11 user nova-compute[70924]: DEBUG nova.policy [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'da204646e8f84693ad470ed1d3eadd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a974cbbf734f51897c3e632ae9e45f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70924) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 15:04:11 user nova-compute[70924]: INFO nova.virt.block_device [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] Booting with volume snapshot 88c5bdaa-f36d-404a-8290-d6f5efedaad2 at /dev/vda
Jul 29 15:04:11 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:04:11 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Starting heal instance info cache {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 15:04:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "refresh_cache-f3f7eeda-a001-4c35-abeb-e459d701bd93" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:04:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquired lock "refresh_cache-f3f7eeda-a001-4c35-abeb-e459d701bd93" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:04:12 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Forcefully refreshing network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 29 15:04:12 user nova-compute[70924]: DEBUG nova.network.neutron [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] Successfully created port: c9d69516-6a60-4516-90cf-45529916012e {{(pid=70924) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 15:04:12 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Updating instance_info_cache with network_info: [{"id": "eafccd28-f902-4bc2-805e-4d2f8bbd4e82", "address": "fa:16:3e:9f:ec:06", "network": {"id": "b2aee530-d195-47bb-b39d-c8bd15b81a08", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-421022738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcf4644e7a24bf68b407be2e3d9732c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeafccd28-f9", "ovs_interfaceid": "eafccd28-f902-4bc2-805e-4d2f8bbd4e82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:04:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Releasing lock "refresh_cache-f3f7eeda-a001-4c35-abeb-e459d701bd93" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:04:12 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Updated the network info_cache for instance {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 29 15:04:12 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:04:13 user nova-compute[70924]: DEBUG nova.network.neutron [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] Successfully updated port: c9d69516-6a60-4516-90cf-45529916012e {{(pid=70924) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 15:04:13 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Acquiring lock "refresh_cache-1d0e4888-6f19-4515-80f6-e3b03427acce" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:04:13 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Acquired lock "refresh_cache-1d0e4888-6f19-4515-80f6-e3b03427acce" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:04:13 user nova-compute[70924]: DEBUG nova.network.neutron [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 15:04:13 user nova-compute[70924]: DEBUG nova.compute.manager [req-c3163a97-8e89-488a-a423-58ba030bb13a req-64992c0c-944d-4995-9c76-fc2412a16d86 service nova] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] Received event network-changed-c9d69516-6a60-4516-90cf-45529916012e {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:04:13 user nova-compute[70924]: DEBUG nova.compute.manager [req-c3163a97-8e89-488a-a423-58ba030bb13a req-64992c0c-944d-4995-9c76-fc2412a16d86 service nova] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] Refreshing instance network info cache due to event network-changed-c9d69516-6a60-4516-90cf-45529916012e. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 15:04:13 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c3163a97-8e89-488a-a423-58ba030bb13a req-64992c0c-944d-4995-9c76-fc2412a16d86 service nova] Acquiring lock "refresh_cache-1d0e4888-6f19-4515-80f6-e3b03427acce" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:04:13 user nova-compute[70924]: DEBUG nova.network.neutron [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] Instance cache missing network info. {{(pid=70924) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 15:04:14 user nova-compute[70924]: DEBUG nova.network.neutron [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] Updating instance_info_cache with network_info: [{"id": "c9d69516-6a60-4516-90cf-45529916012e", "address": "fa:16:3e:b4:5c:36", "network": {"id": "c19ed38b-2acd-421a-9e4b-f60df3db2f1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1812407562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a974cbbf734f51897c3e632ae9e45f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d69516-6a", "ovs_interfaceid": "c9d69516-6a60-4516-90cf-45529916012e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:04:14 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Releasing lock "refresh_cache-1d0e4888-6f19-4515-80f6-e3b03427acce" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:04:14 user nova-compute[70924]: DEBUG nova.compute.manager [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] Instance network_info: |[{"id": "c9d69516-6a60-4516-90cf-45529916012e", "address": "fa:16:3e:b4:5c:36", "network": {"id": "c19ed38b-2acd-421a-9e4b-f60df3db2f1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1812407562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a974cbbf734f51897c3e632ae9e45f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d69516-6a", "ovs_interfaceid": "c9d69516-6a60-4516-90cf-45529916012e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 15:04:14 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c3163a97-8e89-488a-a423-58ba030bb13a req-64992c0c-944d-4995-9c76-fc2412a16d86 service nova] Acquired lock "refresh_cache-1d0e4888-6f19-4515-80f6-e3b03427acce" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:04:14 user nova-compute[70924]: DEBUG nova.network.neutron [req-c3163a97-8e89-488a-a423-58ba030bb13a req-64992c0c-944d-4995-9c76-fc2412a16d86 service nova] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] Refreshing network info cache for port c9d69516-6a60-4516-90cf-45529916012e {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 15:04:14 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4992-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:04:14 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:04:14 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70924) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 29 15:04:14 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70924) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 15:04:14 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70924) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 15:04:14 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:04:14 user nova-compute[70924]: DEBUG nova.network.neutron [req-c3163a97-8e89-488a-a423-58ba030bb13a req-64992c0c-944d-4995-9c76-fc2412a16d86 service nova] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] Updated VIF entry in instance network info cache for port c9d69516-6a60-4516-90cf-45529916012e. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 15:04:14 user nova-compute[70924]: DEBUG nova.network.neutron [req-c3163a97-8e89-488a-a423-58ba030bb13a req-64992c0c-944d-4995-9c76-fc2412a16d86 service nova] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] Updating instance_info_cache with network_info: [{"id": "c9d69516-6a60-4516-90cf-45529916012e", "address": "fa:16:3e:b4:5c:36", "network": {"id": "c19ed38b-2acd-421a-9e4b-f60df3db2f1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1812407562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a974cbbf734f51897c3e632ae9e45f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d69516-6a", "ovs_interfaceid": "c9d69516-6a60-4516-90cf-45529916012e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:04:14 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c3163a97-8e89-488a-a423-58ba030bb13a req-64992c0c-944d-4995-9c76-fc2412a16d86 service nova] Releasing lock "refresh_cache-1d0e4888-6f19-4515-80f6-e3b03427acce" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:04:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-675e1079-002c-4550-a53a-6af6a1e0e604 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Acquiring lock "5865be57-b5f2-4132-bc71-cc41bfe9f897" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:04:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-675e1079-002c-4550-a53a-6af6a1e0e604 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lock "5865be57-b5f2-4132-bc71-cc41bfe9f897" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:04:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-675e1079-002c-4550-a53a-6af6a1e0e604 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Acquiring lock "5865be57-b5f2-4132-bc71-cc41bfe9f897-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:04:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-675e1079-002c-4550-a53a-6af6a1e0e604 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lock "5865be57-b5f2-4132-bc71-cc41bfe9f897-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:04:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-675e1079-002c-4550-a53a-6af6a1e0e604 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lock "5865be57-b5f2-4132-bc71-cc41bfe9f897-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:04:15 user nova-compute[70924]: INFO nova.compute.manager [None req-675e1079-002c-4550-a53a-6af6a1e0e604 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Terminating instance
Jul 29 15:04:15 user nova-compute[70924]: DEBUG nova.compute.manager [None req-675e1079-002c-4550-a53a-6af6a1e0e604 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Start destroying the instance on the hypervisor. {{(pid=70924) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 15:04:15 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:04:15 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:04:15 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:04:15 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:04:15 user nova-compute[70924]: DEBUG nova.compute.manager [req-4e17ab3a-7f81-403c-9097-2fa0920b1462 req-8c878d1b-a3ca-4c6a-9e88-81ce219e443a service nova] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Received event network-vif-unplugged-6641ec75-757f-44fa-980b-5b0f270432eb {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:04:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-4e17ab3a-7f81-403c-9097-2fa0920b1462 req-8c878d1b-a3ca-4c6a-9e88-81ce219e443a service nova] Acquiring lock "5865be57-b5f2-4132-bc71-cc41bfe9f897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:04:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-4e17ab3a-7f81-403c-9097-2fa0920b1462 req-8c878d1b-a3ca-4c6a-9e88-81ce219e443a service nova] Lock "5865be57-b5f2-4132-bc71-cc41bfe9f897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:04:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-4e17ab3a-7f81-403c-9097-2fa0920b1462 req-8c878d1b-a3ca-4c6a-9e88-81ce219e443a service nova] Lock "5865be57-b5f2-4132-bc71-cc41bfe9f897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:04:15 user nova-compute[70924]: DEBUG nova.compute.manager [req-4e17ab3a-7f81-403c-9097-2fa0920b1462 req-8c878d1b-a3ca-4c6a-9e88-81ce219e443a service nova] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] No waiting events found dispatching network-vif-unplugged-6641ec75-757f-44fa-980b-5b0f270432eb {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:04:15 user nova-compute[70924]: DEBUG nova.compute.manager [req-4e17ab3a-7f81-403c-9097-2fa0920b1462 req-8c878d1b-a3ca-4c6a-9e88-81ce219e443a service nova] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Received event network-vif-unplugged-6641ec75-757f-44fa-980b-5b0f270432eb for instance with task_state deleting. {{(pid=70924) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 15:04:16 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Instance destroyed successfully.
Jul 29 15:04:16 user nova-compute[70924]: DEBUG nova.objects.instance [None req-675e1079-002c-4550-a53a-6af6a1e0e604 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lazy-loading 'resources' on Instance uuid 5865be57-b5f2-4132-bc71-cc41bfe9f897 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:04:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-675e1079-002c-4550-a53a-6af6a1e0e604 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:59:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1371283640',display_name='tempest-TestMinimumBasicScenario-server-1371283640',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1371283640',id=36,image_ref='c83df43a-b354-45a0-a7db-20c65b231425',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMM7cK7PNk76BhV8usJuNDNcA0r482y6nz4W0CPMN7SflEic7LFaV/LqSedVzFDIbFKoE1zXWCSnEHzpbKbpwtMgn+vx36311Wv0CEeHkPZaZ23MspqtwlC96510GhE0pA==',key_name='tempest-TestMinimumBasicScenario-1965420479',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:59:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a03844d646454b6ea55e1b5625f7909a',ramdisk_id='',reservation_id='r-dauoklbi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c83df43a-b354-45a0-a7db-20c65b231425',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-944069199',owner_user_name='tempest-TestMinimumBasicScenario-944069199-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T15:01:30Z,user_data=None,user_id='7aa9677ce659431db31a0e513277d692',uuid=5865be57-b5f2-4132-bc71-cc41bfe9f897,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6641ec75-757f-44fa-980b-5b0f270432eb", "address": "fa:16:3e:03:b3:5f", "network": {"id": "21a19801-8526-40a2-9bcb-dda6cfb435fe", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-761511746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a03844d646454b6ea55e1b5625f7909a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6641ec75-75", "ovs_interfaceid": "6641ec75-757f-44fa-980b-5b0f270432eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 15:04:16 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-675e1079-002c-4550-a53a-6af6a1e0e604 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Converting VIF {"id": "6641ec75-757f-44fa-980b-5b0f270432eb", "address": "fa:16:3e:03:b3:5f", "network": {"id": "21a19801-8526-40a2-9bcb-dda6cfb435fe", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-761511746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a03844d646454b6ea55e1b5625f7909a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6641ec75-75", "ovs_interfaceid": "6641ec75-757f-44fa-980b-5b0f270432eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 15:04:16 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-675e1079-002c-4550-a53a-6af6a1e0e604 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:b3:5f,bridge_name='br-int',has_traffic_filtering=True,id=6641ec75-757f-44fa-980b-5b0f270432eb,network=Network(21a19801-8526-40a2-9bcb-dda6cfb435fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6641ec75-75') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 15:04:16 user nova-compute[70924]: DEBUG os_vif [None req-675e1079-002c-4550-a53a-6af6a1e0e604 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:b3:5f,bridge_name='br-int',has_traffic_filtering=True,id=6641ec75-757f-44fa-980b-5b0f270432eb,network=Network(21a19801-8526-40a2-9bcb-dda6cfb435fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6641ec75-75') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 15:04:16 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:04:16 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6641ec75-75, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:04:16 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:04:16 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:04:16 user nova-compute[70924]: INFO os_vif [None req-675e1079-002c-4550-a53a-6af6a1e0e604 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:b3:5f,bridge_name='br-int',has_traffic_filtering=True,id=6641ec75-757f-44fa-980b-5b0f270432eb,network=Network(21a19801-8526-40a2-9bcb-dda6cfb435fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6641ec75-75')
Jul 29 15:04:16 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-675e1079-002c-4550-a53a-6af6a1e0e604 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Deleting instance files /opt/stack/data/nova/instances/5865be57-b5f2-4132-bc71-cc41bfe9f897_del
Jul 29 15:04:16 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-675e1079-002c-4550-a53a-6af6a1e0e604 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Deletion of /opt/stack/data/nova/instances/5865be57-b5f2-4132-bc71-cc41bfe9f897_del complete
Jul 29 15:04:16 user nova-compute[70924]: INFO nova.compute.manager [None req-675e1079-002c-4550-a53a-6af6a1e0e604 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Took 0.95 seconds to destroy the instance on the hypervisor.
Jul 29 15:04:16 user nova-compute[70924]: DEBUG oslo.service.loopingcall [None req-675e1079-002c-4550-a53a-6af6a1e0e604 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70924) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 15:04:16 user nova-compute[70924]: DEBUG nova.compute.manager [-] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Deallocating network for instance {{(pid=70924) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 15:04:16 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] deallocate_for_instance() {{(pid=70924) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 15:04:16 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:04:17 user nova-compute[70924]: DEBUG nova.compute.manager [req-d03072a6-d639-4c82-ae34-d0c92f7c7a4f req-66ef9797-0c05-4e01-932b-12645d601a06 service nova] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Received event network-vif-deleted-6641ec75-757f-44fa-980b-5b0f270432eb {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:04:17 user nova-compute[70924]: INFO nova.compute.manager [req-d03072a6-d639-4c82-ae34-d0c92f7c7a4f req-66ef9797-0c05-4e01-932b-12645d601a06 service nova] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Neutron deleted interface 6641ec75-757f-44fa-980b-5b0f270432eb; detaching it from the instance and deleting it from the info cache
Jul 29 15:04:17 user nova-compute[70924]: DEBUG nova.network.neutron [req-d03072a6-d639-4c82-ae34-d0c92f7c7a4f req-66ef9797-0c05-4e01-932b-12645d601a06 service nova] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:04:17 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Took 0.71 seconds to deallocate network for instance.
Jul 29 15:04:17 user nova-compute[70924]: DEBUG nova.compute.manager [req-d03072a6-d639-4c82-ae34-d0c92f7c7a4f req-66ef9797-0c05-4e01-932b-12645d601a06 service nova] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Detach interface failed, port_id=6641ec75-757f-44fa-980b-5b0f270432eb, reason: Instance 5865be57-b5f2-4132-bc71-cc41bfe9f897 could not be found. {{(pid=70924) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 29 15:04:17 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-675e1079-002c-4550-a53a-6af6a1e0e604 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:04:17 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-675e1079-002c-4550-a53a-6af6a1e0e604 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:04:17 user nova-compute[70924]: DEBUG os_brick.utils [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 15:04:17 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:04:17 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:04:17 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d9af56-65d1-46b5-a595-a9a1d3810826]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f2127c4a30d9\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:04:17 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:04:17 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:04:17 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd42c6c-9235-465a-a4b3-e3b59d41875d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:04:17 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:04:17 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:04:17 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e25b5c8-1939-41bc-bd35-4907e707510d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:04:17 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a70f30f-4318-4417-bb3b-388b85022f5b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:04:17 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Running cmd (subprocess): nvme version {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:04:17 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] 'nvme version' failed. Not Retrying. {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 15:04:17 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] nvme not present on system {{(pid=70924) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 15:04:17 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:04:17 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 15:04:17 user nova-compute[70924]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 15:04:17 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71a385f-f85b-493e-b085-fcd5b14f5eef]: (4, '') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:04:17 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70924) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 15:04:17 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 15:04:17 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] LIGHTOS: no hostnqn found. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 15:04:17 user nova-compute[70924]: DEBUG os_brick.utils [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f2127c4a30d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 15:04:17 user nova-compute[70924]: DEBUG nova.virt.block_device [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] Updating existing volume attachment record: e334ea45-6105-491e-8c18-893f1c39e0cb {{(pid=70924) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 15:04:17 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-675e1079-002c-4550-a53a-6af6a1e0e604 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:04:17 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-675e1079-002c-4550-a53a-6af6a1e0e604 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:04:17 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-675e1079-002c-4550-a53a-6af6a1e0e604 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.361s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:04:17 user nova-compute[70924]: INFO nova.scheduler.client.report [None req-675e1079-002c-4550-a53a-6af6a1e0e604 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Deleted allocations for instance 5865be57-b5f2-4132-bc71-cc41bfe9f897
Jul 29 15:04:17 user nova-compute[70924]: DEBUG nova.compute.manager [req-114749c9-6a4d-401c-8fff-54a7f395cfff req-29903c3a-cc7b-4f16-b3a1-63daee47fa8d service nova] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Received event network-vif-plugged-6641ec75-757f-44fa-980b-5b0f270432eb {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:04:17 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-114749c9-6a4d-401c-8fff-54a7f395cfff req-29903c3a-cc7b-4f16-b3a1-63daee47fa8d service nova] Acquiring lock "5865be57-b5f2-4132-bc71-cc41bfe9f897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:04:17 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-114749c9-6a4d-401c-8fff-54a7f395cfff req-29903c3a-cc7b-4f16-b3a1-63daee47fa8d service nova] Lock "5865be57-b5f2-4132-bc71-cc41bfe9f897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:04:17 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-114749c9-6a4d-401c-8fff-54a7f395cfff req-29903c3a-cc7b-4f16-b3a1-63daee47fa8d service nova] Lock "5865be57-b5f2-4132-bc71-cc41bfe9f897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:04:17 user nova-compute[70924]: DEBUG nova.compute.manager [req-114749c9-6a4d-401c-8fff-54a7f395cfff req-29903c3a-cc7b-4f16-b3a1-63daee47fa8d service nova] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] No waiting events found dispatching network-vif-plugged-6641ec75-757f-44fa-980b-5b0f270432eb {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:04:17 user nova-compute[70924]: WARNING nova.compute.manager [req-114749c9-6a4d-401c-8fff-54a7f395cfff req-29903c3a-cc7b-4f16-b3a1-63daee47fa8d service nova] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Received unexpected event network-vif-plugged-6641ec75-757f-44fa-980b-5b0f270432eb for instance with vm_state deleted and task_state None.
Jul 29 15:04:17 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-675e1079-002c-4550-a53a-6af6a1e0e604 tempest-TestMinimumBasicScenario-944069199 tempest-TestMinimumBasicScenario-944069199-project-member] Lock "5865be57-b5f2-4132-bc71-cc41bfe9f897" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.382s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:04:18 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-c06ba8df-e584-422d-8fba-df870052c171 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Acquiring lock "47104e57-c193-4a85-a2cf-677f0debe373" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:04:18 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-c06ba8df-e584-422d-8fba-df870052c171 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "47104e57-c193-4a85-a2cf-677f0debe373" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:04:18 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-c06ba8df-e584-422d-8fba-df870052c171 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Acquiring lock "47104e57-c193-4a85-a2cf-677f0debe373-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:04:18 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-c06ba8df-e584-422d-8fba-df870052c171 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "47104e57-c193-4a85-a2cf-677f0debe373-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:04:18 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-c06ba8df-e584-422d-8fba-df870052c171 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "47104e57-c193-4a85-a2cf-677f0debe373-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:04:18 user nova-compute[70924]: INFO nova.compute.manager [None req-c06ba8df-e584-422d-8fba-df870052c171 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] Terminating instance
Jul 29 15:04:18 user nova-compute[70924]: DEBUG nova.compute.manager [None req-c06ba8df-e584-422d-8fba-df870052c171 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] Start destroying the instance on the hypervisor. {{(pid=70924) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 15:04:18 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:04:18 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:04:18 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:04:18 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:04:18 user nova-compute[70924]: DEBUG nova.compute.manager [req-27e41d04-7c5d-4e30-82c8-9c40ee920fef req-78514366-5335-4784-b716-48711eb082f8 service nova] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] Received event network-vif-unplugged-5703ca74-726a-4421-bdda-11432cacd536 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:04:18 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-27e41d04-7c5d-4e30-82c8-9c40ee920fef req-78514366-5335-4784-b716-48711eb082f8 service nova] Acquiring lock "47104e57-c193-4a85-a2cf-677f0debe373-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:04:18 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-27e41d04-7c5d-4e30-82c8-9c40ee920fef req-78514366-5335-4784-b716-48711eb082f8 service nova] Lock "47104e57-c193-4a85-a2cf-677f0debe373-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:04:18 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-27e41d04-7c5d-4e30-82c8-9c40ee920fef req-78514366-5335-4784-b716-48711eb082f8 service nova] Lock "47104e57-c193-4a85-a2cf-677f0debe373-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:04:18 user nova-compute[70924]: DEBUG nova.compute.manager [req-27e41d04-7c5d-4e30-82c8-9c40ee920fef req-78514366-5335-4784-b716-48711eb082f8 service nova] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] No waiting events found dispatching network-vif-unplugged-5703ca74-726a-4421-bdda-11432cacd536 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:04:18 user nova-compute[70924]: DEBUG nova.compute.manager [req-27e41d04-7c5d-4e30-82c8-9c40ee920fef req-78514366-5335-4784-b716-48711eb082f8 service nova] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] Received event network-vif-unplugged-5703ca74-726a-4421-bdda-11432cacd536 for instance with task_state deleting. {{(pid=70924) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 15:04:18 user nova-compute[70924]: DEBUG nova.compute.manager [req-27e41d04-7c5d-4e30-82c8-9c40ee920fef req-78514366-5335-4784-b716-48711eb082f8 service nova] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] Received event network-vif-plugged-5703ca74-726a-4421-bdda-11432cacd536 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:04:18 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-27e41d04-7c5d-4e30-82c8-9c40ee920fef req-78514366-5335-4784-b716-48711eb082f8 service nova] Acquiring lock "47104e57-c193-4a85-a2cf-677f0debe373-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:04:18 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-27e41d04-7c5d-4e30-82c8-9c40ee920fef req-78514366-5335-4784-b716-48711eb082f8 service nova] Lock "47104e57-c193-4a85-a2cf-677f0debe373-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:04:18 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-27e41d04-7c5d-4e30-82c8-9c40ee920fef req-78514366-5335-4784-b716-48711eb082f8 service nova] Lock "47104e57-c193-4a85-a2cf-677f0debe373-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:04:18 user nova-compute[70924]: DEBUG nova.compute.manager [req-27e41d04-7c5d-4e30-82c8-9c40ee920fef req-78514366-5335-4784-b716-48711eb082f8 service nova] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] No waiting events found dispatching network-vif-plugged-5703ca74-726a-4421-bdda-11432cacd536 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:04:18 user nova-compute[70924]: WARNING nova.compute.manager [req-27e41d04-7c5d-4e30-82c8-9c40ee920fef req-78514366-5335-4784-b716-48711eb082f8 service nova] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] Received unexpected event network-vif-plugged-5703ca74-726a-4421-bdda-11432cacd536 for instance with vm_state active and task_state deleting.
Jul 29 15:04:19 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] Instance destroyed successfully.
Jul 29 15:04:19 user nova-compute[70924]: DEBUG nova.objects.instance [None req-c06ba8df-e584-422d-8fba-df870052c171 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lazy-loading 'resources' on Instance uuid 47104e57-c193-4a85-a2cf-677f0debe373 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:04:19 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-c06ba8df-e584-422d-8fba-df870052c171 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:58:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-238083547',display_name='tempest-AttachVolumeNegativeTest-server-238083547',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-238083547',id=34,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7FfMkGhmgsKAFS+pIpTfwma7RjXgH4n7Q/niWGGZwznk9kIoThyXjpoAIheWSnt1EOLhCdmo0A/ENFnR7oAIN6OMGPY4SbtF76ilO4sybV6YXZaJTcTCd7aGZW7HgRTw==',key_name='tempest-keypair-1870126065',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:58:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9aadc9385b3b46eebc6e0d81814521af',ramdisk_id='',reservation_id='r-dmzg0ayj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-972203101',owner_user_name='tempest-AttachVolumeNegativeTest-972203101-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:58:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='12cb8299e4d24946bc41a86493f4b426',uuid=47104e57-c193-4a85-a2cf-677f0debe373,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5703ca74-726a-4421-bdda-11432cacd536", "address": "fa:16:3e:62:6c:e1", "network": {"id": "f80826fa-fada-45b9-b969-fd539fd34fd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-465377443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9aadc9385b3b46eebc6e0d81814521af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5703ca74-72", "ovs_interfaceid": "5703ca74-726a-4421-bdda-11432cacd536", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 15:04:19 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-c06ba8df-e584-422d-8fba-df870052c171 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Converting VIF {"id": "5703ca74-726a-4421-bdda-11432cacd536", "address": "fa:16:3e:62:6c:e1", "network": {"id": "f80826fa-fada-45b9-b969-fd539fd34fd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-465377443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9aadc9385b3b46eebc6e0d81814521af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5703ca74-72", "ovs_interfaceid": "5703ca74-726a-4421-bdda-11432cacd536", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 15:04:19 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-c06ba8df-e584-422d-8fba-df870052c171 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:62:6c:e1,bridge_name='br-int',has_traffic_filtering=True,id=5703ca74-726a-4421-bdda-11432cacd536,network=Network(f80826fa-fada-45b9-b969-fd539fd34fd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5703ca74-72') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 15:04:19 user nova-compute[70924]: DEBUG os_vif [None req-c06ba8df-e584-422d-8fba-df870052c171 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:6c:e1,bridge_name='br-int',has_traffic_filtering=True,id=5703ca74-726a-4421-bdda-11432cacd536,network=Network(f80826fa-fada-45b9-b969-fd539fd34fd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5703ca74-72') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 15:04:19 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:04:19 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5703ca74-72, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:04:19 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:04:19 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:04:19 user nova-compute[70924]: INFO os_vif [None req-c06ba8df-e584-422d-8fba-df870052c171 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:6c:e1,bridge_name='br-int',has_traffic_filtering=True,id=5703ca74-726a-4421-bdda-11432cacd536,network=Network(f80826fa-fada-45b9-b969-fd539fd34fd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5703ca74-72')
Jul 29 15:04:19 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-c06ba8df-e584-422d-8fba-df870052c171 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] Deleting instance files /opt/stack/data/nova/instances/47104e57-c193-4a85-a2cf-677f0debe373_del
Jul 29 15:04:19 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-c06ba8df-e584-422d-8fba-df870052c171 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] Deletion of /opt/stack/data/nova/instances/47104e57-c193-4a85-a2cf-677f0debe373_del complete
Jul 29 15:04:19 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:04:19 user nova-compute[70924]: INFO nova.compute.manager [None req-c06ba8df-e584-422d-8fba-df870052c171 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] Took 0.95 seconds to destroy the instance on the hypervisor.
Jul 29 15:04:19 user nova-compute[70924]: DEBUG oslo.service.loopingcall [None req-c06ba8df-e584-422d-8fba-df870052c171 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70924) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 15:04:19 user nova-compute[70924]: DEBUG nova.compute.manager [-] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] Deallocating network for instance {{(pid=70924) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 15:04:19 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] deallocate_for_instance() {{(pid=70924) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 15:04:20 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:04:20 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] Took 0.90 seconds to deallocate network for instance.
Jul 29 15:04:20 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-c06ba8df-e584-422d-8fba-df870052c171 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:04:20 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-c06ba8df-e584-422d-8fba-df870052c171 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:04:20 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-c06ba8df-e584-422d-8fba-df870052c171 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:04:20 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-c06ba8df-e584-422d-8fba-df870052c171 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:04:20 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-c06ba8df-e584-422d-8fba-df870052c171 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.244s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:04:20 user nova-compute[70924]: INFO nova.scheduler.client.report [None req-c06ba8df-e584-422d-8fba-df870052c171 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Deleted allocations for instance 47104e57-c193-4a85-a2cf-677f0debe373
Jul 29 15:04:20 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-c06ba8df-e584-422d-8fba-df870052c171 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "47104e57-c193-4a85-a2cf-677f0debe373" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.304s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:04:20 user nova-compute[70924]: DEBUG nova.compute.manager [req-3abbfbba-40f7-43fc-84ee-d71290c6fb40 req-7926f747-6590-4a03-b38d-278e86e42c47 service nova] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] Received event network-vif-deleted-5703ca74-726a-4421-bdda-11432cacd536 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:04:24 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:04:29 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:04:31 user nova-compute[70924]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690643056.172331, 5865be57-b5f2-4132-bc71-cc41bfe9f897 => Stopped> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 15:04:31 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] VM Stopped (Lifecycle Event)
Jul 29 15:04:31 user nova-compute[70924]: DEBUG nova.compute.manager [None req-3c1e6323-3a9f-4110-9f9a-88bb3bc86931 None None] [instance: 5865be57-b5f2-4132-bc71-cc41bfe9f897] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:04:31 user nova-compute[70924]: DEBUG nova.compute.manager [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] Start spawning the instance on the hypervisor. {{(pid=70924) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 15:04:31 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] Creating instance directory {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 15:04:31 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] Creating image(s)
Jul 29 15:04:31 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] Did not create local disks {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 29 15:04:31 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] Ensure instance console log exists: /opt/stack/data/nova/instances/1d0e4888-6f19-4515-80f6-e3b03427acce/console.log {{(pid=70924) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 15:04:31 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:04:31 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:04:31 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:04:31 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] Start _get_guest_xml network_info=[{"id": "c9d69516-6a60-4516-90cf-45529916012e", "address": "fa:16:3e:b4:5c:36", "network": {"id": "c19ed38b-2acd-421a-9e4b-f60df3db2f1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1812407562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a974cbbf734f51897c3e632ae9e45f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d69516-6a", "ovs_interfaceid": "c9d69516-6a60-4516-90cf-45529916012e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-07-29T15:04:03Z,direct_url=<?>,disk_format='qcow2',id=492cc73f-a8a6-42b5-9d0b-e93dc192131d,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1216733250',owner='99a974cbbf734f51897c3e632ae9e45f',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-07-29T15:04:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:478e6ec2-c325-4c53-b105-d94bb3bc9a28'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DlGdvAVt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1d0e4888-6f19-4515-80f6-e3b03427acce', 'attached_at': '', 'detached_at': '', 'volume_id': '478e6ec2-c325-4c53-b105-d94bb3bc9a28', 'serial': '478e6ec2-c325-4c53-b105-d94bb3bc9a28'}, 'attachment_id': 'e334ea45-6105-491e-8c18-893f1c39e0cb', 'volume_type': None} {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 15:04:31 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:04:31 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:04:31 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 15:04:31 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] CPU controller missing on host. {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 15:04:31 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 15:04:31 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] CPU controller found on host. {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 15:04:31 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70924) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 15:04:31 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T14:36:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-07-29T15:04:03Z,direct_url=<?>,disk_format='qcow2',id=492cc73f-a8a6-42b5-9d0b-e93dc192131d,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1216733250',owner='99a974cbbf734f51897c3e632ae9e45f',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-07-29T15:04:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 15:04:31 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Flavor limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 15:04:31 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Image limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 15:04:31 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Flavor pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 15:04:31 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Image pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 15:04:31 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 15:04:31 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 15:04:31 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 15:04:31 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Got 1 possible topologies {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 15:04:31 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 15:04:31 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 15:04:31 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] Calling os-brick to attach iSCSI Volume {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 15:04:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:478e6ec2-c325-4c53-b105-d94bb3bc9a28'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DlGdvAVt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 15:04:31 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 15:04:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 15:04:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 15:04:31 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 15:04:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:478e6ec2-c325-4c53-b105-d94bb3bc9a28" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 15:04:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:478e6ec2-c325-4c53-b105-d94bb3bc9a28" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 15:04:31 user nova-compute[70924]: INFO os_brick.initiator.connectors.iscsi [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 15:04:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:478e6ec2-c325-4c53-b105-d94bb3bc9a28 -p 172.16.0.220:3260 {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:04:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:478e6ec2-c325-4c53-b105-d94bb3bc9a28 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:04:31 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ac4f55-ef68-40d9-ba33-f5977d8e33d3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:04:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 15:04:31 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:04:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:478e6ec2-c325-4c53-b105-d94bb3bc9a28 -p 172.16.0.220:3260 --interface default --op new {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:04:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:478e6ec2-c325-4c53-b105-d94bb3bc9a28 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:04:31 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[716e120f-bd28-4738-8198-15b7bbd081a2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:478e6ec2-c325-4c53-b105-d94bb3bc9a28] added\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:04:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:478e6ec2-c325-4c53-b105-d94bb3bc9a28] added
Jul 29 15:04:31 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:04:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:478e6ec2-c325-4c53-b105-d94bb3bc9a28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:04:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:478e6ec2-c325-4c53-b105-d94bb3bc9a28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:04:31 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5651df8e-bc5d-432a-827f-672cf7a35345]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:04:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:04:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:478e6ec2-c325-4c53-b105-d94bb3bc9a28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:04:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:478e6ec2-c325-4c53-b105-d94bb3bc9a28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:04:31 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[29177148-3876-4bf6-8e86-0b11c43c4fb8]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:04:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:04:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:478e6ec2-c325-4c53-b105-d94bb3bc9a28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DlGdvAVt {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:04:32 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:478e6ec2-c325-4c53-b105-d94bb3bc9a28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DlGdvAVt" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:04:32 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c905b4-e4cc-4089-8069-922a8d83a718]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:04:32 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DlGdvAVt'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:04:32 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:478e6ec2-c325-4c53-b105-d94bb3bc9a28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:04:32 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:478e6ec2-c325-4c53-b105-d94bb3bc9a28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:04:32 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1440a552-e4af-4a9e-88f7-68527e5c591e]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:04:32 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:04:32 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:04:32 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:04:32 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c49ee3f-95ab-463e-b4bc-32095124c8fb]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acf7212b-b549-46f5-9100-fd4ca336173a (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:04:32 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acf7212b-b549-46f5-9100-fd4ca336173a (non-flash)
Jul 29 15:04:32 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 15:04:32 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acf7212b-b549-46f5-9100-fd4ca336173a (non-flash)
Jul 29 15:04:32 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 15:04:32 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:478e6ec2-c325-4c53-b105-d94bb3bc9a28 -p 172.16.0.220:3260 --login {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:04:32 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:478e6ec2-c325-4c53-b105-d94bb3bc9a28 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:04:32 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e440bc-a65a-400b-a3a0-05dfc7e545da]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:478e6ec2-c325-4c53-b105-d94bb3bc9a28, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:478e6ec2-c325-4c53-b105-d94bb3bc9a28, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:04:32 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:478e6ec2-c325-4c53-b105-d94bb3bc9a28, portal: 172.16.0.220,3260]
Jul 29 15:04:32 user nova-compute[70924]: Login to [iface: default, target: iqn.2010-10.org.openstack:478e6ec2-c325-4c53-b105-d94bb3bc9a28, portal: 172.16.0.220,3260] successful.
Jul 29 15:04:32 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:04:32 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:478e6ec2-c325-4c53-b105-d94bb3bc9a28 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:04:32 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:478e6ec2-c325-4c53-b105-d94bb3bc9a28 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:04:32 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b6c289-2fad-463b-aca4-fb317afe0697]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:04:32 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:04:32 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:04:32 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:04:32 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e302032-8d70-4db1-a97c-d969f390ebee]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acf7212b-b549-46f5-9100-fd4ca336173a (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:478e6ec2-c325-4c53-b105-d94bb3bc9a28 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:04:32 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acf7212b-b549-46f5-9100-fd4ca336173a (non-flash)
Jul 29 15:04:32 user nova-compute[70924]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:478e6ec2-c325-4c53-b105-d94bb3bc9a28 (non-flash)
Jul 29 15:04:32 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 15:04:32 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acf7212b-b549-46f5-9100-fd4ca336173a (non-flash)
Jul 29 15:04:32 user nova-compute[70924]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:478e6ec2-c325-4c53-b105-d94bb3bc9a28 (non-flash)
Jul 29 15:04:32 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 15:04:32 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:478e6ec2-c325-4c53-b105-d94bb3bc9a28" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 15:04:32 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Connected to 172.16.0.220:3260 {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 15:04:32 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=70924) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 15:04:32 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70924) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 15:04:32 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:04:32 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:04:32 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6c2fc9-4c4a-44ad-9a03-54a20d6aebc5]: (4, ('- - 0', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:04:32 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: None {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 15:04:33 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 15:04:33 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DlGdvAVt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 15:04:33 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 15:04:33 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '23165313834353738', 'path': '/dev/sdb'} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 15:04:33 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165313834353738', 'path': '/dev/sdb'} {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 15:04:33 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T15:04:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1310743789',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1310743789',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1310743789',id=41,image_ref='492cc73f-a8a6-42b5-9d0b-e93dc192131d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKKNkcijznLKi8vfR4Oh280fKzMSzAP/YUTayX3pelPFYQ2TwZJ6GkfHEHFfcc21T4lHxm2wGJTd9OWUZd4vDbdv4/IbB5MB1m/0I6LD56PJ3m18Sq53FhHjttcKGm9DaA==',key_name='tempest-keypair-478487356',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99a974cbbf734f51897c3e632ae9e45f',ramdisk_id='',reservation_id='r-nimf9v55',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1030839740',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1030839740-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1030839740',owner_user_name='tempest-TestVolumeBootPattern-1030839740-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T15:04:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='da204646e8f84693ad470ed1d3eadd7c',uuid=1d0e4888-6f19-4515-80f6-e3b03427acce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9d69516-6a60-4516-90cf-45529916012e", "address": "fa:16:3e:b4:5c:36", "network": {"id": "c19ed38b-2acd-421a-9e4b-f60df3db2f1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1812407562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a974cbbf734f51897c3e632ae9e45f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d69516-6a", "ovs_interfaceid": "c9d69516-6a60-4516-90cf-45529916012e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 15:04:33 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Converting VIF {"id": "c9d69516-6a60-4516-90cf-45529916012e", "address": "fa:16:3e:b4:5c:36", "network": {"id": "c19ed38b-2acd-421a-9e4b-f60df3db2f1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1812407562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a974cbbf734f51897c3e632ae9e45f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d69516-6a", "ovs_interfaceid": "c9d69516-6a60-4516-90cf-45529916012e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 15:04:33 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:5c:36,bridge_name='br-int',has_traffic_filtering=True,id=c9d69516-6a60-4516-90cf-45529916012e,network=Network(c19ed38b-2acd-421a-9e4b-f60df3db2f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9d69516-6a') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 15:04:33 user nova-compute[70924]: DEBUG nova.objects.instance [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lazy-loading 'pci_devices' on Instance uuid 1d0e4888-6f19-4515-80f6-e3b03427acce {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:04:33 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] End _get_guest_xml xml=<domain type="kvm">
Jul 29 15:04:33 user nova-compute[70924]:   <uuid>1d0e4888-6f19-4515-80f6-e3b03427acce</uuid>
Jul 29 15:04:33 user nova-compute[70924]:   <name>instance-00000029</name>
Jul 29 15:04:33 user nova-compute[70924]:   <memory>524288</memory>
Jul 29 15:04:33 user nova-compute[70924]:   <vcpu>1</vcpu>
Jul 29 15:04:33 user nova-compute[70924]:   <metadata>
Jul 29 15:04:33 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 15:04:33 user nova-compute[70924]:       <nova:package version="0.0.0"/>
Jul 29 15:04:33 user nova-compute[70924]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1310743789</nova:name>
Jul 29 15:04:33 user nova-compute[70924]:       <nova:creationTime>2023-07-29 15:04:31</nova:creationTime>
Jul 29 15:04:33 user nova-compute[70924]:       <nova:flavor name="m1.tiny">
Jul 29 15:04:33 user nova-compute[70924]:         <nova:memory>512</nova:memory>
Jul 29 15:04:33 user nova-compute[70924]:         <nova:disk>1</nova:disk>
Jul 29 15:04:33 user nova-compute[70924]:         <nova:swap>0</nova:swap>
Jul 29 15:04:33 user nova-compute[70924]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 15:04:33 user nova-compute[70924]:         <nova:vcpus>1</nova:vcpus>
Jul 29 15:04:33 user nova-compute[70924]:       </nova:flavor>
Jul 29 15:04:33 user nova-compute[70924]:       <nova:owner>
Jul 29 15:04:33 user nova-compute[70924]:         <nova:user uuid="da204646e8f84693ad470ed1d3eadd7c">tempest-TestVolumeBootPattern-1030839740-project-member</nova:user>
Jul 29 15:04:33 user nova-compute[70924]:         <nova:project uuid="99a974cbbf734f51897c3e632ae9e45f">tempest-TestVolumeBootPattern-1030839740</nova:project>
Jul 29 15:04:33 user nova-compute[70924]:       </nova:owner>
Jul 29 15:04:33 user nova-compute[70924]:       <nova:root type="image" uuid="492cc73f-a8a6-42b5-9d0b-e93dc192131d"/>
Jul 29 15:04:33 user nova-compute[70924]:       <nova:ports>
Jul 29 15:04:33 user nova-compute[70924]:         <nova:port uuid="c9d69516-6a60-4516-90cf-45529916012e">
Jul 29 15:04:33 user nova-compute[70924]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 29 15:04:33 user nova-compute[70924]:         </nova:port>
Jul 29 15:04:33 user nova-compute[70924]:       </nova:ports>
Jul 29 15:04:33 user nova-compute[70924]:     </nova:instance>
Jul 29 15:04:33 user nova-compute[70924]:   </metadata>
Jul 29 15:04:33 user nova-compute[70924]:   <sysinfo type="smbios">
Jul 29 15:04:33 user nova-compute[70924]:     <system>
Jul 29 15:04:33 user nova-compute[70924]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 15:04:33 user nova-compute[70924]:       <entry name="product">OpenStack Nova</entry>
Jul 29 15:04:33 user nova-compute[70924]:       <entry name="version">0.0.0</entry>
Jul 29 15:04:33 user nova-compute[70924]:       <entry name="serial">1d0e4888-6f19-4515-80f6-e3b03427acce</entry>
Jul 29 15:04:33 user nova-compute[70924]:       <entry name="uuid">1d0e4888-6f19-4515-80f6-e3b03427acce</entry>
Jul 29 15:04:33 user nova-compute[70924]:       <entry name="family">Virtual Machine</entry>
Jul 29 15:04:33 user nova-compute[70924]:     </system>
Jul 29 15:04:33 user nova-compute[70924]:   </sysinfo>
Jul 29 15:04:33 user nova-compute[70924]:   <os>
Jul 29 15:04:33 user nova-compute[70924]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 15:04:33 user nova-compute[70924]:     <boot dev="hd"/>
Jul 29 15:04:33 user nova-compute[70924]:     <smbios mode="sysinfo"/>
Jul 29 15:04:33 user nova-compute[70924]:   </os>
Jul 29 15:04:33 user nova-compute[70924]:   <features>
Jul 29 15:04:33 user nova-compute[70924]:     <acpi/>
Jul 29 15:04:33 user nova-compute[70924]:     <apic/>
Jul 29 15:04:33 user nova-compute[70924]:     <vmcoreinfo/>
Jul 29 15:04:33 user nova-compute[70924]:   </features>
Jul 29 15:04:33 user nova-compute[70924]:   <clock offset="utc">
Jul 29 15:04:33 user nova-compute[70924]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 15:04:33 user nova-compute[70924]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 15:04:33 user nova-compute[70924]:     <timer name="hpet" present="no"/>
Jul 29 15:04:33 user nova-compute[70924]:   </clock>
Jul 29 15:04:33 user nova-compute[70924]:   <cpu mode="custom" match="exact">
Jul 29 15:04:33 user nova-compute[70924]:     <model>Nehalem</model>
Jul 29 15:04:33 user nova-compute[70924]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 15:04:33 user nova-compute[70924]:   </cpu>
Jul 29 15:04:33 user nova-compute[70924]:   <devices>
Jul 29 15:04:33 user nova-compute[70924]:     <disk type="block" device="disk">
Jul 29 15:04:33 user nova-compute[70924]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 15:04:33 user nova-compute[70924]:       <source dev="/dev/sdb"/>
Jul 29 15:04:33 user nova-compute[70924]:       <target dev="vda" bus="virtio"/>
Jul 29 15:04:33 user nova-compute[70924]:       <serial>478e6ec2-c325-4c53-b105-d94bb3bc9a28</serial>
Jul 29 15:04:33 user nova-compute[70924]:     </disk>
Jul 29 15:04:33 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 15:04:33 user nova-compute[70924]:       <mac address="fa:16:3e:b4:5c:36"/>
Jul 29 15:04:33 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 15:04:33 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 15:04:33 user nova-compute[70924]:       <target dev="tapc9d69516-6a"/>
Jul 29 15:04:33 user nova-compute[70924]:     </interface>
Jul 29 15:04:33 user nova-compute[70924]:     <serial type="pty">
Jul 29 15:04:33 user nova-compute[70924]:       <log file="/opt/stack/data/nova/instances/1d0e4888-6f19-4515-80f6-e3b03427acce/console.log" append="off"/>
Jul 29 15:04:33 user nova-compute[70924]:     </serial>
Jul 29 15:04:33 user nova-compute[70924]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 15:04:33 user nova-compute[70924]:     <video>
Jul 29 15:04:33 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 15:04:33 user nova-compute[70924]:     </video>
Jul 29 15:04:33 user nova-compute[70924]:     <rng model="virtio">
Jul 29 15:04:33 user nova-compute[70924]:       <backend model="random">/dev/urandom</backend>
Jul 29 15:04:33 user nova-compute[70924]:     </rng>
Jul 29 15:04:33 user nova-compute[70924]:     <controller type="usb" index="0" model="none"/>
Jul 29 15:04:33 user nova-compute[70924]:     <memballoon model="virtio">
Jul 29 15:04:33 user nova-compute[70924]:       <stats period="10"/>
Jul 29 15:04:33 user nova-compute[70924]:     </memballoon>
Jul 29 15:04:33 user nova-compute[70924]:   </devices>
Jul 29 15:04:33 user nova-compute[70924]: </domain>
Jul 29 15:04:33 user nova-compute[70924]:  {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 15:04:33 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T15:04:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1310743789',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1310743789',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1310743789',id=41,image_ref='492cc73f-a8a6-42b5-9d0b-e93dc192131d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKKNkcijznLKi8vfR4Oh280fKzMSzAP/YUTayX3pelPFYQ2TwZJ6GkfHEHFfcc21T4lHxm2wGJTd9OWUZd4vDbdv4/IbB5MB1m/0I6LD56PJ3m18Sq53FhHjttcKGm9DaA==',key_name='tempest-keypair-478487356',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99a974cbbf734f51897c3e632ae9e45f',ramdisk_id='',reservation_id='r-nimf9v55',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1030839740',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1030839740-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1030839740',owner_user_name='tempest-TestVolumeBootPattern-1030839740-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T15:04:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='da204646e8f84693ad470ed1d3eadd7c',uuid=1d0e4888-6f19-4515-80f6-e3b03427acce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9d69516-6a60-4516-90cf-45529916012e", "address": "fa:16:3e:b4:5c:36", "network": {"id": "c19ed38b-2acd-421a-9e4b-f60df3db2f1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1812407562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a974cbbf734f51897c3e632ae9e45f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d69516-6a", "ovs_interfaceid": "c9d69516-6a60-4516-90cf-45529916012e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 15:04:33 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Converting VIF {"id": "c9d69516-6a60-4516-90cf-45529916012e", "address": "fa:16:3e:b4:5c:36", "network": {"id": "c19ed38b-2acd-421a-9e4b-f60df3db2f1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1812407562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a974cbbf734f51897c3e632ae9e45f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d69516-6a", "ovs_interfaceid": "c9d69516-6a60-4516-90cf-45529916012e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 15:04:33 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:5c:36,bridge_name='br-int',has_traffic_filtering=True,id=c9d69516-6a60-4516-90cf-45529916012e,network=Network(c19ed38b-2acd-421a-9e4b-f60df3db2f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9d69516-6a') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 15:04:33 user nova-compute[70924]: DEBUG os_vif [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:5c:36,bridge_name='br-int',has_traffic_filtering=True,id=c9d69516-6a60-4516-90cf-45529916012e,network=Network(c19ed38b-2acd-421a-9e4b-f60df3db2f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9d69516-6a') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 15:04:33 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:04:33 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:04:33 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 15:04:33 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:04:33 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc9d69516-6a, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:04:33 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc9d69516-6a, col_values=(('external_ids', {'iface-id': 'c9d69516-6a60-4516-90cf-45529916012e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:5c:36', 'vm-uuid': '1d0e4888-6f19-4515-80f6-e3b03427acce'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:04:33 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:04:33 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:04:33 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:04:33 user nova-compute[70924]: INFO os_vif [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:5c:36,bridge_name='br-int',has_traffic_filtering=True,id=c9d69516-6a60-4516-90cf-45529916012e,network=Network(c19ed38b-2acd-421a-9e4b-f60df3db2f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9d69516-6a')
Jul 29 15:04:33 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 15:04:33 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] No VIF found with MAC fa:16:3e:b4:5c:36, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 15:04:34 user nova-compute[70924]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690643059.0722437, 47104e57-c193-4a85-a2cf-677f0debe373 => Stopped> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 15:04:34 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] VM Stopped (Lifecycle Event)
Jul 29 15:04:34 user nova-compute[70924]: DEBUG nova.compute.manager [None req-c312d412-940c-44a2-8d74-b9270a431112 None None] [instance: 47104e57-c193-4a85-a2cf-677f0debe373] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:04:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:04:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-dd102ecf-1d49-47a4-ac19-7a7357bd81d3 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Acquiring lock "f3f7eeda-a001-4c35-abeb-e459d701bd93" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:04:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-dd102ecf-1d49-47a4-ac19-7a7357bd81d3 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "f3f7eeda-a001-4c35-abeb-e459d701bd93" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:04:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-dd102ecf-1d49-47a4-ac19-7a7357bd81d3 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Acquiring lock "f3f7eeda-a001-4c35-abeb-e459d701bd93-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:04:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-dd102ecf-1d49-47a4-ac19-7a7357bd81d3 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "f3f7eeda-a001-4c35-abeb-e459d701bd93-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:04:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-dd102ecf-1d49-47a4-ac19-7a7357bd81d3 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "f3f7eeda-a001-4c35-abeb-e459d701bd93-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:04:34 user nova-compute[70924]: INFO nova.compute.manager [None req-dd102ecf-1d49-47a4-ac19-7a7357bd81d3 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Terminating instance
Jul 29 15:04:34 user nova-compute[70924]: DEBUG nova.compute.manager [None req-dd102ecf-1d49-47a4-ac19-7a7357bd81d3 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Start destroying the instance on the hypervisor. {{(pid=70924) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 15:04:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:04:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:04:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:04:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:04:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:04:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:04:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:04:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:04:34 user nova-compute[70924]: DEBUG nova.compute.manager [req-17e2dc86-e2f2-405d-9718-6addb690425e req-16759a23-10d3-47c1-ab22-e13748966f9c service nova] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Received event network-vif-unplugged-eafccd28-f902-4bc2-805e-4d2f8bbd4e82 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:04:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-17e2dc86-e2f2-405d-9718-6addb690425e req-16759a23-10d3-47c1-ab22-e13748966f9c service nova] Acquiring lock "f3f7eeda-a001-4c35-abeb-e459d701bd93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:04:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-17e2dc86-e2f2-405d-9718-6addb690425e req-16759a23-10d3-47c1-ab22-e13748966f9c service nova] Lock "f3f7eeda-a001-4c35-abeb-e459d701bd93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:04:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-17e2dc86-e2f2-405d-9718-6addb690425e req-16759a23-10d3-47c1-ab22-e13748966f9c service nova] Lock "f3f7eeda-a001-4c35-abeb-e459d701bd93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:04:34 user nova-compute[70924]: DEBUG nova.compute.manager [req-17e2dc86-e2f2-405d-9718-6addb690425e req-16759a23-10d3-47c1-ab22-e13748966f9c service nova] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] No waiting events found dispatching network-vif-unplugged-eafccd28-f902-4bc2-805e-4d2f8bbd4e82 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:04:34 user nova-compute[70924]: DEBUG nova.compute.manager [req-17e2dc86-e2f2-405d-9718-6addb690425e req-16759a23-10d3-47c1-ab22-e13748966f9c service nova] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Received event network-vif-unplugged-eafccd28-f902-4bc2-805e-4d2f8bbd4e82 for instance with task_state deleting. {{(pid=70924) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 15:04:35 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:04:35 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:04:35 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Instance destroyed successfully.
Jul 29 15:04:35 user nova-compute[70924]: DEBUG nova.objects.instance [None req-dd102ecf-1d49-47a4-ac19-7a7357bd81d3 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lazy-loading 'resources' on Instance uuid f3f7eeda-a001-4c35-abeb-e459d701bd93 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:04:35 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-dd102ecf-1d49-47a4-ac19-7a7357bd81d3 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:57:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-860009977',display_name='tempest-ServerRescueNegativeTestJSON-server-860009977',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-860009977',id=33,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYYUTKa/Li7BbPVzmg4ve1vgvH0FEhtwS0gOMqeRhUXC/Ag9zhCHxbsh4O9uwMJ9PeS5iqh/+F1q/DOCjXtppVcKojs97MuEkw+mKkCC6PAntsB1yiqhawyIRrJr7Iulg==',key_name='tempest-keypair-1342138702',keypairs=<?>,launch_index=0,launched_at=2023-07-29T15:00:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8fcf4644e7a24bf68b407be2e3d9732c',ramdisk_id='',reservation_id='r-mz1wzk08',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1436708078',owner_user_name='tempest-ServerRescueNegativeTestJSON-1436708078-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T15:01:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ec7e735cfff48828e0c0c7618f50711',uuid=f3f7eeda-a001-4c35-abeb-e459d701bd93,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eafccd28-f902-4bc2-805e-4d2f8bbd4e82", "address": "fa:16:3e:9f:ec:06", "network": {"id": "b2aee530-d195-47bb-b39d-c8bd15b81a08", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-421022738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcf4644e7a24bf68b407be2e3d9732c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeafccd28-f9", "ovs_interfaceid": "eafccd28-f902-4bc2-805e-4d2f8bbd4e82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 15:04:35 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-dd102ecf-1d49-47a4-ac19-7a7357bd81d3 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Converting VIF {"id": "eafccd28-f902-4bc2-805e-4d2f8bbd4e82", "address": "fa:16:3e:9f:ec:06", "network": {"id": "b2aee530-d195-47bb-b39d-c8bd15b81a08", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-421022738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcf4644e7a24bf68b407be2e3d9732c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeafccd28-f9", "ovs_interfaceid": "eafccd28-f902-4bc2-805e-4d2f8bbd4e82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 15:04:35 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-dd102ecf-1d49-47a4-ac19-7a7357bd81d3 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9f:ec:06,bridge_name='br-int',has_traffic_filtering=True,id=eafccd28-f902-4bc2-805e-4d2f8bbd4e82,network=Network(b2aee530-d195-47bb-b39d-c8bd15b81a08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeafccd28-f9') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 15:04:35 user nova-compute[70924]: DEBUG os_vif [None req-dd102ecf-1d49-47a4-ac19-7a7357bd81d3 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:ec:06,bridge_name='br-int',has_traffic_filtering=True,id=eafccd28-f902-4bc2-805e-4d2f8bbd4e82,network=Network(b2aee530-d195-47bb-b39d-c8bd15b81a08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeafccd28-f9') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 15:04:35 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:04:35 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeafccd28-f9, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:04:35 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:04:35 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:04:35 user nova-compute[70924]: INFO os_vif [None req-dd102ecf-1d49-47a4-ac19-7a7357bd81d3 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:ec:06,bridge_name='br-int',has_traffic_filtering=True,id=eafccd28-f902-4bc2-805e-4d2f8bbd4e82,network=Network(b2aee530-d195-47bb-b39d-c8bd15b81a08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeafccd28-f9')
Jul 29 15:04:35 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-dd102ecf-1d49-47a4-ac19-7a7357bd81d3 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Deleting instance files /opt/stack/data/nova/instances/f3f7eeda-a001-4c35-abeb-e459d701bd93_del
Jul 29 15:04:35 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-dd102ecf-1d49-47a4-ac19-7a7357bd81d3 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Deletion of /opt/stack/data/nova/instances/f3f7eeda-a001-4c35-abeb-e459d701bd93_del complete
Jul 29 15:04:35 user nova-compute[70924]: INFO nova.compute.manager [None req-dd102ecf-1d49-47a4-ac19-7a7357bd81d3 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Took 0.92 seconds to destroy the instance on the hypervisor.
Jul 29 15:04:35 user nova-compute[70924]: DEBUG oslo.service.loopingcall [None req-dd102ecf-1d49-47a4-ac19-7a7357bd81d3 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70924) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 15:04:35 user nova-compute[70924]: DEBUG nova.compute.manager [-] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Deallocating network for instance {{(pid=70924) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 15:04:35 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] deallocate_for_instance() {{(pid=70924) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 15:04:36 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:04:36 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Took 1.01 seconds to deallocate network for instance.
Jul 29 15:04:36 user nova-compute[70924]: DEBUG nova.compute.manager [req-d01e1d09-03f3-46db-9fcd-cd78af1c2d7b req-ec05bef1-3d6e-43d2-b49e-da4f38ff20ee service nova] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Received event network-vif-deleted-eafccd28-f902-4bc2-805e-4d2f8bbd4e82 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:04:36 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-dd102ecf-1d49-47a4-ac19-7a7357bd81d3 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:04:36 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-dd102ecf-1d49-47a4-ac19-7a7357bd81d3 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:04:36 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-dd102ecf-1d49-47a4-ac19-7a7357bd81d3 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:04:36 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-dd102ecf-1d49-47a4-ac19-7a7357bd81d3 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:04:36 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-dd102ecf-1d49-47a4-ac19-7a7357bd81d3 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.271s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:04:36 user nova-compute[70924]: INFO nova.scheduler.client.report [None req-dd102ecf-1d49-47a4-ac19-7a7357bd81d3 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Deleted allocations for instance f3f7eeda-a001-4c35-abeb-e459d701bd93
Jul 29 15:04:36 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-dd102ecf-1d49-47a4-ac19-7a7357bd81d3 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "f3f7eeda-a001-4c35-abeb-e459d701bd93" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.420s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:04:37 user nova-compute[70924]: DEBUG nova.compute.manager [req-c91f7a28-ab15-4f38-9ba5-260c180031c9 req-2226f009-bb74-45a2-8aad-9c7922b91191 service nova] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Received event network-vif-plugged-eafccd28-f902-4bc2-805e-4d2f8bbd4e82 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:04:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c91f7a28-ab15-4f38-9ba5-260c180031c9 req-2226f009-bb74-45a2-8aad-9c7922b91191 service nova] Acquiring lock "f3f7eeda-a001-4c35-abeb-e459d701bd93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:04:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c91f7a28-ab15-4f38-9ba5-260c180031c9 req-2226f009-bb74-45a2-8aad-9c7922b91191 service nova] Lock "f3f7eeda-a001-4c35-abeb-e459d701bd93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:04:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c91f7a28-ab15-4f38-9ba5-260c180031c9 req-2226f009-bb74-45a2-8aad-9c7922b91191 service nova] Lock "f3f7eeda-a001-4c35-abeb-e459d701bd93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:04:37 user nova-compute[70924]: DEBUG nova.compute.manager [req-c91f7a28-ab15-4f38-9ba5-260c180031c9 req-2226f009-bb74-45a2-8aad-9c7922b91191 service nova] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] No waiting events found dispatching network-vif-plugged-eafccd28-f902-4bc2-805e-4d2f8bbd4e82 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:04:37 user nova-compute[70924]: WARNING nova.compute.manager [req-c91f7a28-ab15-4f38-9ba5-260c180031c9 req-2226f009-bb74-45a2-8aad-9c7922b91191 service nova] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Received unexpected event network-vif-plugged-eafccd28-f902-4bc2-805e-4d2f8bbd4e82 for instance with vm_state deleted and task_state None.
Jul 29 15:04:37 user nova-compute[70924]: DEBUG nova.compute.manager [req-c91f7a28-ab15-4f38-9ba5-260c180031c9 req-2226f009-bb74-45a2-8aad-9c7922b91191 service nova] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] Received event network-vif-plugged-c9d69516-6a60-4516-90cf-45529916012e {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:04:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c91f7a28-ab15-4f38-9ba5-260c180031c9 req-2226f009-bb74-45a2-8aad-9c7922b91191 service nova] Acquiring lock "1d0e4888-6f19-4515-80f6-e3b03427acce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:04:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c91f7a28-ab15-4f38-9ba5-260c180031c9 req-2226f009-bb74-45a2-8aad-9c7922b91191 service nova] Lock "1d0e4888-6f19-4515-80f6-e3b03427acce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:04:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c91f7a28-ab15-4f38-9ba5-260c180031c9 req-2226f009-bb74-45a2-8aad-9c7922b91191 service nova] Lock "1d0e4888-6f19-4515-80f6-e3b03427acce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:04:37 user nova-compute[70924]: DEBUG nova.compute.manager [req-c91f7a28-ab15-4f38-9ba5-260c180031c9 req-2226f009-bb74-45a2-8aad-9c7922b91191 service nova] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] No waiting events found dispatching network-vif-plugged-c9d69516-6a60-4516-90cf-45529916012e {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:04:37 user nova-compute[70924]: WARNING nova.compute.manager [req-c91f7a28-ab15-4f38-9ba5-260c180031c9 req-2226f009-bb74-45a2-8aad-9c7922b91191 service nova] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] Received unexpected event network-vif-plugged-c9d69516-6a60-4516-90cf-45529916012e for instance with vm_state building and task_state spawning.
Jul 29 15:04:37 user nova-compute[70924]: DEBUG nova.compute.manager [req-c91f7a28-ab15-4f38-9ba5-260c180031c9 req-2226f009-bb74-45a2-8aad-9c7922b91191 service nova] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] Received event network-vif-plugged-c9d69516-6a60-4516-90cf-45529916012e {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:04:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c91f7a28-ab15-4f38-9ba5-260c180031c9 req-2226f009-bb74-45a2-8aad-9c7922b91191 service nova] Acquiring lock "1d0e4888-6f19-4515-80f6-e3b03427acce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:04:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c91f7a28-ab15-4f38-9ba5-260c180031c9 req-2226f009-bb74-45a2-8aad-9c7922b91191 service nova] Lock "1d0e4888-6f19-4515-80f6-e3b03427acce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:04:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c91f7a28-ab15-4f38-9ba5-260c180031c9 req-2226f009-bb74-45a2-8aad-9c7922b91191 service nova] Lock "1d0e4888-6f19-4515-80f6-e3b03427acce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:04:37 user nova-compute[70924]: DEBUG nova.compute.manager [req-c91f7a28-ab15-4f38-9ba5-260c180031c9 req-2226f009-bb74-45a2-8aad-9c7922b91191 service nova] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] No waiting events found dispatching network-vif-plugged-c9d69516-6a60-4516-90cf-45529916012e {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:04:37 user nova-compute[70924]: WARNING nova.compute.manager [req-c91f7a28-ab15-4f38-9ba5-260c180031c9 req-2226f009-bb74-45a2-8aad-9c7922b91191 service nova] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] Received unexpected event network-vif-plugged-c9d69516-6a60-4516-90cf-45529916012e for instance with vm_state building and task_state spawning.
Jul 29 15:04:37 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690643077.0515716, 1d0e4888-6f19-4515-80f6-e3b03427acce => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 15:04:37 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] VM Resumed (Lifecycle Event)
Jul 29 15:04:37 user nova-compute[70924]: DEBUG nova.compute.manager [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] Instance event wait completed in 0 seconds for  {{(pid=70924) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 15:04:37 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] Guest created on hypervisor {{(pid=70924) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 15:04:37 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] Instance spawned successfully.
Jul 29 15:04:37 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 15:04:37 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:04:37 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] Found default for hw_input_bus of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:04:37 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] Found default for hw_pointer_model of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:04:37 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 15:04:37 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 15:04:37 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690643077.052863, 1d0e4888-6f19-4515-80f6-e3b03427acce => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 15:04:37 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] VM Started (Lifecycle Event)
Jul 29 15:04:37 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:04:37 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 15:04:37 user nova-compute[70924]: INFO nova.compute.manager [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] Took 5.33 seconds to spawn the instance on the hypervisor.
Jul 29 15:04:37 user nova-compute[70924]: DEBUG nova.compute.manager [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:04:37 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 15:04:37 user nova-compute[70924]: INFO nova.compute.manager [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] Took 26.60 seconds to build instance.
Jul 29 15:04:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-e8424d41-443d-46c8-9977-bbd3b2fab836 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "1d0e4888-6f19-4515-80f6-e3b03427acce" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.690s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:04:39 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:04:40 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:04:45 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:04:50 user nova-compute[70924]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690643075.2470434, f3f7eeda-a001-4c35-abeb-e459d701bd93 => Stopped> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 15:04:50 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] VM Stopped (Lifecycle Event)
Jul 29 15:04:50 user nova-compute[70924]: DEBUG nova.compute.manager [None req-9fc2f0b5-73ed-4d02-bf8c-c84ab0213bf1 None None] [instance: f3f7eeda-a001-4c35-abeb-e459d701bd93] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:04:50 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:04:50 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:04:50 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70924) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 29 15:04:50 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70924) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 15:04:50 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70924) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 15:04:50 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:04:54 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:04:55 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:04:59 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:05:00 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:05:00 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:05:00 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:05:04 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:05:04 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:05:05 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:05:05 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:05:05 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:05:06 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:05:06 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:05:06 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:05:06 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:05:06 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Auditing locally available compute resources for user (node: user) {{(pid=70924) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 15:05:06 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 15:05:06 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk.rescue --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:05:06 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:05:06 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk.rescue --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:05:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:05:06 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:05:06 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:05:06 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:05:06 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:05:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:05:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:05:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:05:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:05:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:05:07 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 15:05:07 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:05:07 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:05:07 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Hypervisor/Node resource view: name=user free_ram=8339MB free_disk=25.348247528076172GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70924) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 15:05:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:05:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:05:07 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 9ec07c62-951b-4e3a-bffa-e01dfb4665ec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:05:07 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 091e384f-7851-4ac9-b566-990df0497fc5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:05:07 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance e905081f-dfff-41ab-88b3-8cd91d01671d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:05:07 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 1d0e4888-6f19-4515-80f6-e3b03427acce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:05:07 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 15:05:07 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 15:05:08 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:05:08 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:05:08 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Compute_service record updated for user:user {{(pid=70924) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 15:05:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.266s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:05:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:05:09 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:05:09 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:05:09 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70924) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 15:05:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:05:09 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:05:09 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Starting heal instance info cache {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 15:05:09 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Didn't find any instances for network info cache update. {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 29 15:05:10 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:05:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Acquiring lock "751027e8-91d2-4374-94cb-f4a840d7f7be" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:05:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "751027e8-91d2-4374-94cb-f4a840d7f7be" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:05:12 user nova-compute[70924]: DEBUG nova.compute.manager [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Starting instance... {{(pid=70924) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 15:05:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:05:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:05:12 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70924) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 15:05:12 user nova-compute[70924]: INFO nova.compute.claims [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Claim successful on node user
Jul 29 15:05:12 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:05:12 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:05:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.280s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:05:12 user nova-compute[70924]: DEBUG nova.compute.manager [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Start building networks asynchronously for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 15:05:12 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:05:12 user nova-compute[70924]: DEBUG nova.compute.manager [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Allocating IP information in the background. {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 15:05:12 user nova-compute[70924]: DEBUG nova.network.neutron [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] allocate_for_instance() {{(pid=70924) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 15:05:12 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 15:05:12 user nova-compute[70924]: DEBUG nova.compute.manager [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Start building block device mappings for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 15:05:12 user nova-compute[70924]: DEBUG nova.policy [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '12cb8299e4d24946bc41a86493f4b426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadc9385b3b46eebc6e0d81814521af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70924) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 15:05:12 user nova-compute[70924]: DEBUG nova.compute.manager [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Start spawning the instance on the hypervisor. {{(pid=70924) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 15:05:12 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Creating instance directory {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 15:05:12 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Creating image(s)
Jul 29 15:05:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Acquiring lock "/opt/stack/data/nova/instances/751027e8-91d2-4374-94cb-f4a840d7f7be/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:05:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "/opt/stack/data/nova/instances/751027e8-91d2-4374-94cb-f4a840d7f7be/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:05:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "/opt/stack/data/nova/instances/751027e8-91d2-4374-94cb-f4a840d7f7be/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:05:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:05:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.141s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:05:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Acquiring lock "bd72453517468710f1de26b27fb0ea28688e9009" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:05:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:05:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:05:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.149s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:05:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/751027e8-91d2-4374-94cb-f4a840d7f7be/disk 1073741824 {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:05:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/751027e8-91d2-4374-94cb-f4a840d7f7be/disk 1073741824" returned: 0 in 0.057s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:05:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.214s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:05:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:05:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.135s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:05:13 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Checking if we can resize image /opt/stack/data/nova/instances/751027e8-91d2-4374-94cb-f4a840d7f7be/disk. size=1073741824 {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 15:05:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/751027e8-91d2-4374-94cb-f4a840d7f7be/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:05:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/751027e8-91d2-4374-94cb-f4a840d7f7be/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:05:13 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Cannot resize image /opt/stack/data/nova/instances/751027e8-91d2-4374-94cb-f4a840d7f7be/disk to a smaller size. {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 15:05:13 user nova-compute[70924]: DEBUG nova.objects.instance [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lazy-loading 'migration_context' on Instance uuid 751027e8-91d2-4374-94cb-f4a840d7f7be {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:05:13 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Created local disks {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 15:05:13 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Ensure instance console log exists: /opt/stack/data/nova/instances/751027e8-91d2-4374-94cb-f4a840d7f7be/console.log {{(pid=70924) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 15:05:13 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:05:13 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:05:13 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:05:13 user nova-compute[70924]: DEBUG nova.network.neutron [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Successfully created port: b5f58bd0-1ebf-476d-8c8d-2345228572b2 {{(pid=70924) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 15:05:13 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:05:14 user nova-compute[70924]: DEBUG nova.network.neutron [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Successfully updated port: b5f58bd0-1ebf-476d-8c8d-2345228572b2 {{(pid=70924) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 15:05:14 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Acquiring lock "refresh_cache-751027e8-91d2-4374-94cb-f4a840d7f7be" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:05:14 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Acquired lock "refresh_cache-751027e8-91d2-4374-94cb-f4a840d7f7be" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:05:14 user nova-compute[70924]: DEBUG nova.network.neutron [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 15:05:14 user nova-compute[70924]: DEBUG nova.compute.manager [req-477809ce-026f-4eff-a59d-845754796d9d req-7e626ca8-c201-427f-b0e7-61f57ae8c15c service nova] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Received event network-changed-b5f58bd0-1ebf-476d-8c8d-2345228572b2 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:05:14 user nova-compute[70924]: DEBUG nova.compute.manager [req-477809ce-026f-4eff-a59d-845754796d9d req-7e626ca8-c201-427f-b0e7-61f57ae8c15c service nova] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Refreshing instance network info cache due to event network-changed-b5f58bd0-1ebf-476d-8c8d-2345228572b2. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 15:05:14 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-477809ce-026f-4eff-a59d-845754796d9d req-7e626ca8-c201-427f-b0e7-61f57ae8c15c service nova] Acquiring lock "refresh_cache-751027e8-91d2-4374-94cb-f4a840d7f7be" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:05:14 user nova-compute[70924]: DEBUG nova.network.neutron [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Instance cache missing network info. {{(pid=70924) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 15:05:14 user nova-compute[70924]: DEBUG nova.network.neutron [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Updating instance_info_cache with network_info: [{"id": "b5f58bd0-1ebf-476d-8c8d-2345228572b2", "address": "fa:16:3e:fc:c7:7d", "network": {"id": "f80826fa-fada-45b9-b969-fd539fd34fd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-465377443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9aadc9385b3b46eebc6e0d81814521af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f58bd0-1e", "ovs_interfaceid": "b5f58bd0-1ebf-476d-8c8d-2345228572b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:05:14 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Releasing lock "refresh_cache-751027e8-91d2-4374-94cb-f4a840d7f7be" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:05:14 user nova-compute[70924]: DEBUG nova.compute.manager [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Instance network_info: |[{"id": "b5f58bd0-1ebf-476d-8c8d-2345228572b2", "address": "fa:16:3e:fc:c7:7d", "network": {"id": "f80826fa-fada-45b9-b969-fd539fd34fd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-465377443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9aadc9385b3b46eebc6e0d81814521af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f58bd0-1e", "ovs_interfaceid": "b5f58bd0-1ebf-476d-8c8d-2345228572b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 15:05:14 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-477809ce-026f-4eff-a59d-845754796d9d req-7e626ca8-c201-427f-b0e7-61f57ae8c15c service nova] Acquired lock "refresh_cache-751027e8-91d2-4374-94cb-f4a840d7f7be" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:05:14 user nova-compute[70924]: DEBUG nova.network.neutron [req-477809ce-026f-4eff-a59d-845754796d9d req-7e626ca8-c201-427f-b0e7-61f57ae8c15c service nova] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Refreshing network info cache for port b5f58bd0-1ebf-476d-8c8d-2345228572b2 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 15:05:14 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Start _get_guest_xml network_info=[{"id": "b5f58bd0-1ebf-476d-8c8d-2345228572b2", "address": "fa:16:3e:fc:c7:7d", "network": {"id": "f80826fa-fada-45b9-b969-fd539fd34fd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-465377443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9aadc9385b3b46eebc6e0d81814521af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f58bd0-1e", "ovs_interfaceid": "b5f58bd0-1ebf-476d-8c8d-2345228572b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '3aba2e73-6832-404b-8bd0-d0503ce82b8c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 15:05:14 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:05:14 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:05:14 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 15:05:14 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] CPU controller missing on host. {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 15:05:14 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 15:05:14 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] CPU controller found on host. {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 15:05:14 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70924) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 15:05:14 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T14:36:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 15:05:14 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Flavor limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 15:05:14 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Image limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 15:05:14 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Flavor pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 15:05:14 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Image pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 15:05:14 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 15:05:14 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 15:05:14 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 15:05:14 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Got 1 possible topologies {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 15:05:14 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 15:05:14 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 15:05:14 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T15:05:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1548475347',display_name='tempest-AttachVolumeNegativeTest-server-1548475347',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1548475347',id=42,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEoWXwWSFgorilAbFT1ywLFvMQVbiwX/7wp6J1An4awoQ35nzJw+zlCXbxpIaotB7kFkvTCzAhAQ67MBalG1OCLhplba/XPjeJ341mkN+fMMdedopFzz6iMvR5bExrDsAw==',key_name='tempest-keypair-998531151',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9aadc9385b3b46eebc6e0d81814521af',ramdisk_id='',reservation_id='r-058e53e4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-972203101',owner_user_name='tempest-AttachVolumeNegativeTest-972203101-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T15:05:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='12cb8299e4d24946bc41a86493f4b426',uuid=751027e8-91d2-4374-94cb-f4a840d7f7be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b5f58bd0-1ebf-476d-8c8d-2345228572b2", "address": "fa:16:3e:fc:c7:7d", "network": {"id": "f80826fa-fada-45b9-b969-fd539fd34fd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-465377443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9aadc9385b3b46eebc6e0d81814521af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f58bd0-1e", "ovs_interfaceid": "b5f58bd0-1ebf-476d-8c8d-2345228572b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 15:05:14 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Converting VIF {"id": "b5f58bd0-1ebf-476d-8c8d-2345228572b2", "address": "fa:16:3e:fc:c7:7d", "network": {"id": "f80826fa-fada-45b9-b969-fd539fd34fd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-465377443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9aadc9385b3b46eebc6e0d81814521af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f58bd0-1e", "ovs_interfaceid": "b5f58bd0-1ebf-476d-8c8d-2345228572b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 15:05:14 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:c7:7d,bridge_name='br-int',has_traffic_filtering=True,id=b5f58bd0-1ebf-476d-8c8d-2345228572b2,network=Network(f80826fa-fada-45b9-b969-fd539fd34fd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f58bd0-1e') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 15:05:14 user nova-compute[70924]: DEBUG nova.objects.instance [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lazy-loading 'pci_devices' on Instance uuid 751027e8-91d2-4374-94cb-f4a840d7f7be {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:05:14 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] End _get_guest_xml xml=<domain type="kvm">
Jul 29 15:05:14 user nova-compute[70924]:   <uuid>751027e8-91d2-4374-94cb-f4a840d7f7be</uuid>
Jul 29 15:05:14 user nova-compute[70924]:   <name>instance-0000002a</name>
Jul 29 15:05:14 user nova-compute[70924]:   <memory>524288</memory>
Jul 29 15:05:14 user nova-compute[70924]:   <vcpu>1</vcpu>
Jul 29 15:05:14 user nova-compute[70924]:   <metadata>
Jul 29 15:05:14 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 15:05:14 user nova-compute[70924]:       <nova:package version="0.0.0"/>
Jul 29 15:05:14 user nova-compute[70924]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1548475347</nova:name>
Jul 29 15:05:14 user nova-compute[70924]:       <nova:creationTime>2023-07-29 15:05:14</nova:creationTime>
Jul 29 15:05:14 user nova-compute[70924]:       <nova:flavor name="m1.tiny">
Jul 29 15:05:14 user nova-compute[70924]:         <nova:memory>512</nova:memory>
Jul 29 15:05:14 user nova-compute[70924]:         <nova:disk>1</nova:disk>
Jul 29 15:05:14 user nova-compute[70924]:         <nova:swap>0</nova:swap>
Jul 29 15:05:14 user nova-compute[70924]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 15:05:14 user nova-compute[70924]:         <nova:vcpus>1</nova:vcpus>
Jul 29 15:05:14 user nova-compute[70924]:       </nova:flavor>
Jul 29 15:05:14 user nova-compute[70924]:       <nova:owner>
Jul 29 15:05:14 user nova-compute[70924]:         <nova:user uuid="12cb8299e4d24946bc41a86493f4b426">tempest-AttachVolumeNegativeTest-972203101-project-member</nova:user>
Jul 29 15:05:14 user nova-compute[70924]:         <nova:project uuid="9aadc9385b3b46eebc6e0d81814521af">tempest-AttachVolumeNegativeTest-972203101</nova:project>
Jul 29 15:05:14 user nova-compute[70924]:       </nova:owner>
Jul 29 15:05:14 user nova-compute[70924]:       <nova:root type="image" uuid="3aba2e73-6832-404b-8bd0-d0503ce82b8c"/>
Jul 29 15:05:14 user nova-compute[70924]:       <nova:ports>
Jul 29 15:05:14 user nova-compute[70924]:         <nova:port uuid="b5f58bd0-1ebf-476d-8c8d-2345228572b2">
Jul 29 15:05:14 user nova-compute[70924]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 29 15:05:14 user nova-compute[70924]:         </nova:port>
Jul 29 15:05:14 user nova-compute[70924]:       </nova:ports>
Jul 29 15:05:14 user nova-compute[70924]:     </nova:instance>
Jul 29 15:05:14 user nova-compute[70924]:   </metadata>
Jul 29 15:05:14 user nova-compute[70924]:   <sysinfo type="smbios">
Jul 29 15:05:14 user nova-compute[70924]:     <system>
Jul 29 15:05:14 user nova-compute[70924]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 15:05:14 user nova-compute[70924]:       <entry name="product">OpenStack Nova</entry>
Jul 29 15:05:14 user nova-compute[70924]:       <entry name="version">0.0.0</entry>
Jul 29 15:05:14 user nova-compute[70924]:       <entry name="serial">751027e8-91d2-4374-94cb-f4a840d7f7be</entry>
Jul 29 15:05:14 user nova-compute[70924]:       <entry name="uuid">751027e8-91d2-4374-94cb-f4a840d7f7be</entry>
Jul 29 15:05:14 user nova-compute[70924]:       <entry name="family">Virtual Machine</entry>
Jul 29 15:05:14 user nova-compute[70924]:     </system>
Jul 29 15:05:14 user nova-compute[70924]:   </sysinfo>
Jul 29 15:05:14 user nova-compute[70924]:   <os>
Jul 29 15:05:14 user nova-compute[70924]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 15:05:14 user nova-compute[70924]:     <boot dev="hd"/>
Jul 29 15:05:14 user nova-compute[70924]:     <smbios mode="sysinfo"/>
Jul 29 15:05:14 user nova-compute[70924]:   </os>
Jul 29 15:05:14 user nova-compute[70924]:   <features>
Jul 29 15:05:14 user nova-compute[70924]:     <acpi/>
Jul 29 15:05:14 user nova-compute[70924]:     <apic/>
Jul 29 15:05:14 user nova-compute[70924]:     <vmcoreinfo/>
Jul 29 15:05:14 user nova-compute[70924]:   </features>
Jul 29 15:05:14 user nova-compute[70924]:   <clock offset="utc">
Jul 29 15:05:14 user nova-compute[70924]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 15:05:14 user nova-compute[70924]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 15:05:14 user nova-compute[70924]:     <timer name="hpet" present="no"/>
Jul 29 15:05:14 user nova-compute[70924]:   </clock>
Jul 29 15:05:14 user nova-compute[70924]:   <cpu mode="custom" match="exact">
Jul 29 15:05:14 user nova-compute[70924]:     <model>Nehalem</model>
Jul 29 15:05:14 user nova-compute[70924]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 15:05:14 user nova-compute[70924]:   </cpu>
Jul 29 15:05:14 user nova-compute[70924]:   <devices>
Jul 29 15:05:14 user nova-compute[70924]:     <disk type="file" device="disk">
Jul 29 15:05:14 user nova-compute[70924]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 15:05:14 user nova-compute[70924]:       <source file="/opt/stack/data/nova/instances/751027e8-91d2-4374-94cb-f4a840d7f7be/disk"/>
Jul 29 15:05:14 user nova-compute[70924]:       <target dev="vda" bus="virtio"/>
Jul 29 15:05:14 user nova-compute[70924]:     </disk>
Jul 29 15:05:14 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 15:05:14 user nova-compute[70924]:       <mac address="fa:16:3e:fc:c7:7d"/>
Jul 29 15:05:14 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 15:05:14 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 15:05:14 user nova-compute[70924]:       <target dev="tapb5f58bd0-1e"/>
Jul 29 15:05:14 user nova-compute[70924]:     </interface>
Jul 29 15:05:14 user nova-compute[70924]:     <serial type="pty">
Jul 29 15:05:14 user nova-compute[70924]:       <log file="/opt/stack/data/nova/instances/751027e8-91d2-4374-94cb-f4a840d7f7be/console.log" append="off"/>
Jul 29 15:05:14 user nova-compute[70924]:     </serial>
Jul 29 15:05:14 user nova-compute[70924]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 15:05:14 user nova-compute[70924]:     <video>
Jul 29 15:05:14 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 15:05:14 user nova-compute[70924]:     </video>
Jul 29 15:05:14 user nova-compute[70924]:     <rng model="virtio">
Jul 29 15:05:14 user nova-compute[70924]:       <backend model="random">/dev/urandom</backend>
Jul 29 15:05:14 user nova-compute[70924]:     </rng>
Jul 29 15:05:14 user nova-compute[70924]:     <controller type="usb" index="0" model="none"/>
Jul 29 15:05:14 user nova-compute[70924]:     <memballoon model="virtio">
Jul 29 15:05:14 user nova-compute[70924]:       <stats period="10"/>
Jul 29 15:05:14 user nova-compute[70924]:     </memballoon>
Jul 29 15:05:14 user nova-compute[70924]:   </devices>
Jul 29 15:05:14 user nova-compute[70924]: </domain>
Jul 29 15:05:14 user nova-compute[70924]:  {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 15:05:14 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T15:05:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1548475347',display_name='tempest-AttachVolumeNegativeTest-server-1548475347',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1548475347',id=42,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEoWXwWSFgorilAbFT1ywLFvMQVbiwX/7wp6J1An4awoQ35nzJw+zlCXbxpIaotB7kFkvTCzAhAQ67MBalG1OCLhplba/XPjeJ341mkN+fMMdedopFzz6iMvR5bExrDsAw==',key_name='tempest-keypair-998531151',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9aadc9385b3b46eebc6e0d81814521af',ramdisk_id='',reservation_id='r-058e53e4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-972203101',owner_user_name='tempest-AttachVolumeNegativeTest-972203101-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T15:05:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='12cb8299e4d24946bc41a86493f4b426',uuid=751027e8-91d2-4374-94cb-f4a840d7f7be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b5f58bd0-1ebf-476d-8c8d-2345228572b2", "address": "fa:16:3e:fc:c7:7d", "network": {"id": "f80826fa-fada-45b9-b969-fd539fd34fd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-465377443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9aadc9385b3b46eebc6e0d81814521af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f58bd0-1e", "ovs_interfaceid": "b5f58bd0-1ebf-476d-8c8d-2345228572b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 15:05:14 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Converting VIF {"id": "b5f58bd0-1ebf-476d-8c8d-2345228572b2", "address": "fa:16:3e:fc:c7:7d", "network": {"id": "f80826fa-fada-45b9-b969-fd539fd34fd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-465377443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9aadc9385b3b46eebc6e0d81814521af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f58bd0-1e", "ovs_interfaceid": "b5f58bd0-1ebf-476d-8c8d-2345228572b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 15:05:14 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:c7:7d,bridge_name='br-int',has_traffic_filtering=True,id=b5f58bd0-1ebf-476d-8c8d-2345228572b2,network=Network(f80826fa-fada-45b9-b969-fd539fd34fd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f58bd0-1e') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 15:05:14 user nova-compute[70924]: DEBUG os_vif [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:c7:7d,bridge_name='br-int',has_traffic_filtering=True,id=b5f58bd0-1ebf-476d-8c8d-2345228572b2,network=Network(f80826fa-fada-45b9-b969-fd539fd34fd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f58bd0-1e') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 15:05:14 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:05:14 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:05:14 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 15:05:14 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:05:14 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb5f58bd0-1e, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:05:14 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb5f58bd0-1e, col_values=(('external_ids', {'iface-id': 'b5f58bd0-1ebf-476d-8c8d-2345228572b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:c7:7d', 'vm-uuid': '751027e8-91d2-4374-94cb-f4a840d7f7be'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:05:14 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:05:14 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:05:14 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:05:14 user nova-compute[70924]: INFO os_vif [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:c7:7d,bridge_name='br-int',has_traffic_filtering=True,id=b5f58bd0-1ebf-476d-8c8d-2345228572b2,network=Network(f80826fa-fada-45b9-b969-fd539fd34fd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f58bd0-1e')
Jul 29 15:05:14 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 15:05:14 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] No VIF found with MAC fa:16:3e:fc:c7:7d, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 15:05:15 user nova-compute[70924]: DEBUG nova.network.neutron [req-477809ce-026f-4eff-a59d-845754796d9d req-7e626ca8-c201-427f-b0e7-61f57ae8c15c service nova] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Updated VIF entry in instance network info cache for port b5f58bd0-1ebf-476d-8c8d-2345228572b2. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 15:05:15 user nova-compute[70924]: DEBUG nova.network.neutron [req-477809ce-026f-4eff-a59d-845754796d9d req-7e626ca8-c201-427f-b0e7-61f57ae8c15c service nova] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Updating instance_info_cache with network_info: [{"id": "b5f58bd0-1ebf-476d-8c8d-2345228572b2", "address": "fa:16:3e:fc:c7:7d", "network": {"id": "f80826fa-fada-45b9-b969-fd539fd34fd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-465377443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9aadc9385b3b46eebc6e0d81814521af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f58bd0-1e", "ovs_interfaceid": "b5f58bd0-1ebf-476d-8c8d-2345228572b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:05:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-477809ce-026f-4eff-a59d-845754796d9d req-7e626ca8-c201-427f-b0e7-61f57ae8c15c service nova] Releasing lock "refresh_cache-751027e8-91d2-4374-94cb-f4a840d7f7be" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:05:16 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:05:16 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:05:16 user nova-compute[70924]: DEBUG nova.compute.manager [req-5205f106-73b2-4292-aa91-33ce7507fc7d req-d894769e-edd4-42c4-a111-28ab0d63314f service nova] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Received event network-vif-plugged-b5f58bd0-1ebf-476d-8c8d-2345228572b2 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:05:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-5205f106-73b2-4292-aa91-33ce7507fc7d req-d894769e-edd4-42c4-a111-28ab0d63314f service nova] Acquiring lock "751027e8-91d2-4374-94cb-f4a840d7f7be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:05:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-5205f106-73b2-4292-aa91-33ce7507fc7d req-d894769e-edd4-42c4-a111-28ab0d63314f service nova] Lock "751027e8-91d2-4374-94cb-f4a840d7f7be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:05:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-5205f106-73b2-4292-aa91-33ce7507fc7d req-d894769e-edd4-42c4-a111-28ab0d63314f service nova] Lock "751027e8-91d2-4374-94cb-f4a840d7f7be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:05:16 user nova-compute[70924]: DEBUG nova.compute.manager [req-5205f106-73b2-4292-aa91-33ce7507fc7d req-d894769e-edd4-42c4-a111-28ab0d63314f service nova] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] No waiting events found dispatching network-vif-plugged-b5f58bd0-1ebf-476d-8c8d-2345228572b2 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:05:16 user nova-compute[70924]: WARNING nova.compute.manager [req-5205f106-73b2-4292-aa91-33ce7507fc7d req-d894769e-edd4-42c4-a111-28ab0d63314f service nova] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Received unexpected event network-vif-plugged-b5f58bd0-1ebf-476d-8c8d-2345228572b2 for instance with vm_state building and task_state spawning.
Jul 29 15:05:16 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:05:16 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:05:16 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:05:18 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690643118.4552119, 751027e8-91d2-4374-94cb-f4a840d7f7be => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 15:05:18 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] VM Resumed (Lifecycle Event)
Jul 29 15:05:18 user nova-compute[70924]: DEBUG nova.compute.manager [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Instance event wait completed in 0 seconds for  {{(pid=70924) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 15:05:18 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Guest created on hypervisor {{(pid=70924) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 15:05:18 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Instance spawned successfully.
Jul 29 15:05:18 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 15:05:18 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:05:18 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 15:05:18 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Found default for hw_cdrom_bus of ide {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:05:18 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Found default for hw_disk_bus of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:05:18 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Found default for hw_input_bus of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:05:18 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Found default for hw_pointer_model of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:05:18 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Found default for hw_video_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:05:18 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Found default for hw_vif_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:05:18 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 15:05:18 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690643118.4577587, 751027e8-91d2-4374-94cb-f4a840d7f7be => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 15:05:18 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] VM Started (Lifecycle Event)
Jul 29 15:05:18 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:05:18 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 15:05:18 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 15:05:18 user nova-compute[70924]: INFO nova.compute.manager [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Took 5.97 seconds to spawn the instance on the hypervisor.
Jul 29 15:05:18 user nova-compute[70924]: DEBUG nova.compute.manager [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:05:18 user nova-compute[70924]: INFO nova.compute.manager [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Took 6.58 seconds to build instance.
Jul 29 15:05:18 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-770c84c9-201d-4a6b-8d57-bc90341a2a7a tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "751027e8-91d2-4374-94cb-f4a840d7f7be" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.671s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:05:18 user nova-compute[70924]: DEBUG nova.compute.manager [req-c9974ed1-5fd4-46d5-9568-2856ef88d7be req-d3d49743-31cc-45ac-b383-6685664bea31 service nova] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Received event network-vif-plugged-b5f58bd0-1ebf-476d-8c8d-2345228572b2 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:05:18 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c9974ed1-5fd4-46d5-9568-2856ef88d7be req-d3d49743-31cc-45ac-b383-6685664bea31 service nova] Acquiring lock "751027e8-91d2-4374-94cb-f4a840d7f7be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:05:18 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c9974ed1-5fd4-46d5-9568-2856ef88d7be req-d3d49743-31cc-45ac-b383-6685664bea31 service nova] Lock "751027e8-91d2-4374-94cb-f4a840d7f7be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:05:18 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c9974ed1-5fd4-46d5-9568-2856ef88d7be req-d3d49743-31cc-45ac-b383-6685664bea31 service nova] Lock "751027e8-91d2-4374-94cb-f4a840d7f7be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:05:18 user nova-compute[70924]: DEBUG nova.compute.manager [req-c9974ed1-5fd4-46d5-9568-2856ef88d7be req-d3d49743-31cc-45ac-b383-6685664bea31 service nova] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] No waiting events found dispatching network-vif-plugged-b5f58bd0-1ebf-476d-8c8d-2345228572b2 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:05:18 user nova-compute[70924]: WARNING nova.compute.manager [req-c9974ed1-5fd4-46d5-9568-2856ef88d7be req-d3d49743-31cc-45ac-b383-6685664bea31 service nova] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Received unexpected event network-vif-plugged-b5f58bd0-1ebf-476d-8c8d-2345228572b2 for instance with vm_state active and task_state None.
Jul 29 15:05:19 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:05:19 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:05:19 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:05:21 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:05:24 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:05:24 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:05:25 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:05:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:05:29 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:05:29 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:05:31 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Acquiring lock "0a8fe938-7ca4-4221-9742-9b043050ba84" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:05:31 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Lock "0a8fe938-7ca4-4221-9742-9b043050ba84" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:05:31 user nova-compute[70924]: DEBUG nova.compute.manager [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Starting instance... {{(pid=70924) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 15:05:31 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:05:31 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:05:31 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70924) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 15:05:31 user nova-compute[70924]: INFO nova.compute.claims [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Claim successful on node user
Jul 29 15:05:32 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:05:32 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:05:32 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.336s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:05:32 user nova-compute[70924]: DEBUG nova.compute.manager [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Start building networks asynchronously for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 15:05:32 user nova-compute[70924]: DEBUG nova.compute.manager [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Allocating IP information in the background. {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 15:05:32 user nova-compute[70924]: DEBUG nova.network.neutron [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] allocate_for_instance() {{(pid=70924) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 15:05:32 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 15:05:32 user nova-compute[70924]: DEBUG nova.compute.manager [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Start building block device mappings for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 15:05:32 user nova-compute[70924]: DEBUG nova.policy [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0bab72756da045ccbe725c6ed42df481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '519723b99af84d1b85c40cfbc6518d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70924) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 15:05:32 user nova-compute[70924]: DEBUG nova.compute.manager [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Start spawning the instance on the hypervisor. {{(pid=70924) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 15:05:32 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Creating instance directory {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 15:05:32 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Creating image(s)
Jul 29 15:05:32 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Acquiring lock "/opt/stack/data/nova/instances/0a8fe938-7ca4-4221-9742-9b043050ba84/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:05:32 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Lock "/opt/stack/data/nova/instances/0a8fe938-7ca4-4221-9742-9b043050ba84/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:05:32 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Lock "/opt/stack/data/nova/instances/0a8fe938-7ca4-4221-9742-9b043050ba84/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:05:32 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:05:32 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.151s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:05:32 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Acquiring lock "bd72453517468710f1de26b27fb0ea28688e9009" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:05:32 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:05:32 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:05:32 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.144s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:05:32 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/0a8fe938-7ca4-4221-9742-9b043050ba84/disk 1073741824 {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:05:32 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/0a8fe938-7ca4-4221-9742-9b043050ba84/disk 1073741824" returned: 0 in 0.058s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:05:32 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.209s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:05:32 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:05:33 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.144s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:05:33 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0a8fe938-7ca4-4221-9742-9b043050ba84/disk. size=1073741824 {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 15:05:33 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a8fe938-7ca4-4221-9742-9b043050ba84/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:05:33 user nova-compute[70924]: DEBUG nova.network.neutron [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Successfully created port: 0f6e2258-37e5-4786-898b-d11796a410e7 {{(pid=70924) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 15:05:33 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a8fe938-7ca4-4221-9742-9b043050ba84/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:05:33 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Cannot resize image /opt/stack/data/nova/instances/0a8fe938-7ca4-4221-9742-9b043050ba84/disk to a smaller size. {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 15:05:33 user nova-compute[70924]: DEBUG nova.objects.instance [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Lazy-loading 'migration_context' on Instance uuid 0a8fe938-7ca4-4221-9742-9b043050ba84 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:05:33 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Created local disks {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 15:05:33 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Ensure instance console log exists: /opt/stack/data/nova/instances/0a8fe938-7ca4-4221-9742-9b043050ba84/console.log {{(pid=70924) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 15:05:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:05:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:05:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:05:34 user nova-compute[70924]: DEBUG nova.network.neutron [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Successfully updated port: 0f6e2258-37e5-4786-898b-d11796a410e7 {{(pid=70924) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 15:05:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:05:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Acquiring lock "refresh_cache-0a8fe938-7ca4-4221-9742-9b043050ba84" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:05:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Acquired lock "refresh_cache-0a8fe938-7ca4-4221-9742-9b043050ba84" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:05:34 user nova-compute[70924]: DEBUG nova.network.neutron [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 15:05:34 user nova-compute[70924]: DEBUG nova.compute.manager [req-90e2168a-d2ec-448e-bf5c-35f73e35720d req-ea547a76-71d1-41d0-958c-a9c40a9f274d service nova] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Received event network-changed-0f6e2258-37e5-4786-898b-d11796a410e7 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:05:34 user nova-compute[70924]: DEBUG nova.compute.manager [req-90e2168a-d2ec-448e-bf5c-35f73e35720d req-ea547a76-71d1-41d0-958c-a9c40a9f274d service nova] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Refreshing instance network info cache due to event network-changed-0f6e2258-37e5-4786-898b-d11796a410e7. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 15:05:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-90e2168a-d2ec-448e-bf5c-35f73e35720d req-ea547a76-71d1-41d0-958c-a9c40a9f274d service nova] Acquiring lock "refresh_cache-0a8fe938-7ca4-4221-9742-9b043050ba84" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:05:34 user nova-compute[70924]: DEBUG nova.network.neutron [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Instance cache missing network info. {{(pid=70924) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 15:05:34 user nova-compute[70924]: DEBUG nova.network.neutron [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Updating instance_info_cache with network_info: [{"id": "0f6e2258-37e5-4786-898b-d11796a410e7", "address": "fa:16:3e:0c:50:9c", "network": {"id": "24b90c74-6ebe-42f0-b11f-fc2b23b35188", "bridge": "br-int", "label": "tempest-TestStampPattern-1445459710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "519723b99af84d1b85c40cfbc6518d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f6e2258-37", "ovs_interfaceid": "0f6e2258-37e5-4786-898b-d11796a410e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:05:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Releasing lock "refresh_cache-0a8fe938-7ca4-4221-9742-9b043050ba84" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:05:34 user nova-compute[70924]: DEBUG nova.compute.manager [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Instance network_info: |[{"id": "0f6e2258-37e5-4786-898b-d11796a410e7", "address": "fa:16:3e:0c:50:9c", "network": {"id": "24b90c74-6ebe-42f0-b11f-fc2b23b35188", "bridge": "br-int", "label": "tempest-TestStampPattern-1445459710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "519723b99af84d1b85c40cfbc6518d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f6e2258-37", "ovs_interfaceid": "0f6e2258-37e5-4786-898b-d11796a410e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 15:05:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-90e2168a-d2ec-448e-bf5c-35f73e35720d req-ea547a76-71d1-41d0-958c-a9c40a9f274d service nova] Acquired lock "refresh_cache-0a8fe938-7ca4-4221-9742-9b043050ba84" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:05:34 user nova-compute[70924]: DEBUG nova.network.neutron [req-90e2168a-d2ec-448e-bf5c-35f73e35720d req-ea547a76-71d1-41d0-958c-a9c40a9f274d service nova] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Refreshing network info cache for port 0f6e2258-37e5-4786-898b-d11796a410e7 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 15:05:34 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Start _get_guest_xml network_info=[{"id": "0f6e2258-37e5-4786-898b-d11796a410e7", "address": "fa:16:3e:0c:50:9c", "network": {"id": "24b90c74-6ebe-42f0-b11f-fc2b23b35188", "bridge": "br-int", "label": "tempest-TestStampPattern-1445459710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "519723b99af84d1b85c40cfbc6518d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f6e2258-37", "ovs_interfaceid": "0f6e2258-37e5-4786-898b-d11796a410e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '3aba2e73-6832-404b-8bd0-d0503ce82b8c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 15:05:34 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:05:34 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:05:34 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 15:05:34 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] CPU controller missing on host. {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 15:05:34 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 15:05:34 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] CPU controller found on host. {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 15:05:34 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70924) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 15:05:34 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T14:36:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 15:05:34 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Flavor limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 15:05:34 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Image limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 15:05:34 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Flavor pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 15:05:34 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Image pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 15:05:34 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 15:05:34 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 15:05:34 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 15:05:34 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Got 1 possible topologies {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 15:05:34 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 15:05:34 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 15:05:34 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T15:05:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1498343891',display_name='tempest-TestStampPattern-server-1498343891',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1498343891',id=43,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP9wXXmEpUxSy6sCiiBCVPvhbmxDt3THRKq326W9UvO9W3eISERvSp0FREjZ8D+cDQ7iUcDk1NqJBkukyTT0dSSBRCZHyMnPGsYsEUkqKHShLvimsa51y3TpE3TWdx039g==',key_name='tempest-TestStampPattern-68763195',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='519723b99af84d1b85c40cfbc6518d35',ramdisk_id='',reservation_id='r-z56ldml2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-92673023',owner_user_name='tempest-TestStampPattern-92673023-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T15:05:32Z,user_data=None,user_id='0bab72756da045ccbe725c6ed42df481',uuid=0a8fe938-7ca4-4221-9742-9b043050ba84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f6e2258-37e5-4786-898b-d11796a410e7", "address": "fa:16:3e:0c:50:9c", "network": {"id": "24b90c74-6ebe-42f0-b11f-fc2b23b35188", "bridge": "br-int", "label": "tempest-TestStampPattern-1445459710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "519723b99af84d1b85c40cfbc6518d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f6e2258-37", "ovs_interfaceid": "0f6e2258-37e5-4786-898b-d11796a410e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 15:05:34 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Converting VIF {"id": "0f6e2258-37e5-4786-898b-d11796a410e7", "address": "fa:16:3e:0c:50:9c", "network": {"id": "24b90c74-6ebe-42f0-b11f-fc2b23b35188", "bridge": "br-int", "label": "tempest-TestStampPattern-1445459710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "519723b99af84d1b85c40cfbc6518d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f6e2258-37", "ovs_interfaceid": "0f6e2258-37e5-4786-898b-d11796a410e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 15:05:34 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:50:9c,bridge_name='br-int',has_traffic_filtering=True,id=0f6e2258-37e5-4786-898b-d11796a410e7,network=Network(24b90c74-6ebe-42f0-b11f-fc2b23b35188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f6e2258-37') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 15:05:34 user nova-compute[70924]: DEBUG nova.objects.instance [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Lazy-loading 'pci_devices' on Instance uuid 0a8fe938-7ca4-4221-9742-9b043050ba84 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:05:34 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] End _get_guest_xml xml=<domain type="kvm">
Jul 29 15:05:34 user nova-compute[70924]:   <uuid>0a8fe938-7ca4-4221-9742-9b043050ba84</uuid>
Jul 29 15:05:34 user nova-compute[70924]:   <name>instance-0000002b</name>
Jul 29 15:05:34 user nova-compute[70924]:   <memory>524288</memory>
Jul 29 15:05:34 user nova-compute[70924]:   <vcpu>1</vcpu>
Jul 29 15:05:34 user nova-compute[70924]:   <metadata>
Jul 29 15:05:34 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 15:05:34 user nova-compute[70924]:       <nova:package version="0.0.0"/>
Jul 29 15:05:34 user nova-compute[70924]:       <nova:name>tempest-TestStampPattern-server-1498343891</nova:name>
Jul 29 15:05:34 user nova-compute[70924]:       <nova:creationTime>2023-07-29 15:05:34</nova:creationTime>
Jul 29 15:05:34 user nova-compute[70924]:       <nova:flavor name="m1.tiny">
Jul 29 15:05:34 user nova-compute[70924]:         <nova:memory>512</nova:memory>
Jul 29 15:05:34 user nova-compute[70924]:         <nova:disk>1</nova:disk>
Jul 29 15:05:34 user nova-compute[70924]:         <nova:swap>0</nova:swap>
Jul 29 15:05:34 user nova-compute[70924]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 15:05:34 user nova-compute[70924]:         <nova:vcpus>1</nova:vcpus>
Jul 29 15:05:34 user nova-compute[70924]:       </nova:flavor>
Jul 29 15:05:34 user nova-compute[70924]:       <nova:owner>
Jul 29 15:05:34 user nova-compute[70924]:         <nova:user uuid="0bab72756da045ccbe725c6ed42df481">tempest-TestStampPattern-92673023-project-member</nova:user>
Jul 29 15:05:34 user nova-compute[70924]:         <nova:project uuid="519723b99af84d1b85c40cfbc6518d35">tempest-TestStampPattern-92673023</nova:project>
Jul 29 15:05:34 user nova-compute[70924]:       </nova:owner>
Jul 29 15:05:34 user nova-compute[70924]:       <nova:root type="image" uuid="3aba2e73-6832-404b-8bd0-d0503ce82b8c"/>
Jul 29 15:05:34 user nova-compute[70924]:       <nova:ports>
Jul 29 15:05:34 user nova-compute[70924]:         <nova:port uuid="0f6e2258-37e5-4786-898b-d11796a410e7">
Jul 29 15:05:34 user nova-compute[70924]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 29 15:05:34 user nova-compute[70924]:         </nova:port>
Jul 29 15:05:34 user nova-compute[70924]:       </nova:ports>
Jul 29 15:05:34 user nova-compute[70924]:     </nova:instance>
Jul 29 15:05:34 user nova-compute[70924]:   </metadata>
Jul 29 15:05:34 user nova-compute[70924]:   <sysinfo type="smbios">
Jul 29 15:05:34 user nova-compute[70924]:     <system>
Jul 29 15:05:34 user nova-compute[70924]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 15:05:34 user nova-compute[70924]:       <entry name="product">OpenStack Nova</entry>
Jul 29 15:05:34 user nova-compute[70924]:       <entry name="version">0.0.0</entry>
Jul 29 15:05:34 user nova-compute[70924]:       <entry name="serial">0a8fe938-7ca4-4221-9742-9b043050ba84</entry>
Jul 29 15:05:34 user nova-compute[70924]:       <entry name="uuid">0a8fe938-7ca4-4221-9742-9b043050ba84</entry>
Jul 29 15:05:34 user nova-compute[70924]:       <entry name="family">Virtual Machine</entry>
Jul 29 15:05:34 user nova-compute[70924]:     </system>
Jul 29 15:05:34 user nova-compute[70924]:   </sysinfo>
Jul 29 15:05:34 user nova-compute[70924]:   <os>
Jul 29 15:05:34 user nova-compute[70924]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 15:05:34 user nova-compute[70924]:     <boot dev="hd"/>
Jul 29 15:05:34 user nova-compute[70924]:     <smbios mode="sysinfo"/>
Jul 29 15:05:34 user nova-compute[70924]:   </os>
Jul 29 15:05:34 user nova-compute[70924]:   <features>
Jul 29 15:05:34 user nova-compute[70924]:     <acpi/>
Jul 29 15:05:34 user nova-compute[70924]:     <apic/>
Jul 29 15:05:34 user nova-compute[70924]:     <vmcoreinfo/>
Jul 29 15:05:34 user nova-compute[70924]:   </features>
Jul 29 15:05:34 user nova-compute[70924]:   <clock offset="utc">
Jul 29 15:05:34 user nova-compute[70924]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 15:05:34 user nova-compute[70924]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 15:05:34 user nova-compute[70924]:     <timer name="hpet" present="no"/>
Jul 29 15:05:34 user nova-compute[70924]:   </clock>
Jul 29 15:05:34 user nova-compute[70924]:   <cpu mode="custom" match="exact">
Jul 29 15:05:34 user nova-compute[70924]:     <model>Nehalem</model>
Jul 29 15:05:34 user nova-compute[70924]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 15:05:34 user nova-compute[70924]:   </cpu>
Jul 29 15:05:34 user nova-compute[70924]:   <devices>
Jul 29 15:05:34 user nova-compute[70924]:     <disk type="file" device="disk">
Jul 29 15:05:34 user nova-compute[70924]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 15:05:34 user nova-compute[70924]:       <source file="/opt/stack/data/nova/instances/0a8fe938-7ca4-4221-9742-9b043050ba84/disk"/>
Jul 29 15:05:34 user nova-compute[70924]:       <target dev="vda" bus="virtio"/>
Jul 29 15:05:34 user nova-compute[70924]:     </disk>
Jul 29 15:05:34 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 15:05:34 user nova-compute[70924]:       <mac address="fa:16:3e:0c:50:9c"/>
Jul 29 15:05:34 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 15:05:34 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 15:05:34 user nova-compute[70924]:       <target dev="tap0f6e2258-37"/>
Jul 29 15:05:34 user nova-compute[70924]:     </interface>
Jul 29 15:05:34 user nova-compute[70924]:     <serial type="pty">
Jul 29 15:05:34 user nova-compute[70924]:       <log file="/opt/stack/data/nova/instances/0a8fe938-7ca4-4221-9742-9b043050ba84/console.log" append="off"/>
Jul 29 15:05:34 user nova-compute[70924]:     </serial>
Jul 29 15:05:34 user nova-compute[70924]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 15:05:34 user nova-compute[70924]:     <video>
Jul 29 15:05:34 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 15:05:34 user nova-compute[70924]:     </video>
Jul 29 15:05:34 user nova-compute[70924]:     <rng model="virtio">
Jul 29 15:05:34 user nova-compute[70924]:       <backend model="random">/dev/urandom</backend>
Jul 29 15:05:34 user nova-compute[70924]:     </rng>
Jul 29 15:05:34 user nova-compute[70924]:     <controller type="usb" index="0" model="none"/>
Jul 29 15:05:34 user nova-compute[70924]:     <memballoon model="virtio">
Jul 29 15:05:34 user nova-compute[70924]:       <stats period="10"/>
Jul 29 15:05:34 user nova-compute[70924]:     </memballoon>
Jul 29 15:05:34 user nova-compute[70924]:   </devices>
Jul 29 15:05:34 user nova-compute[70924]: </domain>
Jul 29 15:05:34 user nova-compute[70924]:  {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 15:05:34 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T15:05:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1498343891',display_name='tempest-TestStampPattern-server-1498343891',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1498343891',id=43,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP9wXXmEpUxSy6sCiiBCVPvhbmxDt3THRKq326W9UvO9W3eISERvSp0FREjZ8D+cDQ7iUcDk1NqJBkukyTT0dSSBRCZHyMnPGsYsEUkqKHShLvimsa51y3TpE3TWdx039g==',key_name='tempest-TestStampPattern-68763195',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='519723b99af84d1b85c40cfbc6518d35',ramdisk_id='',reservation_id='r-z56ldml2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-92673023',owner_user_name='tempest-TestStampPattern-92673023-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T15:05:32Z,user_data=None,user_id='0bab72756da045ccbe725c6ed42df481',uuid=0a8fe938-7ca4-4221-9742-9b043050ba84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f6e2258-37e5-4786-898b-d11796a410e7", "address": "fa:16:3e:0c:50:9c", "network": {"id": "24b90c74-6ebe-42f0-b11f-fc2b23b35188", "bridge": "br-int", "label": "tempest-TestStampPattern-1445459710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "519723b99af84d1b85c40cfbc6518d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f6e2258-37", "ovs_interfaceid": "0f6e2258-37e5-4786-898b-d11796a410e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 15:05:34 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Converting VIF {"id": "0f6e2258-37e5-4786-898b-d11796a410e7", "address": "fa:16:3e:0c:50:9c", "network": {"id": "24b90c74-6ebe-42f0-b11f-fc2b23b35188", "bridge": "br-int", "label": "tempest-TestStampPattern-1445459710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "519723b99af84d1b85c40cfbc6518d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f6e2258-37", "ovs_interfaceid": "0f6e2258-37e5-4786-898b-d11796a410e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 15:05:34 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:50:9c,bridge_name='br-int',has_traffic_filtering=True,id=0f6e2258-37e5-4786-898b-d11796a410e7,network=Network(24b90c74-6ebe-42f0-b11f-fc2b23b35188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f6e2258-37') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 15:05:34 user nova-compute[70924]: DEBUG os_vif [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:50:9c,bridge_name='br-int',has_traffic_filtering=True,id=0f6e2258-37e5-4786-898b-d11796a410e7,network=Network(24b90c74-6ebe-42f0-b11f-fc2b23b35188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f6e2258-37') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 15:05:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:05:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:05:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 15:05:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:05:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0f6e2258-37, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:05:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0f6e2258-37, col_values=(('external_ids', {'iface-id': '0f6e2258-37e5-4786-898b-d11796a410e7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:50:9c', 'vm-uuid': '0a8fe938-7ca4-4221-9742-9b043050ba84'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:05:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:05:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:05:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:05:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:05:34 user nova-compute[70924]: INFO os_vif [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:50:9c,bridge_name='br-int',has_traffic_filtering=True,id=0f6e2258-37e5-4786-898b-d11796a410e7,network=Network(24b90c74-6ebe-42f0-b11f-fc2b23b35188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f6e2258-37')
Jul 29 15:05:34 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 15:05:34 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] No VIF found with MAC fa:16:3e:0c:50:9c, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 15:05:35 user nova-compute[70924]: DEBUG nova.network.neutron [req-90e2168a-d2ec-448e-bf5c-35f73e35720d req-ea547a76-71d1-41d0-958c-a9c40a9f274d service nova] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Updated VIF entry in instance network info cache for port 0f6e2258-37e5-4786-898b-d11796a410e7. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 15:05:35 user nova-compute[70924]: DEBUG nova.network.neutron [req-90e2168a-d2ec-448e-bf5c-35f73e35720d req-ea547a76-71d1-41d0-958c-a9c40a9f274d service nova] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Updating instance_info_cache with network_info: [{"id": "0f6e2258-37e5-4786-898b-d11796a410e7", "address": "fa:16:3e:0c:50:9c", "network": {"id": "24b90c74-6ebe-42f0-b11f-fc2b23b35188", "bridge": "br-int", "label": "tempest-TestStampPattern-1445459710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "519723b99af84d1b85c40cfbc6518d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f6e2258-37", "ovs_interfaceid": "0f6e2258-37e5-4786-898b-d11796a410e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:05:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-90e2168a-d2ec-448e-bf5c-35f73e35720d req-ea547a76-71d1-41d0-958c-a9c40a9f274d service nova] Releasing lock "refresh_cache-0a8fe938-7ca4-4221-9742-9b043050ba84" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:05:36 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-8f048f7e-47b7-4103-936b-df0dd572273d tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Acquiring lock "091e384f-7851-4ac9-b566-990df0497fc5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:05:36 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-8f048f7e-47b7-4103-936b-df0dd572273d tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "091e384f-7851-4ac9-b566-990df0497fc5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:05:36 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-8f048f7e-47b7-4103-936b-df0dd572273d tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Acquiring lock "091e384f-7851-4ac9-b566-990df0497fc5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:05:36 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-8f048f7e-47b7-4103-936b-df0dd572273d tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "091e384f-7851-4ac9-b566-990df0497fc5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:05:36 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-8f048f7e-47b7-4103-936b-df0dd572273d tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "091e384f-7851-4ac9-b566-990df0497fc5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:05:36 user nova-compute[70924]: INFO nova.compute.manager [None req-8f048f7e-47b7-4103-936b-df0dd572273d tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Terminating instance
Jul 29 15:05:36 user nova-compute[70924]: DEBUG nova.compute.manager [None req-8f048f7e-47b7-4103-936b-df0dd572273d tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Start destroying the instance on the hypervisor. {{(pid=70924) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 15:05:36 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:05:36 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:05:36 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:05:36 user nova-compute[70924]: DEBUG nova.compute.manager [req-4f0f23ae-34f8-4c37-8646-96c20c14242e req-d4f241a9-1c12-423c-8cfe-683c9f539234 service nova] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Received event network-vif-unplugged-1da26b57-ec30-415a-8a43-fe0e662667e1 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:05:36 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-4f0f23ae-34f8-4c37-8646-96c20c14242e req-d4f241a9-1c12-423c-8cfe-683c9f539234 service nova] Acquiring lock "091e384f-7851-4ac9-b566-990df0497fc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:05:36 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-4f0f23ae-34f8-4c37-8646-96c20c14242e req-d4f241a9-1c12-423c-8cfe-683c9f539234 service nova] Lock "091e384f-7851-4ac9-b566-990df0497fc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:05:36 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-4f0f23ae-34f8-4c37-8646-96c20c14242e req-d4f241a9-1c12-423c-8cfe-683c9f539234 service nova] Lock "091e384f-7851-4ac9-b566-990df0497fc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:05:36 user nova-compute[70924]: DEBUG nova.compute.manager [req-4f0f23ae-34f8-4c37-8646-96c20c14242e req-d4f241a9-1c12-423c-8cfe-683c9f539234 service nova] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] No waiting events found dispatching network-vif-unplugged-1da26b57-ec30-415a-8a43-fe0e662667e1 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:05:36 user nova-compute[70924]: DEBUG nova.compute.manager [req-4f0f23ae-34f8-4c37-8646-96c20c14242e req-d4f241a9-1c12-423c-8cfe-683c9f539234 service nova] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Received event network-vif-unplugged-1da26b57-ec30-415a-8a43-fe0e662667e1 for instance with task_state deleting. {{(pid=70924) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 15:05:36 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:05:36 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:05:36 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:05:36 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:05:36 user nova-compute[70924]: DEBUG nova.compute.manager [req-cb04fe1b-2706-4744-9712-5d32a168659c req-34e0cd4f-59ab-40a5-9dcb-080196dca0c1 service nova] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Received event network-vif-plugged-0f6e2258-37e5-4786-898b-d11796a410e7 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:05:36 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-cb04fe1b-2706-4744-9712-5d32a168659c req-34e0cd4f-59ab-40a5-9dcb-080196dca0c1 service nova] Acquiring lock "0a8fe938-7ca4-4221-9742-9b043050ba84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:05:36 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-cb04fe1b-2706-4744-9712-5d32a168659c req-34e0cd4f-59ab-40a5-9dcb-080196dca0c1 service nova] Lock "0a8fe938-7ca4-4221-9742-9b043050ba84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:05:36 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-cb04fe1b-2706-4744-9712-5d32a168659c req-34e0cd4f-59ab-40a5-9dcb-080196dca0c1 service nova] Lock "0a8fe938-7ca4-4221-9742-9b043050ba84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:05:36 user nova-compute[70924]: DEBUG nova.compute.manager [req-cb04fe1b-2706-4744-9712-5d32a168659c req-34e0cd4f-59ab-40a5-9dcb-080196dca0c1 service nova] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] No waiting events found dispatching network-vif-plugged-0f6e2258-37e5-4786-898b-d11796a410e7 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:05:36 user nova-compute[70924]: WARNING nova.compute.manager [req-cb04fe1b-2706-4744-9712-5d32a168659c req-34e0cd4f-59ab-40a5-9dcb-080196dca0c1 service nova] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Received unexpected event network-vif-plugged-0f6e2258-37e5-4786-898b-d11796a410e7 for instance with vm_state building and task_state spawning.
Jul 29 15:05:36 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:05:36 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:05:36 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Instance destroyed successfully.
Jul 29 15:05:36 user nova-compute[70924]: DEBUG nova.objects.instance [None req-8f048f7e-47b7-4103-936b-df0dd572273d tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lazy-loading 'resources' on Instance uuid 091e384f-7851-4ac9-b566-990df0497fc5 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:05:37 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-8f048f7e-47b7-4103-936b-df0dd572273d tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:49:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-985418414',display_name='tempest-ServerRescueNegativeTestJSON-server-985418414',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-985418414',id=25,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:51:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8fcf4644e7a24bf68b407be2e3d9732c',ramdisk_id='',reservation_id='r-77bcp480',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1436708078',owner_user_name='tempest-ServerRescueNegativeTestJSON-1436708078-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:51:22Z,user_data=None,user_id='8ec7e735cfff48828e0c0c7618f50711',uuid=091e384f-7851-4ac9-b566-990df0497fc5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "1da26b57-ec30-415a-8a43-fe0e662667e1", "address": "fa:16:3e:7c:7f:15", "network": {"id": "b2aee530-d195-47bb-b39d-c8bd15b81a08", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-421022738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcf4644e7a24bf68b407be2e3d9732c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1da26b57-ec", "ovs_interfaceid": "1da26b57-ec30-415a-8a43-fe0e662667e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 15:05:37 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-8f048f7e-47b7-4103-936b-df0dd572273d tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Converting VIF {"id": "1da26b57-ec30-415a-8a43-fe0e662667e1", "address": "fa:16:3e:7c:7f:15", "network": {"id": "b2aee530-d195-47bb-b39d-c8bd15b81a08", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-421022738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcf4644e7a24bf68b407be2e3d9732c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1da26b57-ec", "ovs_interfaceid": "1da26b57-ec30-415a-8a43-fe0e662667e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 15:05:37 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-8f048f7e-47b7-4103-936b-df0dd572273d tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:7f:15,bridge_name='br-int',has_traffic_filtering=True,id=1da26b57-ec30-415a-8a43-fe0e662667e1,network=Network(b2aee530-d195-47bb-b39d-c8bd15b81a08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1da26b57-ec') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 15:05:37 user nova-compute[70924]: DEBUG os_vif [None req-8f048f7e-47b7-4103-936b-df0dd572273d tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:7f:15,bridge_name='br-int',has_traffic_filtering=True,id=1da26b57-ec30-415a-8a43-fe0e662667e1,network=Network(b2aee530-d195-47bb-b39d-c8bd15b81a08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1da26b57-ec') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 15:05:37 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:05:37 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1da26b57-ec, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:05:37 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:05:37 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:05:37 user nova-compute[70924]: INFO os_vif [None req-8f048f7e-47b7-4103-936b-df0dd572273d tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:7f:15,bridge_name='br-int',has_traffic_filtering=True,id=1da26b57-ec30-415a-8a43-fe0e662667e1,network=Network(b2aee530-d195-47bb-b39d-c8bd15b81a08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1da26b57-ec')
Jul 29 15:05:37 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-8f048f7e-47b7-4103-936b-df0dd572273d tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Deleting instance files /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5_del
Jul 29 15:05:37 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-8f048f7e-47b7-4103-936b-df0dd572273d tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Deletion of /opt/stack/data/nova/instances/091e384f-7851-4ac9-b566-990df0497fc5_del complete
Jul 29 15:05:37 user nova-compute[70924]: INFO nova.compute.manager [None req-8f048f7e-47b7-4103-936b-df0dd572273d tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Took 1.08 seconds to destroy the instance on the hypervisor.
Jul 29 15:05:37 user nova-compute[70924]: DEBUG oslo.service.loopingcall [None req-8f048f7e-47b7-4103-936b-df0dd572273d tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70924) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 15:05:37 user nova-compute[70924]: DEBUG nova.compute.manager [-] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Deallocating network for instance {{(pid=70924) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 15:05:37 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] deallocate_for_instance() {{(pid=70924) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 15:05:37 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:05:37 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:05:37 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:05:37 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:05:37 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Took 0.45 seconds to deallocate network for instance.
Jul 29 15:05:37 user nova-compute[70924]: DEBUG nova.compute.manager [req-ef0409f4-f9a8-4062-9e56-9b50635b5800 req-9a1b1f3b-bee5-4137-af53-142361cfb58f service nova] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Received event network-vif-deleted-1da26b57-ec30-415a-8a43-fe0e662667e1 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:05:37 user nova-compute[70924]: INFO nova.compute.manager [req-ef0409f4-f9a8-4062-9e56-9b50635b5800 req-9a1b1f3b-bee5-4137-af53-142361cfb58f service nova] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Neutron deleted interface 1da26b57-ec30-415a-8a43-fe0e662667e1; detaching it from the instance and deleting it from the info cache
Jul 29 15:05:37 user nova-compute[70924]: DEBUG nova.network.neutron [req-ef0409f4-f9a8-4062-9e56-9b50635b5800 req-9a1b1f3b-bee5-4137-af53-142361cfb58f service nova] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:05:37 user nova-compute[70924]: DEBUG nova.compute.manager [req-ef0409f4-f9a8-4062-9e56-9b50635b5800 req-9a1b1f3b-bee5-4137-af53-142361cfb58f service nova] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Detach interface failed, port_id=1da26b57-ec30-415a-8a43-fe0e662667e1, reason: Instance 091e384f-7851-4ac9-b566-990df0497fc5 could not be found. {{(pid=70924) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 29 15:05:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-8f048f7e-47b7-4103-936b-df0dd572273d tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:05:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-8f048f7e-47b7-4103-936b-df0dd572273d tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:05:37 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-8f048f7e-47b7-4103-936b-df0dd572273d tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:05:37 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-8f048f7e-47b7-4103-936b-df0dd572273d tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:05:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-8f048f7e-47b7-4103-936b-df0dd572273d tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.282s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:05:37 user nova-compute[70924]: INFO nova.scheduler.client.report [None req-8f048f7e-47b7-4103-936b-df0dd572273d tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Deleted allocations for instance 091e384f-7851-4ac9-b566-990df0497fc5
Jul 29 15:05:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-8f048f7e-47b7-4103-936b-df0dd572273d tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "091e384f-7851-4ac9-b566-990df0497fc5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.004s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:05:38 user nova-compute[70924]: DEBUG nova.compute.manager [req-71084f55-c10f-439a-8b45-d5cd313cf480 req-dfe4bca8-beba-4f70-8e1d-f3e84960893a service nova] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Received event network-vif-plugged-1da26b57-ec30-415a-8a43-fe0e662667e1 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:05:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-71084f55-c10f-439a-8b45-d5cd313cf480 req-dfe4bca8-beba-4f70-8e1d-f3e84960893a service nova] Acquiring lock "091e384f-7851-4ac9-b566-990df0497fc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:05:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-71084f55-c10f-439a-8b45-d5cd313cf480 req-dfe4bca8-beba-4f70-8e1d-f3e84960893a service nova] Lock "091e384f-7851-4ac9-b566-990df0497fc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:05:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-71084f55-c10f-439a-8b45-d5cd313cf480 req-dfe4bca8-beba-4f70-8e1d-f3e84960893a service nova] Lock "091e384f-7851-4ac9-b566-990df0497fc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:05:38 user nova-compute[70924]: DEBUG nova.compute.manager [req-71084f55-c10f-439a-8b45-d5cd313cf480 req-dfe4bca8-beba-4f70-8e1d-f3e84960893a service nova] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] No waiting events found dispatching network-vif-plugged-1da26b57-ec30-415a-8a43-fe0e662667e1 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:05:38 user nova-compute[70924]: WARNING nova.compute.manager [req-71084f55-c10f-439a-8b45-d5cd313cf480 req-dfe4bca8-beba-4f70-8e1d-f3e84960893a service nova] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Received unexpected event network-vif-plugged-1da26b57-ec30-415a-8a43-fe0e662667e1 for instance with vm_state deleted and task_state None.
Jul 29 15:05:38 user nova-compute[70924]: DEBUG nova.compute.manager [req-b6ee64cb-4aaa-4c8b-ba20-ab157db382d7 req-437d6d4a-cc5c-474e-a4ec-d874445f7f3f service nova] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Received event network-vif-plugged-0f6e2258-37e5-4786-898b-d11796a410e7 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:05:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b6ee64cb-4aaa-4c8b-ba20-ab157db382d7 req-437d6d4a-cc5c-474e-a4ec-d874445f7f3f service nova] Acquiring lock "0a8fe938-7ca4-4221-9742-9b043050ba84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:05:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b6ee64cb-4aaa-4c8b-ba20-ab157db382d7 req-437d6d4a-cc5c-474e-a4ec-d874445f7f3f service nova] Lock "0a8fe938-7ca4-4221-9742-9b043050ba84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:05:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b6ee64cb-4aaa-4c8b-ba20-ab157db382d7 req-437d6d4a-cc5c-474e-a4ec-d874445f7f3f service nova] Lock "0a8fe938-7ca4-4221-9742-9b043050ba84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:05:38 user nova-compute[70924]: DEBUG nova.compute.manager [req-b6ee64cb-4aaa-4c8b-ba20-ab157db382d7 req-437d6d4a-cc5c-474e-a4ec-d874445f7f3f service nova] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] No waiting events found dispatching network-vif-plugged-0f6e2258-37e5-4786-898b-d11796a410e7 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:05:38 user nova-compute[70924]: WARNING nova.compute.manager [req-b6ee64cb-4aaa-4c8b-ba20-ab157db382d7 req-437d6d4a-cc5c-474e-a4ec-d874445f7f3f service nova] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Received unexpected event network-vif-plugged-0f6e2258-37e5-4786-898b-d11796a410e7 for instance with vm_state building and task_state spawning.
Jul 29 15:05:38 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690643138.86869, 0a8fe938-7ca4-4221-9742-9b043050ba84 => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 15:05:38 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] VM Resumed (Lifecycle Event)
Jul 29 15:05:38 user nova-compute[70924]: DEBUG nova.compute.manager [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Instance event wait completed in 0 seconds for  {{(pid=70924) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 15:05:38 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Guest created on hypervisor {{(pid=70924) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 15:05:38 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Instance spawned successfully.
Jul 29 15:05:38 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 15:05:38 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:05:38 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 15:05:38 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Found default for hw_cdrom_bus of ide {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:05:38 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Found default for hw_disk_bus of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:05:38 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Found default for hw_input_bus of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:05:38 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Found default for hw_pointer_model of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:05:38 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Found default for hw_video_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:05:38 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Found default for hw_vif_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:05:38 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 15:05:38 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690643138.8719437, 0a8fe938-7ca4-4221-9742-9b043050ba84 => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 15:05:38 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] VM Started (Lifecycle Event)
Jul 29 15:05:38 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:05:38 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 15:05:38 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 15:05:38 user nova-compute[70924]: INFO nova.compute.manager [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Took 6.47 seconds to spawn the instance on the hypervisor.
Jul 29 15:05:38 user nova-compute[70924]: DEBUG nova.compute.manager [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:05:39 user nova-compute[70924]: INFO nova.compute.manager [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Took 7.13 seconds to build instance.
Jul 29 15:05:39 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ec600005-e9b9-4bb5-92d7-2c49d71849b4 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Lock "0a8fe938-7ca4-4221-9742-9b043050ba84" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.237s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:05:39 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:05:42 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:05:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:05:47 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:05:49 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:05:52 user nova-compute[70924]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690643136.989913, 091e384f-7851-4ac9-b566-990df0497fc5 => Stopped> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 15:05:52 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] VM Stopped (Lifecycle Event)
Jul 29 15:05:52 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:05:52 user nova-compute[70924]: DEBUG nova.compute.manager [None req-51c1f984-183b-48c4-a843-835edc9db426 None None] [instance: 091e384f-7851-4ac9-b566-990df0497fc5] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:05:54 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:05:57 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:05:59 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:06:01 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:06:01 user nova-compute[70924]: DEBUG nova.compute.manager [req-51bf1baf-613d-4fd9-84cb-27a58e77b4a9 req-3baa4d55-07ce-4896-a53c-fbf8c2ef5397 service nova] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] Received event network-changed-c9d69516-6a60-4516-90cf-45529916012e {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:06:01 user nova-compute[70924]: DEBUG nova.compute.manager [req-51bf1baf-613d-4fd9-84cb-27a58e77b4a9 req-3baa4d55-07ce-4896-a53c-fbf8c2ef5397 service nova] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] Refreshing instance network info cache due to event network-changed-c9d69516-6a60-4516-90cf-45529916012e. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 15:06:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-51bf1baf-613d-4fd9-84cb-27a58e77b4a9 req-3baa4d55-07ce-4896-a53c-fbf8c2ef5397 service nova] Acquiring lock "refresh_cache-1d0e4888-6f19-4515-80f6-e3b03427acce" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:06:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-51bf1baf-613d-4fd9-84cb-27a58e77b4a9 req-3baa4d55-07ce-4896-a53c-fbf8c2ef5397 service nova] Acquired lock "refresh_cache-1d0e4888-6f19-4515-80f6-e3b03427acce" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:06:01 user nova-compute[70924]: DEBUG nova.network.neutron [req-51bf1baf-613d-4fd9-84cb-27a58e77b4a9 req-3baa4d55-07ce-4896-a53c-fbf8c2ef5397 service nova] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] Refreshing network info cache for port c9d69516-6a60-4516-90cf-45529916012e {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 15:06:01 user nova-compute[70924]: DEBUG nova.network.neutron [req-51bf1baf-613d-4fd9-84cb-27a58e77b4a9 req-3baa4d55-07ce-4896-a53c-fbf8c2ef5397 service nova] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] Updated VIF entry in instance network info cache for port c9d69516-6a60-4516-90cf-45529916012e. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 15:06:01 user nova-compute[70924]: DEBUG nova.network.neutron [req-51bf1baf-613d-4fd9-84cb-27a58e77b4a9 req-3baa4d55-07ce-4896-a53c-fbf8c2ef5397 service nova] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] Updating instance_info_cache with network_info: [{"id": "c9d69516-6a60-4516-90cf-45529916012e", "address": "fa:16:3e:b4:5c:36", "network": {"id": "c19ed38b-2acd-421a-9e4b-f60df3db2f1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1812407562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a974cbbf734f51897c3e632ae9e45f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d69516-6a", "ovs_interfaceid": "c9d69516-6a60-4516-90cf-45529916012e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:06:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-51bf1baf-613d-4fd9-84cb-27a58e77b4a9 req-3baa4d55-07ce-4896-a53c-fbf8c2ef5397 service nova] Releasing lock "refresh_cache-1d0e4888-6f19-4515-80f6-e3b03427acce" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:06:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-3858fbbf-3178-4166-ba55-99fc22729542 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Acquiring lock "1d0e4888-6f19-4515-80f6-e3b03427acce" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:06:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-3858fbbf-3178-4166-ba55-99fc22729542 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "1d0e4888-6f19-4515-80f6-e3b03427acce" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:06:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-3858fbbf-3178-4166-ba55-99fc22729542 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Acquiring lock "1d0e4888-6f19-4515-80f6-e3b03427acce-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:06:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-3858fbbf-3178-4166-ba55-99fc22729542 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "1d0e4888-6f19-4515-80f6-e3b03427acce-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:06:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-3858fbbf-3178-4166-ba55-99fc22729542 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "1d0e4888-6f19-4515-80f6-e3b03427acce-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:06:02 user nova-compute[70924]: INFO nova.compute.manager [None req-3858fbbf-3178-4166-ba55-99fc22729542 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] Terminating instance
Jul 29 15:06:02 user nova-compute[70924]: DEBUG nova.compute.manager [None req-3858fbbf-3178-4166-ba55-99fc22729542 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] Start destroying the instance on the hypervisor. {{(pid=70924) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 15:06:02 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:06:02 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:06:02 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:06:02 user nova-compute[70924]: DEBUG nova.compute.manager [req-b484b98d-fb90-4d12-86ad-e4c584553be8 req-34f6df2d-44ec-4819-9f85-c127222080c7 service nova] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] Received event network-vif-unplugged-c9d69516-6a60-4516-90cf-45529916012e {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:06:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b484b98d-fb90-4d12-86ad-e4c584553be8 req-34f6df2d-44ec-4819-9f85-c127222080c7 service nova] Acquiring lock "1d0e4888-6f19-4515-80f6-e3b03427acce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:06:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b484b98d-fb90-4d12-86ad-e4c584553be8 req-34f6df2d-44ec-4819-9f85-c127222080c7 service nova] Lock "1d0e4888-6f19-4515-80f6-e3b03427acce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:06:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b484b98d-fb90-4d12-86ad-e4c584553be8 req-34f6df2d-44ec-4819-9f85-c127222080c7 service nova] Lock "1d0e4888-6f19-4515-80f6-e3b03427acce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:06:02 user nova-compute[70924]: DEBUG nova.compute.manager [req-b484b98d-fb90-4d12-86ad-e4c584553be8 req-34f6df2d-44ec-4819-9f85-c127222080c7 service nova] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] No waiting events found dispatching network-vif-unplugged-c9d69516-6a60-4516-90cf-45529916012e {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:06:02 user nova-compute[70924]: DEBUG nova.compute.manager [req-b484b98d-fb90-4d12-86ad-e4c584553be8 req-34f6df2d-44ec-4819-9f85-c127222080c7 service nova] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] Received event network-vif-unplugged-c9d69516-6a60-4516-90cf-45529916012e for instance with task_state deleting. {{(pid=70924) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 15:06:02 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:06:02 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:06:02 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:06:02 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] Instance destroyed successfully.
Jul 29 15:06:02 user nova-compute[70924]: DEBUG nova.objects.instance [None req-3858fbbf-3178-4166-ba55-99fc22729542 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lazy-loading 'resources' on Instance uuid 1d0e4888-6f19-4515-80f6-e3b03427acce {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:06:02 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-3858fbbf-3178-4166-ba55-99fc22729542 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T15:04:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1310743789',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1310743789',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1310743789',id=41,image_ref='492cc73f-a8a6-42b5-9d0b-e93dc192131d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKKNkcijznLKi8vfR4Oh280fKzMSzAP/YUTayX3pelPFYQ2TwZJ6GkfHEHFfcc21T4lHxm2wGJTd9OWUZd4vDbdv4/IbB5MB1m/0I6LD56PJ3m18Sq53FhHjttcKGm9DaA==',key_name='tempest-keypair-478487356',keypairs=<?>,launch_index=0,launched_at=2023-07-29T15:04:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='99a974cbbf734f51897c3e632ae9e45f',ramdisk_id='',reservation_id='r-nimf9v55',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1030839740',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1030839740-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1030839740',owner_user_name='tempest-TestVolumeBootPattern-1030839740-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T15:04:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='da204646e8f84693ad470ed1d3eadd7c',uuid=1d0e4888-6f19-4515-80f6-e3b03427acce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c9d69516-6a60-4516-90cf-45529916012e", "address": "fa:16:3e:b4:5c:36", "network": {"id": "c19ed38b-2acd-421a-9e4b-f60df3db2f1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1812407562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a974cbbf734f51897c3e632ae9e45f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d69516-6a", "ovs_interfaceid": "c9d69516-6a60-4516-90cf-45529916012e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 15:06:02 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-3858fbbf-3178-4166-ba55-99fc22729542 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Converting VIF {"id": "c9d69516-6a60-4516-90cf-45529916012e", "address": "fa:16:3e:b4:5c:36", "network": {"id": "c19ed38b-2acd-421a-9e4b-f60df3db2f1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1812407562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a974cbbf734f51897c3e632ae9e45f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d69516-6a", "ovs_interfaceid": "c9d69516-6a60-4516-90cf-45529916012e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 15:06:02 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-3858fbbf-3178-4166-ba55-99fc22729542 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:5c:36,bridge_name='br-int',has_traffic_filtering=True,id=c9d69516-6a60-4516-90cf-45529916012e,network=Network(c19ed38b-2acd-421a-9e4b-f60df3db2f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9d69516-6a') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 15:06:02 user nova-compute[70924]: DEBUG os_vif [None req-3858fbbf-3178-4166-ba55-99fc22729542 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:5c:36,bridge_name='br-int',has_traffic_filtering=True,id=c9d69516-6a60-4516-90cf-45529916012e,network=Network(c19ed38b-2acd-421a-9e4b-f60df3db2f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9d69516-6a') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 15:06:02 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:06:02 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc9d69516-6a, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:06:02 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:06:02 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:06:02 user nova-compute[70924]: INFO os_vif [None req-3858fbbf-3178-4166-ba55-99fc22729542 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:5c:36,bridge_name='br-int',has_traffic_filtering=True,id=c9d69516-6a60-4516-90cf-45529916012e,network=Network(c19ed38b-2acd-421a-9e4b-f60df3db2f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9d69516-6a')
Jul 29 15:06:02 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3858fbbf-3178-4166-ba55-99fc22729542 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] calling os-brick to detach iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 15:06:02 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-3858fbbf-3178-4166-ba55-99fc22729542 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, {'target_iqns': ['iqn.2010-10.org.openstack:478e6ec2-c325-4c53-b105-d94bb3bc9a28'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DlGdvAVt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 15:06:02 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-3858fbbf-3178-4166-ba55-99fc22729542 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 15:06:02 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-3858fbbf-3178-4166-ba55-99fc22729542 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 15:06:02 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-3858fbbf-3178-4166-ba55-99fc22729542 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 15:06:02 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-3858fbbf-3178-4166-ba55-99fc22729542 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:478e6ec2-c325-4c53-b105-d94bb3bc9a28', 0)] {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 15:06:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:06:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:06:02 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46a6f97-8fb1-40bd-9826-22dc67e482ce]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:478e6ec2-c325-4c53-b105-d94bb3bc9a28\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acf7212b-b549-46f5-9100-fd4ca336173a\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:06:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:06:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:06:02 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[484a0fdb-a608-4175-aa1a-4845a570404d]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acf7212b-b549-46f5-9100-fd4ca336173a (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:478e6ec2-c325-4c53-b105-d94bb3bc9a28 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:06:02 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-3858fbbf-3178-4166-ba55-99fc22729542 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acf7212b-b549-46f5-9100-fd4ca336173a (non-flash)
Jul 29 15:06:02 user nova-compute[70924]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:478e6ec2-c325-4c53-b105-d94bb3bc9a28 (non-flash)
Jul 29 15:06:02 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 15:06:02 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-3858fbbf-3178-4166-ba55-99fc22729542 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acf7212b-b549-46f5-9100-fd4ca336173a (non-flash)
Jul 29 15:06:02 user nova-compute[70924]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:478e6ec2-c325-4c53-b105-d94bb3bc9a28 (non-flash)
Jul 29 15:06:02 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 15:06:02 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-3858fbbf-3178-4166-ba55-99fc22729542 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feecc669c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:478e6ec2-c325-4c53-b105-d94bb3bc9a28'): ({'sdb'}, set())}) {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 15:06:02 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-3858fbbf-3178-4166-ba55-99fc22729542 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Removing single pathed devices sdb {{(pid=70924) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 15:06:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:06:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:06:02 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a734eaa-a666-4c85-8cc1-783b59a16a8c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:06:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:06:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:06:02 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3df4fc2-ae8c-4f20-af4d-30b0643d432d]: (4, ('ok\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:06:02 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-3858fbbf-3178-4166-ba55-99fc22729542 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Flushing IO for device /dev/sdb {{(pid=70924) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 15:06:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:06:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:06:02 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a0eece-f540-456b-9fd6-667d4af7ad49]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:06:02 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-3858fbbf-3178-4166-ba55-99fc22729542 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70924) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 15:06:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:06:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:06:02 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc89f29b-1239-4c1b-b732-413dc2fed250]: (4, ('1', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:06:02 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-3858fbbf-3178-4166-ba55-99fc22729542 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 15:06:02 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-3858fbbf-3178-4166-ba55-99fc22729542 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] SCSI volumes sdb have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 15:06:02 user nova-compute[70924]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23165313834353738', '/dev/disk/by-id/scsi-1SCST_BIO7dfc43d8-1e1845787396c213', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_7dfc43d8') {{(pid=81998) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 29 15:06:02 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a75ee2-6836-4f94-a3b0-5edae626e35a]: (4, None) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:06:02 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-3858fbbf-3178-4166-ba55-99fc22729542 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:478e6ec2-c325-4c53-b105-d94bb3bc9a28')] {{(pid=70924) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 15:06:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:478e6ec2-c325-4c53-b105-d94bb3bc9a28 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:06:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:478e6ec2-c325-4c53-b105-d94bb3bc9a28 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:06:03 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e99e917-96c1-481d-a31d-56694f62b6d0]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:06:03 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-3858fbbf-3178-4166-ba55-99fc22729542 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:06:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:478e6ec2-c325-4c53-b105-d94bb3bc9a28 -p 172.16.0.220:3260 --logout {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:06:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:478e6ec2-c325-4c53-b105-d94bb3bc9a28 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:06:03 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b157b21-fe8e-4666-860c-91492a27ff57]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:478e6ec2-c325-4c53-b105-d94bb3bc9a28, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:478e6ec2-c325-4c53-b105-d94bb3bc9a28, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:06:03 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-3858fbbf-3178-4166-ba55-99fc22729542 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:478e6ec2-c325-4c53-b105-d94bb3bc9a28, portal: 172.16.0.220,3260]
Jul 29 15:06:03 user nova-compute[70924]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:478e6ec2-c325-4c53-b105-d94bb3bc9a28, portal: 172.16.0.220,3260] successful.
Jul 29 15:06:03 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:06:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:478e6ec2-c325-4c53-b105-d94bb3bc9a28 -p 172.16.0.220:3260 --op delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:06:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:478e6ec2-c325-4c53-b105-d94bb3bc9a28 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:06:03 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d52d8b-f646-44c5-b296-e330e2475bbd]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:06:03 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-3858fbbf-3178-4166-ba55-99fc22729542 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:06:03 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-3858fbbf-3178-4166-ba55-99fc22729542 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 15:06:03 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-3858fbbf-3178-4166-ba55-99fc22729542 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] <== disconnect_volume: return (304ms) None {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 15:06:03 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3858fbbf-3178-4166-ba55-99fc22729542 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] Disconnected iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 15:06:03 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-3858fbbf-3178-4166-ba55-99fc22729542 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] Deleting instance files /opt/stack/data/nova/instances/1d0e4888-6f19-4515-80f6-e3b03427acce_del
Jul 29 15:06:03 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-3858fbbf-3178-4166-ba55-99fc22729542 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] Deletion of /opt/stack/data/nova/instances/1d0e4888-6f19-4515-80f6-e3b03427acce_del complete
Jul 29 15:06:03 user nova-compute[70924]: INFO nova.compute.manager [None req-3858fbbf-3178-4166-ba55-99fc22729542 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] Took 1.14 seconds to destroy the instance on the hypervisor.
Jul 29 15:06:03 user nova-compute[70924]: DEBUG oslo.service.loopingcall [None req-3858fbbf-3178-4166-ba55-99fc22729542 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70924) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 15:06:03 user nova-compute[70924]: DEBUG nova.compute.manager [-] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] Deallocating network for instance {{(pid=70924) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 15:06:03 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] deallocate_for_instance() {{(pid=70924) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 15:06:03 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:06:03 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] Took 0.81 seconds to deallocate network for instance.
Jul 29 15:06:04 user nova-compute[70924]: DEBUG nova.compute.manager [req-82b11652-72f3-4098-a0d8-727a4e30abc3 req-b2af91df-7905-4c58-8810-e806873c2466 service nova] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] Received event network-vif-deleted-c9d69516-6a60-4516-90cf-45529916012e {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:06:04 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:06:04 user nova-compute[70924]: DEBUG nova.compute.manager [req-46a158de-4e4d-4b20-9742-e6cf98ff5f52 req-56e94975-f56c-49f8-a2c9-b924012af49f service nova] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] Received event network-vif-plugged-c9d69516-6a60-4516-90cf-45529916012e {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:06:04 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-46a158de-4e4d-4b20-9742-e6cf98ff5f52 req-56e94975-f56c-49f8-a2c9-b924012af49f service nova] Acquiring lock "1d0e4888-6f19-4515-80f6-e3b03427acce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:06:04 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-46a158de-4e4d-4b20-9742-e6cf98ff5f52 req-56e94975-f56c-49f8-a2c9-b924012af49f service nova] Lock "1d0e4888-6f19-4515-80f6-e3b03427acce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:06:04 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-46a158de-4e4d-4b20-9742-e6cf98ff5f52 req-56e94975-f56c-49f8-a2c9-b924012af49f service nova] Lock "1d0e4888-6f19-4515-80f6-e3b03427acce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:06:04 user nova-compute[70924]: DEBUG nova.compute.manager [req-46a158de-4e4d-4b20-9742-e6cf98ff5f52 req-56e94975-f56c-49f8-a2c9-b924012af49f service nova] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] No waiting events found dispatching network-vif-plugged-c9d69516-6a60-4516-90cf-45529916012e {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:06:04 user nova-compute[70924]: WARNING nova.compute.manager [req-46a158de-4e4d-4b20-9742-e6cf98ff5f52 req-56e94975-f56c-49f8-a2c9-b924012af49f service nova] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] Received unexpected event network-vif-plugged-c9d69516-6a60-4516-90cf-45529916012e for instance with vm_state active and task_state deleting.
Jul 29 15:06:04 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:06:04 user nova-compute[70924]: INFO nova.compute.manager [None req-3858fbbf-3178-4166-ba55-99fc22729542 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] Took 0.79 seconds to detach 1 volumes for instance.
Jul 29 15:06:04 user nova-compute[70924]: DEBUG nova.compute.manager [None req-3858fbbf-3178-4166-ba55-99fc22729542 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] Deleting volume: 478e6ec2-c325-4c53-b105-d94bb3bc9a28 {{(pid=70924) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Jul 29 15:06:04 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-3858fbbf-3178-4166-ba55-99fc22729542 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:06:04 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-3858fbbf-3178-4166-ba55-99fc22729542 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:06:05 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-3858fbbf-3178-4166-ba55-99fc22729542 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:06:05 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-3858fbbf-3178-4166-ba55-99fc22729542 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:06:05 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-3858fbbf-3178-4166-ba55-99fc22729542 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.238s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:06:05 user nova-compute[70924]: INFO nova.scheduler.client.report [None req-3858fbbf-3178-4166-ba55-99fc22729542 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Deleted allocations for instance 1d0e4888-6f19-4515-80f6-e3b03427acce
Jul 29 15:06:05 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-3858fbbf-3178-4166-ba55-99fc22729542 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "1d0e4888-6f19-4515-80f6-e3b03427acce" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.214s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:06:05 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:06:06 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:06:06 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:06:06 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:06:06 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:06:06 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Auditing locally available compute resources for user (node: user) {{(pid=70924) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 15:06:06 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a8fe938-7ca4-4221-9742-9b043050ba84/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:06:06 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a8fe938-7ca4-4221-9742-9b043050ba84/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:06:06 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a8fe938-7ca4-4221-9742-9b043050ba84/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:06:06 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a8fe938-7ca4-4221-9742-9b043050ba84/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:06:06 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/751027e8-91d2-4374-94cb-f4a840d7f7be/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:06:06 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/751027e8-91d2-4374-94cb-f4a840d7f7be/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:06:06 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/751027e8-91d2-4374-94cb-f4a840d7f7be/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:06:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/751027e8-91d2-4374-94cb-f4a840d7f7be/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:06:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:06:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:06:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:06:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:06:07 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 15:06:07 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:06:07 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:06:07 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Hypervisor/Node resource view: name=user free_ram=8237MB free_disk=25.308135986328125GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70924) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 15:06:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:06:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:06:07 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:06:07 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 9ec07c62-951b-4e3a-bffa-e01dfb4665ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:06:07 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance e905081f-dfff-41ab-88b3-8cd91d01671d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:06:07 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 751027e8-91d2-4374-94cb-f4a840d7f7be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:06:07 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 0a8fe938-7ca4-4221-9742-9b043050ba84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:06:07 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 15:06:07 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 15:06:08 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:06:08 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:06:08 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Compute_service record updated for user:user {{(pid=70924) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 15:06:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.305s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:06:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:06:10 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:06:10 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:06:10 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70924) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 15:06:10 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:06:10 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Starting heal instance info cache {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 15:06:10 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Rebuilding the list of instances to heal {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 29 15:06:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "refresh_cache-9ec07c62-951b-4e3a-bffa-e01dfb4665ec" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:06:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquired lock "refresh_cache-9ec07c62-951b-4e3a-bffa-e01dfb4665ec" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:06:10 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Forcefully refreshing network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 29 15:06:10 user nova-compute[70924]: DEBUG nova.objects.instance [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lazy-loading 'info_cache' on Instance uuid 9ec07c62-951b-4e3a-bffa-e01dfb4665ec {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:06:11 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Updating instance_info_cache with network_info: [{"id": "cb01658e-4dd9-426e-9b45-340ea19db056", "address": "fa:16:3e:75:a4:24", "network": {"id": "b2aee530-d195-47bb-b39d-c8bd15b81a08", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-421022738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcf4644e7a24bf68b407be2e3d9732c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb01658e-4d", "ovs_interfaceid": "cb01658e-4dd9-426e-9b45-340ea19db056", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:06:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Releasing lock "refresh_cache-9ec07c62-951b-4e3a-bffa-e01dfb4665ec" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:06:11 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Updated the network info_cache for instance {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 29 15:06:12 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:06:15 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:06:17 user nova-compute[70924]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690643162.7514389, 1d0e4888-6f19-4515-80f6-e3b03427acce => Stopped> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 15:06:17 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] VM Stopped (Lifecycle Event)
Jul 29 15:06:17 user nova-compute[70924]: DEBUG nova.compute.manager [None req-e6d82967-db3e-4dd5-ab65-2666b96d225b None None] [instance: 1d0e4888-6f19-4515-80f6-e3b03427acce] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:06:17 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:06:22 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:06:26 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5f966345-bd55-4abc-a57f-43e69bf5e681 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Acquiring lock "9ec07c62-951b-4e3a-bffa-e01dfb4665ec" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:06:26 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5f966345-bd55-4abc-a57f-43e69bf5e681 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "9ec07c62-951b-4e3a-bffa-e01dfb4665ec" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:06:26 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5f966345-bd55-4abc-a57f-43e69bf5e681 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Acquiring lock "9ec07c62-951b-4e3a-bffa-e01dfb4665ec-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:06:26 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5f966345-bd55-4abc-a57f-43e69bf5e681 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "9ec07c62-951b-4e3a-bffa-e01dfb4665ec-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:06:26 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5f966345-bd55-4abc-a57f-43e69bf5e681 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "9ec07c62-951b-4e3a-bffa-e01dfb4665ec-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:06:26 user nova-compute[70924]: INFO nova.compute.manager [None req-5f966345-bd55-4abc-a57f-43e69bf5e681 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Terminating instance
Jul 29 15:06:26 user nova-compute[70924]: DEBUG nova.compute.manager [None req-5f966345-bd55-4abc-a57f-43e69bf5e681 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Start destroying the instance on the hypervisor. {{(pid=70924) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 15:06:26 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:06:26 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:06:26 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:06:26 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:06:26 user nova-compute[70924]: DEBUG nova.compute.manager [req-4e1ddbb6-d723-46c8-ab64-ef03807e8186 req-3285e927-2763-4f0d-884f-824c55ab6c67 service nova] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Received event network-vif-unplugged-cb01658e-4dd9-426e-9b45-340ea19db056 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:06:26 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-4e1ddbb6-d723-46c8-ab64-ef03807e8186 req-3285e927-2763-4f0d-884f-824c55ab6c67 service nova] Acquiring lock "9ec07c62-951b-4e3a-bffa-e01dfb4665ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:06:26 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-4e1ddbb6-d723-46c8-ab64-ef03807e8186 req-3285e927-2763-4f0d-884f-824c55ab6c67 service nova] Lock "9ec07c62-951b-4e3a-bffa-e01dfb4665ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:06:26 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-4e1ddbb6-d723-46c8-ab64-ef03807e8186 req-3285e927-2763-4f0d-884f-824c55ab6c67 service nova] Lock "9ec07c62-951b-4e3a-bffa-e01dfb4665ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:06:26 user nova-compute[70924]: DEBUG nova.compute.manager [req-4e1ddbb6-d723-46c8-ab64-ef03807e8186 req-3285e927-2763-4f0d-884f-824c55ab6c67 service nova] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] No waiting events found dispatching network-vif-unplugged-cb01658e-4dd9-426e-9b45-340ea19db056 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:06:26 user nova-compute[70924]: DEBUG nova.compute.manager [req-4e1ddbb6-d723-46c8-ab64-ef03807e8186 req-3285e927-2763-4f0d-884f-824c55ab6c67 service nova] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Received event network-vif-unplugged-cb01658e-4dd9-426e-9b45-340ea19db056 for instance with task_state deleting. {{(pid=70924) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 15:06:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:06:27 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Instance destroyed successfully.
Jul 29 15:06:27 user nova-compute[70924]: DEBUG nova.objects.instance [None req-5f966345-bd55-4abc-a57f-43e69bf5e681 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lazy-loading 'resources' on Instance uuid 9ec07c62-951b-4e3a-bffa-e01dfb4665ec {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:06:27 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-5f966345-bd55-4abc-a57f-43e69bf5e681 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:49:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-399297785',display_name='tempest-ServerRescueNegativeTestJSON-server-399297785',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-399297785',id=24,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:54:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8fcf4644e7a24bf68b407be2e3d9732c',ramdisk_id='',reservation_id='r-nfbumwrt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1436708078',owner_user_name='tempest-ServerRescueNegativeTestJSON-1436708078-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:56:06Z,user_data=None,user_id='8ec7e735cfff48828e0c0c7618f50711',uuid=9ec07c62-951b-4e3a-bffa-e01dfb4665ec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb01658e-4dd9-426e-9b45-340ea19db056", "address": "fa:16:3e:75:a4:24", "network": {"id": "b2aee530-d195-47bb-b39d-c8bd15b81a08", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-421022738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcf4644e7a24bf68b407be2e3d9732c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb01658e-4d", "ovs_interfaceid": "cb01658e-4dd9-426e-9b45-340ea19db056", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 15:06:27 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-5f966345-bd55-4abc-a57f-43e69bf5e681 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Converting VIF {"id": "cb01658e-4dd9-426e-9b45-340ea19db056", "address": "fa:16:3e:75:a4:24", "network": {"id": "b2aee530-d195-47bb-b39d-c8bd15b81a08", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-421022738-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcf4644e7a24bf68b407be2e3d9732c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb01658e-4d", "ovs_interfaceid": "cb01658e-4dd9-426e-9b45-340ea19db056", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 15:06:27 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-5f966345-bd55-4abc-a57f-43e69bf5e681 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:75:a4:24,bridge_name='br-int',has_traffic_filtering=True,id=cb01658e-4dd9-426e-9b45-340ea19db056,network=Network(b2aee530-d195-47bb-b39d-c8bd15b81a08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb01658e-4d') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 15:06:27 user nova-compute[70924]: DEBUG os_vif [None req-5f966345-bd55-4abc-a57f-43e69bf5e681 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:a4:24,bridge_name='br-int',has_traffic_filtering=True,id=cb01658e-4dd9-426e-9b45-340ea19db056,network=Network(b2aee530-d195-47bb-b39d-c8bd15b81a08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb01658e-4d') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 15:06:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:06:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcb01658e-4d, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:06:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:06:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:06:27 user nova-compute[70924]: INFO os_vif [None req-5f966345-bd55-4abc-a57f-43e69bf5e681 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:a4:24,bridge_name='br-int',has_traffic_filtering=True,id=cb01658e-4dd9-426e-9b45-340ea19db056,network=Network(b2aee530-d195-47bb-b39d-c8bd15b81a08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb01658e-4d')
Jul 29 15:06:27 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-5f966345-bd55-4abc-a57f-43e69bf5e681 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Deleting instance files /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec_del
Jul 29 15:06:27 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-5f966345-bd55-4abc-a57f-43e69bf5e681 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Deletion of /opt/stack/data/nova/instances/9ec07c62-951b-4e3a-bffa-e01dfb4665ec_del complete
Jul 29 15:06:27 user nova-compute[70924]: INFO nova.compute.manager [None req-5f966345-bd55-4abc-a57f-43e69bf5e681 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Took 0.88 seconds to destroy the instance on the hypervisor.
Jul 29 15:06:27 user nova-compute[70924]: DEBUG oslo.service.loopingcall [None req-5f966345-bd55-4abc-a57f-43e69bf5e681 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70924) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 15:06:27 user nova-compute[70924]: DEBUG nova.compute.manager [-] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Deallocating network for instance {{(pid=70924) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 15:06:27 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] deallocate_for_instance() {{(pid=70924) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 15:06:27 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:06:27 user nova-compute[70924]: DEBUG nova.compute.manager [req-25beccb7-f33f-4829-ac0f-91e1ec0f6a1d req-bb4db311-741d-45eb-872d-93336c62e000 service nova] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Received event network-vif-deleted-cb01658e-4dd9-426e-9b45-340ea19db056 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:06:27 user nova-compute[70924]: INFO nova.compute.manager [req-25beccb7-f33f-4829-ac0f-91e1ec0f6a1d req-bb4db311-741d-45eb-872d-93336c62e000 service nova] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Neutron deleted interface cb01658e-4dd9-426e-9b45-340ea19db056; detaching it from the instance and deleting it from the info cache
Jul 29 15:06:27 user nova-compute[70924]: DEBUG nova.network.neutron [req-25beccb7-f33f-4829-ac0f-91e1ec0f6a1d req-bb4db311-741d-45eb-872d-93336c62e000 service nova] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:06:27 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Took 0.50 seconds to deallocate network for instance.
Jul 29 15:06:27 user nova-compute[70924]: DEBUG nova.compute.manager [req-25beccb7-f33f-4829-ac0f-91e1ec0f6a1d req-bb4db311-741d-45eb-872d-93336c62e000 service nova] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Detach interface failed, port_id=cb01658e-4dd9-426e-9b45-340ea19db056, reason: Instance 9ec07c62-951b-4e3a-bffa-e01dfb4665ec could not be found. {{(pid=70924) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 29 15:06:27 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5f966345-bd55-4abc-a57f-43e69bf5e681 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:06:27 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5f966345-bd55-4abc-a57f-43e69bf5e681 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:06:28 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-5f966345-bd55-4abc-a57f-43e69bf5e681 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:06:28 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-5f966345-bd55-4abc-a57f-43e69bf5e681 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:06:28 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5f966345-bd55-4abc-a57f-43e69bf5e681 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.179s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:06:28 user nova-compute[70924]: INFO nova.scheduler.client.report [None req-5f966345-bd55-4abc-a57f-43e69bf5e681 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Deleted allocations for instance 9ec07c62-951b-4e3a-bffa-e01dfb4665ec
Jul 29 15:06:28 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5f966345-bd55-4abc-a57f-43e69bf5e681 tempest-ServerRescueNegativeTestJSON-1436708078 tempest-ServerRescueNegativeTestJSON-1436708078-project-member] Lock "9ec07c62-951b-4e3a-bffa-e01dfb4665ec" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.777s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:06:28 user nova-compute[70924]: DEBUG nova.compute.manager [req-d395e89a-ff6f-45b5-972e-abf26b2ddd96 req-9a06e73e-f4ac-4e2e-b736-19393b010c2f service nova] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Received event network-vif-plugged-cb01658e-4dd9-426e-9b45-340ea19db056 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:06:28 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-d395e89a-ff6f-45b5-972e-abf26b2ddd96 req-9a06e73e-f4ac-4e2e-b736-19393b010c2f service nova] Acquiring lock "9ec07c62-951b-4e3a-bffa-e01dfb4665ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:06:28 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-d395e89a-ff6f-45b5-972e-abf26b2ddd96 req-9a06e73e-f4ac-4e2e-b736-19393b010c2f service nova] Lock "9ec07c62-951b-4e3a-bffa-e01dfb4665ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:06:28 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-d395e89a-ff6f-45b5-972e-abf26b2ddd96 req-9a06e73e-f4ac-4e2e-b736-19393b010c2f service nova] Lock "9ec07c62-951b-4e3a-bffa-e01dfb4665ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:06:28 user nova-compute[70924]: DEBUG nova.compute.manager [req-d395e89a-ff6f-45b5-972e-abf26b2ddd96 req-9a06e73e-f4ac-4e2e-b736-19393b010c2f service nova] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] No waiting events found dispatching network-vif-plugged-cb01658e-4dd9-426e-9b45-340ea19db056 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:06:28 user nova-compute[70924]: WARNING nova.compute.manager [req-d395e89a-ff6f-45b5-972e-abf26b2ddd96 req-9a06e73e-f4ac-4e2e-b736-19393b010c2f service nova] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Received unexpected event network-vif-plugged-cb01658e-4dd9-426e-9b45-340ea19db056 for instance with vm_state deleted and task_state None.
Jul 29 15:06:32 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:06:37 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:06:42 user nova-compute[70924]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690643187.2559443, 9ec07c62-951b-4e3a-bffa-e01dfb4665ec => Stopped> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 15:06:42 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] VM Stopped (Lifecycle Event)
Jul 29 15:06:42 user nova-compute[70924]: DEBUG nova.compute.manager [None req-77b55e6a-3648-4b54-bbc1-e0774d0033ec None None] [instance: 9ec07c62-951b-4e3a-bffa-e01dfb4665ec] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:06:42 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:06:42 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:06:42 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70924) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 29 15:06:42 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70924) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 15:06:42 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70924) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 15:06:42 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:06:47 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:06:51 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:06:52 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:06:52 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:06:52 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70924) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 29 15:06:52 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70924) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 15:06:52 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70924) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 15:06:52 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:06:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a69867fe-dfa4-4c3d-b442-0f1b79178961 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Acquiring lock "e905081f-dfff-41ab-88b3-8cd91d01671d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:06:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a69867fe-dfa4-4c3d-b442-0f1b79178961 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "e905081f-dfff-41ab-88b3-8cd91d01671d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:06:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a69867fe-dfa4-4c3d-b442-0f1b79178961 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Acquiring lock "e905081f-dfff-41ab-88b3-8cd91d01671d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:06:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a69867fe-dfa4-4c3d-b442-0f1b79178961 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "e905081f-dfff-41ab-88b3-8cd91d01671d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:06:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a69867fe-dfa4-4c3d-b442-0f1b79178961 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "e905081f-dfff-41ab-88b3-8cd91d01671d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:06:55 user nova-compute[70924]: INFO nova.compute.manager [None req-a69867fe-dfa4-4c3d-b442-0f1b79178961 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] Terminating instance
Jul 29 15:06:55 user nova-compute[70924]: DEBUG nova.compute.manager [None req-a69867fe-dfa4-4c3d-b442-0f1b79178961 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] Start destroying the instance on the hypervisor. {{(pid=70924) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 15:06:55 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:06:55 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:06:55 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:06:55 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:06:55 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:06:56 user nova-compute[70924]: DEBUG nova.compute.manager [req-3f70d286-c1db-4fc8-bd66-2d9faa12426d req-ee238994-3f08-4fc0-b7f2-72b626b0b27c service nova] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] Received event network-vif-unplugged-6e00390b-efbf-4b94-9709-d1427afd0854 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:06:56 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-3f70d286-c1db-4fc8-bd66-2d9faa12426d req-ee238994-3f08-4fc0-b7f2-72b626b0b27c service nova] Acquiring lock "e905081f-dfff-41ab-88b3-8cd91d01671d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:06:56 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-3f70d286-c1db-4fc8-bd66-2d9faa12426d req-ee238994-3f08-4fc0-b7f2-72b626b0b27c service nova] Lock "e905081f-dfff-41ab-88b3-8cd91d01671d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:06:56 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-3f70d286-c1db-4fc8-bd66-2d9faa12426d req-ee238994-3f08-4fc0-b7f2-72b626b0b27c service nova] Lock "e905081f-dfff-41ab-88b3-8cd91d01671d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:06:56 user nova-compute[70924]: DEBUG nova.compute.manager [req-3f70d286-c1db-4fc8-bd66-2d9faa12426d req-ee238994-3f08-4fc0-b7f2-72b626b0b27c service nova] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] No waiting events found dispatching network-vif-unplugged-6e00390b-efbf-4b94-9709-d1427afd0854 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:06:56 user nova-compute[70924]: DEBUG nova.compute.manager [req-3f70d286-c1db-4fc8-bd66-2d9faa12426d req-ee238994-3f08-4fc0-b7f2-72b626b0b27c service nova] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] Received event network-vif-unplugged-6e00390b-efbf-4b94-9709-d1427afd0854 for instance with task_state deleting. {{(pid=70924) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 15:06:56 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] Instance destroyed successfully.
Jul 29 15:06:56 user nova-compute[70924]: DEBUG nova.objects.instance [None req-a69867fe-dfa4-4c3d-b442-0f1b79178961 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lazy-loading 'resources' on Instance uuid e905081f-dfff-41ab-88b3-8cd91d01671d {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:06:56 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-a69867fe-dfa4-4c3d-b442-0f1b79178961 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T15:02:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-669052453',display_name='tempest-TestVolumeBootPattern-volume-backed-server-669052453',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-669052453',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOsLqIdnBbcW149s2Cgb3NiPTizk+X228iVG4DiQuLfIGCV5bXm09FSe2PTjgun4AgNlorX3vx8DALtaGfPo4uqusBo7yXutwGgEKJk2VxSN0T5dbWj+E7cSXaa27WUaIg==',key_name='tempest-keypair-786800977',keypairs=<?>,launch_index=0,launched_at=2023-07-29T15:02:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='99a974cbbf734f51897c3e632ae9e45f',ramdisk_id='',reservation_id='r-0fa1ijy8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1030839740',owner_user_name='tempest-TestVolumeBootPattern-1030839740-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T15:02:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='da204646e8f84693ad470ed1d3eadd7c',uuid=e905081f-dfff-41ab-88b3-8cd91d01671d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6e00390b-efbf-4b94-9709-d1427afd0854", "address": "fa:16:3e:76:51:ad", "network": {"id": "c19ed38b-2acd-421a-9e4b-f60df3db2f1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1812407562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a974cbbf734f51897c3e632ae9e45f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e00390b-ef", "ovs_interfaceid": "6e00390b-efbf-4b94-9709-d1427afd0854", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 15:06:56 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-a69867fe-dfa4-4c3d-b442-0f1b79178961 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Converting VIF {"id": "6e00390b-efbf-4b94-9709-d1427afd0854", "address": "fa:16:3e:76:51:ad", "network": {"id": "c19ed38b-2acd-421a-9e4b-f60df3db2f1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1812407562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a974cbbf734f51897c3e632ae9e45f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e00390b-ef", "ovs_interfaceid": "6e00390b-efbf-4b94-9709-d1427afd0854", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 15:06:56 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-a69867fe-dfa4-4c3d-b442-0f1b79178961 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:51:ad,bridge_name='br-int',has_traffic_filtering=True,id=6e00390b-efbf-4b94-9709-d1427afd0854,network=Network(c19ed38b-2acd-421a-9e4b-f60df3db2f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e00390b-ef') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 15:06:56 user nova-compute[70924]: DEBUG os_vif [None req-a69867fe-dfa4-4c3d-b442-0f1b79178961 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:51:ad,bridge_name='br-int',has_traffic_filtering=True,id=6e00390b-efbf-4b94-9709-d1427afd0854,network=Network(c19ed38b-2acd-421a-9e4b-f60df3db2f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e00390b-ef') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 15:06:56 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:06:56 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6e00390b-ef, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:06:56 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:06:56 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:06:56 user nova-compute[70924]: INFO os_vif [None req-a69867fe-dfa4-4c3d-b442-0f1b79178961 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:51:ad,bridge_name='br-int',has_traffic_filtering=True,id=6e00390b-efbf-4b94-9709-d1427afd0854,network=Network(c19ed38b-2acd-421a-9e4b-f60df3db2f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e00390b-ef')
Jul 29 15:06:56 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a69867fe-dfa4-4c3d-b442-0f1b79178961 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] calling os-brick to detach iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 15:06:56 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69867fe-dfa4-4c3d-b442-0f1b79178961 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, {'target_iqns': ['iqn.2010-10.org.openstack:acf7212b-b549-46f5-9100-fd4ca336173a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RuNZCaGw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 15:06:56 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-a69867fe-dfa4-4c3d-b442-0f1b79178961 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 15:06:56 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-a69867fe-dfa4-4c3d-b442-0f1b79178961 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 15:06:56 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-a69867fe-dfa4-4c3d-b442-0f1b79178961 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 15:06:56 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69867fe-dfa4-4c3d-b442-0f1b79178961 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:acf7212b-b549-46f5-9100-fd4ca336173a', 0)] {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 15:06:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:06:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:06:56 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a6bcd4-0c3f-4329-adc1-c99adb879c19]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acf7212b-b549-46f5-9100-fd4ca336173a\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:06:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:06:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:06:56 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[09718e25-3db5-41d7-b61e-c7753c00c29b]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acf7212b-b549-46f5-9100-fd4ca336173a (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:06:56 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69867fe-dfa4-4c3d-b442-0f1b79178961 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acf7212b-b549-46f5-9100-fd4ca336173a (non-flash)
Jul 29 15:06:56 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 15:06:56 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69867fe-dfa4-4c3d-b442-0f1b79178961 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acf7212b-b549-46f5-9100-fd4ca336173a (non-flash)
Jul 29 15:06:56 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 15:06:56 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69867fe-dfa4-4c3d-b442-0f1b79178961 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feecc37b640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:acf7212b-b549-46f5-9100-fd4ca336173a'): ({'sde'}, set())}) {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 15:06:56 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-a69867fe-dfa4-4c3d-b442-0f1b79178961 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Removing single pathed devices sde {{(pid=70924) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 15:06:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:06:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:06:56 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1253301b-eea1-4fb6-8550-e38b94d08451]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:06:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:06:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:06:56 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[484b598f-fe93-409d-8381-e8e86d981fe0]: (4, ('ok\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:06:56 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-a69867fe-dfa4-4c3d-b442-0f1b79178961 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Flushing IO for device /dev/sde {{(pid=70924) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 15:06:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:06:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:06:56 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6b22c6-6d9e-45ef-9b1c-79887cb11a9b]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:06:56 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-a69867fe-dfa4-4c3d-b442-0f1b79178961 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70924) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 15:06:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:06:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.052s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:06:56 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3745258-fcea-486f-96bd-6706974e8dc0]: (4, ('1', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:06:56 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-a69867fe-dfa4-4c3d-b442-0f1b79178961 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 15:06:56 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-a69867fe-dfa4-4c3d-b442-0f1b79178961 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] SCSI volumes sde have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 15:06:56 user nova-compute[70924]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO36b966c-6a60cf24538ad0ac', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_36b966c', '/dev/disk/by-id/scsi-23661363063663234') {{(pid=81998) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 29 15:06:56 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7368dea-7708-40b0-b8a2-12a12fcb3d48]: (4, None) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:06:56 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69867fe-dfa4-4c3d-b442-0f1b79178961 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:acf7212b-b549-46f5-9100-fd4ca336173a')] {{(pid=70924) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 15:06:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acf7212b-b549-46f5-9100-fd4ca336173a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:06:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acf7212b-b549-46f5-9100-fd4ca336173a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:06:56 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9432a844-f99e-4aa6-908a-5ed23d14bf2d]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:06:56 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69867fe-dfa4-4c3d-b442-0f1b79178961 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:06:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acf7212b-b549-46f5-9100-fd4ca336173a -p 172.16.0.220:3260 --logout {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:06:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acf7212b-b549-46f5-9100-fd4ca336173a -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:06:56 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[8184d3a7-2f51-4460-83a9-2de4c60d048a]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:acf7212b-b549-46f5-9100-fd4ca336173a, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:acf7212b-b549-46f5-9100-fd4ca336173a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:06:56 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69867fe-dfa4-4c3d-b442-0f1b79178961 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:acf7212b-b549-46f5-9100-fd4ca336173a, portal: 172.16.0.220,3260]
Jul 29 15:06:56 user nova-compute[70924]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:acf7212b-b549-46f5-9100-fd4ca336173a, portal: 172.16.0.220,3260] successful.
Jul 29 15:06:56 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:06:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acf7212b-b549-46f5-9100-fd4ca336173a -p 172.16.0.220:3260 --op delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:06:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acf7212b-b549-46f5-9100-fd4ca336173a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:06:56 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24bcb4d-2380-49f1-a7ab-07bea49d3fa4]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:06:56 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69867fe-dfa4-4c3d-b442-0f1b79178961 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:06:56 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-a69867fe-dfa4-4c3d-b442-0f1b79178961 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 15:06:56 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69867fe-dfa4-4c3d-b442-0f1b79178961 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] <== disconnect_volume: return (295ms) None {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 15:06:56 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a69867fe-dfa4-4c3d-b442-0f1b79178961 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] Disconnected iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 15:06:56 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-a69867fe-dfa4-4c3d-b442-0f1b79178961 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] Deleting instance files /opt/stack/data/nova/instances/e905081f-dfff-41ab-88b3-8cd91d01671d_del
Jul 29 15:06:56 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-a69867fe-dfa4-4c3d-b442-0f1b79178961 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] Deletion of /opt/stack/data/nova/instances/e905081f-dfff-41ab-88b3-8cd91d01671d_del complete
Jul 29 15:06:56 user nova-compute[70924]: INFO nova.compute.manager [None req-a69867fe-dfa4-4c3d-b442-0f1b79178961 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] Took 1.14 seconds to destroy the instance on the hypervisor.
Jul 29 15:06:56 user nova-compute[70924]: DEBUG oslo.service.loopingcall [None req-a69867fe-dfa4-4c3d-b442-0f1b79178961 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70924) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 15:06:56 user nova-compute[70924]: DEBUG nova.compute.manager [-] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] Deallocating network for instance {{(pid=70924) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 15:06:56 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] deallocate_for_instance() {{(pid=70924) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 15:06:57 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:06:57 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] Took 0.85 seconds to deallocate network for instance.
Jul 29 15:06:58 user nova-compute[70924]: DEBUG nova.compute.manager [req-155f67f2-9734-4fb2-84e5-f67a4b11329f req-fa8a9b4e-f383-4ca1-b65a-219af0ccf1f4 service nova] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] Received event network-vif-plugged-6e00390b-efbf-4b94-9709-d1427afd0854 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:06:58 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-155f67f2-9734-4fb2-84e5-f67a4b11329f req-fa8a9b4e-f383-4ca1-b65a-219af0ccf1f4 service nova] Acquiring lock "e905081f-dfff-41ab-88b3-8cd91d01671d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:06:58 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-155f67f2-9734-4fb2-84e5-f67a4b11329f req-fa8a9b4e-f383-4ca1-b65a-219af0ccf1f4 service nova] Lock "e905081f-dfff-41ab-88b3-8cd91d01671d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:06:58 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-155f67f2-9734-4fb2-84e5-f67a4b11329f req-fa8a9b4e-f383-4ca1-b65a-219af0ccf1f4 service nova] Lock "e905081f-dfff-41ab-88b3-8cd91d01671d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:06:58 user nova-compute[70924]: DEBUG nova.compute.manager [req-155f67f2-9734-4fb2-84e5-f67a4b11329f req-fa8a9b4e-f383-4ca1-b65a-219af0ccf1f4 service nova] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] No waiting events found dispatching network-vif-plugged-6e00390b-efbf-4b94-9709-d1427afd0854 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:06:58 user nova-compute[70924]: WARNING nova.compute.manager [req-155f67f2-9734-4fb2-84e5-f67a4b11329f req-fa8a9b4e-f383-4ca1-b65a-219af0ccf1f4 service nova] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] Received unexpected event network-vif-plugged-6e00390b-efbf-4b94-9709-d1427afd0854 for instance with vm_state active and task_state deleting.
Jul 29 15:06:58 user nova-compute[70924]: DEBUG nova.compute.manager [req-155f67f2-9734-4fb2-84e5-f67a4b11329f req-fa8a9b4e-f383-4ca1-b65a-219af0ccf1f4 service nova] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] Received event network-vif-deleted-6e00390b-efbf-4b94-9709-d1427afd0854 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:06:58 user nova-compute[70924]: INFO nova.compute.manager [None req-a69867fe-dfa4-4c3d-b442-0f1b79178961 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] Took 0.72 seconds to detach 1 volumes for instance.
Jul 29 15:06:58 user nova-compute[70924]: DEBUG nova.compute.manager [None req-a69867fe-dfa4-4c3d-b442-0f1b79178961 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] Deleting volume: acf7212b-b549-46f5-9100-fd4ca336173a {{(pid=70924) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Jul 29 15:06:58 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a69867fe-dfa4-4c3d-b442-0f1b79178961 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:06:58 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a69867fe-dfa4-4c3d-b442-0f1b79178961 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:06:58 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-a69867fe-dfa4-4c3d-b442-0f1b79178961 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:06:58 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-a69867fe-dfa4-4c3d-b442-0f1b79178961 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:06:58 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a69867fe-dfa4-4c3d-b442-0f1b79178961 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.157s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:06:58 user nova-compute[70924]: INFO nova.scheduler.client.report [None req-a69867fe-dfa4-4c3d-b442-0f1b79178961 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Deleted allocations for instance e905081f-dfff-41ab-88b3-8cd91d01671d
Jul 29 15:06:58 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a69867fe-dfa4-4c3d-b442-0f1b79178961 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "e905081f-dfff-41ab-88b3-8cd91d01671d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.107s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:06:59 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:06:59 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Cleaning up deleted instances {{(pid=70924) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 29 15:06:59 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] There are 0 instances to clean {{(pid=70924) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 29 15:07:01 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:07:02 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:07:03 user nova-compute[70924]: DEBUG nova.compute.manager [req-647c9dc9-955e-47d3-a533-ec7662a65c05 req-de7a3063-7b11-4830-b240-1c8970261d88 service nova] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Received event network-changed-b5f58bd0-1ebf-476d-8c8d-2345228572b2 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:07:03 user nova-compute[70924]: DEBUG nova.compute.manager [req-647c9dc9-955e-47d3-a533-ec7662a65c05 req-de7a3063-7b11-4830-b240-1c8970261d88 service nova] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Refreshing instance network info cache due to event network-changed-b5f58bd0-1ebf-476d-8c8d-2345228572b2. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 15:07:03 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-647c9dc9-955e-47d3-a533-ec7662a65c05 req-de7a3063-7b11-4830-b240-1c8970261d88 service nova] Acquiring lock "refresh_cache-751027e8-91d2-4374-94cb-f4a840d7f7be" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:07:03 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-647c9dc9-955e-47d3-a533-ec7662a65c05 req-de7a3063-7b11-4830-b240-1c8970261d88 service nova] Acquired lock "refresh_cache-751027e8-91d2-4374-94cb-f4a840d7f7be" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:07:03 user nova-compute[70924]: DEBUG nova.network.neutron [req-647c9dc9-955e-47d3-a533-ec7662a65c05 req-de7a3063-7b11-4830-b240-1c8970261d88 service nova] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Refreshing network info cache for port b5f58bd0-1ebf-476d-8c8d-2345228572b2 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 15:07:03 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:07:03 user nova-compute[70924]: DEBUG nova.network.neutron [req-647c9dc9-955e-47d3-a533-ec7662a65c05 req-de7a3063-7b11-4830-b240-1c8970261d88 service nova] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Updated VIF entry in instance network info cache for port b5f58bd0-1ebf-476d-8c8d-2345228572b2. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 15:07:03 user nova-compute[70924]: DEBUG nova.network.neutron [req-647c9dc9-955e-47d3-a533-ec7662a65c05 req-de7a3063-7b11-4830-b240-1c8970261d88 service nova] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Updating instance_info_cache with network_info: [{"id": "b5f58bd0-1ebf-476d-8c8d-2345228572b2", "address": "fa:16:3e:fc:c7:7d", "network": {"id": "f80826fa-fada-45b9-b969-fd539fd34fd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-465377443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9aadc9385b3b46eebc6e0d81814521af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f58bd0-1e", "ovs_interfaceid": "b5f58bd0-1ebf-476d-8c8d-2345228572b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:07:03 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-647c9dc9-955e-47d3-a533-ec7662a65c05 req-de7a3063-7b11-4830-b240-1c8970261d88 service nova] Releasing lock "refresh_cache-751027e8-91d2-4374-94cb-f4a840d7f7be" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:07:04 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:07:04 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:07:05 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:07:06 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:07:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:07:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-f3aa014f-c4d2-40b6-bfab-3aded731987f tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Acquiring lock "751027e8-91d2-4374-94cb-f4a840d7f7be" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:07:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-f3aa014f-c4d2-40b6-bfab-3aded731987f tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "751027e8-91d2-4374-94cb-f4a840d7f7be" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:07:08 user nova-compute[70924]: DEBUG nova.objects.instance [None req-f3aa014f-c4d2-40b6-bfab-3aded731987f tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lazy-loading 'flavor' on Instance uuid 751027e8-91d2-4374-94cb-f4a840d7f7be {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:07:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-f3aa014f-c4d2-40b6-bfab-3aded731987f tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "751027e8-91d2-4374-94cb-f4a840d7f7be" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:07:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-f3aa014f-c4d2-40b6-bfab-3aded731987f tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Acquiring lock "751027e8-91d2-4374-94cb-f4a840d7f7be" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:07:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-f3aa014f-c4d2-40b6-bfab-3aded731987f tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "751027e8-91d2-4374-94cb-f4a840d7f7be" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:07:08 user nova-compute[70924]: INFO nova.compute.manager [None req-f3aa014f-c4d2-40b6-bfab-3aded731987f tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Attaching volume 042213d2-6ca7-4274-8350-50678d3eb724 to /dev/vdb
Jul 29 15:07:08 user nova-compute[70924]: DEBUG os_brick.utils [None req-f3aa014f-c4d2-40b6-bfab-3aded731987f tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 15:07:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:07:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:07:08 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a59dea-e2a4-4af4-b457-86e37500a7fa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f2127c4a30d9\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:07:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:07:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:07:08 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bac0e24-f328-4bc2-afe5-e043fe9748ba]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:07:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:07:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:07:08 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a20374a-4640-44de-afb2-9feb86a2a1fb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:07:08 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a8006b-866a-42b3-b476-95a420d3226d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:07:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-f3aa014f-c4d2-40b6-bfab-3aded731987f tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Running cmd (subprocess): nvme version {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:07:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-f3aa014f-c4d2-40b6-bfab-3aded731987f tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] 'nvme version' failed. Not Retrying. {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 15:07:08 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:07:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f3aa014f-c4d2-40b6-bfab-3aded731987f tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] nvme not present on system {{(pid=70924) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 15:07:08 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:07:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:07:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 15:07:08 user nova-compute[70924]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 15:07:08 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9bd6ac-745a-471d-8e2b-49aac8994417]: (4, '') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:07:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-f3aa014f-c4d2-40b6-bfab-3aded731987f tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70924) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 15:07:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-f3aa014f-c4d2-40b6-bfab-3aded731987f tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 15:07:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-f3aa014f-c4d2-40b6-bfab-3aded731987f tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] LIGHTOS: no hostnqn found. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 15:07:08 user nova-compute[70924]: DEBUG os_brick.utils [None req-f3aa014f-c4d2-40b6-bfab-3aded731987f tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f2127c4a30d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 15:07:08 user nova-compute[70924]: DEBUG nova.virt.block_device [None req-f3aa014f-c4d2-40b6-bfab-3aded731987f tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Updating existing volume attachment record: 2b6d4559-8727-4fd5-bd4e-9e08735be716 {{(pid=70924) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 15:07:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:07:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:07:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:07:08 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Auditing locally available compute resources for user (node: user) {{(pid=70924) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 15:07:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/751027e8-91d2-4374-94cb-f4a840d7f7be/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:07:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/751027e8-91d2-4374-94cb-f4a840d7f7be/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:07:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/751027e8-91d2-4374-94cb-f4a840d7f7be/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:07:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/751027e8-91d2-4374-94cb-f4a840d7f7be/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:07:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a8fe938-7ca4-4221-9742-9b043050ba84/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:07:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a8fe938-7ca4-4221-9742-9b043050ba84/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:07:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a8fe938-7ca4-4221-9742-9b043050ba84/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:07:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a8fe938-7ca4-4221-9742-9b043050ba84/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:07:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:07:09 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:07:09 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:07:09 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Hypervisor/Node resource view: name=user free_ram=8568MB free_disk=25.334938049316406GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70924) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 15:07:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:07:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:07:09 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 751027e8-91d2-4374-94cb-f4a840d7f7be actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:07:09 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 0a8fe938-7ca4-4221-9742-9b043050ba84 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:07:09 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 15:07:09 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 15:07:09 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:07:09 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:07:09 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Compute_service record updated for user:user {{(pid=70924) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 15:07:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.222s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:07:10 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:07:10 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:07:10 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70924) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 15:07:11 user nova-compute[70924]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690643216.3555079, e905081f-dfff-41ab-88b3-8cd91d01671d => Stopped> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 15:07:11 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] VM Stopped (Lifecycle Event)
Jul 29 15:07:11 user nova-compute[70924]: DEBUG nova.compute.manager [None req-a6fb60c9-1ab2-4963-b928-75d64b595eca None None] [instance: e905081f-dfff-41ab-88b3-8cd91d01671d] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:07:11 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:07:11 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Starting heal instance info cache {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 15:07:11 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:07:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "refresh_cache-751027e8-91d2-4374-94cb-f4a840d7f7be" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:07:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquired lock "refresh_cache-751027e8-91d2-4374-94cb-f4a840d7f7be" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:07:11 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Forcefully refreshing network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 29 15:07:12 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Updating instance_info_cache with network_info: [{"id": "b5f58bd0-1ebf-476d-8c8d-2345228572b2", "address": "fa:16:3e:fc:c7:7d", "network": {"id": "f80826fa-fada-45b9-b969-fd539fd34fd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-465377443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9aadc9385b3b46eebc6e0d81814521af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f58bd0-1e", "ovs_interfaceid": "b5f58bd0-1ebf-476d-8c8d-2345228572b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:07:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Releasing lock "refresh_cache-751027e8-91d2-4374-94cb-f4a840d7f7be" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:07:12 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Updated the network info_cache for instance {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 29 15:07:14 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:07:15 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3aa014f-c4d2-40b6-bfab-3aded731987f tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Calling os-brick to attach iSCSI Volume {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 15:07:15 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3aa014f-c4d2-40b6-bfab-3aded731987f tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:042213d2-6ca7-4274-8350-50678d3eb724'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BXUEZfeI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 15:07:15 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-f3aa014f-c4d2-40b6-bfab-3aded731987f tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 15:07:15 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-f3aa014f-c4d2-40b6-bfab-3aded731987f tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 15:07:15 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-f3aa014f-c4d2-40b6-bfab-3aded731987f tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 15:07:15 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-f3aa014f-c4d2-40b6-bfab-3aded731987f tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 15:07:15 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-f3aa014f-c4d2-40b6-bfab-3aded731987f tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:042213d2-6ca7-4274-8350-50678d3eb724" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 15:07:15 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-f3aa014f-c4d2-40b6-bfab-3aded731987f tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:042213d2-6ca7-4274-8350-50678d3eb724" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 15:07:15 user nova-compute[70924]: INFO os_brick.initiator.connectors.iscsi [None req-f3aa014f-c4d2-40b6-bfab-3aded731987f tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 15:07:15 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:042213d2-6ca7-4274-8350-50678d3eb724 -p 172.16.0.220:3260 {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:07:15 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:042213d2-6ca7-4274-8350-50678d3eb724 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:07:15 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06af6fe-004b-4ea6-8a40-86c578b61a66]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:07:15 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3aa014f-c4d2-40b6-bfab-3aded731987f tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 15:07:15 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:07:15 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:042213d2-6ca7-4274-8350-50678d3eb724 -p 172.16.0.220:3260 --interface default --op new {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:07:15 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:042213d2-6ca7-4274-8350-50678d3eb724 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:07:15 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea978da3-2ef8-41a9-8d4a-5c774b982feb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:042213d2-6ca7-4274-8350-50678d3eb724] added\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:07:15 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3aa014f-c4d2-40b6-bfab-3aded731987f tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:042213d2-6ca7-4274-8350-50678d3eb724] added
Jul 29 15:07:15 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:07:15 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:042213d2-6ca7-4274-8350-50678d3eb724 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:07:15 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:042213d2-6ca7-4274-8350-50678d3eb724 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:07:15 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d792778e-c11a-436a-8f76-ce9d957a4eae]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:07:15 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3aa014f-c4d2-40b6-bfab-3aded731987f tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:07:15 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:042213d2-6ca7-4274-8350-50678d3eb724 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:07:15 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:042213d2-6ca7-4274-8350-50678d3eb724 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:07:15 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f0fac8-4521-4e32-94c7-662f0f8c9ef5]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:07:15 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3aa014f-c4d2-40b6-bfab-3aded731987f tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:07:15 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:042213d2-6ca7-4274-8350-50678d3eb724 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BXUEZfeI {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:07:15 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:07:15 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:042213d2-6ca7-4274-8350-50678d3eb724 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BXUEZfeI" returned: 0 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:07:15 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee000b1-dbd7-4592-8fd9-4a376e2ec5d8]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:07:15 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3aa014f-c4d2-40b6-bfab-3aded731987f tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BXUEZfeI'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:07:15 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:042213d2-6ca7-4274-8350-50678d3eb724 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:07:15 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:042213d2-6ca7-4274-8350-50678d3eb724 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:07:15 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[200e309f-82a4-4341-b94e-114101f307c4]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:07:15 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3aa014f-c4d2-40b6-bfab-3aded731987f tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:07:15 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:07:15 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:07:15 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb4d321-740a-4a59-9b4e-a545391070af]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:07:15 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3aa014f-c4d2-40b6-bfab-3aded731987f tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 29 15:07:15 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 15:07:15 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3aa014f-c4d2-40b6-bfab-3aded731987f tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 29 15:07:15 user nova-compute[70924]:  {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 15:07:15 user nova-compute[70924]: WARNING os_brick.initiator.connectors.iscsi [None req-f3aa014f-c4d2-40b6-bfab-3aded731987f tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 29 15:07:15 user nova-compute[70924]: 
Jul 29 15:07:15 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:042213d2-6ca7-4274-8350-50678d3eb724 -p 172.16.0.220:3260 --login {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:07:15 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:042213d2-6ca7-4274-8350-50678d3eb724 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:07:15 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f06eaf25-dfde-4c67-84c7-150d3dab17ed]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:042213d2-6ca7-4274-8350-50678d3eb724, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:042213d2-6ca7-4274-8350-50678d3eb724, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:07:15 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3aa014f-c4d2-40b6-bfab-3aded731987f tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:042213d2-6ca7-4274-8350-50678d3eb724, portal: 172.16.0.220,3260]
Jul 29 15:07:15 user nova-compute[70924]: Login to [iface: default, target: iqn.2010-10.org.openstack:042213d2-6ca7-4274-8350-50678d3eb724, portal: 172.16.0.220,3260] successful.
Jul 29 15:07:15 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:07:15 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:042213d2-6ca7-4274-8350-50678d3eb724 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:07:15 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:042213d2-6ca7-4274-8350-50678d3eb724 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:07:15 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8e083e-40b9-4a0a-936b-be119d76a370]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:07:15 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3aa014f-c4d2-40b6-bfab-3aded731987f tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:07:15 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:07:15 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:07:15 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5079b6-52fa-4999-a47f-cd3fbe017db9]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042213d2-6ca7-4274-8350-50678d3eb724 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:07:15 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3aa014f-c4d2-40b6-bfab-3aded731987f tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042213d2-6ca7-4274-8350-50678d3eb724 (non-flash)
Jul 29 15:07:15 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 15:07:15 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3aa014f-c4d2-40b6-bfab-3aded731987f tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042213d2-6ca7-4274-8350-50678d3eb724 (non-flash)
Jul 29 15:07:15 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 15:07:15 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-f3aa014f-c4d2-40b6-bfab-3aded731987f tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:042213d2-6ca7-4274-8350-50678d3eb724" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 15:07:15 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3aa014f-c4d2-40b6-bfab-3aded731987f tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Connected to 172.16.0.220:3260 {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 15:07:15 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-f3aa014f-c4d2-40b6-bfab-3aded731987f tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=70924) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 15:07:15 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-f3aa014f-c4d2-40b6-bfab-3aded731987f tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70924) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 15:07:15 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:07:15 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:07:15 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aec1ed5-ea05-45e8-8933-a83c08cd3700]: (4, ('- - 0', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:07:15 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-f3aa014f-c4d2-40b6-bfab-3aded731987f tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: None {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 15:07:16 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:07:16 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Cleaning up deleted instances with incomplete migration  {{(pid=70924) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 29 15:07:16 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:07:16 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-f3aa014f-c4d2-40b6-bfab-3aded731987f tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 15:07:16 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3aa014f-c4d2-40b6-bfab-3aded731987f tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BXUEZfeI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 15:07:16 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-f3aa014f-c4d2-40b6-bfab-3aded731987f tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 15:07:16 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3aa014f-c4d2-40b6-bfab-3aded731987f tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] <== connect_volume: return (1283ms) {'type': 'block', 'scsi_wwn': '26530303864346336', 'path': '/dev/sdb'} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 15:07:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3aa014f-c4d2-40b6-bfab-3aded731987f tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530303864346336', 'path': '/dev/sdb'} {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 15:07:16 user nova-compute[70924]: DEBUG nova.objects.instance [None req-f3aa014f-c4d2-40b6-bfab-3aded731987f tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lazy-loading 'flavor' on Instance uuid 751027e8-91d2-4374-94cb-f4a840d7f7be {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:07:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-f3aa014f-c4d2-40b6-bfab-3aded731987f tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] attach device xml: <disk type="block" device="disk">
Jul 29 15:07:16 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 15:07:16 user nova-compute[70924]:   <source dev="/dev/sdb"/>
Jul 29 15:07:16 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 15:07:16 user nova-compute[70924]:   <serial>042213d2-6ca7-4274-8350-50678d3eb724</serial>
Jul 29 15:07:16 user nova-compute[70924]: </disk>
Jul 29 15:07:16 user nova-compute[70924]:  {{(pid=70924) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 29 15:07:17 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-f3aa014f-c4d2-40b6-bfab-3aded731987f tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 15:07:17 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-f3aa014f-c4d2-40b6-bfab-3aded731987f tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 15:07:17 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-f3aa014f-c4d2-40b6-bfab-3aded731987f tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] No VIF found with MAC fa:16:3e:fc:c7:7d, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 15:07:17 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-f3aa014f-c4d2-40b6-bfab-3aded731987f tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "751027e8-91d2-4374-94cb-f4a840d7f7be" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.937s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:07:18 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9bae6d47-5aac-4ad0-8e8f-c1d67d4b4c5d tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Acquiring lock "751027e8-91d2-4374-94cb-f4a840d7f7be" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:07:18 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9bae6d47-5aac-4ad0-8e8f-c1d67d4b4c5d tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "751027e8-91d2-4374-94cb-f4a840d7f7be" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:07:18 user nova-compute[70924]: INFO nova.compute.manager [None req-9bae6d47-5aac-4ad0-8e8f-c1d67d4b4c5d tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Detaching volume 042213d2-6ca7-4274-8350-50678d3eb724
Jul 29 15:07:18 user nova-compute[70924]: INFO nova.virt.block_device [None req-9bae6d47-5aac-4ad0-8e8f-c1d67d4b4c5d tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Attempting to driver detach volume 042213d2-6ca7-4274-8350-50678d3eb724 from mountpoint /dev/vdb
Jul 29 15:07:18 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-9bae6d47-5aac-4ad0-8e8f-c1d67d4b4c5d tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Attempting to detach device vdb from instance 751027e8-91d2-4374-94cb-f4a840d7f7be from the persistent domain config. {{(pid=70924) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 29 15:07:18 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-9bae6d47-5aac-4ad0-8e8f-c1d67d4b4c5d tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 15:07:18 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 15:07:18 user nova-compute[70924]:   <source dev="/dev/sdb"/>
Jul 29 15:07:18 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 15:07:18 user nova-compute[70924]:   <serial>042213d2-6ca7-4274-8350-50678d3eb724</serial>
Jul 29 15:07:18 user nova-compute[70924]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 15:07:18 user nova-compute[70924]: </disk>
Jul 29 15:07:18 user nova-compute[70924]:  {{(pid=70924) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 15:07:18 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-9bae6d47-5aac-4ad0-8e8f-c1d67d4b4c5d tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Successfully detached device vdb from instance 751027e8-91d2-4374-94cb-f4a840d7f7be from the persistent domain config.
Jul 29 15:07:18 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-9bae6d47-5aac-4ad0-8e8f-c1d67d4b4c5d tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 751027e8-91d2-4374-94cb-f4a840d7f7be from the live domain config. {{(pid=70924) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 29 15:07:18 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-9bae6d47-5aac-4ad0-8e8f-c1d67d4b4c5d tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 15:07:18 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 15:07:18 user nova-compute[70924]:   <source dev="/dev/sdb"/>
Jul 29 15:07:18 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 15:07:18 user nova-compute[70924]:   <serial>042213d2-6ca7-4274-8350-50678d3eb724</serial>
Jul 29 15:07:18 user nova-compute[70924]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 15:07:18 user nova-compute[70924]: </disk>
Jul 29 15:07:18 user nova-compute[70924]:  {{(pid=70924) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 15:07:18 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Received event <DeviceRemovedEvent: 1690643238.7029166, 751027e8-91d2-4374-94cb-f4a840d7f7be => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70924) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 29 15:07:18 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-9bae6d47-5aac-4ad0-8e8f-c1d67d4b4c5d tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 751027e8-91d2-4374-94cb-f4a840d7f7be {{(pid=70924) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 29 15:07:18 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-9bae6d47-5aac-4ad0-8e8f-c1d67d4b4c5d tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Successfully detached device vdb from instance 751027e8-91d2-4374-94cb-f4a840d7f7be from the live domain config.
Jul 29 15:07:18 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9bae6d47-5aac-4ad0-8e8f-c1d67d4b4c5d tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] calling os-brick to detach iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 15:07:18 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bae6d47-5aac-4ad0-8e8f-c1d67d4b4c5d tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, {'target_iqns': ['iqn.2010-10.org.openstack:042213d2-6ca7-4274-8350-50678d3eb724'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BXUEZfeI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 15:07:18 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-9bae6d47-5aac-4ad0-8e8f-c1d67d4b4c5d tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 15:07:18 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-9bae6d47-5aac-4ad0-8e8f-c1d67d4b4c5d tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 15:07:18 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-9bae6d47-5aac-4ad0-8e8f-c1d67d4b4c5d tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 15:07:18 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bae6d47-5aac-4ad0-8e8f-c1d67d4b4c5d tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:042213d2-6ca7-4274-8350-50678d3eb724', 0)] {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 15:07:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:07:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:07:18 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[73bb1bbe-a70e-4226-a9cc-c4c0dba472ec]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:042213d2-6ca7-4274-8350-50678d3eb724\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:07:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:07:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:07:18 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c49255-b108-41a1-883a-e9209afd4cf1]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042213d2-6ca7-4274-8350-50678d3eb724 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:07:18 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bae6d47-5aac-4ad0-8e8f-c1d67d4b4c5d tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042213d2-6ca7-4274-8350-50678d3eb724 (non-flash)
Jul 29 15:07:18 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 15:07:18 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bae6d47-5aac-4ad0-8e8f-c1d67d4b4c5d tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042213d2-6ca7-4274-8350-50678d3eb724 (non-flash)
Jul 29 15:07:18 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 15:07:18 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bae6d47-5aac-4ad0-8e8f-c1d67d4b4c5d tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feecc5e9240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:042213d2-6ca7-4274-8350-50678d3eb724'): ({'sdb'}, set())}) {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 15:07:18 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-9bae6d47-5aac-4ad0-8e8f-c1d67d4b4c5d tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Removing single pathed devices sdb {{(pid=70924) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 15:07:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:07:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:07:18 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[491e8616-431e-48b2-befe-5a322e4dd75a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:07:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:07:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:07:18 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff98aed-1933-48b7-b9f7-a8f55a5f0074]: (4, ('ok\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:07:18 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-9bae6d47-5aac-4ad0-8e8f-c1d67d4b4c5d tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Flushing IO for device /dev/sdb {{(pid=70924) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 15:07:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:07:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:07:18 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d2e0e4-16a1-4deb-92c2-55d4043697b4]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:07:18 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-9bae6d47-5aac-4ad0-8e8f-c1d67d4b4c5d tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70924) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 15:07:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:07:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:07:18 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[33001f23-604c-4349-b1c4-459729fd00f4]: (4, ('1', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:07:18 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-9bae6d47-5aac-4ad0-8e8f-c1d67d4b4c5d tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 15:07:18 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-9bae6d47-5aac-4ad0-8e8f-c1d67d4b4c5d tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] SCSI volumes sdb have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 15:07:18 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bae6d47-5aac-4ad0-8e8f-c1d67d4b4c5d tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:042213d2-6ca7-4274-8350-50678d3eb724')] {{(pid=70924) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 15:07:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:042213d2-6ca7-4274-8350-50678d3eb724 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:07:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:042213d2-6ca7-4274-8350-50678d3eb724 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:07:18 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97e0be3-7cd8-4c79-a377-1a56cce06a11]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:07:18 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bae6d47-5aac-4ad0-8e8f-c1d67d4b4c5d tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:07:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:042213d2-6ca7-4274-8350-50678d3eb724 -p 172.16.0.220:3260 --logout {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:07:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:042213d2-6ca7-4274-8350-50678d3eb724 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:07:18 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1136c809-f754-4da8-9e24-dcb8205e0dcc]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:042213d2-6ca7-4274-8350-50678d3eb724, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:042213d2-6ca7-4274-8350-50678d3eb724, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:07:18 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bae6d47-5aac-4ad0-8e8f-c1d67d4b4c5d tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:042213d2-6ca7-4274-8350-50678d3eb724, portal: 172.16.0.220,3260]
Jul 29 15:07:18 user nova-compute[70924]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:042213d2-6ca7-4274-8350-50678d3eb724, portal: 172.16.0.220,3260] successful.
Jul 29 15:07:18 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:07:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:042213d2-6ca7-4274-8350-50678d3eb724 -p 172.16.0.220:3260 --op delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:07:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:042213d2-6ca7-4274-8350-50678d3eb724 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:07:18 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c04506b-e4b5-4069-800a-00a073b035c4]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:07:18 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bae6d47-5aac-4ad0-8e8f-c1d67d4b4c5d tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:07:18 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-9bae6d47-5aac-4ad0-8e8f-c1d67d4b4c5d tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.267s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 15:07:18 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bae6d47-5aac-4ad0-8e8f-c1d67d4b4c5d tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] <== disconnect_volume: return (268ms) None {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 15:07:18 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9bae6d47-5aac-4ad0-8e8f-c1d67d4b4c5d tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Disconnected iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 15:07:19 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:07:19 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:07:19 user nova-compute[70924]: DEBUG nova.objects.instance [None req-9bae6d47-5aac-4ad0-8e8f-c1d67d4b4c5d tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lazy-loading 'flavor' on Instance uuid 751027e8-91d2-4374-94cb-f4a840d7f7be {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:07:19 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9bae6d47-5aac-4ad0-8e8f-c1d67d4b4c5d tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "751027e8-91d2-4374-94cb-f4a840d7f7be" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.596s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:07:19 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:07:21 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:07:23 user nova-compute[70924]: DEBUG nova.compute.manager [req-ac90b7ec-a5a4-4b63-a609-7d8d98c314ed req-752dcbd4-cefa-43f5-858b-50fb946906ff service nova] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Received event network-changed-0f6e2258-37e5-4786-898b-d11796a410e7 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:07:23 user nova-compute[70924]: DEBUG nova.compute.manager [req-ac90b7ec-a5a4-4b63-a609-7d8d98c314ed req-752dcbd4-cefa-43f5-858b-50fb946906ff service nova] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Refreshing instance network info cache due to event network-changed-0f6e2258-37e5-4786-898b-d11796a410e7. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 15:07:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-ac90b7ec-a5a4-4b63-a609-7d8d98c314ed req-752dcbd4-cefa-43f5-858b-50fb946906ff service nova] Acquiring lock "refresh_cache-0a8fe938-7ca4-4221-9742-9b043050ba84" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:07:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-ac90b7ec-a5a4-4b63-a609-7d8d98c314ed req-752dcbd4-cefa-43f5-858b-50fb946906ff service nova] Acquired lock "refresh_cache-0a8fe938-7ca4-4221-9742-9b043050ba84" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:07:23 user nova-compute[70924]: DEBUG nova.network.neutron [req-ac90b7ec-a5a4-4b63-a609-7d8d98c314ed req-752dcbd4-cefa-43f5-858b-50fb946906ff service nova] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Refreshing network info cache for port 0f6e2258-37e5-4786-898b-d11796a410e7 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 15:07:24 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:07:24 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-67bc9425-06a6-44aa-9116-1b0518a71653 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Acquiring lock "0a8fe938-7ca4-4221-9742-9b043050ba84" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:07:24 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-67bc9425-06a6-44aa-9116-1b0518a71653 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Lock "0a8fe938-7ca4-4221-9742-9b043050ba84" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:07:24 user nova-compute[70924]: DEBUG nova.objects.instance [None req-67bc9425-06a6-44aa-9116-1b0518a71653 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Lazy-loading 'flavor' on Instance uuid 0a8fe938-7ca4-4221-9742-9b043050ba84 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:07:24 user nova-compute[70924]: DEBUG nova.network.neutron [req-ac90b7ec-a5a4-4b63-a609-7d8d98c314ed req-752dcbd4-cefa-43f5-858b-50fb946906ff service nova] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Updated VIF entry in instance network info cache for port 0f6e2258-37e5-4786-898b-d11796a410e7. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 15:07:24 user nova-compute[70924]: DEBUG nova.network.neutron [req-ac90b7ec-a5a4-4b63-a609-7d8d98c314ed req-752dcbd4-cefa-43f5-858b-50fb946906ff service nova] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Updating instance_info_cache with network_info: [{"id": "0f6e2258-37e5-4786-898b-d11796a410e7", "address": "fa:16:3e:0c:50:9c", "network": {"id": "24b90c74-6ebe-42f0-b11f-fc2b23b35188", "bridge": "br-int", "label": "tempest-TestStampPattern-1445459710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "519723b99af84d1b85c40cfbc6518d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f6e2258-37", "ovs_interfaceid": "0f6e2258-37e5-4786-898b-d11796a410e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:07:24 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-67bc9425-06a6-44aa-9116-1b0518a71653 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Lock "0a8fe938-7ca4-4221-9742-9b043050ba84" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:07:24 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-ac90b7ec-a5a4-4b63-a609-7d8d98c314ed req-752dcbd4-cefa-43f5-858b-50fb946906ff service nova] Releasing lock "refresh_cache-0a8fe938-7ca4-4221-9742-9b043050ba84" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:07:24 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-67bc9425-06a6-44aa-9116-1b0518a71653 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Acquiring lock "0a8fe938-7ca4-4221-9742-9b043050ba84" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:07:24 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-67bc9425-06a6-44aa-9116-1b0518a71653 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Lock "0a8fe938-7ca4-4221-9742-9b043050ba84" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:07:24 user nova-compute[70924]: INFO nova.compute.manager [None req-67bc9425-06a6-44aa-9116-1b0518a71653 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Attaching volume 0252e16b-c370-4e98-8fc0-006fee5f63fe to /dev/vdb
Jul 29 15:07:24 user nova-compute[70924]: DEBUG os_brick.utils [None req-67bc9425-06a6-44aa-9116-1b0518a71653 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 15:07:24 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:07:24 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:07:24 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[50419002-c514-463e-844b-6fd180831124]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f2127c4a30d9\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:07:24 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:07:24 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:07:24 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[548601b7-16a7-487c-b880-ef8b6ad0f981]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:07:24 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:07:24 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:07:24 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb839a9f-860c-4d1b-bbdc-7be71d07cd5d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:07:24 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eaa4269-d330-4914-9669-8122f00e575c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:07:24 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-67bc9425-06a6-44aa-9116-1b0518a71653 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Running cmd (subprocess): nvme version {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:07:24 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-67bc9425-06a6-44aa-9116-1b0518a71653 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] 'nvme version' failed. Not Retrying. {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 15:07:24 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.nvmeof [None req-67bc9425-06a6-44aa-9116-1b0518a71653 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] nvme not present on system {{(pid=70924) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 15:07:24 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:07:24 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 15:07:24 user nova-compute[70924]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 15:07:24 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[28fbf331-b26e-4887-a222-56b760822ebe]: (4, '') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:07:24 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-67bc9425-06a6-44aa-9116-1b0518a71653 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70924) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 15:07:24 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-67bc9425-06a6-44aa-9116-1b0518a71653 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 15:07:24 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-67bc9425-06a6-44aa-9116-1b0518a71653 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] LIGHTOS: no hostnqn found. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 15:07:24 user nova-compute[70924]: DEBUG os_brick.utils [None req-67bc9425-06a6-44aa-9116-1b0518a71653 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f2127c4a30d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 15:07:24 user nova-compute[70924]: DEBUG nova.virt.block_device [None req-67bc9425-06a6-44aa-9116-1b0518a71653 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Updating existing volume attachment record: 2e7a4247-4195-44bd-be37-03176fff160e {{(pid=70924) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 15:07:25 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._sync_power_states {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:07:25 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Triggering sync for uuid 751027e8-91d2-4374-94cb-f4a840d7f7be {{(pid=70924) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 29 15:07:25 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Triggering sync for uuid 0a8fe938-7ca4-4221-9742-9b043050ba84 {{(pid=70924) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 29 15:07:25 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "751027e8-91d2-4374-94cb-f4a840d7f7be" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:07:25 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "751027e8-91d2-4374-94cb-f4a840d7f7be" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:07:25 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "0a8fe938-7ca4-4221-9742-9b043050ba84" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:07:25 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "751027e8-91d2-4374-94cb-f4a840d7f7be" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:07:26 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:07:29 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:07:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:07:31 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67bc9425-06a6-44aa-9116-1b0518a71653 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Calling os-brick to attach iSCSI Volume {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 15:07:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-67bc9425-06a6-44aa-9116-1b0518a71653 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0252e16b-c370-4e98-8fc0-006fee5f63fe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rRjmHsFh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 15:07:31 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-67bc9425-06a6-44aa-9116-1b0518a71653 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 15:07:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-67bc9425-06a6-44aa-9116-1b0518a71653 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 15:07:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-67bc9425-06a6-44aa-9116-1b0518a71653 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 15:07:31 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-67bc9425-06a6-44aa-9116-1b0518a71653 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 15:07:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-67bc9425-06a6-44aa-9116-1b0518a71653 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0252e16b-c370-4e98-8fc0-006fee5f63fe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 15:07:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-67bc9425-06a6-44aa-9116-1b0518a71653 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0252e16b-c370-4e98-8fc0-006fee5f63fe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 15:07:31 user nova-compute[70924]: INFO os_brick.initiator.connectors.iscsi [None req-67bc9425-06a6-44aa-9116-1b0518a71653 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 15:07:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0252e16b-c370-4e98-8fc0-006fee5f63fe -p 172.16.0.220:3260 {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:07:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0252e16b-c370-4e98-8fc0-006fee5f63fe -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:07:31 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5b5403-bf7e-468f-b416-bcb3b0c53bd4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:07:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-67bc9425-06a6-44aa-9116-1b0518a71653 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 15:07:31 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:07:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0252e16b-c370-4e98-8fc0-006fee5f63fe -p 172.16.0.220:3260 --interface default --op new {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:07:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0252e16b-c370-4e98-8fc0-006fee5f63fe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:07:31 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08abf40-a15d-4544-b2c1-62f52e7a8815]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0252e16b-c370-4e98-8fc0-006fee5f63fe] added\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:07:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-67bc9425-06a6-44aa-9116-1b0518a71653 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0252e16b-c370-4e98-8fc0-006fee5f63fe] added
Jul 29 15:07:31 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:07:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0252e16b-c370-4e98-8fc0-006fee5f63fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:07:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0252e16b-c370-4e98-8fc0-006fee5f63fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:07:31 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b14fa13-e6b5-4ee4-b619-64e8f983db2c]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:07:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-67bc9425-06a6-44aa-9116-1b0518a71653 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:07:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0252e16b-c370-4e98-8fc0-006fee5f63fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:07:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0252e16b-c370-4e98-8fc0-006fee5f63fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:07:31 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef93345d-40cf-4994-a498-dfdf38d48901]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:07:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-67bc9425-06a6-44aa-9116-1b0518a71653 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:07:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0252e16b-c370-4e98-8fc0-006fee5f63fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rRjmHsFh {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:07:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0252e16b-c370-4e98-8fc0-006fee5f63fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rRjmHsFh" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:07:31 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca56067b-152c-4087-8555-dbc531b19c5a]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:07:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-67bc9425-06a6-44aa-9116-1b0518a71653 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rRjmHsFh'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:07:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0252e16b-c370-4e98-8fc0-006fee5f63fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:07:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0252e16b-c370-4e98-8fc0-006fee5f63fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:07:31 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2026bd2-233d-4093-bc53-efb860e87096]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:07:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-67bc9425-06a6-44aa-9116-1b0518a71653 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:07:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:07:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:07:31 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4d9cc2-5b46-4972-b178-c4f8331815e6]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:07:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-67bc9425-06a6-44aa-9116-1b0518a71653 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 29 15:07:31 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 15:07:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-67bc9425-06a6-44aa-9116-1b0518a71653 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 29 15:07:31 user nova-compute[70924]:  {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 15:07:31 user nova-compute[70924]: WARNING os_brick.initiator.connectors.iscsi [None req-67bc9425-06a6-44aa-9116-1b0518a71653 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 29 15:07:31 user nova-compute[70924]: 
Jul 29 15:07:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0252e16b-c370-4e98-8fc0-006fee5f63fe -p 172.16.0.220:3260 --login {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:07:32 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0252e16b-c370-4e98-8fc0-006fee5f63fe -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:07:32 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1774186-8b1c-4e33-b1af-ecc3d66ad0f7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0252e16b-c370-4e98-8fc0-006fee5f63fe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0252e16b-c370-4e98-8fc0-006fee5f63fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:07:32 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-67bc9425-06a6-44aa-9116-1b0518a71653 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0252e16b-c370-4e98-8fc0-006fee5f63fe, portal: 172.16.0.220,3260]
Jul 29 15:07:32 user nova-compute[70924]: Login to [iface: default, target: iqn.2010-10.org.openstack:0252e16b-c370-4e98-8fc0-006fee5f63fe, portal: 172.16.0.220,3260] successful.
Jul 29 15:07:32 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:07:32 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0252e16b-c370-4e98-8fc0-006fee5f63fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:07:32 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0252e16b-c370-4e98-8fc0-006fee5f63fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:07:32 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[588c90dd-3e7b-4b76-920d-c200f342da86]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:07:32 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-67bc9425-06a6-44aa-9116-1b0518a71653 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:07:32 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:07:32 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:07:32 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26842be-6188-4391-a8d3-46a64f572ecb]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0252e16b-c370-4e98-8fc0-006fee5f63fe (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:07:32 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-67bc9425-06a6-44aa-9116-1b0518a71653 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0252e16b-c370-4e98-8fc0-006fee5f63fe (non-flash)
Jul 29 15:07:32 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 15:07:32 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-67bc9425-06a6-44aa-9116-1b0518a71653 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0252e16b-c370-4e98-8fc0-006fee5f63fe (non-flash)
Jul 29 15:07:32 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 15:07:32 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-67bc9425-06a6-44aa-9116-1b0518a71653 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0252e16b-c370-4e98-8fc0-006fee5f63fe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 15:07:32 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-67bc9425-06a6-44aa-9116-1b0518a71653 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Connected to 172.16.0.220:3260 {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 15:07:32 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-67bc9425-06a6-44aa-9116-1b0518a71653 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=70924) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 15:07:32 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-67bc9425-06a6-44aa-9116-1b0518a71653 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70924) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 15:07:32 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:07:32 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:07:32 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbdb11a4-3ebc-45a9-b42b-e43bd409ac01]: (4, ('- - 0', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:07:32 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-67bc9425-06a6-44aa-9116-1b0518a71653 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 15:07:32 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-67bc9425-06a6-44aa-9116-1b0518a71653 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rRjmHsFh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 15:07:33 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-67bc9425-06a6-44aa-9116-1b0518a71653 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 15:07:33 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-67bc9425-06a6-44aa-9116-1b0518a71653 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '23830393164643638', 'path': '/dev/sdb'} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 15:07:33 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67bc9425-06a6-44aa-9116-1b0518a71653 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830393164643638', 'path': '/dev/sdb'} {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 15:07:33 user nova-compute[70924]: DEBUG nova.objects.instance [None req-67bc9425-06a6-44aa-9116-1b0518a71653 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Lazy-loading 'flavor' on Instance uuid 0a8fe938-7ca4-4221-9742-9b043050ba84 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:07:33 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-67bc9425-06a6-44aa-9116-1b0518a71653 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] attach device xml: <disk type="block" device="disk">
Jul 29 15:07:33 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 15:07:33 user nova-compute[70924]:   <source dev="/dev/sdb"/>
Jul 29 15:07:33 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 15:07:33 user nova-compute[70924]:   <serial>0252e16b-c370-4e98-8fc0-006fee5f63fe</serial>
Jul 29 15:07:33 user nova-compute[70924]: </disk>
Jul 29 15:07:33 user nova-compute[70924]:  {{(pid=70924) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 29 15:07:33 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-67bc9425-06a6-44aa-9116-1b0518a71653 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 15:07:33 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-67bc9425-06a6-44aa-9116-1b0518a71653 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 15:07:33 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-67bc9425-06a6-44aa-9116-1b0518a71653 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] No VIF found with MAC fa:16:3e:0c:50:9c, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 15:07:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-67bc9425-06a6-44aa-9116-1b0518a71653 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Lock "0a8fe938-7ca4-4221-9742-9b043050ba84" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.061s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:07:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "0a8fe938-7ca4-4221-9742-9b043050ba84" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 8.009s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:07:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "0a8fe938-7ca4-4221-9742-9b043050ba84" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:07:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:07:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-e26511cb-bfaf-448a-bcb2-0c15bd583683 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Acquiring lock "0a8fe938-7ca4-4221-9742-9b043050ba84" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:07:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-e26511cb-bfaf-448a-bcb2-0c15bd583683 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Lock "0a8fe938-7ca4-4221-9742-9b043050ba84" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:07:35 user nova-compute[70924]: INFO nova.compute.manager [None req-e26511cb-bfaf-448a-bcb2-0c15bd583683 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Detaching volume 0252e16b-c370-4e98-8fc0-006fee5f63fe
Jul 29 15:07:35 user nova-compute[70924]: INFO nova.virt.block_device [None req-e26511cb-bfaf-448a-bcb2-0c15bd583683 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Attempting to driver detach volume 0252e16b-c370-4e98-8fc0-006fee5f63fe from mountpoint /dev/vdb
Jul 29 15:07:35 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-e26511cb-bfaf-448a-bcb2-0c15bd583683 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Attempting to detach device vdb from instance 0a8fe938-7ca4-4221-9742-9b043050ba84 from the persistent domain config. {{(pid=70924) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 29 15:07:35 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-e26511cb-bfaf-448a-bcb2-0c15bd583683 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 15:07:35 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 15:07:35 user nova-compute[70924]:   <source dev="/dev/sdb"/>
Jul 29 15:07:35 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 15:07:35 user nova-compute[70924]:   <serial>0252e16b-c370-4e98-8fc0-006fee5f63fe</serial>
Jul 29 15:07:35 user nova-compute[70924]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 15:07:35 user nova-compute[70924]: </disk>
Jul 29 15:07:35 user nova-compute[70924]:  {{(pid=70924) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 15:07:35 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-e26511cb-bfaf-448a-bcb2-0c15bd583683 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Successfully detached device vdb from instance 0a8fe938-7ca4-4221-9742-9b043050ba84 from the persistent domain config.
Jul 29 15:07:35 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-e26511cb-bfaf-448a-bcb2-0c15bd583683 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0a8fe938-7ca4-4221-9742-9b043050ba84 from the live domain config. {{(pid=70924) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 29 15:07:35 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-e26511cb-bfaf-448a-bcb2-0c15bd583683 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 15:07:35 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 15:07:35 user nova-compute[70924]:   <source dev="/dev/sdb"/>
Jul 29 15:07:35 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 15:07:35 user nova-compute[70924]:   <serial>0252e16b-c370-4e98-8fc0-006fee5f63fe</serial>
Jul 29 15:07:35 user nova-compute[70924]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 15:07:35 user nova-compute[70924]: </disk>
Jul 29 15:07:35 user nova-compute[70924]:  {{(pid=70924) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 15:07:36 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:07:36 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Received event <DeviceRemovedEvent: 1690643256.426096, 0a8fe938-7ca4-4221-9742-9b043050ba84 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70924) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 29 15:07:36 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-e26511cb-bfaf-448a-bcb2-0c15bd583683 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0a8fe938-7ca4-4221-9742-9b043050ba84 {{(pid=70924) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 29 15:07:36 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-e26511cb-bfaf-448a-bcb2-0c15bd583683 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Successfully detached device vdb from instance 0a8fe938-7ca4-4221-9742-9b043050ba84 from the live domain config.
Jul 29 15:07:36 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e26511cb-bfaf-448a-bcb2-0c15bd583683 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] calling os-brick to detach iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 15:07:36 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26511cb-bfaf-448a-bcb2-0c15bd583683 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, {'target_iqns': ['iqn.2010-10.org.openstack:0252e16b-c370-4e98-8fc0-006fee5f63fe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rRjmHsFh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 15:07:36 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-e26511cb-bfaf-448a-bcb2-0c15bd583683 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 15:07:36 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-e26511cb-bfaf-448a-bcb2-0c15bd583683 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 15:07:36 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-e26511cb-bfaf-448a-bcb2-0c15bd583683 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 15:07:36 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26511cb-bfaf-448a-bcb2-0c15bd583683 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0252e16b-c370-4e98-8fc0-006fee5f63fe', 0)] {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 15:07:36 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:07:36 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:07:36 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[98db59e6-6152-467b-9edc-afa1b9e5805b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0252e16b-c370-4e98-8fc0-006fee5f63fe\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:07:36 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:07:36 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:07:36 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[91074265-3f4a-46b6-813e-bd30c9ca1ae1]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0252e16b-c370-4e98-8fc0-006fee5f63fe (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:07:36 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26511cb-bfaf-448a-bcb2-0c15bd583683 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0252e16b-c370-4e98-8fc0-006fee5f63fe (non-flash)
Jul 29 15:07:36 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 15:07:36 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26511cb-bfaf-448a-bcb2-0c15bd583683 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0252e16b-c370-4e98-8fc0-006fee5f63fe (non-flash)
Jul 29 15:07:36 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 15:07:36 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26511cb-bfaf-448a-bcb2-0c15bd583683 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feecc668160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0252e16b-c370-4e98-8fc0-006fee5f63fe'): ({'sdb'}, set())}) {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 15:07:36 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-e26511cb-bfaf-448a-bcb2-0c15bd583683 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Removing single pathed devices sdb {{(pid=70924) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 15:07:36 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:07:36 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:07:36 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87f74b0-92d0-4f8a-a024-f7a478f53c6a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:07:36 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:07:36 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:07:36 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[692ad05d-1e24-4eba-895c-2fc35e46950b]: (4, ('ok\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:07:36 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-e26511cb-bfaf-448a-bcb2-0c15bd583683 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Flushing IO for device /dev/sdb {{(pid=70924) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 15:07:36 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:07:36 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:07:36 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0b7b55-5a2e-48be-a964-25b33ceb8a70]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:07:36 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-e26511cb-bfaf-448a-bcb2-0c15bd583683 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70924) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 15:07:36 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:07:36 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:07:36 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0084c28f-374f-474a-b0d2-7e9858c55e30]: (4, ('1', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:07:36 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-e26511cb-bfaf-448a-bcb2-0c15bd583683 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 15:07:36 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-e26511cb-bfaf-448a-bcb2-0c15bd583683 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] SCSI volumes sdb have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 15:07:36 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26511cb-bfaf-448a-bcb2-0c15bd583683 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0252e16b-c370-4e98-8fc0-006fee5f63fe')] {{(pid=70924) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 15:07:36 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0252e16b-c370-4e98-8fc0-006fee5f63fe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:07:36 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0252e16b-c370-4e98-8fc0-006fee5f63fe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:07:36 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55b8d13-99d4-4c5c-ae8e-29e4c57a216b]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:07:36 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26511cb-bfaf-448a-bcb2-0c15bd583683 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:07:36 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0252e16b-c370-4e98-8fc0-006fee5f63fe -p 172.16.0.220:3260 --logout {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:07:36 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0252e16b-c370-4e98-8fc0-006fee5f63fe -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:07:36 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddcc8b9d-6adc-4dc2-8e69-59e058ab7cff]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:0252e16b-c370-4e98-8fc0-006fee5f63fe, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:0252e16b-c370-4e98-8fc0-006fee5f63fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:07:36 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26511cb-bfaf-448a-bcb2-0c15bd583683 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:0252e16b-c370-4e98-8fc0-006fee5f63fe, portal: 172.16.0.220,3260]
Jul 29 15:07:36 user nova-compute[70924]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:0252e16b-c370-4e98-8fc0-006fee5f63fe, portal: 172.16.0.220,3260] successful.
Jul 29 15:07:36 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:07:36 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0252e16b-c370-4e98-8fc0-006fee5f63fe -p 172.16.0.220:3260 --op delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:07:36 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0252e16b-c370-4e98-8fc0-006fee5f63fe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:07:36 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b75a3dd-c212-4e04-ae0c-da7937f13f9a]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:07:36 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26511cb-bfaf-448a-bcb2-0c15bd583683 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:07:36 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-e26511cb-bfaf-448a-bcb2-0c15bd583683 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.262s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 15:07:36 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26511cb-bfaf-448a-bcb2-0c15bd583683 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] <== disconnect_volume: return (263ms) None {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 15:07:36 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e26511cb-bfaf-448a-bcb2-0c15bd583683 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Disconnected iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 15:07:37 user nova-compute[70924]: DEBUG nova.objects.instance [None req-e26511cb-bfaf-448a-bcb2-0c15bd583683 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Lazy-loading 'flavor' on Instance uuid 0a8fe938-7ca4-4221-9742-9b043050ba84 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:07:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-e26511cb-bfaf-448a-bcb2-0c15bd583683 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Lock "0a8fe938-7ca4-4221-9742-9b043050ba84" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.615s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:07:39 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:07:41 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:07:46 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:07:50 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:07:51 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:07:52 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:07:54 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:07:56 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:07:56 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:07:57 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Acquiring lock "45a4c141-3b2f-452c-a0ab-be3474f3b953" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:07:57 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "45a4c141-3b2f-452c-a0ab-be3474f3b953" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:07:57 user nova-compute[70924]: DEBUG nova.compute.manager [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] Starting instance... {{(pid=70924) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 15:07:57 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:07:57 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:07:57 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70924) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 15:07:57 user nova-compute[70924]: INFO nova.compute.claims [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] Claim successful on node user
Jul 29 15:07:57 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Refreshing inventories for resource provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 29 15:07:57 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Updating ProviderTree inventory for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 29 15:07:57 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Updating inventory in ProviderTree for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 29 15:07:57 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Refreshing aggregate associations for resource provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832, aggregates: None {{(pid=70924) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 29 15:07:57 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Refreshing trait associations for resource provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832, traits: COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=70924) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 29 15:07:57 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:07:57 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:07:57 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.395s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:07:57 user nova-compute[70924]: DEBUG nova.compute.manager [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] Start building networks asynchronously for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 15:07:57 user nova-compute[70924]: DEBUG nova.compute.manager [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] Allocating IP information in the background. {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 15:07:57 user nova-compute[70924]: DEBUG nova.network.neutron [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] allocate_for_instance() {{(pid=70924) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 15:07:57 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 15:07:58 user nova-compute[70924]: DEBUG nova.compute.manager [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] Start building block device mappings for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 15:07:58 user nova-compute[70924]: INFO nova.virt.block_device [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] Booting with volume 9d7c7925-8381-4bfc-aff1-c1948bbd7490 at /dev/vda
Jul 29 15:07:58 user nova-compute[70924]: DEBUG nova.policy [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'da204646e8f84693ad470ed1d3eadd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a974cbbf734f51897c3e632ae9e45f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70924) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 15:07:58 user nova-compute[70924]: DEBUG os_brick.utils [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 15:07:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:07:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:07:58 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b4082c-8548-41a1-86a7-e3619cfdba88]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f2127c4a30d9\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:07:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:07:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:07:58 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e084a8db-7820-4920-be50-6644925228d6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:07:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:07:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:07:58 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bacb6b5-93a8-40f1-a23f-452f096ce444]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:07:58 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddfdcee4-3a82-4229-a8fd-3e5eea176a19]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:07:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Running cmd (subprocess): nvme version {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:07:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] 'nvme version' failed. Not Retrying. {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 15:07:58 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] nvme not present on system {{(pid=70924) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 15:07:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:07:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 15:07:58 user nova-compute[70924]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 15:07:58 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[936fe835-e26c-42c2-b5a5-659900e3b6d3]: (4, '') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:07:58 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70924) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 15:07:58 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 15:07:58 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] LIGHTOS: no hostnqn found. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 15:07:58 user nova-compute[70924]: DEBUG os_brick.utils [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f2127c4a30d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 15:07:58 user nova-compute[70924]: DEBUG nova.virt.block_device [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] Updating existing volume attachment record: ad33b27d-cf78-4e13-bf35-b58b9b01464f {{(pid=70924) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 15:07:59 user nova-compute[70924]: DEBUG nova.network.neutron [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] Successfully created port: 7af29ac0-4a0d-41ab-b21e-bd3c215f1d00 {{(pid=70924) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 15:07:59 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:07:59 user nova-compute[70924]: DEBUG nova.network.neutron [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] Successfully updated port: 7af29ac0-4a0d-41ab-b21e-bd3c215f1d00 {{(pid=70924) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 15:07:59 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Acquiring lock "refresh_cache-45a4c141-3b2f-452c-a0ab-be3474f3b953" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:07:59 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Acquired lock "refresh_cache-45a4c141-3b2f-452c-a0ab-be3474f3b953" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:07:59 user nova-compute[70924]: DEBUG nova.network.neutron [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 15:07:59 user nova-compute[70924]: DEBUG nova.compute.manager [req-c317f8a9-2b7e-4d76-b7e6-e642c39ce0bf req-9bd9fc3a-1173-4875-8e78-9660a93b64dd service nova] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] Received event network-changed-7af29ac0-4a0d-41ab-b21e-bd3c215f1d00 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:07:59 user nova-compute[70924]: DEBUG nova.compute.manager [req-c317f8a9-2b7e-4d76-b7e6-e642c39ce0bf req-9bd9fc3a-1173-4875-8e78-9660a93b64dd service nova] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] Refreshing instance network info cache due to event network-changed-7af29ac0-4a0d-41ab-b21e-bd3c215f1d00. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 15:07:59 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c317f8a9-2b7e-4d76-b7e6-e642c39ce0bf req-9bd9fc3a-1173-4875-8e78-9660a93b64dd service nova] Acquiring lock "refresh_cache-45a4c141-3b2f-452c-a0ab-be3474f3b953" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:07:59 user nova-compute[70924]: DEBUG nova.network.neutron [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] Instance cache missing network info. {{(pid=70924) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 15:08:00 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:08:00 user nova-compute[70924]: DEBUG nova.network.neutron [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] Updating instance_info_cache with network_info: [{"id": "7af29ac0-4a0d-41ab-b21e-bd3c215f1d00", "address": "fa:16:3e:39:4e:2c", "network": {"id": "c19ed38b-2acd-421a-9e4b-f60df3db2f1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1812407562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a974cbbf734f51897c3e632ae9e45f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7af29ac0-4a", "ovs_interfaceid": "7af29ac0-4a0d-41ab-b21e-bd3c215f1d00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:08:00 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Releasing lock "refresh_cache-45a4c141-3b2f-452c-a0ab-be3474f3b953" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:08:00 user nova-compute[70924]: DEBUG nova.compute.manager [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] Instance network_info: |[{"id": "7af29ac0-4a0d-41ab-b21e-bd3c215f1d00", "address": "fa:16:3e:39:4e:2c", "network": {"id": "c19ed38b-2acd-421a-9e4b-f60df3db2f1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1812407562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a974cbbf734f51897c3e632ae9e45f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7af29ac0-4a", "ovs_interfaceid": "7af29ac0-4a0d-41ab-b21e-bd3c215f1d00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 15:08:00 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c317f8a9-2b7e-4d76-b7e6-e642c39ce0bf req-9bd9fc3a-1173-4875-8e78-9660a93b64dd service nova] Acquired lock "refresh_cache-45a4c141-3b2f-452c-a0ab-be3474f3b953" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:08:00 user nova-compute[70924]: DEBUG nova.network.neutron [req-c317f8a9-2b7e-4d76-b7e6-e642c39ce0bf req-9bd9fc3a-1173-4875-8e78-9660a93b64dd service nova] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] Refreshing network info cache for port 7af29ac0-4a0d-41ab-b21e-bd3c215f1d00 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 15:08:00 user nova-compute[70924]: DEBUG nova.network.neutron [req-c317f8a9-2b7e-4d76-b7e6-e642c39ce0bf req-9bd9fc3a-1173-4875-8e78-9660a93b64dd service nova] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] Updated VIF entry in instance network info cache for port 7af29ac0-4a0d-41ab-b21e-bd3c215f1d00. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 15:08:00 user nova-compute[70924]: DEBUG nova.network.neutron [req-c317f8a9-2b7e-4d76-b7e6-e642c39ce0bf req-9bd9fc3a-1173-4875-8e78-9660a93b64dd service nova] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] Updating instance_info_cache with network_info: [{"id": "7af29ac0-4a0d-41ab-b21e-bd3c215f1d00", "address": "fa:16:3e:39:4e:2c", "network": {"id": "c19ed38b-2acd-421a-9e4b-f60df3db2f1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1812407562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a974cbbf734f51897c3e632ae9e45f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7af29ac0-4a", "ovs_interfaceid": "7af29ac0-4a0d-41ab-b21e-bd3c215f1d00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:08:00 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c317f8a9-2b7e-4d76-b7e6-e642c39ce0bf req-9bd9fc3a-1173-4875-8e78-9660a93b64dd service nova] Releasing lock "refresh_cache-45a4c141-3b2f-452c-a0ab-be3474f3b953" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:08:01 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:08:02 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:08:03 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Acquiring lock "5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:08:03 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Lock "5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:08:03 user nova-compute[70924]: DEBUG nova.compute.manager [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Starting instance... {{(pid=70924) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 15:08:03 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:08:03 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:08:03 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70924) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 15:08:03 user nova-compute[70924]: INFO nova.compute.claims [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Claim successful on node user
Jul 29 15:08:03 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:08:03 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:08:03 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.275s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:08:03 user nova-compute[70924]: DEBUG nova.compute.manager [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Start building networks asynchronously for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 15:08:03 user nova-compute[70924]: DEBUG nova.compute.manager [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Allocating IP information in the background. {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 15:08:03 user nova-compute[70924]: DEBUG nova.network.neutron [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] allocate_for_instance() {{(pid=70924) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 15:08:03 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 15:08:03 user nova-compute[70924]: DEBUG nova.compute.manager [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Start building block device mappings for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 15:08:04 user nova-compute[70924]: DEBUG nova.policy [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b5bbd4e5383b45539992fc66c28c11f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40fb0f2b05f34e648ae30bc15758df66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70924) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 15:08:04 user nova-compute[70924]: DEBUG nova.compute.manager [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Start spawning the instance on the hypervisor. {{(pid=70924) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 15:08:04 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Creating instance directory {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 15:08:04 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Creating image(s)
Jul 29 15:08:04 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Acquiring lock "/opt/stack/data/nova/instances/5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:08:04 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Lock "/opt/stack/data/nova/instances/5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:08:04 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Lock "/opt/stack/data/nova/instances/5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:08:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:08:04 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:08:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.150s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:08:04 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Acquiring lock "bd72453517468710f1de26b27fb0ea28688e9009" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:08:04 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:08:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:08:04 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:08:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.132s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:08:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9/disk 1073741824 {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:08:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9/disk 1073741824" returned: 0 in 0.054s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:08:04 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.192s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:08:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:08:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.132s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:08:04 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9/disk. size=1073741824 {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 15:08:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:08:04 user nova-compute[70924]: DEBUG nova.network.neutron [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Successfully created port: 6a119205-17da-4214-a6dc-6d19712e40f8 {{(pid=70924) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 15:08:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:08:04 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Cannot resize image /opt/stack/data/nova/instances/5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9/disk to a smaller size. {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 15:08:04 user nova-compute[70924]: DEBUG nova.objects.instance [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Lazy-loading 'migration_context' on Instance uuid 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:08:04 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Created local disks {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 15:08:04 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Ensure instance console log exists: /opt/stack/data/nova/instances/5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9/console.log {{(pid=70924) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 15:08:04 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:08:04 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:08:04 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG nova.network.neutron [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Successfully updated port: 6a119205-17da-4214-a6dc-6d19712e40f8 {{(pid=70924) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Acquiring lock "refresh_cache-5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Acquired lock "refresh_cache-5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG nova.network.neutron [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG nova.compute.manager [req-d882e58c-25e7-4a0a-8ad4-fa7f74954861 req-1e5b63ef-46f0-4fb9-9a0a-40cd3f06d6d4 service nova] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Received event network-changed-6a119205-17da-4214-a6dc-6d19712e40f8 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG nova.compute.manager [req-d882e58c-25e7-4a0a-8ad4-fa7f74954861 req-1e5b63ef-46f0-4fb9-9a0a-40cd3f06d6d4 service nova] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Refreshing instance network info cache due to event network-changed-6a119205-17da-4214-a6dc-6d19712e40f8. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-d882e58c-25e7-4a0a-8ad4-fa7f74954861 req-1e5b63ef-46f0-4fb9-9a0a-40cd3f06d6d4 service nova] Acquiring lock "refresh_cache-5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG nova.network.neutron [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Instance cache missing network info. {{(pid=70924) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG nova.compute.manager [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] Start spawning the instance on the hypervisor. {{(pid=70924) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] Creating instance directory {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 15:08:05 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] Creating image(s)
Jul 29 15:08:05 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] Did not create local disks {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] Ensure instance console log exists: /opt/stack/data/nova/instances/45a4c141-3b2f-452c-a0ab-be3474f3b953/console.log {{(pid=70924) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] Start _get_guest_xml network_info=[{"id": "7af29ac0-4a0d-41ab-b21e-bd3c215f1d00", "address": "fa:16:3e:39:4e:2c", "network": {"id": "c19ed38b-2acd-421a-9e4b-f60df3db2f1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1812407562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a974cbbf734f51897c3e632ae9e45f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7af29ac0-4a", "ovs_interfaceid": "7af29ac0-4a0d-41ab-b21e-bd3c215f1d00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ANSHrCvV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '45a4c141-3b2f-452c-a0ab-be3474f3b953', 'attached_at': '', 'detached_at': '', 'volume_id': '9d7c7925-8381-4bfc-aff1-c1948bbd7490', 'serial': '9d7c7925-8381-4bfc-aff1-c1948bbd7490'}, 'attachment_id': 'ad33b27d-cf78-4e13-bf35-b58b9b01464f', 'volume_type': None} {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 15:08:05 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:08:05 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:08:05 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] CPU controller missing on host. {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] CPU controller found on host. {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70924) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T14:36:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Flavor limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Image limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Flavor pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Image pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Got 1 possible topologies {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] Calling os-brick to attach iSCSI Volume {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ANSHrCvV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 15:08:05 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 15:08:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 15:08:05 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 15:08:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 15:08:05 user nova-compute[70924]: INFO os_brick.initiator.connectors.iscsi [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 15:08:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 -p 172.16.0.220:3260 {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b6e4255-2148-442d-af28-79cd7046ec0a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 15:08:05 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 -p 172.16.0.220:3260 --interface default --op new {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c456f50b-b871-4f4c-9682-bd88c49275e4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490] added\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490] added
Jul 29 15:08:05 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1adf2cb9-889b-41fa-86ee-46409bf8968b]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13ea6e8-9901-40c1-83d5-e8b1ef41887b]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ANSHrCvV {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ANSHrCvV" returned: 0 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[52815142-9d83-4fbe-a05c-2419cc9b9579]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ANSHrCvV'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c103ebb-0a0d-4db9-bd5f-2c4a47b44b77]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a40e2be-79a5-4733-a3a2-c58c567068ab]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 29 15:08:05 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 29 15:08:05 user nova-compute[70924]:  {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 15:08:05 user nova-compute[70924]: WARNING os_brick.initiator.connectors.iscsi [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 29 15:08:05 user nova-compute[70924]: 
Jul 29 15:08:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 -p 172.16.0.220:3260 --login {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG nova.network.neutron [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Updating instance_info_cache with network_info: [{"id": "6a119205-17da-4214-a6dc-6d19712e40f8", "address": "fa:16:3e:31:4f:9d", "network": {"id": "10f0e77e-05d5-4c59-972d-60af9bc958b2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-887718488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40fb0f2b05f34e648ae30bc15758df66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a119205-17", "ovs_interfaceid": "6a119205-17da-4214-a6dc-6d19712e40f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ba75d4-73ac-4055-ba0e-8b25afaf45a3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490, portal: 172.16.0.220,3260]
Jul 29 15:08:05 user nova-compute[70924]: Login to [iface: default, target: iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490, portal: 172.16.0.220,3260] successful.
Jul 29 15:08:05 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Releasing lock "refresh_cache-5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG nova.compute.manager [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Instance network_info: |[{"id": "6a119205-17da-4214-a6dc-6d19712e40f8", "address": "fa:16:3e:31:4f:9d", "network": {"id": "10f0e77e-05d5-4c59-972d-60af9bc958b2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-887718488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40fb0f2b05f34e648ae30bc15758df66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a119205-17", "ovs_interfaceid": "6a119205-17da-4214-a6dc-6d19712e40f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-d882e58c-25e7-4a0a-8ad4-fa7f74954861 req-1e5b63ef-46f0-4fb9-9a0a-40cd3f06d6d4 service nova] Acquired lock "refresh_cache-5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG nova.network.neutron [req-d882e58c-25e7-4a0a-8ad4-fa7f74954861 req-1e5b63ef-46f0-4fb9-9a0a-40cd3f06d6d4 service nova] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Refreshing network info cache for port 6a119205-17da-4214-a6dc-6d19712e40f8 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Start _get_guest_xml network_info=[{"id": "6a119205-17da-4214-a6dc-6d19712e40f8", "address": "fa:16:3e:31:4f:9d", "network": {"id": "10f0e77e-05d5-4c59-972d-60af9bc958b2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-887718488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40fb0f2b05f34e648ae30bc15758df66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a119205-17", "ovs_interfaceid": "6a119205-17da-4214-a6dc-6d19712e40f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '3aba2e73-6832-404b-8bd0-d0503ce82b8c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce042b3f-03c1-4ba4-af27-4c70b475878d]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:08:05 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:08:05 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:08:05 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] CPU controller missing on host. {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] CPU controller found on host. {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70924) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T14:36:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Flavor limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Image limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Flavor pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Image pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Got 1 possible topologies {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T15:08:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2010148558',display_name='tempest-TestServerVolumeAttachmentScenario-server-2010148558',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-2010148558',id=45,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLt99YqumusuTAjRBX9WbVgyzUc6lRH7yHU9R7lt65UH/4XS6rVqP5GqU01p7p153P9jMphLDkXYlmIKEfXbxr+QTGOcUcPHeWTZMYn5Vya2yRTPclYaHBG3soqiqvzGwA==',key_name='tempest-keypair-1890991636',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40fb0f2b05f34e648ae30bc15758df66',ramdisk_id='',reservation_id='r-0xmwjqy0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1208562195',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1208562195-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T15:08:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5bbd4e5383b45539992fc66c28c11f7',uuid=5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a119205-17da-4214-a6dc-6d19712e40f8", "address": "fa:16:3e:31:4f:9d", "network": {"id": "10f0e77e-05d5-4c59-972d-60af9bc958b2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-887718488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40fb0f2b05f34e648ae30bc15758df66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a119205-17", "ovs_interfaceid": "6a119205-17da-4214-a6dc-6d19712e40f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Converting VIF {"id": "6a119205-17da-4214-a6dc-6d19712e40f8", "address": "fa:16:3e:31:4f:9d", "network": {"id": "10f0e77e-05d5-4c59-972d-60af9bc958b2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-887718488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40fb0f2b05f34e648ae30bc15758df66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a119205-17", "ovs_interfaceid": "6a119205-17da-4214-a6dc-6d19712e40f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:4f:9d,bridge_name='br-int',has_traffic_filtering=True,id=6a119205-17da-4214-a6dc-6d19712e40f8,network=Network(10f0e77e-05d5-4c59-972d-60af9bc958b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a119205-17') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG nova.objects.instance [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Lazy-loading 'pci_devices' on Instance uuid 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d27053-6baa-4448-b5ec-dee107387894]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 (non-flash)
Jul 29 15:08:05 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 (non-flash)
Jul 29 15:08:05 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Connected to 172.16.0.220:3260 {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=70924) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70924) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] End _get_guest_xml xml=<domain type="kvm">
Jul 29 15:08:05 user nova-compute[70924]:   <uuid>5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9</uuid>
Jul 29 15:08:05 user nova-compute[70924]:   <name>instance-0000002d</name>
Jul 29 15:08:05 user nova-compute[70924]:   <memory>524288</memory>
Jul 29 15:08:05 user nova-compute[70924]:   <vcpu>1</vcpu>
Jul 29 15:08:05 user nova-compute[70924]:   <metadata>
Jul 29 15:08:05 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 15:08:05 user nova-compute[70924]:       <nova:package version="0.0.0"/>
Jul 29 15:08:05 user nova-compute[70924]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-2010148558</nova:name>
Jul 29 15:08:05 user nova-compute[70924]:       <nova:creationTime>2023-07-29 15:08:05</nova:creationTime>
Jul 29 15:08:05 user nova-compute[70924]:       <nova:flavor name="m1.tiny">
Jul 29 15:08:05 user nova-compute[70924]:         <nova:memory>512</nova:memory>
Jul 29 15:08:05 user nova-compute[70924]:         <nova:disk>1</nova:disk>
Jul 29 15:08:05 user nova-compute[70924]:         <nova:swap>0</nova:swap>
Jul 29 15:08:05 user nova-compute[70924]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 15:08:05 user nova-compute[70924]:         <nova:vcpus>1</nova:vcpus>
Jul 29 15:08:05 user nova-compute[70924]:       </nova:flavor>
Jul 29 15:08:05 user nova-compute[70924]:       <nova:owner>
Jul 29 15:08:05 user nova-compute[70924]:         <nova:user uuid="b5bbd4e5383b45539992fc66c28c11f7">tempest-TestServerVolumeAttachmentScenario-1208562195-project-member</nova:user>
Jul 29 15:08:05 user nova-compute[70924]:         <nova:project uuid="40fb0f2b05f34e648ae30bc15758df66">tempest-TestServerVolumeAttachmentScenario-1208562195</nova:project>
Jul 29 15:08:05 user nova-compute[70924]:       </nova:owner>
Jul 29 15:08:05 user nova-compute[70924]:       <nova:root type="image" uuid="3aba2e73-6832-404b-8bd0-d0503ce82b8c"/>
Jul 29 15:08:05 user nova-compute[70924]:       <nova:ports>
Jul 29 15:08:05 user nova-compute[70924]:         <nova:port uuid="6a119205-17da-4214-a6dc-6d19712e40f8">
Jul 29 15:08:05 user nova-compute[70924]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 29 15:08:05 user nova-compute[70924]:         </nova:port>
Jul 29 15:08:05 user nova-compute[70924]:       </nova:ports>
Jul 29 15:08:05 user nova-compute[70924]:     </nova:instance>
Jul 29 15:08:05 user nova-compute[70924]:   </metadata>
Jul 29 15:08:05 user nova-compute[70924]:   <sysinfo type="smbios">
Jul 29 15:08:05 user nova-compute[70924]:     <system>
Jul 29 15:08:05 user nova-compute[70924]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 15:08:05 user nova-compute[70924]:       <entry name="product">OpenStack Nova</entry>
Jul 29 15:08:05 user nova-compute[70924]:       <entry name="version">0.0.0</entry>
Jul 29 15:08:05 user nova-compute[70924]:       <entry name="serial">5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9</entry>
Jul 29 15:08:05 user nova-compute[70924]:       <entry name="uuid">5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9</entry>
Jul 29 15:08:05 user nova-compute[70924]:       <entry name="family">Virtual Machine</entry>
Jul 29 15:08:05 user nova-compute[70924]:     </system>
Jul 29 15:08:05 user nova-compute[70924]:   </sysinfo>
Jul 29 15:08:05 user nova-compute[70924]:   <os>
Jul 29 15:08:05 user nova-compute[70924]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 15:08:05 user nova-compute[70924]:     <boot dev="hd"/>
Jul 29 15:08:05 user nova-compute[70924]:     <smbios mode="sysinfo"/>
Jul 29 15:08:05 user nova-compute[70924]:   </os>
Jul 29 15:08:05 user nova-compute[70924]:   <features>
Jul 29 15:08:05 user nova-compute[70924]:     <acpi/>
Jul 29 15:08:05 user nova-compute[70924]:     <apic/>
Jul 29 15:08:05 user nova-compute[70924]:     <vmcoreinfo/>
Jul 29 15:08:05 user nova-compute[70924]:   </features>
Jul 29 15:08:05 user nova-compute[70924]:   <clock offset="utc">
Jul 29 15:08:05 user nova-compute[70924]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 15:08:05 user nova-compute[70924]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 15:08:05 user nova-compute[70924]:     <timer name="hpet" present="no"/>
Jul 29 15:08:05 user nova-compute[70924]:   </clock>
Jul 29 15:08:05 user nova-compute[70924]:   <cpu mode="custom" match="exact">
Jul 29 15:08:05 user nova-compute[70924]:     <model>Nehalem</model>
Jul 29 15:08:05 user nova-compute[70924]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 15:08:05 user nova-compute[70924]:   </cpu>
Jul 29 15:08:05 user nova-compute[70924]:   <devices>
Jul 29 15:08:05 user nova-compute[70924]:     <disk type="file" device="disk">
Jul 29 15:08:05 user nova-compute[70924]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 15:08:05 user nova-compute[70924]:       <source file="/opt/stack/data/nova/instances/5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9/disk"/>
Jul 29 15:08:05 user nova-compute[70924]:       <target dev="vda" bus="virtio"/>
Jul 29 15:08:05 user nova-compute[70924]:     </disk>
Jul 29 15:08:05 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 15:08:05 user nova-compute[70924]:       <mac address="fa:16:3e:31:4f:9d"/>
Jul 29 15:08:05 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 15:08:05 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 15:08:05 user nova-compute[70924]:       <target dev="tap6a119205-17"/>
Jul 29 15:08:05 user nova-compute[70924]:     </interface>
Jul 29 15:08:05 user nova-compute[70924]:     <serial type="pty">
Jul 29 15:08:05 user nova-compute[70924]:       <log file="/opt/stack/data/nova/instances/5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9/console.log" append="off"/>
Jul 29 15:08:05 user nova-compute[70924]:     </serial>
Jul 29 15:08:05 user nova-compute[70924]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 15:08:05 user nova-compute[70924]:     <video>
Jul 29 15:08:05 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 15:08:05 user nova-compute[70924]:     </video>
Jul 29 15:08:05 user nova-compute[70924]:     <rng model="virtio">
Jul 29 15:08:05 user nova-compute[70924]:       <backend model="random">/dev/urandom</backend>
Jul 29 15:08:05 user nova-compute[70924]:     </rng>
Jul 29 15:08:05 user nova-compute[70924]:     <controller type="usb" index="0" model="none"/>
Jul 29 15:08:05 user nova-compute[70924]:     <memballoon model="virtio">
Jul 29 15:08:05 user nova-compute[70924]:       <stats period="10"/>
Jul 29 15:08:05 user nova-compute[70924]:     </memballoon>
Jul 29 15:08:05 user nova-compute[70924]:   </devices>
Jul 29 15:08:05 user nova-compute[70924]: </domain>
Jul 29 15:08:05 user nova-compute[70924]:  {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T15:08:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2010148558',display_name='tempest-TestServerVolumeAttachmentScenario-server-2010148558',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-2010148558',id=45,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLt99YqumusuTAjRBX9WbVgyzUc6lRH7yHU9R7lt65UH/4XS6rVqP5GqU01p7p153P9jMphLDkXYlmIKEfXbxr+QTGOcUcPHeWTZMYn5Vya2yRTPclYaHBG3soqiqvzGwA==',key_name='tempest-keypair-1890991636',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40fb0f2b05f34e648ae30bc15758df66',ramdisk_id='',reservation_id='r-0xmwjqy0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1208562195',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1208562195-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T15:08:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5bbd4e5383b45539992fc66c28c11f7',uuid=5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a119205-17da-4214-a6dc-6d19712e40f8", "address": "fa:16:3e:31:4f:9d", "network": {"id": "10f0e77e-05d5-4c59-972d-60af9bc958b2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-887718488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40fb0f2b05f34e648ae30bc15758df66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a119205-17", "ovs_interfaceid": "6a119205-17da-4214-a6dc-6d19712e40f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Converting VIF {"id": "6a119205-17da-4214-a6dc-6d19712e40f8", "address": "fa:16:3e:31:4f:9d", "network": {"id": "10f0e77e-05d5-4c59-972d-60af9bc958b2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-887718488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40fb0f2b05f34e648ae30bc15758df66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a119205-17", "ovs_interfaceid": "6a119205-17da-4214-a6dc-6d19712e40f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:4f:9d,bridge_name='br-int',has_traffic_filtering=True,id=6a119205-17da-4214-a6dc-6d19712e40f8,network=Network(10f0e77e-05d5-4c59-972d-60af9bc958b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a119205-17') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG os_vif [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:4f:9d,bridge_name='br-int',has_traffic_filtering=True,id=6a119205-17da-4214-a6dc-6d19712e40f8,network=Network(10f0e77e-05d5-4c59-972d-60af9bc958b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a119205-17') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6a119205-17, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6a119205-17, col_values=(('external_ids', {'iface-id': '6a119205-17da-4214-a6dc-6d19712e40f8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:4f:9d', 'vm-uuid': '5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a19653-39a5-44f8-8b86-4e2562bcd2e4]: (4, ('- - 0', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ANSHrCvV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:08:05 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:08:05 user nova-compute[70924]: INFO os_vif [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:4f:9d,bridge_name='br-int',has_traffic_filtering=True,id=6a119205-17da-4214-a6dc-6d19712e40f8,network=Network(10f0e77e-05d5-4c59-972d-60af9bc958b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a119205-17')
Jul 29 15:08:06 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 15:08:06 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] No VIF found with MAC fa:16:3e:31:4f:9d, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 15:08:06 user nova-compute[70924]: DEBUG nova.network.neutron [req-d882e58c-25e7-4a0a-8ad4-fa7f74954861 req-1e5b63ef-46f0-4fb9-9a0a-40cd3f06d6d4 service nova] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Updated VIF entry in instance network info cache for port 6a119205-17da-4214-a6dc-6d19712e40f8. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 15:08:06 user nova-compute[70924]: DEBUG nova.network.neutron [req-d882e58c-25e7-4a0a-8ad4-fa7f74954861 req-1e5b63ef-46f0-4fb9-9a0a-40cd3f06d6d4 service nova] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Updating instance_info_cache with network_info: [{"id": "6a119205-17da-4214-a6dc-6d19712e40f8", "address": "fa:16:3e:31:4f:9d", "network": {"id": "10f0e77e-05d5-4c59-972d-60af9bc958b2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-887718488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40fb0f2b05f34e648ae30bc15758df66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a119205-17", "ovs_interfaceid": "6a119205-17da-4214-a6dc-6d19712e40f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:08:06 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-d882e58c-25e7-4a0a-8ad4-fa7f74954861 req-1e5b63ef-46f0-4fb9-9a0a-40cd3f06d6d4 service nova] Releasing lock "refresh_cache-5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:08:06 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:08:06 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 15:08:06 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23165663864343861', 'path': '/dev/sdb'} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 15:08:06 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165663864343861', 'path': '/dev/sdb'} {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 15:08:07 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T15:07:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2029591163',display_name='tempest-TestVolumeBootPattern-server-2029591163',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2029591163',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ85EoxOcLUTgXe8luwDJdmSAuW16EOphuu0LzU/6Hdmcve8fH6stAD+XoS0+shU7N/jDe0exnSkgWjCon0Br/QYJqNqli+yWYkmG2icNLlmtzdYRBdyLvXLjiH1TkzZOA==',key_name='tempest-TestVolumeBootPattern-447927024',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99a974cbbf734f51897c3e632ae9e45f',ramdisk_id='',reservation_id='r-46wtb8mc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1030839740',owner_user_name='tempest-TestVolumeBootPattern-1030839740-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T15:07:58Z,user_data=None,user_id='da204646e8f84693ad470ed1d3eadd7c',uuid=45a4c141-3b2f-452c-a0ab-be3474f3b953,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7af29ac0-4a0d-41ab-b21e-bd3c215f1d00", "address": "fa:16:3e:39:4e:2c", "network": {"id": "c19ed38b-2acd-421a-9e4b-f60df3db2f1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1812407562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a974cbbf734f51897c3e632ae9e45f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7af29ac0-4a", "ovs_interfaceid": "7af29ac0-4a0d-41ab-b21e-bd3c215f1d00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 15:08:07 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Converting VIF {"id": "7af29ac0-4a0d-41ab-b21e-bd3c215f1d00", "address": "fa:16:3e:39:4e:2c", "network": {"id": "c19ed38b-2acd-421a-9e4b-f60df3db2f1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1812407562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a974cbbf734f51897c3e632ae9e45f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7af29ac0-4a", "ovs_interfaceid": "7af29ac0-4a0d-41ab-b21e-bd3c215f1d00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 15:08:07 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:4e:2c,bridge_name='br-int',has_traffic_filtering=True,id=7af29ac0-4a0d-41ab-b21e-bd3c215f1d00,network=Network(c19ed38b-2acd-421a-9e4b-f60df3db2f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7af29ac0-4a') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 15:08:07 user nova-compute[70924]: DEBUG nova.objects.instance [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lazy-loading 'pci_devices' on Instance uuid 45a4c141-3b2f-452c-a0ab-be3474f3b953 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:08:07 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] End _get_guest_xml xml=<domain type="kvm">
Jul 29 15:08:07 user nova-compute[70924]:   <uuid>45a4c141-3b2f-452c-a0ab-be3474f3b953</uuid>
Jul 29 15:08:07 user nova-compute[70924]:   <name>instance-0000002c</name>
Jul 29 15:08:07 user nova-compute[70924]:   <memory>524288</memory>
Jul 29 15:08:07 user nova-compute[70924]:   <vcpu>1</vcpu>
Jul 29 15:08:07 user nova-compute[70924]:   <metadata>
Jul 29 15:08:07 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 15:08:07 user nova-compute[70924]:       <nova:package version="0.0.0"/>
Jul 29 15:08:07 user nova-compute[70924]:       <nova:name>tempest-TestVolumeBootPattern-server-2029591163</nova:name>
Jul 29 15:08:07 user nova-compute[70924]:       <nova:creationTime>2023-07-29 15:08:05</nova:creationTime>
Jul 29 15:08:07 user nova-compute[70924]:       <nova:flavor name="m1.tiny">
Jul 29 15:08:07 user nova-compute[70924]:         <nova:memory>512</nova:memory>
Jul 29 15:08:07 user nova-compute[70924]:         <nova:disk>1</nova:disk>
Jul 29 15:08:07 user nova-compute[70924]:         <nova:swap>0</nova:swap>
Jul 29 15:08:07 user nova-compute[70924]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 15:08:07 user nova-compute[70924]:         <nova:vcpus>1</nova:vcpus>
Jul 29 15:08:07 user nova-compute[70924]:       </nova:flavor>
Jul 29 15:08:07 user nova-compute[70924]:       <nova:owner>
Jul 29 15:08:07 user nova-compute[70924]:         <nova:user uuid="da204646e8f84693ad470ed1d3eadd7c">tempest-TestVolumeBootPattern-1030839740-project-member</nova:user>
Jul 29 15:08:07 user nova-compute[70924]:         <nova:project uuid="99a974cbbf734f51897c3e632ae9e45f">tempest-TestVolumeBootPattern-1030839740</nova:project>
Jul 29 15:08:07 user nova-compute[70924]:       </nova:owner>
Jul 29 15:08:07 user nova-compute[70924]:       <nova:ports>
Jul 29 15:08:07 user nova-compute[70924]:         <nova:port uuid="7af29ac0-4a0d-41ab-b21e-bd3c215f1d00">
Jul 29 15:08:07 user nova-compute[70924]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 29 15:08:07 user nova-compute[70924]:         </nova:port>
Jul 29 15:08:07 user nova-compute[70924]:       </nova:ports>
Jul 29 15:08:07 user nova-compute[70924]:     </nova:instance>
Jul 29 15:08:07 user nova-compute[70924]:   </metadata>
Jul 29 15:08:07 user nova-compute[70924]:   <sysinfo type="smbios">
Jul 29 15:08:07 user nova-compute[70924]:     <system>
Jul 29 15:08:07 user nova-compute[70924]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 15:08:07 user nova-compute[70924]:       <entry name="product">OpenStack Nova</entry>
Jul 29 15:08:07 user nova-compute[70924]:       <entry name="version">0.0.0</entry>
Jul 29 15:08:07 user nova-compute[70924]:       <entry name="serial">45a4c141-3b2f-452c-a0ab-be3474f3b953</entry>
Jul 29 15:08:07 user nova-compute[70924]:       <entry name="uuid">45a4c141-3b2f-452c-a0ab-be3474f3b953</entry>
Jul 29 15:08:07 user nova-compute[70924]:       <entry name="family">Virtual Machine</entry>
Jul 29 15:08:07 user nova-compute[70924]:     </system>
Jul 29 15:08:07 user nova-compute[70924]:   </sysinfo>
Jul 29 15:08:07 user nova-compute[70924]:   <os>
Jul 29 15:08:07 user nova-compute[70924]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 15:08:07 user nova-compute[70924]:     <boot dev="hd"/>
Jul 29 15:08:07 user nova-compute[70924]:     <smbios mode="sysinfo"/>
Jul 29 15:08:07 user nova-compute[70924]:   </os>
Jul 29 15:08:07 user nova-compute[70924]:   <features>
Jul 29 15:08:07 user nova-compute[70924]:     <acpi/>
Jul 29 15:08:07 user nova-compute[70924]:     <apic/>
Jul 29 15:08:07 user nova-compute[70924]:     <vmcoreinfo/>
Jul 29 15:08:07 user nova-compute[70924]:   </features>
Jul 29 15:08:07 user nova-compute[70924]:   <clock offset="utc">
Jul 29 15:08:07 user nova-compute[70924]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 15:08:07 user nova-compute[70924]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 15:08:07 user nova-compute[70924]:     <timer name="hpet" present="no"/>
Jul 29 15:08:07 user nova-compute[70924]:   </clock>
Jul 29 15:08:07 user nova-compute[70924]:   <cpu mode="custom" match="exact">
Jul 29 15:08:07 user nova-compute[70924]:     <model>Nehalem</model>
Jul 29 15:08:07 user nova-compute[70924]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 15:08:07 user nova-compute[70924]:   </cpu>
Jul 29 15:08:07 user nova-compute[70924]:   <devices>
Jul 29 15:08:07 user nova-compute[70924]:     <disk type="block" device="disk">
Jul 29 15:08:07 user nova-compute[70924]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 15:08:07 user nova-compute[70924]:       <source dev="/dev/sdb"/>
Jul 29 15:08:07 user nova-compute[70924]:       <target dev="vda" bus="virtio"/>
Jul 29 15:08:07 user nova-compute[70924]:       <serial>9d7c7925-8381-4bfc-aff1-c1948bbd7490</serial>
Jul 29 15:08:07 user nova-compute[70924]:     </disk>
Jul 29 15:08:07 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 15:08:07 user nova-compute[70924]:       <mac address="fa:16:3e:39:4e:2c"/>
Jul 29 15:08:07 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 15:08:07 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 15:08:07 user nova-compute[70924]:       <target dev="tap7af29ac0-4a"/>
Jul 29 15:08:07 user nova-compute[70924]:     </interface>
Jul 29 15:08:07 user nova-compute[70924]:     <serial type="pty">
Jul 29 15:08:07 user nova-compute[70924]:       <log file="/opt/stack/data/nova/instances/45a4c141-3b2f-452c-a0ab-be3474f3b953/console.log" append="off"/>
Jul 29 15:08:07 user nova-compute[70924]:     </serial>
Jul 29 15:08:07 user nova-compute[70924]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 15:08:07 user nova-compute[70924]:     <video>
Jul 29 15:08:07 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 15:08:07 user nova-compute[70924]:     </video>
Jul 29 15:08:07 user nova-compute[70924]:     <rng model="virtio">
Jul 29 15:08:07 user nova-compute[70924]:       <backend model="random">/dev/urandom</backend>
Jul 29 15:08:07 user nova-compute[70924]:     </rng>
Jul 29 15:08:07 user nova-compute[70924]:     <controller type="usb" index="0" model="none"/>
Jul 29 15:08:07 user nova-compute[70924]:     <memballoon model="virtio">
Jul 29 15:08:07 user nova-compute[70924]:       <stats period="10"/>
Jul 29 15:08:07 user nova-compute[70924]:     </memballoon>
Jul 29 15:08:07 user nova-compute[70924]:   </devices>
Jul 29 15:08:07 user nova-compute[70924]: </domain>
Jul 29 15:08:07 user nova-compute[70924]:  {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 15:08:07 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T15:07:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2029591163',display_name='tempest-TestVolumeBootPattern-server-2029591163',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2029591163',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ85EoxOcLUTgXe8luwDJdmSAuW16EOphuu0LzU/6Hdmcve8fH6stAD+XoS0+shU7N/jDe0exnSkgWjCon0Br/QYJqNqli+yWYkmG2icNLlmtzdYRBdyLvXLjiH1TkzZOA==',key_name='tempest-TestVolumeBootPattern-447927024',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99a974cbbf734f51897c3e632ae9e45f',ramdisk_id='',reservation_id='r-46wtb8mc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1030839740',owner_user_name='tempest-TestVolumeBootPattern-1030839740-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T15:07:58Z,user_data=None,user_id='da204646e8f84693ad470ed1d3eadd7c',uuid=45a4c141-3b2f-452c-a0ab-be3474f3b953,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7af29ac0-4a0d-41ab-b21e-bd3c215f1d00", "address": "fa:16:3e:39:4e:2c", "network": {"id": "c19ed38b-2acd-421a-9e4b-f60df3db2f1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1812407562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a974cbbf734f51897c3e632ae9e45f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7af29ac0-4a", "ovs_interfaceid": "7af29ac0-4a0d-41ab-b21e-bd3c215f1d00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 15:08:07 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Converting VIF {"id": "7af29ac0-4a0d-41ab-b21e-bd3c215f1d00", "address": "fa:16:3e:39:4e:2c", "network": {"id": "c19ed38b-2acd-421a-9e4b-f60df3db2f1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1812407562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a974cbbf734f51897c3e632ae9e45f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7af29ac0-4a", "ovs_interfaceid": "7af29ac0-4a0d-41ab-b21e-bd3c215f1d00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 15:08:07 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:4e:2c,bridge_name='br-int',has_traffic_filtering=True,id=7af29ac0-4a0d-41ab-b21e-bd3c215f1d00,network=Network(c19ed38b-2acd-421a-9e4b-f60df3db2f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7af29ac0-4a') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 15:08:07 user nova-compute[70924]: DEBUG os_vif [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:4e:2c,bridge_name='br-int',has_traffic_filtering=True,id=7af29ac0-4a0d-41ab-b21e-bd3c215f1d00,network=Network(c19ed38b-2acd-421a-9e4b-f60df3db2f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7af29ac0-4a') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 15:08:07 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:08:07 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:08:07 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 15:08:07 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:08:07 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7af29ac0-4a, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:08:07 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7af29ac0-4a, col_values=(('external_ids', {'iface-id': '7af29ac0-4a0d-41ab-b21e-bd3c215f1d00', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:4e:2c', 'vm-uuid': '45a4c141-3b2f-452c-a0ab-be3474f3b953'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:08:07 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:08:07 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:08:07 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:08:07 user nova-compute[70924]: INFO os_vif [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:4e:2c,bridge_name='br-int',has_traffic_filtering=True,id=7af29ac0-4a0d-41ab-b21e-bd3c215f1d00,network=Network(c19ed38b-2acd-421a-9e4b-f60df3db2f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7af29ac0-4a')
Jul 29 15:08:07 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 15:08:07 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] No VIF found with MAC fa:16:3e:39:4e:2c, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 15:08:07 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:08:07 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:08:07 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:08:07 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:08:07 user nova-compute[70924]: DEBUG nova.compute.manager [req-515e746a-a1d4-494a-9006-70e81817f4bd req-02ad11e4-f2cb-4eca-9492-5c0f96ae852c service nova] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Received event network-vif-plugged-6a119205-17da-4214-a6dc-6d19712e40f8 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:08:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-515e746a-a1d4-494a-9006-70e81817f4bd req-02ad11e4-f2cb-4eca-9492-5c0f96ae852c service nova] Acquiring lock "5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:08:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-515e746a-a1d4-494a-9006-70e81817f4bd req-02ad11e4-f2cb-4eca-9492-5c0f96ae852c service nova] Lock "5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:08:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-515e746a-a1d4-494a-9006-70e81817f4bd req-02ad11e4-f2cb-4eca-9492-5c0f96ae852c service nova] Lock "5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:08:07 user nova-compute[70924]: DEBUG nova.compute.manager [req-515e746a-a1d4-494a-9006-70e81817f4bd req-02ad11e4-f2cb-4eca-9492-5c0f96ae852c service nova] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] No waiting events found dispatching network-vif-plugged-6a119205-17da-4214-a6dc-6d19712e40f8 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:08:07 user nova-compute[70924]: WARNING nova.compute.manager [req-515e746a-a1d4-494a-9006-70e81817f4bd req-02ad11e4-f2cb-4eca-9492-5c0f96ae852c service nova] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Received unexpected event network-vif-plugged-6a119205-17da-4214-a6dc-6d19712e40f8 for instance with vm_state building and task_state spawning.
Jul 29 15:08:07 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:08:07 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:08:07 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:08:07 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:08:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:08:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-6c64f01d-b34b-41e8-819f-a705f4d63e89 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Acquiring lock "751027e8-91d2-4374-94cb-f4a840d7f7be" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:08:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-6c64f01d-b34b-41e8-819f-a705f4d63e89 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "751027e8-91d2-4374-94cb-f4a840d7f7be" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:08:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-6c64f01d-b34b-41e8-819f-a705f4d63e89 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Acquiring lock "751027e8-91d2-4374-94cb-f4a840d7f7be-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:08:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-6c64f01d-b34b-41e8-819f-a705f4d63e89 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "751027e8-91d2-4374-94cb-f4a840d7f7be-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:08:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-6c64f01d-b34b-41e8-819f-a705f4d63e89 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "751027e8-91d2-4374-94cb-f4a840d7f7be-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:08:08 user nova-compute[70924]: INFO nova.compute.manager [None req-6c64f01d-b34b-41e8-819f-a705f4d63e89 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Terminating instance
Jul 29 15:08:08 user nova-compute[70924]: DEBUG nova.compute.manager [None req-6c64f01d-b34b-41e8-819f-a705f4d63e89 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Start destroying the instance on the hypervisor. {{(pid=70924) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 15:08:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:08:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:08:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:08:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:08:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:08:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:08:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:08:08 user nova-compute[70924]: DEBUG nova.compute.manager [req-b0643e34-040c-4980-8255-ff4bc250226e req-1e20ca32-862b-426d-bd8b-5abaf8536d48 service nova] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Received event network-vif-unplugged-b5f58bd0-1ebf-476d-8c8d-2345228572b2 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:08:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b0643e34-040c-4980-8255-ff4bc250226e req-1e20ca32-862b-426d-bd8b-5abaf8536d48 service nova] Acquiring lock "751027e8-91d2-4374-94cb-f4a840d7f7be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:08:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b0643e34-040c-4980-8255-ff4bc250226e req-1e20ca32-862b-426d-bd8b-5abaf8536d48 service nova] Lock "751027e8-91d2-4374-94cb-f4a840d7f7be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:08:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b0643e34-040c-4980-8255-ff4bc250226e req-1e20ca32-862b-426d-bd8b-5abaf8536d48 service nova] Lock "751027e8-91d2-4374-94cb-f4a840d7f7be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:08:08 user nova-compute[70924]: DEBUG nova.compute.manager [req-b0643e34-040c-4980-8255-ff4bc250226e req-1e20ca32-862b-426d-bd8b-5abaf8536d48 service nova] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] No waiting events found dispatching network-vif-unplugged-b5f58bd0-1ebf-476d-8c8d-2345228572b2 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:08:08 user nova-compute[70924]: DEBUG nova.compute.manager [req-b0643e34-040c-4980-8255-ff4bc250226e req-1e20ca32-862b-426d-bd8b-5abaf8536d48 service nova] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Received event network-vif-unplugged-b5f58bd0-1ebf-476d-8c8d-2345228572b2 for instance with task_state deleting. {{(pid=70924) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 15:08:09 user nova-compute[70924]: DEBUG nova.compute.manager [req-a60bde15-4c31-44cf-8d93-045fd9f8f85d req-9ad987da-5a28-42f1-b100-9e14e8e1a5ab service nova] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] Received event network-vif-plugged-7af29ac0-4a0d-41ab-b21e-bd3c215f1d00 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:08:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a60bde15-4c31-44cf-8d93-045fd9f8f85d req-9ad987da-5a28-42f1-b100-9e14e8e1a5ab service nova] Acquiring lock "45a4c141-3b2f-452c-a0ab-be3474f3b953-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:08:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a60bde15-4c31-44cf-8d93-045fd9f8f85d req-9ad987da-5a28-42f1-b100-9e14e8e1a5ab service nova] Lock "45a4c141-3b2f-452c-a0ab-be3474f3b953-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:08:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a60bde15-4c31-44cf-8d93-045fd9f8f85d req-9ad987da-5a28-42f1-b100-9e14e8e1a5ab service nova] Lock "45a4c141-3b2f-452c-a0ab-be3474f3b953-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:08:09 user nova-compute[70924]: DEBUG nova.compute.manager [req-a60bde15-4c31-44cf-8d93-045fd9f8f85d req-9ad987da-5a28-42f1-b100-9e14e8e1a5ab service nova] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] No waiting events found dispatching network-vif-plugged-7af29ac0-4a0d-41ab-b21e-bd3c215f1d00 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:08:09 user nova-compute[70924]: WARNING nova.compute.manager [req-a60bde15-4c31-44cf-8d93-045fd9f8f85d req-9ad987da-5a28-42f1-b100-9e14e8e1a5ab service nova] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] Received unexpected event network-vif-plugged-7af29ac0-4a0d-41ab-b21e-bd3c215f1d00 for instance with vm_state building and task_state spawning.
Jul 29 15:08:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:08:09 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:08:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:08:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:08:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:08:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:08:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:08:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:08:09 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Instance destroyed successfully.
Jul 29 15:08:09 user nova-compute[70924]: DEBUG nova.objects.instance [None req-6c64f01d-b34b-41e8-819f-a705f4d63e89 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lazy-loading 'resources' on Instance uuid 751027e8-91d2-4374-94cb-f4a840d7f7be {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:08:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:08:09 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-6c64f01d-b34b-41e8-819f-a705f4d63e89 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T15:05:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1548475347',display_name='tempest-AttachVolumeNegativeTest-server-1548475347',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1548475347',id=42,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEoWXwWSFgorilAbFT1ywLFvMQVbiwX/7wp6J1An4awoQ35nzJw+zlCXbxpIaotB7kFkvTCzAhAQ67MBalG1OCLhplba/XPjeJ341mkN+fMMdedopFzz6iMvR5bExrDsAw==',key_name='tempest-keypair-998531151',keypairs=<?>,launch_index=0,launched_at=2023-07-29T15:05:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9aadc9385b3b46eebc6e0d81814521af',ramdisk_id='',reservation_id='r-058e53e4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-972203101',owner_user_name='tempest-AttachVolumeNegativeTest-972203101-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T15:05:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='12cb8299e4d24946bc41a86493f4b426',uuid=751027e8-91d2-4374-94cb-f4a840d7f7be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b5f58bd0-1ebf-476d-8c8d-2345228572b2", "address": "fa:16:3e:fc:c7:7d", "network": {"id": "f80826fa-fada-45b9-b969-fd539fd34fd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-465377443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9aadc9385b3b46eebc6e0d81814521af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f58bd0-1e", "ovs_interfaceid": "b5f58bd0-1ebf-476d-8c8d-2345228572b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 15:08:09 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-6c64f01d-b34b-41e8-819f-a705f4d63e89 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Converting VIF {"id": "b5f58bd0-1ebf-476d-8c8d-2345228572b2", "address": "fa:16:3e:fc:c7:7d", "network": {"id": "f80826fa-fada-45b9-b969-fd539fd34fd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-465377443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9aadc9385b3b46eebc6e0d81814521af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f58bd0-1e", "ovs_interfaceid": "b5f58bd0-1ebf-476d-8c8d-2345228572b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 15:08:09 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-6c64f01d-b34b-41e8-819f-a705f4d63e89 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:c7:7d,bridge_name='br-int',has_traffic_filtering=True,id=b5f58bd0-1ebf-476d-8c8d-2345228572b2,network=Network(f80826fa-fada-45b9-b969-fd539fd34fd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f58bd0-1e') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 15:08:09 user nova-compute[70924]: DEBUG os_vif [None req-6c64f01d-b34b-41e8-819f-a705f4d63e89 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:c7:7d,bridge_name='br-int',has_traffic_filtering=True,id=b5f58bd0-1ebf-476d-8c8d-2345228572b2,network=Network(f80826fa-fada-45b9-b969-fd539fd34fd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f58bd0-1e') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 15:08:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:08:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb5f58bd0-1e, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:08:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:08:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:08:09 user nova-compute[70924]: INFO os_vif [None req-6c64f01d-b34b-41e8-819f-a705f4d63e89 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:c7:7d,bridge_name='br-int',has_traffic_filtering=True,id=b5f58bd0-1ebf-476d-8c8d-2345228572b2,network=Network(f80826fa-fada-45b9-b969-fd539fd34fd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f58bd0-1e')
Jul 29 15:08:09 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-6c64f01d-b34b-41e8-819f-a705f4d63e89 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Deleting instance files /opt/stack/data/nova/instances/751027e8-91d2-4374-94cb-f4a840d7f7be_del
Jul 29 15:08:09 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-6c64f01d-b34b-41e8-819f-a705f4d63e89 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Deletion of /opt/stack/data/nova/instances/751027e8-91d2-4374-94cb-f4a840d7f7be_del complete
Jul 29 15:08:09 user nova-compute[70924]: INFO nova.compute.manager [None req-6c64f01d-b34b-41e8-819f-a705f4d63e89 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Took 1.09 seconds to destroy the instance on the hypervisor.
Jul 29 15:08:09 user nova-compute[70924]: DEBUG oslo.service.loopingcall [None req-6c64f01d-b34b-41e8-819f-a705f4d63e89 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70924) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 15:08:09 user nova-compute[70924]: DEBUG nova.compute.manager [-] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Deallocating network for instance {{(pid=70924) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 15:08:09 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] deallocate_for_instance() {{(pid=70924) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 15:08:09 user nova-compute[70924]: DEBUG nova.compute.manager [req-d95b1541-924f-4cd4-aeed-0c73eda295ce req-e18aca1a-9ba4-4dd3-a878-5e2fa898a41b service nova] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Received event network-vif-plugged-6a119205-17da-4214-a6dc-6d19712e40f8 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:08:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-d95b1541-924f-4cd4-aeed-0c73eda295ce req-e18aca1a-9ba4-4dd3-a878-5e2fa898a41b service nova] Acquiring lock "5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:08:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-d95b1541-924f-4cd4-aeed-0c73eda295ce req-e18aca1a-9ba4-4dd3-a878-5e2fa898a41b service nova] Lock "5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:08:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-d95b1541-924f-4cd4-aeed-0c73eda295ce req-e18aca1a-9ba4-4dd3-a878-5e2fa898a41b service nova] Lock "5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:08:09 user nova-compute[70924]: DEBUG nova.compute.manager [req-d95b1541-924f-4cd4-aeed-0c73eda295ce req-e18aca1a-9ba4-4dd3-a878-5e2fa898a41b service nova] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] No waiting events found dispatching network-vif-plugged-6a119205-17da-4214-a6dc-6d19712e40f8 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:08:09 user nova-compute[70924]: WARNING nova.compute.manager [req-d95b1541-924f-4cd4-aeed-0c73eda295ce req-e18aca1a-9ba4-4dd3-a878-5e2fa898a41b service nova] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Received unexpected event network-vif-plugged-6a119205-17da-4214-a6dc-6d19712e40f8 for instance with vm_state building and task_state spawning.
Jul 29 15:08:10 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:08:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:08:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:08:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:08:10 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Auditing locally available compute resources for user (node: user) {{(pid=70924) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 15:08:10 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:08:10 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Took 0.87 seconds to deallocate network for instance.
Jul 29 15:08:10 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 15:08:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:08:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-6c64f01d-b34b-41e8-819f-a705f4d63e89 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:08:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-6c64f01d-b34b-41e8-819f-a705f4d63e89 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:08:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:08:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:08:10 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-6c64f01d-b34b-41e8-819f-a705f4d63e89 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:08:10 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-6c64f01d-b34b-41e8-819f-a705f4d63e89 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:08:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:08:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-6c64f01d-b34b-41e8-819f-a705f4d63e89 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.247s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:08:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a8fe938-7ca4-4221-9742-9b043050ba84/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:08:10 user nova-compute[70924]: INFO nova.scheduler.client.report [None req-6c64f01d-b34b-41e8-819f-a705f4d63e89 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Deleted allocations for instance 751027e8-91d2-4374-94cb-f4a840d7f7be
Jul 29 15:08:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-6c64f01d-b34b-41e8-819f-a705f4d63e89 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "751027e8-91d2-4374-94cb-f4a840d7f7be" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.465s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:08:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a8fe938-7ca4-4221-9742-9b043050ba84/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:08:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a8fe938-7ca4-4221-9742-9b043050ba84/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:08:11 user nova-compute[70924]: DEBUG nova.compute.manager [req-12579763-9f0c-4a97-b12e-c3fa2bb6ddc4 req-bf2cae1d-f7ef-4ad5-b0eb-58af97ae2e4b service nova] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Received event network-vif-plugged-b5f58bd0-1ebf-476d-8c8d-2345228572b2 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:08:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-12579763-9f0c-4a97-b12e-c3fa2bb6ddc4 req-bf2cae1d-f7ef-4ad5-b0eb-58af97ae2e4b service nova] Acquiring lock "751027e8-91d2-4374-94cb-f4a840d7f7be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:08:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-12579763-9f0c-4a97-b12e-c3fa2bb6ddc4 req-bf2cae1d-f7ef-4ad5-b0eb-58af97ae2e4b service nova] Lock "751027e8-91d2-4374-94cb-f4a840d7f7be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:08:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-12579763-9f0c-4a97-b12e-c3fa2bb6ddc4 req-bf2cae1d-f7ef-4ad5-b0eb-58af97ae2e4b service nova] Lock "751027e8-91d2-4374-94cb-f4a840d7f7be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:08:11 user nova-compute[70924]: DEBUG nova.compute.manager [req-12579763-9f0c-4a97-b12e-c3fa2bb6ddc4 req-bf2cae1d-f7ef-4ad5-b0eb-58af97ae2e4b service nova] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] No waiting events found dispatching network-vif-plugged-b5f58bd0-1ebf-476d-8c8d-2345228572b2 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:08:11 user nova-compute[70924]: WARNING nova.compute.manager [req-12579763-9f0c-4a97-b12e-c3fa2bb6ddc4 req-bf2cae1d-f7ef-4ad5-b0eb-58af97ae2e4b service nova] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Received unexpected event network-vif-plugged-b5f58bd0-1ebf-476d-8c8d-2345228572b2 for instance with vm_state deleted and task_state None.
Jul 29 15:08:11 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690643291.0511227, 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9 => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 15:08:11 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] VM Resumed (Lifecycle Event)
Jul 29 15:08:11 user nova-compute[70924]: DEBUG nova.compute.manager [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Instance event wait completed in 0 seconds for  {{(pid=70924) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 15:08:11 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Guest created on hypervisor {{(pid=70924) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 15:08:11 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Instance spawned successfully.
Jul 29 15:08:11 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 15:08:11 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:08:11 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 15:08:11 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Found default for hw_cdrom_bus of ide {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:08:11 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Found default for hw_disk_bus of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:08:11 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Found default for hw_input_bus of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:08:11 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Found default for hw_pointer_model of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:08:11 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Found default for hw_video_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:08:11 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Found default for hw_vif_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:08:11 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 15:08:11 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690643291.058357, 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9 => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 15:08:11 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] VM Started (Lifecycle Event)
Jul 29 15:08:11 user nova-compute[70924]: DEBUG nova.compute.manager [req-23003865-0ca4-4d00-ae7d-f266479df21b req-8c1cdab1-6301-4ef7-8632-f1282931b36d service nova] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] Received event network-vif-plugged-7af29ac0-4a0d-41ab-b21e-bd3c215f1d00 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:08:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-23003865-0ca4-4d00-ae7d-f266479df21b req-8c1cdab1-6301-4ef7-8632-f1282931b36d service nova] Acquiring lock "45a4c141-3b2f-452c-a0ab-be3474f3b953-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:08:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-23003865-0ca4-4d00-ae7d-f266479df21b req-8c1cdab1-6301-4ef7-8632-f1282931b36d service nova] Lock "45a4c141-3b2f-452c-a0ab-be3474f3b953-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:08:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-23003865-0ca4-4d00-ae7d-f266479df21b req-8c1cdab1-6301-4ef7-8632-f1282931b36d service nova] Lock "45a4c141-3b2f-452c-a0ab-be3474f3b953-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:08:11 user nova-compute[70924]: DEBUG nova.compute.manager [req-23003865-0ca4-4d00-ae7d-f266479df21b req-8c1cdab1-6301-4ef7-8632-f1282931b36d service nova] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] No waiting events found dispatching network-vif-plugged-7af29ac0-4a0d-41ab-b21e-bd3c215f1d00 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:08:11 user nova-compute[70924]: WARNING nova.compute.manager [req-23003865-0ca4-4d00-ae7d-f266479df21b req-8c1cdab1-6301-4ef7-8632-f1282931b36d service nova] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] Received unexpected event network-vif-plugged-7af29ac0-4a0d-41ab-b21e-bd3c215f1d00 for instance with vm_state building and task_state spawning.
Jul 29 15:08:11 user nova-compute[70924]: DEBUG nova.compute.manager [req-23003865-0ca4-4d00-ae7d-f266479df21b req-8c1cdab1-6301-4ef7-8632-f1282931b36d service nova] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Received event network-vif-deleted-b5f58bd0-1ebf-476d-8c8d-2345228572b2 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:08:11 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:08:11 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 15:08:11 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 15:08:11 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a8fe938-7ca4-4221-9742-9b043050ba84/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:08:11 user nova-compute[70924]: INFO nova.compute.manager [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Took 7.09 seconds to spawn the instance on the hypervisor.
Jul 29 15:08:11 user nova-compute[70924]: DEBUG nova.compute.manager [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:08:11 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690643291.2871392, 45a4c141-3b2f-452c-a0ab-be3474f3b953 => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 15:08:11 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] VM Resumed (Lifecycle Event)
Jul 29 15:08:11 user nova-compute[70924]: DEBUG nova.compute.manager [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] Instance event wait completed in 0 seconds for  {{(pid=70924) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 15:08:11 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] Guest created on hypervisor {{(pid=70924) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 15:08:11 user nova-compute[70924]: INFO nova.compute.manager [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Took 8.05 seconds to build instance.
Jul 29 15:08:11 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:08:11 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 15:08:11 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] Instance spawned successfully.
Jul 29 15:08:11 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 15:08:11 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:08:11 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:08:11 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Hypervisor/Node resource view: name=user free_ram=8569MB free_disk=25.34876251220703GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70924) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 15:08:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:08:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:08:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-613cb4c4-64cc-47c5-92a6-ca39ad7b26b5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Lock "5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.164s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:08:11 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 15:08:11 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690643291.288427, 45a4c141-3b2f-452c-a0ab-be3474f3b953 => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 15:08:11 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] VM Started (Lifecycle Event)
Jul 29 15:08:11 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] Found default for hw_cdrom_bus of ide {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:08:11 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] Found default for hw_disk_bus of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:08:11 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] Found default for hw_input_bus of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:08:11 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] Found default for hw_pointer_model of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:08:11 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] Found default for hw_video_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:08:11 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] Found default for hw_vif_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:08:11 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:08:11 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 15:08:11 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 15:08:11 user nova-compute[70924]: INFO nova.compute.manager [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] Took 6.17 seconds to spawn the instance on the hypervisor.
Jul 29 15:08:11 user nova-compute[70924]: DEBUG nova.compute.manager [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:08:11 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 0a8fe938-7ca4-4221-9742-9b043050ba84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:08:11 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 45a4c141-3b2f-452c-a0ab-be3474f3b953 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:08:11 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:08:11 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 15:08:11 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 15:08:11 user nova-compute[70924]: INFO nova.compute.manager [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] Took 14.65 seconds to build instance.
Jul 29 15:08:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-b1c34ccc-4db5-469a-bc41-e8a18fbc7717 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "45a4c141-3b2f-452c-a0ab-be3474f3b953" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.752s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:08:11 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:08:11 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:08:11 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Compute_service record updated for user:user {{(pid=70924) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 15:08:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.285s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:08:12 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:08:12 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Starting heal instance info cache {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 15:08:13 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "refresh_cache-0a8fe938-7ca4-4221-9742-9b043050ba84" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:08:13 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquired lock "refresh_cache-0a8fe938-7ca4-4221-9742-9b043050ba84" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:08:13 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Forcefully refreshing network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 29 15:08:13 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Updating instance_info_cache with network_info: [{"id": "0f6e2258-37e5-4786-898b-d11796a410e7", "address": "fa:16:3e:0c:50:9c", "network": {"id": "24b90c74-6ebe-42f0-b11f-fc2b23b35188", "bridge": "br-int", "label": "tempest-TestStampPattern-1445459710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "519723b99af84d1b85c40cfbc6518d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f6e2258-37", "ovs_interfaceid": "0f6e2258-37e5-4786-898b-d11796a410e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:08:13 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Releasing lock "refresh_cache-0a8fe938-7ca4-4221-9742-9b043050ba84" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:08:13 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Updated the network info_cache for instance {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 29 15:08:13 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:08:13 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70924) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 15:08:14 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:08:14 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:08:15 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:08:19 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:08:24 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:08:24 user nova-compute[70924]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690643289.5000784, 751027e8-91d2-4374-94cb-f4a840d7f7be => Stopped> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 15:08:24 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] VM Stopped (Lifecycle Event)
Jul 29 15:08:24 user nova-compute[70924]: DEBUG nova.compute.manager [None req-c0676a7a-cffe-40fc-9ec8-729174e03542 None None] [instance: 751027e8-91d2-4374-94cb-f4a840d7f7be] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:08:24 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:08:29 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:08:29 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:08:31 user nova-compute[70924]: DEBUG nova.compute.manager [None req-ee7da0fc-d7c7-42d7-8469-de12312f6fc1 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:08:31 user nova-compute[70924]: INFO nova.compute.manager [None req-ee7da0fc-d7c7-42d7-8469-de12312f6fc1 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] instance snapshotting
Jul 29 15:08:31 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-ee7da0fc-d7c7-42d7-8469-de12312f6fc1 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Beginning live snapshot process
Jul 29 15:08:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-ee7da0fc-d7c7-42d7-8469-de12312f6fc1 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a8fe938-7ca4-4221-9742-9b043050ba84/disk --force-share --output=json -f qcow2 {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:08:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-ee7da0fc-d7c7-42d7-8469-de12312f6fc1 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a8fe938-7ca4-4221-9742-9b043050ba84/disk --force-share --output=json -f qcow2" returned: 0 in 0.152s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:08:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-ee7da0fc-d7c7-42d7-8469-de12312f6fc1 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a8fe938-7ca4-4221-9742-9b043050ba84/disk --force-share --output=json -f qcow2 {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:08:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-ee7da0fc-d7c7-42d7-8469-de12312f6fc1 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a8fe938-7ca4-4221-9742-9b043050ba84/disk --force-share --output=json -f qcow2" returned: 0 in 0.192s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:08:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-ee7da0fc-d7c7-42d7-8469-de12312f6fc1 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:08:32 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-ee7da0fc-d7c7-42d7-8469-de12312f6fc1 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.209s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:08:32 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-ee7da0fc-d7c7-42d7-8469-de12312f6fc1 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp6kol74ba/aa6e4b6a25d94335a13c334999da42ff.delta 1073741824 {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:08:32 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-ee7da0fc-d7c7-42d7-8469-de12312f6fc1 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp6kol74ba/aa6e4b6a25d94335a13c334999da42ff.delta 1073741824" returned: 0 in 0.052s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:08:32 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-ee7da0fc-d7c7-42d7-8469-de12312f6fc1 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 29 15:08:32 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-ee7da0fc-d7c7-42d7-8469-de12312f6fc1 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=70924) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 29 15:08:33 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-ee7da0fc-d7c7-42d7-8469-de12312f6fc1 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=70924) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 29 15:08:33 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-ee7da0fc-d7c7-42d7-8469-de12312f6fc1 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 29 15:08:33 user nova-compute[70924]: DEBUG nova.privsep.utils [None req-ee7da0fc-d7c7-42d7-8469-de12312f6fc1 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70924) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 29 15:08:33 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-ee7da0fc-d7c7-42d7-8469-de12312f6fc1 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp6kol74ba/aa6e4b6a25d94335a13c334999da42ff.delta /opt/stack/data/nova/instances/snapshots/tmp6kol74ba/aa6e4b6a25d94335a13c334999da42ff {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:08:34 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-ee7da0fc-d7c7-42d7-8469-de12312f6fc1 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp6kol74ba/aa6e4b6a25d94335a13c334999da42ff.delta /opt/stack/data/nova/instances/snapshots/tmp6kol74ba/aa6e4b6a25d94335a13c334999da42ff" returned: 0 in 0.634s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:08:34 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-ee7da0fc-d7c7-42d7-8469-de12312f6fc1 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Snapshot extracted, beginning image upload
Jul 29 15:08:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:08:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:08:36 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-ee7da0fc-d7c7-42d7-8469-de12312f6fc1 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Snapshot image upload complete
Jul 29 15:08:36 user nova-compute[70924]: INFO nova.compute.manager [None req-ee7da0fc-d7c7-42d7-8469-de12312f6fc1 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Took 5.21 seconds to snapshot the instance on the hypervisor.
Jul 29 15:08:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Acquiring lock "d0df1b67-aab1-4a27-9ef9-00e02a5dfca5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:08:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Lock "d0df1b67-aab1-4a27-9ef9-00e02a5dfca5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:08:39 user nova-compute[70924]: DEBUG nova.compute.manager [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Starting instance... {{(pid=70924) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 15:08:39 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:08:39 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:08:39 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70924) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 15:08:39 user nova-compute[70924]: INFO nova.compute.claims [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Claim successful on node user
Jul 29 15:08:39 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:08:39 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:08:39 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:08:39 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.273s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:08:39 user nova-compute[70924]: DEBUG nova.compute.manager [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Start building networks asynchronously for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 15:08:39 user nova-compute[70924]: DEBUG nova.compute.manager [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Allocating IP information in the background. {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 15:08:39 user nova-compute[70924]: DEBUG nova.network.neutron [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] allocate_for_instance() {{(pid=70924) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 15:08:39 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 15:08:39 user nova-compute[70924]: DEBUG nova.compute.manager [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Start building block device mappings for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 15:08:39 user nova-compute[70924]: DEBUG nova.policy [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0bab72756da045ccbe725c6ed42df481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '519723b99af84d1b85c40cfbc6518d35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70924) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 15:08:39 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:08:39 user nova-compute[70924]: DEBUG nova.compute.manager [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Start spawning the instance on the hypervisor. {{(pid=70924) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 15:08:39 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Creating instance directory {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 15:08:39 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Creating image(s)
Jul 29 15:08:39 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Acquiring lock "/opt/stack/data/nova/instances/d0df1b67-aab1-4a27-9ef9-00e02a5dfca5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:08:39 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Lock "/opt/stack/data/nova/instances/d0df1b67-aab1-4a27-9ef9-00e02a5dfca5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:08:39 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Lock "/opt/stack/data/nova/instances/d0df1b67-aab1-4a27-9ef9-00e02a5dfca5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:08:39 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Acquiring lock "517f9f18b87237442c9e82ec23fe9ab83c72ff21" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:08:39 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Lock "517f9f18b87237442c9e82ec23fe9ab83c72ff21" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:08:40 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/517f9f18b87237442c9e82ec23fe9ab83c72ff21.part --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:08:40 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:08:40 user nova-compute[70924]: DEBUG nova.network.neutron [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Successfully created port: 9993f68e-4ceb-4974-9224-2fd3866899ce {{(pid=70924) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 15:08:40 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/517f9f18b87237442c9e82ec23fe9ab83c72ff21.part --force-share --output=json" returned: 0 in 0.139s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:08:40 user nova-compute[70924]: DEBUG nova.virt.images [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] ddd07860-4952-40c2-863c-244e50f8dd39 was qcow2, converting to raw {{(pid=70924) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 29 15:08:40 user nova-compute[70924]: DEBUG nova.privsep.utils [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70924) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 29 15:08:40 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/517f9f18b87237442c9e82ec23fe9ab83c72ff21.part /opt/stack/data/nova/instances/_base/517f9f18b87237442c9e82ec23fe9ab83c72ff21.converted {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:08:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/517f9f18b87237442c9e82ec23fe9ab83c72ff21.part /opt/stack/data/nova/instances/_base/517f9f18b87237442c9e82ec23fe9ab83c72ff21.converted" returned: 0 in 0.715s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:08:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/517f9f18b87237442c9e82ec23fe9ab83c72ff21.converted --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:08:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/517f9f18b87237442c9e82ec23fe9ab83c72ff21.converted --force-share --output=json" returned: 0 in 0.145s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:08:41 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Lock "517f9f18b87237442c9e82ec23fe9ab83c72ff21" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.848s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:08:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/517f9f18b87237442c9e82ec23fe9ab83c72ff21 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:08:41 user nova-compute[70924]: DEBUG nova.network.neutron [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Successfully updated port: 9993f68e-4ceb-4974-9224-2fd3866899ce {{(pid=70924) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 15:08:41 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Acquiring lock "refresh_cache-d0df1b67-aab1-4a27-9ef9-00e02a5dfca5" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:08:41 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Acquired lock "refresh_cache-d0df1b67-aab1-4a27-9ef9-00e02a5dfca5" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:08:41 user nova-compute[70924]: DEBUG nova.network.neutron [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 15:08:41 user nova-compute[70924]: DEBUG nova.compute.manager [req-f42feb4b-eff1-41cf-bd57-bc01e020f690 req-e0e5e73a-4abe-4845-9139-cf3515099c7d service nova] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Received event network-changed-9993f68e-4ceb-4974-9224-2fd3866899ce {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:08:41 user nova-compute[70924]: DEBUG nova.compute.manager [req-f42feb4b-eff1-41cf-bd57-bc01e020f690 req-e0e5e73a-4abe-4845-9139-cf3515099c7d service nova] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Refreshing instance network info cache due to event network-changed-9993f68e-4ceb-4974-9224-2fd3866899ce. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 15:08:41 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-f42feb4b-eff1-41cf-bd57-bc01e020f690 req-e0e5e73a-4abe-4845-9139-cf3515099c7d service nova] Acquiring lock "refresh_cache-d0df1b67-aab1-4a27-9ef9-00e02a5dfca5" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:08:41 user nova-compute[70924]: DEBUG nova.network.neutron [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Instance cache missing network info. {{(pid=70924) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 15:08:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/517f9f18b87237442c9e82ec23fe9ab83c72ff21 --force-share --output=json" returned: 0 in 0.156s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:08:41 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Acquiring lock "517f9f18b87237442c9e82ec23fe9ab83c72ff21" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:08:41 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Lock "517f9f18b87237442c9e82ec23fe9ab83c72ff21" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:08:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/517f9f18b87237442c9e82ec23fe9ab83c72ff21 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:08:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/517f9f18b87237442c9e82ec23fe9ab83c72ff21 --force-share --output=json" returned: 0 in 0.135s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:08:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/517f9f18b87237442c9e82ec23fe9ab83c72ff21,backing_fmt=raw /opt/stack/data/nova/instances/d0df1b67-aab1-4a27-9ef9-00e02a5dfca5/disk 1073741824 {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:08:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/517f9f18b87237442c9e82ec23fe9ab83c72ff21,backing_fmt=raw /opt/stack/data/nova/instances/d0df1b67-aab1-4a27-9ef9-00e02a5dfca5/disk 1073741824" returned: 0 in 0.053s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:08:41 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Lock "517f9f18b87237442c9e82ec23fe9ab83c72ff21" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:08:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/517f9f18b87237442c9e82ec23fe9ab83c72ff21 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:08:41 user nova-compute[70924]: DEBUG nova.network.neutron [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Updating instance_info_cache with network_info: [{"id": "9993f68e-4ceb-4974-9224-2fd3866899ce", "address": "fa:16:3e:eb:3b:0c", "network": {"id": "24b90c74-6ebe-42f0-b11f-fc2b23b35188", "bridge": "br-int", "label": "tempest-TestStampPattern-1445459710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "519723b99af84d1b85c40cfbc6518d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9993f68e-4c", "ovs_interfaceid": "9993f68e-4ceb-4974-9224-2fd3866899ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:08:41 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Releasing lock "refresh_cache-d0df1b67-aab1-4a27-9ef9-00e02a5dfca5" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:08:41 user nova-compute[70924]: DEBUG nova.compute.manager [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Instance network_info: |[{"id": "9993f68e-4ceb-4974-9224-2fd3866899ce", "address": "fa:16:3e:eb:3b:0c", "network": {"id": "24b90c74-6ebe-42f0-b11f-fc2b23b35188", "bridge": "br-int", "label": "tempest-TestStampPattern-1445459710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "519723b99af84d1b85c40cfbc6518d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9993f68e-4c", "ovs_interfaceid": "9993f68e-4ceb-4974-9224-2fd3866899ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 15:08:41 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/517f9f18b87237442c9e82ec23fe9ab83c72ff21 --force-share --output=json" returned: 0 in 0.144s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:08:41 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-f42feb4b-eff1-41cf-bd57-bc01e020f690 req-e0e5e73a-4abe-4845-9139-cf3515099c7d service nova] Acquired lock "refresh_cache-d0df1b67-aab1-4a27-9ef9-00e02a5dfca5" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:08:41 user nova-compute[70924]: DEBUG nova.network.neutron [req-f42feb4b-eff1-41cf-bd57-bc01e020f690 req-e0e5e73a-4abe-4845-9139-cf3515099c7d service nova] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Refreshing network info cache for port 9993f68e-4ceb-4974-9224-2fd3866899ce {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 15:08:41 user nova-compute[70924]: DEBUG nova.objects.instance [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Lazy-loading 'migration_context' on Instance uuid d0df1b67-aab1-4a27-9ef9-00e02a5dfca5 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:08:41 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Created local disks {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 15:08:41 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Ensure instance console log exists: /opt/stack/data/nova/instances/d0df1b67-aab1-4a27-9ef9-00e02a5dfca5/console.log {{(pid=70924) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 15:08:41 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:08:41 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:08:41 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:08:41 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Start _get_guest_xml network_info=[{"id": "9993f68e-4ceb-4974-9224-2fd3866899ce", "address": "fa:16:3e:eb:3b:0c", "network": {"id": "24b90c74-6ebe-42f0-b11f-fc2b23b35188", "bridge": "br-int", "label": "tempest-TestStampPattern-1445459710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "519723b99af84d1b85c40cfbc6518d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9993f68e-4c", "ovs_interfaceid": "9993f68e-4ceb-4974-9224-2fd3866899ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='00c1e3efdb179baab0660e6ee1161866',container_format='bare',created_at=2023-07-29T15:08:31Z,direct_url=<?>,disk_format='qcow2',id=ddd07860-4952-40c2-863c-244e50f8dd39,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-668386022',owner='519723b99af84d1b85c40cfbc6518d35',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-07-29T15:08:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': 'ddd07860-4952-40c2-863c-244e50f8dd39'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 15:08:41 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:08:41 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:08:41 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 15:08:41 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] CPU controller missing on host. {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 15:08:42 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 15:08:42 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] CPU controller found on host. {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 15:08:42 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70924) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 15:08:42 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T14:36:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='00c1e3efdb179baab0660e6ee1161866',container_format='bare',created_at=2023-07-29T15:08:31Z,direct_url=<?>,disk_format='qcow2',id=ddd07860-4952-40c2-863c-244e50f8dd39,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-668386022',owner='519723b99af84d1b85c40cfbc6518d35',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-07-29T15:08:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 15:08:42 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Flavor limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 15:08:42 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Image limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 15:08:42 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Flavor pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 15:08:42 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Image pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 15:08:42 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 15:08:42 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 15:08:42 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 15:08:42 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Got 1 possible topologies {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 15:08:42 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 15:08:42 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 15:08:42 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T15:08:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-899471333',display_name='tempest-TestStampPattern-server-899471333',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-899471333',id=46,image_ref='ddd07860-4952-40c2-863c-244e50f8dd39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP9wXXmEpUxSy6sCiiBCVPvhbmxDt3THRKq326W9UvO9W3eISERvSp0FREjZ8D+cDQ7iUcDk1NqJBkukyTT0dSSBRCZHyMnPGsYsEUkqKHShLvimsa51y3TpE3TWdx039g==',key_name='tempest-TestStampPattern-68763195',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='519723b99af84d1b85c40cfbc6518d35',ramdisk_id='',reservation_id='r-7sixtjbd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='0a8fe938-7ca4-4221-9742-9b043050ba84',image_min_disk='1',image_min_ram='0',image_owner_id='519723b99af84d1b85c40cfbc6518d35',image_owner_project_name='tempest-TestStampPattern-92673023',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-92673023-project-member',image_user_id='0bab72756da045ccbe725c6ed42df481',network_allocated='True',owner_project_name='tempest-TestStampPattern-92673023',owner_user_name='tempest-TestStampPattern-92673023-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T15:08:40Z,user_data=None,user_id='0bab72756da045ccbe725c6ed42df481',uuid=d0df1b67-aab1-4a27-9ef9-00e02a5dfca5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9993f68e-4ceb-4974-9224-2fd3866899ce", "address": "fa:16:3e:eb:3b:0c", "network": {"id": "24b90c74-6ebe-42f0-b11f-fc2b23b35188", "bridge": "br-int", "label": "tempest-TestStampPattern-1445459710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "519723b99af84d1b85c40cfbc6518d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9993f68e-4c", "ovs_interfaceid": "9993f68e-4ceb-4974-9224-2fd3866899ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 15:08:42 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Converting VIF {"id": "9993f68e-4ceb-4974-9224-2fd3866899ce", "address": "fa:16:3e:eb:3b:0c", "network": {"id": "24b90c74-6ebe-42f0-b11f-fc2b23b35188", "bridge": "br-int", "label": "tempest-TestStampPattern-1445459710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "519723b99af84d1b85c40cfbc6518d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9993f68e-4c", "ovs_interfaceid": "9993f68e-4ceb-4974-9224-2fd3866899ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 15:08:42 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:3b:0c,bridge_name='br-int',has_traffic_filtering=True,id=9993f68e-4ceb-4974-9224-2fd3866899ce,network=Network(24b90c74-6ebe-42f0-b11f-fc2b23b35188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9993f68e-4c') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 15:08:42 user nova-compute[70924]: DEBUG nova.objects.instance [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Lazy-loading 'pci_devices' on Instance uuid d0df1b67-aab1-4a27-9ef9-00e02a5dfca5 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:08:42 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] End _get_guest_xml xml=<domain type="kvm">
Jul 29 15:08:42 user nova-compute[70924]:   <uuid>d0df1b67-aab1-4a27-9ef9-00e02a5dfca5</uuid>
Jul 29 15:08:42 user nova-compute[70924]:   <name>instance-0000002e</name>
Jul 29 15:08:42 user nova-compute[70924]:   <memory>524288</memory>
Jul 29 15:08:42 user nova-compute[70924]:   <vcpu>1</vcpu>
Jul 29 15:08:42 user nova-compute[70924]:   <metadata>
Jul 29 15:08:42 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 15:08:42 user nova-compute[70924]:       <nova:package version="0.0.0"/>
Jul 29 15:08:42 user nova-compute[70924]:       <nova:name>tempest-TestStampPattern-server-899471333</nova:name>
Jul 29 15:08:42 user nova-compute[70924]:       <nova:creationTime>2023-07-29 15:08:41</nova:creationTime>
Jul 29 15:08:42 user nova-compute[70924]:       <nova:flavor name="m1.tiny">
Jul 29 15:08:42 user nova-compute[70924]:         <nova:memory>512</nova:memory>
Jul 29 15:08:42 user nova-compute[70924]:         <nova:disk>1</nova:disk>
Jul 29 15:08:42 user nova-compute[70924]:         <nova:swap>0</nova:swap>
Jul 29 15:08:42 user nova-compute[70924]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 15:08:42 user nova-compute[70924]:         <nova:vcpus>1</nova:vcpus>
Jul 29 15:08:42 user nova-compute[70924]:       </nova:flavor>
Jul 29 15:08:42 user nova-compute[70924]:       <nova:owner>
Jul 29 15:08:42 user nova-compute[70924]:         <nova:user uuid="0bab72756da045ccbe725c6ed42df481">tempest-TestStampPattern-92673023-project-member</nova:user>
Jul 29 15:08:42 user nova-compute[70924]:         <nova:project uuid="519723b99af84d1b85c40cfbc6518d35">tempest-TestStampPattern-92673023</nova:project>
Jul 29 15:08:42 user nova-compute[70924]:       </nova:owner>
Jul 29 15:08:42 user nova-compute[70924]:       <nova:root type="image" uuid="ddd07860-4952-40c2-863c-244e50f8dd39"/>
Jul 29 15:08:42 user nova-compute[70924]:       <nova:ports>
Jul 29 15:08:42 user nova-compute[70924]:         <nova:port uuid="9993f68e-4ceb-4974-9224-2fd3866899ce">
Jul 29 15:08:42 user nova-compute[70924]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 29 15:08:42 user nova-compute[70924]:         </nova:port>
Jul 29 15:08:42 user nova-compute[70924]:       </nova:ports>
Jul 29 15:08:42 user nova-compute[70924]:     </nova:instance>
Jul 29 15:08:42 user nova-compute[70924]:   </metadata>
Jul 29 15:08:42 user nova-compute[70924]:   <sysinfo type="smbios">
Jul 29 15:08:42 user nova-compute[70924]:     <system>
Jul 29 15:08:42 user nova-compute[70924]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 15:08:42 user nova-compute[70924]:       <entry name="product">OpenStack Nova</entry>
Jul 29 15:08:42 user nova-compute[70924]:       <entry name="version">0.0.0</entry>
Jul 29 15:08:42 user nova-compute[70924]:       <entry name="serial">d0df1b67-aab1-4a27-9ef9-00e02a5dfca5</entry>
Jul 29 15:08:42 user nova-compute[70924]:       <entry name="uuid">d0df1b67-aab1-4a27-9ef9-00e02a5dfca5</entry>
Jul 29 15:08:42 user nova-compute[70924]:       <entry name="family">Virtual Machine</entry>
Jul 29 15:08:42 user nova-compute[70924]:     </system>
Jul 29 15:08:42 user nova-compute[70924]:   </sysinfo>
Jul 29 15:08:42 user nova-compute[70924]:   <os>
Jul 29 15:08:42 user nova-compute[70924]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 15:08:42 user nova-compute[70924]:     <boot dev="hd"/>
Jul 29 15:08:42 user nova-compute[70924]:     <smbios mode="sysinfo"/>
Jul 29 15:08:42 user nova-compute[70924]:   </os>
Jul 29 15:08:42 user nova-compute[70924]:   <features>
Jul 29 15:08:42 user nova-compute[70924]:     <acpi/>
Jul 29 15:08:42 user nova-compute[70924]:     <apic/>
Jul 29 15:08:42 user nova-compute[70924]:     <vmcoreinfo/>
Jul 29 15:08:42 user nova-compute[70924]:   </features>
Jul 29 15:08:42 user nova-compute[70924]:   <clock offset="utc">
Jul 29 15:08:42 user nova-compute[70924]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 15:08:42 user nova-compute[70924]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 15:08:42 user nova-compute[70924]:     <timer name="hpet" present="no"/>
Jul 29 15:08:42 user nova-compute[70924]:   </clock>
Jul 29 15:08:42 user nova-compute[70924]:   <cpu mode="custom" match="exact">
Jul 29 15:08:42 user nova-compute[70924]:     <model>Nehalem</model>
Jul 29 15:08:42 user nova-compute[70924]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 15:08:42 user nova-compute[70924]:   </cpu>
Jul 29 15:08:42 user nova-compute[70924]:   <devices>
Jul 29 15:08:42 user nova-compute[70924]:     <disk type="file" device="disk">
Jul 29 15:08:42 user nova-compute[70924]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 15:08:42 user nova-compute[70924]:       <source file="/opt/stack/data/nova/instances/d0df1b67-aab1-4a27-9ef9-00e02a5dfca5/disk"/>
Jul 29 15:08:42 user nova-compute[70924]:       <target dev="vda" bus="virtio"/>
Jul 29 15:08:42 user nova-compute[70924]:     </disk>
Jul 29 15:08:42 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 15:08:42 user nova-compute[70924]:       <mac address="fa:16:3e:eb:3b:0c"/>
Jul 29 15:08:42 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 15:08:42 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 15:08:42 user nova-compute[70924]:       <target dev="tap9993f68e-4c"/>
Jul 29 15:08:42 user nova-compute[70924]:     </interface>
Jul 29 15:08:42 user nova-compute[70924]:     <serial type="pty">
Jul 29 15:08:42 user nova-compute[70924]:       <log file="/opt/stack/data/nova/instances/d0df1b67-aab1-4a27-9ef9-00e02a5dfca5/console.log" append="off"/>
Jul 29 15:08:42 user nova-compute[70924]:     </serial>
Jul 29 15:08:42 user nova-compute[70924]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 15:08:42 user nova-compute[70924]:     <video>
Jul 29 15:08:42 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 15:08:42 user nova-compute[70924]:     </video>
Jul 29 15:08:42 user nova-compute[70924]:     <rng model="virtio">
Jul 29 15:08:42 user nova-compute[70924]:       <backend model="random">/dev/urandom</backend>
Jul 29 15:08:42 user nova-compute[70924]:     </rng>
Jul 29 15:08:42 user nova-compute[70924]:     <controller type="usb" index="0" model="none"/>
Jul 29 15:08:42 user nova-compute[70924]:     <memballoon model="virtio">
Jul 29 15:08:42 user nova-compute[70924]:       <stats period="10"/>
Jul 29 15:08:42 user nova-compute[70924]:     </memballoon>
Jul 29 15:08:42 user nova-compute[70924]:   </devices>
Jul 29 15:08:42 user nova-compute[70924]: </domain>
Jul 29 15:08:42 user nova-compute[70924]:  {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 15:08:42 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T15:08:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-899471333',display_name='tempest-TestStampPattern-server-899471333',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-899471333',id=46,image_ref='ddd07860-4952-40c2-863c-244e50f8dd39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP9wXXmEpUxSy6sCiiBCVPvhbmxDt3THRKq326W9UvO9W3eISERvSp0FREjZ8D+cDQ7iUcDk1NqJBkukyTT0dSSBRCZHyMnPGsYsEUkqKHShLvimsa51y3TpE3TWdx039g==',key_name='tempest-TestStampPattern-68763195',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='519723b99af84d1b85c40cfbc6518d35',ramdisk_id='',reservation_id='r-7sixtjbd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='0a8fe938-7ca4-4221-9742-9b043050ba84',image_min_disk='1',image_min_ram='0',image_owner_id='519723b99af84d1b85c40cfbc6518d35',image_owner_project_name='tempest-TestStampPattern-92673023',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-92673023-project-member',image_user_id='0bab72756da045ccbe725c6ed42df481',network_allocated='True',owner_project_name='tempest-TestStampPattern-92673023',owner_user_name='tempest-TestStampPattern-92673023-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T15:08:40Z,user_data=None,user_id='0bab72756da045ccbe725c6ed42df481',uuid=d0df1b67-aab1-4a27-9ef9-00e02a5dfca5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9993f68e-4ceb-4974-9224-2fd3866899ce", "address": "fa:16:3e:eb:3b:0c", "network": {"id": "24b90c74-6ebe-42f0-b11f-fc2b23b35188", "bridge": "br-int", "label": "tempest-TestStampPattern-1445459710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "519723b99af84d1b85c40cfbc6518d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9993f68e-4c", "ovs_interfaceid": "9993f68e-4ceb-4974-9224-2fd3866899ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 15:08:42 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Converting VIF {"id": "9993f68e-4ceb-4974-9224-2fd3866899ce", "address": "fa:16:3e:eb:3b:0c", "network": {"id": "24b90c74-6ebe-42f0-b11f-fc2b23b35188", "bridge": "br-int", "label": "tempest-TestStampPattern-1445459710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "519723b99af84d1b85c40cfbc6518d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9993f68e-4c", "ovs_interfaceid": "9993f68e-4ceb-4974-9224-2fd3866899ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 15:08:42 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:3b:0c,bridge_name='br-int',has_traffic_filtering=True,id=9993f68e-4ceb-4974-9224-2fd3866899ce,network=Network(24b90c74-6ebe-42f0-b11f-fc2b23b35188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9993f68e-4c') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 15:08:42 user nova-compute[70924]: DEBUG os_vif [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:3b:0c,bridge_name='br-int',has_traffic_filtering=True,id=9993f68e-4ceb-4974-9224-2fd3866899ce,network=Network(24b90c74-6ebe-42f0-b11f-fc2b23b35188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9993f68e-4c') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 15:08:42 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:08:42 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:08:42 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 15:08:42 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:08:42 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9993f68e-4c, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:08:42 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9993f68e-4c, col_values=(('external_ids', {'iface-id': '9993f68e-4ceb-4974-9224-2fd3866899ce', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:3b:0c', 'vm-uuid': 'd0df1b67-aab1-4a27-9ef9-00e02a5dfca5'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:08:42 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:08:42 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:08:42 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:08:42 user nova-compute[70924]: INFO os_vif [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:3b:0c,bridge_name='br-int',has_traffic_filtering=True,id=9993f68e-4ceb-4974-9224-2fd3866899ce,network=Network(24b90c74-6ebe-42f0-b11f-fc2b23b35188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9993f68e-4c')
Jul 29 15:08:42 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 15:08:42 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] No VIF found with MAC fa:16:3e:eb:3b:0c, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 15:08:42 user nova-compute[70924]: DEBUG nova.network.neutron [req-f42feb4b-eff1-41cf-bd57-bc01e020f690 req-e0e5e73a-4abe-4845-9139-cf3515099c7d service nova] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Updated VIF entry in instance network info cache for port 9993f68e-4ceb-4974-9224-2fd3866899ce. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 15:08:42 user nova-compute[70924]: DEBUG nova.network.neutron [req-f42feb4b-eff1-41cf-bd57-bc01e020f690 req-e0e5e73a-4abe-4845-9139-cf3515099c7d service nova] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Updating instance_info_cache with network_info: [{"id": "9993f68e-4ceb-4974-9224-2fd3866899ce", "address": "fa:16:3e:eb:3b:0c", "network": {"id": "24b90c74-6ebe-42f0-b11f-fc2b23b35188", "bridge": "br-int", "label": "tempest-TestStampPattern-1445459710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "519723b99af84d1b85c40cfbc6518d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9993f68e-4c", "ovs_interfaceid": "9993f68e-4ceb-4974-9224-2fd3866899ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:08:42 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-f42feb4b-eff1-41cf-bd57-bc01e020f690 req-e0e5e73a-4abe-4845-9139-cf3515099c7d service nova] Releasing lock "refresh_cache-d0df1b67-aab1-4a27-9ef9-00e02a5dfca5" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:08:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:08:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:08:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:08:43 user nova-compute[70924]: DEBUG nova.compute.manager [req-2f0a6d10-952f-4411-92e5-c9bf629cdf28 req-8f83fae5-c2db-4d9e-aa90-85e01e3ef9c6 service nova] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Received event network-vif-plugged-9993f68e-4ceb-4974-9224-2fd3866899ce {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:08:43 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-2f0a6d10-952f-4411-92e5-c9bf629cdf28 req-8f83fae5-c2db-4d9e-aa90-85e01e3ef9c6 service nova] Acquiring lock "d0df1b67-aab1-4a27-9ef9-00e02a5dfca5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:08:43 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-2f0a6d10-952f-4411-92e5-c9bf629cdf28 req-8f83fae5-c2db-4d9e-aa90-85e01e3ef9c6 service nova] Lock "d0df1b67-aab1-4a27-9ef9-00e02a5dfca5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:08:43 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-2f0a6d10-952f-4411-92e5-c9bf629cdf28 req-8f83fae5-c2db-4d9e-aa90-85e01e3ef9c6 service nova] Lock "d0df1b67-aab1-4a27-9ef9-00e02a5dfca5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:08:43 user nova-compute[70924]: DEBUG nova.compute.manager [req-2f0a6d10-952f-4411-92e5-c9bf629cdf28 req-8f83fae5-c2db-4d9e-aa90-85e01e3ef9c6 service nova] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] No waiting events found dispatching network-vif-plugged-9993f68e-4ceb-4974-9224-2fd3866899ce {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:08:43 user nova-compute[70924]: WARNING nova.compute.manager [req-2f0a6d10-952f-4411-92e5-c9bf629cdf28 req-8f83fae5-c2db-4d9e-aa90-85e01e3ef9c6 service nova] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Received unexpected event network-vif-plugged-9993f68e-4ceb-4974-9224-2fd3866899ce for instance with vm_state building and task_state spawning.
Jul 29 15:08:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:08:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:08:45 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690643325.5852747, d0df1b67-aab1-4a27-9ef9-00e02a5dfca5 => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 15:08:45 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] VM Resumed (Lifecycle Event)
Jul 29 15:08:45 user nova-compute[70924]: DEBUG nova.compute.manager [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Instance event wait completed in 0 seconds for  {{(pid=70924) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 15:08:45 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Guest created on hypervisor {{(pid=70924) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 15:08:45 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Instance spawned successfully.
Jul 29 15:08:45 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 15:08:45 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Found default for hw_input_bus of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:08:45 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Found default for hw_pointer_model of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:08:45 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:08:45 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 15:08:45 user nova-compute[70924]: DEBUG nova.compute.manager [req-5991e912-1810-4803-8f1c-631bc75060b0 req-4ef0a71c-a873-46ce-84a7-b2942be89529 service nova] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Received event network-vif-plugged-9993f68e-4ceb-4974-9224-2fd3866899ce {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:08:45 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-5991e912-1810-4803-8f1c-631bc75060b0 req-4ef0a71c-a873-46ce-84a7-b2942be89529 service nova] Acquiring lock "d0df1b67-aab1-4a27-9ef9-00e02a5dfca5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:08:45 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-5991e912-1810-4803-8f1c-631bc75060b0 req-4ef0a71c-a873-46ce-84a7-b2942be89529 service nova] Lock "d0df1b67-aab1-4a27-9ef9-00e02a5dfca5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:08:45 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-5991e912-1810-4803-8f1c-631bc75060b0 req-4ef0a71c-a873-46ce-84a7-b2942be89529 service nova] Lock "d0df1b67-aab1-4a27-9ef9-00e02a5dfca5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:08:45 user nova-compute[70924]: DEBUG nova.compute.manager [req-5991e912-1810-4803-8f1c-631bc75060b0 req-4ef0a71c-a873-46ce-84a7-b2942be89529 service nova] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] No waiting events found dispatching network-vif-plugged-9993f68e-4ceb-4974-9224-2fd3866899ce {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:08:45 user nova-compute[70924]: WARNING nova.compute.manager [req-5991e912-1810-4803-8f1c-631bc75060b0 req-4ef0a71c-a873-46ce-84a7-b2942be89529 service nova] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Received unexpected event network-vif-plugged-9993f68e-4ceb-4974-9224-2fd3866899ce for instance with vm_state building and task_state spawning.
Jul 29 15:08:45 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 15:08:45 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690643325.586602, d0df1b67-aab1-4a27-9ef9-00e02a5dfca5 => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 15:08:45 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] VM Started (Lifecycle Event)
Jul 29 15:08:45 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:08:45 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 15:08:45 user nova-compute[70924]: INFO nova.compute.manager [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Took 6.09 seconds to spawn the instance on the hypervisor.
Jul 29 15:08:45 user nova-compute[70924]: DEBUG nova.compute.manager [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:08:45 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 15:08:45 user nova-compute[70924]: INFO nova.compute.manager [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Took 6.71 seconds to build instance.
Jul 29 15:08:45 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-bbac4f26-7a64-4294-a4cd-ae44ac0b0d81 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Lock "d0df1b67-aab1-4a27-9ef9-00e02a5dfca5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.814s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:08:47 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:08:52 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:08:57 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:08:57 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:08:57 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70924) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 29 15:08:57 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70924) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 15:08:57 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70924) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 15:08:57 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:08:59 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:09:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Acquiring lock "fc2c25cc-9d79-45a2-9d50-862b7592f7f7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:09:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "fc2c25cc-9d79-45a2-9d50-862b7592f7f7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:09:01 user nova-compute[70924]: DEBUG nova.compute.manager [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] Starting instance... {{(pid=70924) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 15:09:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:09:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:09:01 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70924) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 15:09:01 user nova-compute[70924]: INFO nova.compute.claims [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] Claim successful on node user
Jul 29 15:09:02 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:09:02 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:09:02 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:09:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.258s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:09:02 user nova-compute[70924]: DEBUG nova.compute.manager [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] Start building networks asynchronously for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 15:09:02 user nova-compute[70924]: DEBUG nova.compute.manager [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] Allocating IP information in the background. {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 15:09:02 user nova-compute[70924]: DEBUG nova.network.neutron [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] allocate_for_instance() {{(pid=70924) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 15:09:02 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 15:09:02 user nova-compute[70924]: DEBUG nova.compute.manager [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] Start building block device mappings for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 15:09:02 user nova-compute[70924]: DEBUG nova.policy [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '12cb8299e4d24946bc41a86493f4b426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aadc9385b3b46eebc6e0d81814521af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70924) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 15:09:02 user nova-compute[70924]: DEBUG nova.compute.manager [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] Start spawning the instance on the hypervisor. {{(pid=70924) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 15:09:02 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] Creating instance directory {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 15:09:02 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] Creating image(s)
Jul 29 15:09:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Acquiring lock "/opt/stack/data/nova/instances/fc2c25cc-9d79-45a2-9d50-862b7592f7f7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:09:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "/opt/stack/data/nova/instances/fc2c25cc-9d79-45a2-9d50-862b7592f7f7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:09:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "/opt/stack/data/nova/instances/fc2c25cc-9d79-45a2-9d50-862b7592f7f7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:09:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:09:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.141s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:09:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Acquiring lock "bd72453517468710f1de26b27fb0ea28688e9009" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:09:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:09:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:09:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.138s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:09:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/fc2c25cc-9d79-45a2-9d50-862b7592f7f7/disk 1073741824 {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:09:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/fc2c25cc-9d79-45a2-9d50-862b7592f7f7/disk 1073741824" returned: 0 in 0.051s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:09:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:09:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:09:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.135s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:09:02 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fc2c25cc-9d79-45a2-9d50-862b7592f7f7/disk. size=1073741824 {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 15:09:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2c25cc-9d79-45a2-9d50-862b7592f7f7/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:09:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2c25cc-9d79-45a2-9d50-862b7592f7f7/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:09:03 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Cannot resize image /opt/stack/data/nova/instances/fc2c25cc-9d79-45a2-9d50-862b7592f7f7/disk to a smaller size. {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 15:09:03 user nova-compute[70924]: DEBUG nova.objects.instance [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lazy-loading 'migration_context' on Instance uuid fc2c25cc-9d79-45a2-9d50-862b7592f7f7 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:09:03 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] Created local disks {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 15:09:03 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] Ensure instance console log exists: /opt/stack/data/nova/instances/fc2c25cc-9d79-45a2-9d50-862b7592f7f7/console.log {{(pid=70924) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 15:09:03 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:09:03 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:09:03 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:09:03 user nova-compute[70924]: DEBUG nova.network.neutron [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] Successfully created port: 4216c4cd-08b6-4e6f-a4f8-9b34c2b42756 {{(pid=70924) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 15:09:03 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:09:04 user nova-compute[70924]: DEBUG nova.network.neutron [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] Successfully updated port: 4216c4cd-08b6-4e6f-a4f8-9b34c2b42756 {{(pid=70924) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 15:09:04 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Acquiring lock "refresh_cache-fc2c25cc-9d79-45a2-9d50-862b7592f7f7" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:09:04 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Acquired lock "refresh_cache-fc2c25cc-9d79-45a2-9d50-862b7592f7f7" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:09:04 user nova-compute[70924]: DEBUG nova.network.neutron [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 15:09:04 user nova-compute[70924]: DEBUG nova.network.neutron [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] Instance cache missing network info. {{(pid=70924) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 15:09:04 user nova-compute[70924]: DEBUG nova.compute.manager [req-cbf2bef4-135b-472d-a707-fbf19a86f775 req-82acf8fb-ac4a-4734-b927-a1cb24eb07bd service nova] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] Received event network-changed-4216c4cd-08b6-4e6f-a4f8-9b34c2b42756 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:09:04 user nova-compute[70924]: DEBUG nova.compute.manager [req-cbf2bef4-135b-472d-a707-fbf19a86f775 req-82acf8fb-ac4a-4734-b927-a1cb24eb07bd service nova] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] Refreshing instance network info cache due to event network-changed-4216c4cd-08b6-4e6f-a4f8-9b34c2b42756. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 15:09:04 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-cbf2bef4-135b-472d-a707-fbf19a86f775 req-82acf8fb-ac4a-4734-b927-a1cb24eb07bd service nova] Acquiring lock "refresh_cache-fc2c25cc-9d79-45a2-9d50-862b7592f7f7" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:09:04 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:09:04 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:09:04 user nova-compute[70924]: DEBUG nova.network.neutron [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] Updating instance_info_cache with network_info: [{"id": "4216c4cd-08b6-4e6f-a4f8-9b34c2b42756", "address": "fa:16:3e:6e:a3:e0", "network": {"id": "f80826fa-fada-45b9-b969-fd539fd34fd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-465377443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9aadc9385b3b46eebc6e0d81814521af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4216c4cd-08", "ovs_interfaceid": "4216c4cd-08b6-4e6f-a4f8-9b34c2b42756", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:09:04 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Releasing lock "refresh_cache-fc2c25cc-9d79-45a2-9d50-862b7592f7f7" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:09:04 user nova-compute[70924]: DEBUG nova.compute.manager [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] Instance network_info: |[{"id": "4216c4cd-08b6-4e6f-a4f8-9b34c2b42756", "address": "fa:16:3e:6e:a3:e0", "network": {"id": "f80826fa-fada-45b9-b969-fd539fd34fd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-465377443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9aadc9385b3b46eebc6e0d81814521af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4216c4cd-08", "ovs_interfaceid": "4216c4cd-08b6-4e6f-a4f8-9b34c2b42756", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 15:09:04 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-cbf2bef4-135b-472d-a707-fbf19a86f775 req-82acf8fb-ac4a-4734-b927-a1cb24eb07bd service nova] Acquired lock "refresh_cache-fc2c25cc-9d79-45a2-9d50-862b7592f7f7" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:09:04 user nova-compute[70924]: DEBUG nova.network.neutron [req-cbf2bef4-135b-472d-a707-fbf19a86f775 req-82acf8fb-ac4a-4734-b927-a1cb24eb07bd service nova] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] Refreshing network info cache for port 4216c4cd-08b6-4e6f-a4f8-9b34c2b42756 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 15:09:04 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] Start _get_guest_xml network_info=[{"id": "4216c4cd-08b6-4e6f-a4f8-9b34c2b42756", "address": "fa:16:3e:6e:a3:e0", "network": {"id": "f80826fa-fada-45b9-b969-fd539fd34fd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-465377443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9aadc9385b3b46eebc6e0d81814521af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4216c4cd-08", "ovs_interfaceid": "4216c4cd-08b6-4e6f-a4f8-9b34c2b42756", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '3aba2e73-6832-404b-8bd0-d0503ce82b8c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 15:09:04 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:09:04 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:09:04 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 15:09:04 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] CPU controller missing on host. {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 15:09:04 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 15:09:04 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] CPU controller found on host. {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 15:09:04 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70924) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 15:09:04 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T14:36:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 15:09:04 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Flavor limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 15:09:04 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Image limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 15:09:04 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Flavor pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 15:09:04 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Image pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 15:09:04 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 15:09:04 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 15:09:04 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 15:09:04 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Got 1 possible topologies {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 15:09:04 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 15:09:04 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 15:09:04 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T15:09:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-189645111',display_name='tempest-AttachVolumeNegativeTest-server-189645111',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-189645111',id=47,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpyJkk17R9ToaiZTlPTLuCE4oval1DrBbefLqdKXR4x91mJT/GIXisv97ul11yogu6qVJ9CihjcmkNXyKQsx5OkK7a5HaMkDvAvtb/myOim31HBd7+9lawbcSTd2NCNnQ==',key_name='tempest-keypair-60654091',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9aadc9385b3b46eebc6e0d81814521af',ramdisk_id='',reservation_id='r-n2bomhip',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-972203101',owner_user_name='tempest-AttachVolumeNegativeTest-972203101-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T15:09:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='12cb8299e4d24946bc41a86493f4b426',uuid=fc2c25cc-9d79-45a2-9d50-862b7592f7f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4216c4cd-08b6-4e6f-a4f8-9b34c2b42756", "address": "fa:16:3e:6e:a3:e0", "network": {"id": "f80826fa-fada-45b9-b969-fd539fd34fd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-465377443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9aadc9385b3b46eebc6e0d81814521af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4216c4cd-08", "ovs_interfaceid": "4216c4cd-08b6-4e6f-a4f8-9b34c2b42756", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 15:09:04 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Converting VIF {"id": "4216c4cd-08b6-4e6f-a4f8-9b34c2b42756", "address": "fa:16:3e:6e:a3:e0", "network": {"id": "f80826fa-fada-45b9-b969-fd539fd34fd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-465377443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9aadc9385b3b46eebc6e0d81814521af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4216c4cd-08", "ovs_interfaceid": "4216c4cd-08b6-4e6f-a4f8-9b34c2b42756", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 15:09:04 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:a3:e0,bridge_name='br-int',has_traffic_filtering=True,id=4216c4cd-08b6-4e6f-a4f8-9b34c2b42756,network=Network(f80826fa-fada-45b9-b969-fd539fd34fd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4216c4cd-08') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 15:09:04 user nova-compute[70924]: DEBUG nova.objects.instance [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lazy-loading 'pci_devices' on Instance uuid fc2c25cc-9d79-45a2-9d50-862b7592f7f7 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:09:04 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] End _get_guest_xml xml=<domain type="kvm">
Jul 29 15:09:04 user nova-compute[70924]:   <uuid>fc2c25cc-9d79-45a2-9d50-862b7592f7f7</uuid>
Jul 29 15:09:04 user nova-compute[70924]:   <name>instance-0000002f</name>
Jul 29 15:09:04 user nova-compute[70924]:   <memory>524288</memory>
Jul 29 15:09:04 user nova-compute[70924]:   <vcpu>1</vcpu>
Jul 29 15:09:04 user nova-compute[70924]:   <metadata>
Jul 29 15:09:04 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 15:09:04 user nova-compute[70924]:       <nova:package version="0.0.0"/>
Jul 29 15:09:04 user nova-compute[70924]:       <nova:name>tempest-AttachVolumeNegativeTest-server-189645111</nova:name>
Jul 29 15:09:04 user nova-compute[70924]:       <nova:creationTime>2023-07-29 15:09:04</nova:creationTime>
Jul 29 15:09:04 user nova-compute[70924]:       <nova:flavor name="m1.tiny">
Jul 29 15:09:04 user nova-compute[70924]:         <nova:memory>512</nova:memory>
Jul 29 15:09:04 user nova-compute[70924]:         <nova:disk>1</nova:disk>
Jul 29 15:09:04 user nova-compute[70924]:         <nova:swap>0</nova:swap>
Jul 29 15:09:04 user nova-compute[70924]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 15:09:04 user nova-compute[70924]:         <nova:vcpus>1</nova:vcpus>
Jul 29 15:09:04 user nova-compute[70924]:       </nova:flavor>
Jul 29 15:09:04 user nova-compute[70924]:       <nova:owner>
Jul 29 15:09:04 user nova-compute[70924]:         <nova:user uuid="12cb8299e4d24946bc41a86493f4b426">tempest-AttachVolumeNegativeTest-972203101-project-member</nova:user>
Jul 29 15:09:04 user nova-compute[70924]:         <nova:project uuid="9aadc9385b3b46eebc6e0d81814521af">tempest-AttachVolumeNegativeTest-972203101</nova:project>
Jul 29 15:09:04 user nova-compute[70924]:       </nova:owner>
Jul 29 15:09:04 user nova-compute[70924]:       <nova:root type="image" uuid="3aba2e73-6832-404b-8bd0-d0503ce82b8c"/>
Jul 29 15:09:04 user nova-compute[70924]:       <nova:ports>
Jul 29 15:09:04 user nova-compute[70924]:         <nova:port uuid="4216c4cd-08b6-4e6f-a4f8-9b34c2b42756">
Jul 29 15:09:04 user nova-compute[70924]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 29 15:09:04 user nova-compute[70924]:         </nova:port>
Jul 29 15:09:04 user nova-compute[70924]:       </nova:ports>
Jul 29 15:09:04 user nova-compute[70924]:     </nova:instance>
Jul 29 15:09:04 user nova-compute[70924]:   </metadata>
Jul 29 15:09:04 user nova-compute[70924]:   <sysinfo type="smbios">
Jul 29 15:09:04 user nova-compute[70924]:     <system>
Jul 29 15:09:04 user nova-compute[70924]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 15:09:04 user nova-compute[70924]:       <entry name="product">OpenStack Nova</entry>
Jul 29 15:09:04 user nova-compute[70924]:       <entry name="version">0.0.0</entry>
Jul 29 15:09:04 user nova-compute[70924]:       <entry name="serial">fc2c25cc-9d79-45a2-9d50-862b7592f7f7</entry>
Jul 29 15:09:04 user nova-compute[70924]:       <entry name="uuid">fc2c25cc-9d79-45a2-9d50-862b7592f7f7</entry>
Jul 29 15:09:04 user nova-compute[70924]:       <entry name="family">Virtual Machine</entry>
Jul 29 15:09:04 user nova-compute[70924]:     </system>
Jul 29 15:09:04 user nova-compute[70924]:   </sysinfo>
Jul 29 15:09:04 user nova-compute[70924]:   <os>
Jul 29 15:09:04 user nova-compute[70924]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 15:09:04 user nova-compute[70924]:     <boot dev="hd"/>
Jul 29 15:09:04 user nova-compute[70924]:     <smbios mode="sysinfo"/>
Jul 29 15:09:04 user nova-compute[70924]:   </os>
Jul 29 15:09:04 user nova-compute[70924]:   <features>
Jul 29 15:09:04 user nova-compute[70924]:     <acpi/>
Jul 29 15:09:04 user nova-compute[70924]:     <apic/>
Jul 29 15:09:04 user nova-compute[70924]:     <vmcoreinfo/>
Jul 29 15:09:04 user nova-compute[70924]:   </features>
Jul 29 15:09:04 user nova-compute[70924]:   <clock offset="utc">
Jul 29 15:09:04 user nova-compute[70924]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 15:09:04 user nova-compute[70924]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 15:09:04 user nova-compute[70924]:     <timer name="hpet" present="no"/>
Jul 29 15:09:04 user nova-compute[70924]:   </clock>
Jul 29 15:09:04 user nova-compute[70924]:   <cpu mode="custom" match="exact">
Jul 29 15:09:04 user nova-compute[70924]:     <model>Nehalem</model>
Jul 29 15:09:04 user nova-compute[70924]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 15:09:04 user nova-compute[70924]:   </cpu>
Jul 29 15:09:04 user nova-compute[70924]:   <devices>
Jul 29 15:09:04 user nova-compute[70924]:     <disk type="file" device="disk">
Jul 29 15:09:04 user nova-compute[70924]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 15:09:04 user nova-compute[70924]:       <source file="/opt/stack/data/nova/instances/fc2c25cc-9d79-45a2-9d50-862b7592f7f7/disk"/>
Jul 29 15:09:04 user nova-compute[70924]:       <target dev="vda" bus="virtio"/>
Jul 29 15:09:04 user nova-compute[70924]:     </disk>
Jul 29 15:09:04 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 15:09:04 user nova-compute[70924]:       <mac address="fa:16:3e:6e:a3:e0"/>
Jul 29 15:09:04 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 15:09:04 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 15:09:04 user nova-compute[70924]:       <target dev="tap4216c4cd-08"/>
Jul 29 15:09:04 user nova-compute[70924]:     </interface>
Jul 29 15:09:04 user nova-compute[70924]:     <serial type="pty">
Jul 29 15:09:04 user nova-compute[70924]:       <log file="/opt/stack/data/nova/instances/fc2c25cc-9d79-45a2-9d50-862b7592f7f7/console.log" append="off"/>
Jul 29 15:09:04 user nova-compute[70924]:     </serial>
Jul 29 15:09:04 user nova-compute[70924]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 15:09:04 user nova-compute[70924]:     <video>
Jul 29 15:09:04 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 15:09:04 user nova-compute[70924]:     </video>
Jul 29 15:09:04 user nova-compute[70924]:     <rng model="virtio">
Jul 29 15:09:04 user nova-compute[70924]:       <backend model="random">/dev/urandom</backend>
Jul 29 15:09:04 user nova-compute[70924]:     </rng>
Jul 29 15:09:04 user nova-compute[70924]:     <controller type="usb" index="0" model="none"/>
Jul 29 15:09:04 user nova-compute[70924]:     <memballoon model="virtio">
Jul 29 15:09:04 user nova-compute[70924]:       <stats period="10"/>
Jul 29 15:09:04 user nova-compute[70924]:     </memballoon>
Jul 29 15:09:04 user nova-compute[70924]:   </devices>
Jul 29 15:09:04 user nova-compute[70924]: </domain>
Jul 29 15:09:04 user nova-compute[70924]:  {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 15:09:04 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T15:09:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-189645111',display_name='tempest-AttachVolumeNegativeTest-server-189645111',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-189645111',id=47,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpyJkk17R9ToaiZTlPTLuCE4oval1DrBbefLqdKXR4x91mJT/GIXisv97ul11yogu6qVJ9CihjcmkNXyKQsx5OkK7a5HaMkDvAvtb/myOim31HBd7+9lawbcSTd2NCNnQ==',key_name='tempest-keypair-60654091',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9aadc9385b3b46eebc6e0d81814521af',ramdisk_id='',reservation_id='r-n2bomhip',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-972203101',owner_user_name='tempest-AttachVolumeNegativeTest-972203101-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T15:09:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='12cb8299e4d24946bc41a86493f4b426',uuid=fc2c25cc-9d79-45a2-9d50-862b7592f7f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4216c4cd-08b6-4e6f-a4f8-9b34c2b42756", "address": "fa:16:3e:6e:a3:e0", "network": {"id": "f80826fa-fada-45b9-b969-fd539fd34fd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-465377443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9aadc9385b3b46eebc6e0d81814521af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4216c4cd-08", "ovs_interfaceid": "4216c4cd-08b6-4e6f-a4f8-9b34c2b42756", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 15:09:04 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Converting VIF {"id": "4216c4cd-08b6-4e6f-a4f8-9b34c2b42756", "address": "fa:16:3e:6e:a3:e0", "network": {"id": "f80826fa-fada-45b9-b969-fd539fd34fd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-465377443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9aadc9385b3b46eebc6e0d81814521af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4216c4cd-08", "ovs_interfaceid": "4216c4cd-08b6-4e6f-a4f8-9b34c2b42756", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 15:09:04 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:a3:e0,bridge_name='br-int',has_traffic_filtering=True,id=4216c4cd-08b6-4e6f-a4f8-9b34c2b42756,network=Network(f80826fa-fada-45b9-b969-fd539fd34fd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4216c4cd-08') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 15:09:04 user nova-compute[70924]: DEBUG os_vif [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:a3:e0,bridge_name='br-int',has_traffic_filtering=True,id=4216c4cd-08b6-4e6f-a4f8-9b34c2b42756,network=Network(f80826fa-fada-45b9-b969-fd539fd34fd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4216c4cd-08') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 15:09:04 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:09:04 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:09:04 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 15:09:04 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:09:04 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4216c4cd-08, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:09:04 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4216c4cd-08, col_values=(('external_ids', {'iface-id': '4216c4cd-08b6-4e6f-a4f8-9b34c2b42756', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:a3:e0', 'vm-uuid': 'fc2c25cc-9d79-45a2-9d50-862b7592f7f7'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:09:04 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:09:04 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:09:04 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:09:04 user nova-compute[70924]: INFO os_vif [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:a3:e0,bridge_name='br-int',has_traffic_filtering=True,id=4216c4cd-08b6-4e6f-a4f8-9b34c2b42756,network=Network(f80826fa-fada-45b9-b969-fd539fd34fd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4216c4cd-08')
Jul 29 15:09:04 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 15:09:04 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] No VIF found with MAC fa:16:3e:6e:a3:e0, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 15:09:04 user nova-compute[70924]: DEBUG nova.network.neutron [req-cbf2bef4-135b-472d-a707-fbf19a86f775 req-82acf8fb-ac4a-4734-b927-a1cb24eb07bd service nova] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] Updated VIF entry in instance network info cache for port 4216c4cd-08b6-4e6f-a4f8-9b34c2b42756. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 15:09:04 user nova-compute[70924]: DEBUG nova.network.neutron [req-cbf2bef4-135b-472d-a707-fbf19a86f775 req-82acf8fb-ac4a-4734-b927-a1cb24eb07bd service nova] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] Updating instance_info_cache with network_info: [{"id": "4216c4cd-08b6-4e6f-a4f8-9b34c2b42756", "address": "fa:16:3e:6e:a3:e0", "network": {"id": "f80826fa-fada-45b9-b969-fd539fd34fd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-465377443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9aadc9385b3b46eebc6e0d81814521af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4216c4cd-08", "ovs_interfaceid": "4216c4cd-08b6-4e6f-a4f8-9b34c2b42756", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:09:04 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-cbf2bef4-135b-472d-a707-fbf19a86f775 req-82acf8fb-ac4a-4734-b927-a1cb24eb07bd service nova] Releasing lock "refresh_cache-fc2c25cc-9d79-45a2-9d50-862b7592f7f7" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:09:05 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:09:05 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:09:05 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:09:05 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:09:06 user nova-compute[70924]: DEBUG nova.compute.manager [req-d73af523-8277-48c9-bed1-31337adb6041 req-c8ea1ada-1d41-4965-8751-b45f774671fe service nova] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] Received event network-vif-plugged-4216c4cd-08b6-4e6f-a4f8-9b34c2b42756 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:09:06 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-d73af523-8277-48c9-bed1-31337adb6041 req-c8ea1ada-1d41-4965-8751-b45f774671fe service nova] Acquiring lock "fc2c25cc-9d79-45a2-9d50-862b7592f7f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:09:06 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-d73af523-8277-48c9-bed1-31337adb6041 req-c8ea1ada-1d41-4965-8751-b45f774671fe service nova] Lock "fc2c25cc-9d79-45a2-9d50-862b7592f7f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:09:06 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-d73af523-8277-48c9-bed1-31337adb6041 req-c8ea1ada-1d41-4965-8751-b45f774671fe service nova] Lock "fc2c25cc-9d79-45a2-9d50-862b7592f7f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:09:06 user nova-compute[70924]: DEBUG nova.compute.manager [req-d73af523-8277-48c9-bed1-31337adb6041 req-c8ea1ada-1d41-4965-8751-b45f774671fe service nova] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] No waiting events found dispatching network-vif-plugged-4216c4cd-08b6-4e6f-a4f8-9b34c2b42756 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:09:06 user nova-compute[70924]: WARNING nova.compute.manager [req-d73af523-8277-48c9-bed1-31337adb6041 req-c8ea1ada-1d41-4965-8751-b45f774671fe service nova] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] Received unexpected event network-vif-plugged-4216c4cd-08b6-4e6f-a4f8-9b34c2b42756 for instance with vm_state building and task_state spawning.
Jul 29 15:09:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:09:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:09:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:09:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:09:07 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690643347.9607837, fc2c25cc-9d79-45a2-9d50-862b7592f7f7 => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 15:09:07 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] VM Resumed (Lifecycle Event)
Jul 29 15:09:07 user nova-compute[70924]: DEBUG nova.compute.manager [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] Instance event wait completed in 0 seconds for  {{(pid=70924) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 15:09:07 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] Guest created on hypervisor {{(pid=70924) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 15:09:07 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] Instance spawned successfully.
Jul 29 15:09:07 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 15:09:07 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:09:07 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 15:09:07 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] Found default for hw_cdrom_bus of ide {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:09:07 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] Found default for hw_disk_bus of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:09:07 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] Found default for hw_input_bus of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:09:07 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] Found default for hw_pointer_model of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:09:07 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] Found default for hw_video_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:09:07 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] Found default for hw_vif_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:09:08 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 15:09:08 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690643347.9659443, fc2c25cc-9d79-45a2-9d50-862b7592f7f7 => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 15:09:08 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] VM Started (Lifecycle Event)
Jul 29 15:09:08 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:09:08 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 15:09:08 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 15:09:08 user nova-compute[70924]: INFO nova.compute.manager [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] Took 5.62 seconds to spawn the instance on the hypervisor.
Jul 29 15:09:08 user nova-compute[70924]: DEBUG nova.compute.manager [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:09:08 user nova-compute[70924]: INFO nova.compute.manager [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] Took 6.21 seconds to build instance.
Jul 29 15:09:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a8cd141a-3fd0-4d32-abe0-9b57d70362a6 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "fc2c25cc-9d79-45a2-9d50-862b7592f7f7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.304s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:09:08 user nova-compute[70924]: DEBUG nova.compute.manager [req-e1b5f339-00fa-4ada-91d2-d74134c550b3 req-df5f012a-8ed2-4b63-84b0-8a38bf35a658 service nova] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] Received event network-vif-plugged-4216c4cd-08b6-4e6f-a4f8-9b34c2b42756 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:09:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-e1b5f339-00fa-4ada-91d2-d74134c550b3 req-df5f012a-8ed2-4b63-84b0-8a38bf35a658 service nova] Acquiring lock "fc2c25cc-9d79-45a2-9d50-862b7592f7f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:09:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-e1b5f339-00fa-4ada-91d2-d74134c550b3 req-df5f012a-8ed2-4b63-84b0-8a38bf35a658 service nova] Lock "fc2c25cc-9d79-45a2-9d50-862b7592f7f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:09:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-e1b5f339-00fa-4ada-91d2-d74134c550b3 req-df5f012a-8ed2-4b63-84b0-8a38bf35a658 service nova] Lock "fc2c25cc-9d79-45a2-9d50-862b7592f7f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:09:08 user nova-compute[70924]: DEBUG nova.compute.manager [req-e1b5f339-00fa-4ada-91d2-d74134c550b3 req-df5f012a-8ed2-4b63-84b0-8a38bf35a658 service nova] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] No waiting events found dispatching network-vif-plugged-4216c4cd-08b6-4e6f-a4f8-9b34c2b42756 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:09:08 user nova-compute[70924]: WARNING nova.compute.manager [req-e1b5f339-00fa-4ada-91d2-d74134c550b3 req-df5f012a-8ed2-4b63-84b0-8a38bf35a658 service nova] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] Received unexpected event network-vif-plugged-4216c4cd-08b6-4e6f-a4f8-9b34c2b42756 for instance with vm_state active and task_state None.
Jul 29 15:09:08 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:09:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:09:09 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:09:09 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:09:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:09:12 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:09:12 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Starting heal instance info cache {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 15:09:12 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Rebuilding the list of instances to heal {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 29 15:09:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "refresh_cache-0a8fe938-7ca4-4221-9742-9b043050ba84" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:09:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquired lock "refresh_cache-0a8fe938-7ca4-4221-9742-9b043050ba84" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:09:12 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Forcefully refreshing network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 29 15:09:12 user nova-compute[70924]: DEBUG nova.objects.instance [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lazy-loading 'info_cache' on Instance uuid 0a8fe938-7ca4-4221-9742-9b043050ba84 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:09:12 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Updating instance_info_cache with network_info: [{"id": "0f6e2258-37e5-4786-898b-d11796a410e7", "address": "fa:16:3e:0c:50:9c", "network": {"id": "24b90c74-6ebe-42f0-b11f-fc2b23b35188", "bridge": "br-int", "label": "tempest-TestStampPattern-1445459710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "519723b99af84d1b85c40cfbc6518d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f6e2258-37", "ovs_interfaceid": "0f6e2258-37e5-4786-898b-d11796a410e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:09:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Releasing lock "refresh_cache-0a8fe938-7ca4-4221-9742-9b043050ba84" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:09:12 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Updated the network info_cache for instance {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 29 15:09:12 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:09:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:09:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:09:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:09:12 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Auditing locally available compute resources for user (node: user) {{(pid=70924) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 15:09:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0df1b67-aab1-4a27-9ef9-00e02a5dfca5/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:09:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0df1b67-aab1-4a27-9ef9-00e02a5dfca5/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:09:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0df1b67-aab1-4a27-9ef9-00e02a5dfca5/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:09:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0df1b67-aab1-4a27-9ef9-00e02a5dfca5/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:09:13 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 15:09:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:09:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:09:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:09:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:09:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2c25cc-9d79-45a2-9d50-862b7592f7f7/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:09:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2c25cc-9d79-45a2-9d50-862b7592f7f7/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:09:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2c25cc-9d79-45a2-9d50-862b7592f7f7/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:09:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2c25cc-9d79-45a2-9d50-862b7592f7f7/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:09:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a8fe938-7ca4-4221-9742-9b043050ba84/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:09:14 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a8fe938-7ca4-4221-9742-9b043050ba84/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:09:14 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a8fe938-7ca4-4221-9742-9b043050ba84/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:09:14 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a8fe938-7ca4-4221-9742-9b043050ba84/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:09:14 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:09:14 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:09:14 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:09:14 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Hypervisor/Node resource view: name=user free_ram=8178MB free_disk=25.173030853271484GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70924) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 15:09:14 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:09:14 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:09:14 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 0a8fe938-7ca4-4221-9742-9b043050ba84 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:09:14 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 45a4c141-3b2f-452c-a0ab-be3474f3b953 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:09:14 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:09:14 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance d0df1b67-aab1-4a27-9ef9-00e02a5dfca5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:09:14 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance fc2c25cc-9d79-45a2-9d50-862b7592f7f7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:09:14 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 15:09:14 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 15:09:14 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:09:14 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:09:14 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Compute_service record updated for user:user {{(pid=70924) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 15:09:14 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.308s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:09:15 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:09:15 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:09:15 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70924) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 15:09:16 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:09:19 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:09:19 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:09:19 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70924) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 29 15:09:19 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70924) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 15:09:19 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:09:19 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70924) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 15:09:24 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:09:24 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:09:29 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:09:29 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:09:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:09:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:09:39 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:09:39 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:09:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:09:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:09:49 user nova-compute[70924]: DEBUG nova.compute.manager [req-01504144-ccc6-42ef-9bb4-df9230cc3660 req-7a77a4af-ac3e-4309-b2b0-8bd002c2fd4a service nova] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] Received event network-changed-7af29ac0-4a0d-41ab-b21e-bd3c215f1d00 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:09:49 user nova-compute[70924]: DEBUG nova.compute.manager [req-01504144-ccc6-42ef-9bb4-df9230cc3660 req-7a77a4af-ac3e-4309-b2b0-8bd002c2fd4a service nova] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] Refreshing instance network info cache due to event network-changed-7af29ac0-4a0d-41ab-b21e-bd3c215f1d00. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 15:09:49 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-01504144-ccc6-42ef-9bb4-df9230cc3660 req-7a77a4af-ac3e-4309-b2b0-8bd002c2fd4a service nova] Acquiring lock "refresh_cache-45a4c141-3b2f-452c-a0ab-be3474f3b953" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:09:49 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-01504144-ccc6-42ef-9bb4-df9230cc3660 req-7a77a4af-ac3e-4309-b2b0-8bd002c2fd4a service nova] Acquired lock "refresh_cache-45a4c141-3b2f-452c-a0ab-be3474f3b953" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:09:49 user nova-compute[70924]: DEBUG nova.network.neutron [req-01504144-ccc6-42ef-9bb4-df9230cc3660 req-7a77a4af-ac3e-4309-b2b0-8bd002c2fd4a service nova] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] Refreshing network info cache for port 7af29ac0-4a0d-41ab-b21e-bd3c215f1d00 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 15:09:49 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:09:50 user nova-compute[70924]: DEBUG nova.network.neutron [req-01504144-ccc6-42ef-9bb4-df9230cc3660 req-7a77a4af-ac3e-4309-b2b0-8bd002c2fd4a service nova] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] Updated VIF entry in instance network info cache for port 7af29ac0-4a0d-41ab-b21e-bd3c215f1d00. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 15:09:50 user nova-compute[70924]: DEBUG nova.network.neutron [req-01504144-ccc6-42ef-9bb4-df9230cc3660 req-7a77a4af-ac3e-4309-b2b0-8bd002c2fd4a service nova] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] Updating instance_info_cache with network_info: [{"id": "7af29ac0-4a0d-41ab-b21e-bd3c215f1d00", "address": "fa:16:3e:39:4e:2c", "network": {"id": "c19ed38b-2acd-421a-9e4b-f60df3db2f1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1812407562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a974cbbf734f51897c3e632ae9e45f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7af29ac0-4a", "ovs_interfaceid": "7af29ac0-4a0d-41ab-b21e-bd3c215f1d00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:09:50 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-01504144-ccc6-42ef-9bb4-df9230cc3660 req-7a77a4af-ac3e-4309-b2b0-8bd002c2fd4a service nova] Releasing lock "refresh_cache-45a4c141-3b2f-452c-a0ab-be3474f3b953" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:09:50 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-27c6b762-d22a-46f8-857a-1ed9879e3d73 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Acquiring lock "45a4c141-3b2f-452c-a0ab-be3474f3b953" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:09:50 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-27c6b762-d22a-46f8-857a-1ed9879e3d73 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "45a4c141-3b2f-452c-a0ab-be3474f3b953" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:09:50 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-27c6b762-d22a-46f8-857a-1ed9879e3d73 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Acquiring lock "45a4c141-3b2f-452c-a0ab-be3474f3b953-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:09:50 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-27c6b762-d22a-46f8-857a-1ed9879e3d73 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "45a4c141-3b2f-452c-a0ab-be3474f3b953-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:09:50 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-27c6b762-d22a-46f8-857a-1ed9879e3d73 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "45a4c141-3b2f-452c-a0ab-be3474f3b953-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:09:50 user nova-compute[70924]: INFO nova.compute.manager [None req-27c6b762-d22a-46f8-857a-1ed9879e3d73 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] Terminating instance
Jul 29 15:09:50 user nova-compute[70924]: DEBUG nova.compute.manager [None req-27c6b762-d22a-46f8-857a-1ed9879e3d73 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] Start destroying the instance on the hypervisor. {{(pid=70924) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 15:09:50 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:09:50 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:09:50 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:09:50 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:09:50 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] Instance destroyed successfully.
Jul 29 15:09:50 user nova-compute[70924]: DEBUG nova.objects.instance [None req-27c6b762-d22a-46f8-857a-1ed9879e3d73 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lazy-loading 'resources' on Instance uuid 45a4c141-3b2f-452c-a0ab-be3474f3b953 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:09:50 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-27c6b762-d22a-46f8-857a-1ed9879e3d73 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T15:07:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2029591163',display_name='tempest-TestVolumeBootPattern-server-2029591163',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2029591163',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ85EoxOcLUTgXe8luwDJdmSAuW16EOphuu0LzU/6Hdmcve8fH6stAD+XoS0+shU7N/jDe0exnSkgWjCon0Br/QYJqNqli+yWYkmG2icNLlmtzdYRBdyLvXLjiH1TkzZOA==',key_name='tempest-TestVolumeBootPattern-447927024',keypairs=<?>,launch_index=0,launched_at=2023-07-29T15:08:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='99a974cbbf734f51897c3e632ae9e45f',ramdisk_id='',reservation_id='r-46wtb8mc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1030839740',owner_user_name='tempest-TestVolumeBootPattern-1030839740-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T15:08:12Z,user_data=None,user_id='da204646e8f84693ad470ed1d3eadd7c',uuid=45a4c141-3b2f-452c-a0ab-be3474f3b953,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7af29ac0-4a0d-41ab-b21e-bd3c215f1d00", "address": "fa:16:3e:39:4e:2c", "network": {"id": "c19ed38b-2acd-421a-9e4b-f60df3db2f1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1812407562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a974cbbf734f51897c3e632ae9e45f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7af29ac0-4a", "ovs_interfaceid": "7af29ac0-4a0d-41ab-b21e-bd3c215f1d00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 15:09:50 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-27c6b762-d22a-46f8-857a-1ed9879e3d73 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Converting VIF {"id": "7af29ac0-4a0d-41ab-b21e-bd3c215f1d00", "address": "fa:16:3e:39:4e:2c", "network": {"id": "c19ed38b-2acd-421a-9e4b-f60df3db2f1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1812407562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a974cbbf734f51897c3e632ae9e45f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7af29ac0-4a", "ovs_interfaceid": "7af29ac0-4a0d-41ab-b21e-bd3c215f1d00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 15:09:50 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-27c6b762-d22a-46f8-857a-1ed9879e3d73 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:4e:2c,bridge_name='br-int',has_traffic_filtering=True,id=7af29ac0-4a0d-41ab-b21e-bd3c215f1d00,network=Network(c19ed38b-2acd-421a-9e4b-f60df3db2f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7af29ac0-4a') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 15:09:50 user nova-compute[70924]: DEBUG os_vif [None req-27c6b762-d22a-46f8-857a-1ed9879e3d73 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:4e:2c,bridge_name='br-int',has_traffic_filtering=True,id=7af29ac0-4a0d-41ab-b21e-bd3c215f1d00,network=Network(c19ed38b-2acd-421a-9e4b-f60df3db2f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7af29ac0-4a') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 15:09:50 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:09:50 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7af29ac0-4a, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:09:50 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:09:50 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:09:50 user nova-compute[70924]: INFO os_vif [None req-27c6b762-d22a-46f8-857a-1ed9879e3d73 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:4e:2c,bridge_name='br-int',has_traffic_filtering=True,id=7af29ac0-4a0d-41ab-b21e-bd3c215f1d00,network=Network(c19ed38b-2acd-421a-9e4b-f60df3db2f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7af29ac0-4a')
Jul 29 15:09:50 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27c6b762-d22a-46f8-857a-1ed9879e3d73 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] calling os-brick to detach iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 15:09:50 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c6b762-d22a-46f8-857a-1ed9879e3d73 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, {'target_iqns': ['iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ANSHrCvV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 15:09:50 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-27c6b762-d22a-46f8-857a-1ed9879e3d73 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 15:09:50 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-27c6b762-d22a-46f8-857a-1ed9879e3d73 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 15:09:50 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-27c6b762-d22a-46f8-857a-1ed9879e3d73 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 15:09:50 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c6b762-d22a-46f8-857a-1ed9879e3d73 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490', 0)] {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 15:09:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:09:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:09:50 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a47c516-a114-462b-bf1c-95c04dd4b6e3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:09:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:09:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:09:50 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6060a66-62eb-49d0-9ecf-879427e5cc1e]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:09:50 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c6b762-d22a-46f8-857a-1ed9879e3d73 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 (non-flash)
Jul 29 15:09:50 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 15:09:50 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c6b762-d22a-46f8-857a-1ed9879e3d73 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 (non-flash)
Jul 29 15:09:50 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 15:09:50 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c6b762-d22a-46f8-857a-1ed9879e3d73 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feedc34fd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490'): ({'sdb'}, set())}) {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 15:09:50 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-27c6b762-d22a-46f8-857a-1ed9879e3d73 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Removing single pathed devices sdb {{(pid=70924) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 15:09:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:09:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:09:50 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[520f3bdb-b350-44ed-99f5-859259be3046]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:09:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:09:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:09:51 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6962ccc3-f2ea-40df-8891-81e5dd1f8274]: (4, ('ok\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:09:51 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-27c6b762-d22a-46f8-857a-1ed9879e3d73 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Flushing IO for device /dev/sdb {{(pid=70924) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 15:09:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:09:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:09:51 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0830f2-44f2-4eaa-aa72-a8c0eb0009e7]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:09:51 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-27c6b762-d22a-46f8-857a-1ed9879e3d73 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70924) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 15:09:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:09:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:09:51 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[75528bf9-cc0e-48c5-aba2-d0b3c7428920]: (4, ('1', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:09:51 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-27c6b762-d22a-46f8-857a-1ed9879e3d73 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 15:09:51 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-27c6b762-d22a-46f8-857a-1ed9879e3d73 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] SCSI volumes sdb have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 15:09:51 user nova-compute[70924]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23165663864343861', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_3895041a', '/dev/disk/by-id/scsi-1SCST_BIO3895041a-1ef8d48a9950cecd') {{(pid=81998) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 29 15:09:51 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30bff78-24bb-4070-b029-f88346fd320a]: (4, None) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:09:51 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c6b762-d22a-46f8-857a-1ed9879e3d73 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490')] {{(pid=70924) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 15:09:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:09:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:09:51 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[00bdb944-bdf0-4259-8902-c9d3cd832096]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:09:51 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c6b762-d22a-46f8-857a-1ed9879e3d73 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:09:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 -p 172.16.0.220:3260 --logout {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:09:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:09:51 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba95285-a0fc-4f32-8b23-ab37d4e728e8]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:09:51 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c6b762-d22a-46f8-857a-1ed9879e3d73 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490, portal: 172.16.0.220,3260]
Jul 29 15:09:51 user nova-compute[70924]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490, portal: 172.16.0.220,3260] successful.
Jul 29 15:09:51 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:09:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 -p 172.16.0.220:3260 --op delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:09:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:09:51 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf46f83a-436c-478e-a518-a03227aa9d37]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:09:51 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c6b762-d22a-46f8-857a-1ed9879e3d73 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:09:51 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-27c6b762-d22a-46f8-857a-1ed9879e3d73 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 15:09:51 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c6b762-d22a-46f8-857a-1ed9879e3d73 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] <== disconnect_volume: return (278ms) None {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 15:09:51 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27c6b762-d22a-46f8-857a-1ed9879e3d73 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] Disconnected iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 15:09:51 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-27c6b762-d22a-46f8-857a-1ed9879e3d73 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] Deleting instance files /opt/stack/data/nova/instances/45a4c141-3b2f-452c-a0ab-be3474f3b953_del
Jul 29 15:09:51 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-27c6b762-d22a-46f8-857a-1ed9879e3d73 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] Deletion of /opt/stack/data/nova/instances/45a4c141-3b2f-452c-a0ab-be3474f3b953_del complete
Jul 29 15:09:51 user nova-compute[70924]: INFO nova.compute.manager [None req-27c6b762-d22a-46f8-857a-1ed9879e3d73 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] Took 1.14 seconds to destroy the instance on the hypervisor.
Jul 29 15:09:51 user nova-compute[70924]: DEBUG oslo.service.loopingcall [None req-27c6b762-d22a-46f8-857a-1ed9879e3d73 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70924) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 15:09:51 user nova-compute[70924]: DEBUG nova.compute.manager [-] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] Deallocating network for instance {{(pid=70924) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 15:09:51 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] deallocate_for_instance() {{(pid=70924) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 15:09:51 user nova-compute[70924]: DEBUG nova.compute.manager [req-a27dd0d4-baf1-412d-81f4-b54b1e17b1c2 req-50c74093-90cd-4ea4-bb87-457cfb2397fd service nova] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] Received event network-vif-unplugged-7af29ac0-4a0d-41ab-b21e-bd3c215f1d00 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:09:51 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a27dd0d4-baf1-412d-81f4-b54b1e17b1c2 req-50c74093-90cd-4ea4-bb87-457cfb2397fd service nova] Acquiring lock "45a4c141-3b2f-452c-a0ab-be3474f3b953-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:09:51 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a27dd0d4-baf1-412d-81f4-b54b1e17b1c2 req-50c74093-90cd-4ea4-bb87-457cfb2397fd service nova] Lock "45a4c141-3b2f-452c-a0ab-be3474f3b953-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:09:51 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a27dd0d4-baf1-412d-81f4-b54b1e17b1c2 req-50c74093-90cd-4ea4-bb87-457cfb2397fd service nova] Lock "45a4c141-3b2f-452c-a0ab-be3474f3b953-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:09:51 user nova-compute[70924]: DEBUG nova.compute.manager [req-a27dd0d4-baf1-412d-81f4-b54b1e17b1c2 req-50c74093-90cd-4ea4-bb87-457cfb2397fd service nova] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] No waiting events found dispatching network-vif-unplugged-7af29ac0-4a0d-41ab-b21e-bd3c215f1d00 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:09:51 user nova-compute[70924]: DEBUG nova.compute.manager [req-a27dd0d4-baf1-412d-81f4-b54b1e17b1c2 req-50c74093-90cd-4ea4-bb87-457cfb2397fd service nova] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] Received event network-vif-unplugged-7af29ac0-4a0d-41ab-b21e-bd3c215f1d00 for instance with task_state deleting. {{(pid=70924) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 15:09:51 user nova-compute[70924]: DEBUG nova.compute.manager [req-a27dd0d4-baf1-412d-81f4-b54b1e17b1c2 req-50c74093-90cd-4ea4-bb87-457cfb2397fd service nova] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] Received event network-vif-plugged-7af29ac0-4a0d-41ab-b21e-bd3c215f1d00 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:09:51 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a27dd0d4-baf1-412d-81f4-b54b1e17b1c2 req-50c74093-90cd-4ea4-bb87-457cfb2397fd service nova] Acquiring lock "45a4c141-3b2f-452c-a0ab-be3474f3b953-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:09:51 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a27dd0d4-baf1-412d-81f4-b54b1e17b1c2 req-50c74093-90cd-4ea4-bb87-457cfb2397fd service nova] Lock "45a4c141-3b2f-452c-a0ab-be3474f3b953-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:09:51 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a27dd0d4-baf1-412d-81f4-b54b1e17b1c2 req-50c74093-90cd-4ea4-bb87-457cfb2397fd service nova] Lock "45a4c141-3b2f-452c-a0ab-be3474f3b953-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:09:51 user nova-compute[70924]: DEBUG nova.compute.manager [req-a27dd0d4-baf1-412d-81f4-b54b1e17b1c2 req-50c74093-90cd-4ea4-bb87-457cfb2397fd service nova] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] No waiting events found dispatching network-vif-plugged-7af29ac0-4a0d-41ab-b21e-bd3c215f1d00 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:09:51 user nova-compute[70924]: WARNING nova.compute.manager [req-a27dd0d4-baf1-412d-81f4-b54b1e17b1c2 req-50c74093-90cd-4ea4-bb87-457cfb2397fd service nova] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] Received unexpected event network-vif-plugged-7af29ac0-4a0d-41ab-b21e-bd3c215f1d00 for instance with vm_state active and task_state deleting.
Jul 29 15:09:52 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:09:52 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] Took 1.03 seconds to deallocate network for instance.
Jul 29 15:09:53 user nova-compute[70924]: INFO nova.compute.manager [None req-27c6b762-d22a-46f8-857a-1ed9879e3d73 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] Took 0.73 seconds to detach 1 volumes for instance.
Jul 29 15:09:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-27c6b762-d22a-46f8-857a-1ed9879e3d73 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:09:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-27c6b762-d22a-46f8-857a-1ed9879e3d73 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:09:53 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-27c6b762-d22a-46f8-857a-1ed9879e3d73 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:09:53 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-27c6b762-d22a-46f8-857a-1ed9879e3d73 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:09:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-27c6b762-d22a-46f8-857a-1ed9879e3d73 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.199s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:09:53 user nova-compute[70924]: INFO nova.scheduler.client.report [None req-27c6b762-d22a-46f8-857a-1ed9879e3d73 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Deleted allocations for instance 45a4c141-3b2f-452c-a0ab-be3474f3b953
Jul 29 15:09:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-27c6b762-d22a-46f8-857a-1ed9879e3d73 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "45a4c141-3b2f-452c-a0ab-be3474f3b953" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.270s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:09:53 user nova-compute[70924]: DEBUG nova.compute.manager [req-4ef05f25-a676-4616-b80d-b29ca33e96b7 req-b6b550d1-33c2-49fa-9e66-5b4584c01733 service nova] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] Received event network-vif-deleted-7af29ac0-4a0d-41ab-b21e-bd3c215f1d00 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:09:54 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:09:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-e581efe3-75c6-4523-9580-065ce7867049 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Acquiring lock "5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:09:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-e581efe3-75c6-4523-9580-065ce7867049 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Lock "5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:09:55 user nova-compute[70924]: DEBUG nova.objects.instance [None req-e581efe3-75c6-4523-9580-065ce7867049 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Lazy-loading 'flavor' on Instance uuid 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:09:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-e581efe3-75c6-4523-9580-065ce7867049 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Lock "5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:09:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-e581efe3-75c6-4523-9580-065ce7867049 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Acquiring lock "5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:09:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-e581efe3-75c6-4523-9580-065ce7867049 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Lock "5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:09:55 user nova-compute[70924]: INFO nova.compute.manager [None req-e581efe3-75c6-4523-9580-065ce7867049 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Attaching volume f96d969f-0a50-439b-ae92-ad66d43b2497 to /dev/vdb
Jul 29 15:09:55 user nova-compute[70924]: DEBUG os_brick.utils [None req-e581efe3-75c6-4523-9580-065ce7867049 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 15:09:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:09:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:09:55 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f098853-7f11-44f4-bcc6-807a430cdf41]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f2127c4a30d9\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:09:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:09:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:09:55 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[465d8ebe-cdaf-4211-99b2-328ea47628b0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:09:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:09:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:09:55 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf22eaff-32a8-4eeb-aaa4-7137bb7c23e8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:09:55 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6bc238c-9354-4c64-b916-816620a51f55]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:09:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-e581efe3-75c6-4523-9580-065ce7867049 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Running cmd (subprocess): nvme version {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:09:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-e581efe3-75c6-4523-9580-065ce7867049 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] 'nvme version' failed. Not Retrying. {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 15:09:55 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e581efe3-75c6-4523-9580-065ce7867049 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] nvme not present on system {{(pid=70924) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 15:09:55 user nova-compute[70924]: DEBUG nova.compute.manager [req-1614dcaa-70ae-4470-91d1-c3a71466e22c req-98f4ee41-3664-49e6-b429-2df2057d363f service nova] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Received event network-changed-6a119205-17da-4214-a6dc-6d19712e40f8 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:09:55 user nova-compute[70924]: DEBUG nova.compute.manager [req-1614dcaa-70ae-4470-91d1-c3a71466e22c req-98f4ee41-3664-49e6-b429-2df2057d363f service nova] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Refreshing instance network info cache due to event network-changed-6a119205-17da-4214-a6dc-6d19712e40f8. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 15:09:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-1614dcaa-70ae-4470-91d1-c3a71466e22c req-98f4ee41-3664-49e6-b429-2df2057d363f service nova] Acquiring lock "refresh_cache-5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:09:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-1614dcaa-70ae-4470-91d1-c3a71466e22c req-98f4ee41-3664-49e6-b429-2df2057d363f service nova] Acquired lock "refresh_cache-5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:09:55 user nova-compute[70924]: DEBUG nova.network.neutron [req-1614dcaa-70ae-4470-91d1-c3a71466e22c req-98f4ee41-3664-49e6-b429-2df2057d363f service nova] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Refreshing network info cache for port 6a119205-17da-4214-a6dc-6d19712e40f8 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 15:09:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:09:55 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 15:09:55 user nova-compute[70924]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 15:09:55 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f927ce0-b3b4-4196-a604-8b5a623ced78]: (4, '') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:09:55 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-e581efe3-75c6-4523-9580-065ce7867049 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70924) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 15:09:55 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-e581efe3-75c6-4523-9580-065ce7867049 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 15:09:55 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-e581efe3-75c6-4523-9580-065ce7867049 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] LIGHTOS: no hostnqn found. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 15:09:55 user nova-compute[70924]: DEBUG os_brick.utils [None req-e581efe3-75c6-4523-9580-065ce7867049 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f2127c4a30d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 15:09:55 user nova-compute[70924]: DEBUG nova.virt.block_device [None req-e581efe3-75c6-4523-9580-065ce7867049 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Updating existing volume attachment record: 93204c0a-6b7f-46cb-8d28-9a20e19c16e7 {{(pid=70924) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 15:09:55 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:09:56 user nova-compute[70924]: DEBUG nova.network.neutron [req-1614dcaa-70ae-4470-91d1-c3a71466e22c req-98f4ee41-3664-49e6-b429-2df2057d363f service nova] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Updated VIF entry in instance network info cache for port 6a119205-17da-4214-a6dc-6d19712e40f8. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 15:09:56 user nova-compute[70924]: DEBUG nova.network.neutron [req-1614dcaa-70ae-4470-91d1-c3a71466e22c req-98f4ee41-3664-49e6-b429-2df2057d363f service nova] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Updating instance_info_cache with network_info: [{"id": "6a119205-17da-4214-a6dc-6d19712e40f8", "address": "fa:16:3e:31:4f:9d", "network": {"id": "10f0e77e-05d5-4c59-972d-60af9bc958b2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-887718488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40fb0f2b05f34e648ae30bc15758df66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a119205-17", "ovs_interfaceid": "6a119205-17da-4214-a6dc-6d19712e40f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:09:56 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-1614dcaa-70ae-4470-91d1-c3a71466e22c req-98f4ee41-3664-49e6-b429-2df2057d363f service nova] Releasing lock "refresh_cache-5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:09:59 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:10:00 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:10:02 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e581efe3-75c6-4523-9580-065ce7867049 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Calling os-brick to attach iSCSI Volume {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 15:10:02 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e581efe3-75c6-4523-9580-065ce7867049 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dvAxLjIc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 15:10:02 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-e581efe3-75c6-4523-9580-065ce7867049 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 15:10:02 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-e581efe3-75c6-4523-9580-065ce7867049 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 15:10:02 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-e581efe3-75c6-4523-9580-065ce7867049 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 15:10:02 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-e581efe3-75c6-4523-9580-065ce7867049 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 15:10:02 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-e581efe3-75c6-4523-9580-065ce7867049 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 15:10:02 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-e581efe3-75c6-4523-9580-065ce7867049 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 15:10:02 user nova-compute[70924]: INFO os_brick.initiator.connectors.iscsi [None req-e581efe3-75c6-4523-9580-065ce7867049 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 15:10:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497 -p 172.16.0.220:3260 {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:02 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[df754da2-5f6e-4e45-9cd8-756a46c26b40]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:02 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e581efe3-75c6-4523-9580-065ce7867049 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 15:10:02 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:10:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497 -p 172.16.0.220:3260 --interface default --op new {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:02 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0450d597-39f8-4088-bff6-ede3637a1d6a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497] added\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:02 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e581efe3-75c6-4523-9580-065ce7867049 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497] added
Jul 29 15:10:02 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:10:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:02 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7d0def-8045-46bb-965d-d39ac4fa7c0a]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:02 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e581efe3-75c6-4523-9580-065ce7867049 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:10:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:02 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d15796-5272-41e8-99ff-5b2bd4ece332]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:02 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e581efe3-75c6-4523-9580-065ce7867049 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:10:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dvAxLjIc {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dvAxLjIc" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:02 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4c5649-961d-438e-86f6-c3f7a03aa931]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:02 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e581efe3-75c6-4523-9580-065ce7867049 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dvAxLjIc'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:10:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:02 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec9e637-79a4-45f4-b3e9-a243663c804a]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:02 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e581efe3-75c6-4523-9580-065ce7867049 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:10:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:02 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[158348af-48bc-424e-91ba-91ee1439aa67]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:02 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e581efe3-75c6-4523-9580-065ce7867049 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 29 15:10:02 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 15:10:02 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e581efe3-75c6-4523-9580-065ce7867049 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 29 15:10:02 user nova-compute[70924]:  {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 15:10:02 user nova-compute[70924]: WARNING os_brick.initiator.connectors.iscsi [None req-e581efe3-75c6-4523-9580-065ce7867049 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 29 15:10:02 user nova-compute[70924]: 
Jul 29 15:10:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497 -p 172.16.0.220:3260 --login {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:02 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c315a9c4-1add-4798-988b-26bb6ed0b908]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:02 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e581efe3-75c6-4523-9580-065ce7867049 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497, portal: 172.16.0.220,3260]
Jul 29 15:10:02 user nova-compute[70924]: Login to [iface: default, target: iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497, portal: 172.16.0.220,3260] successful.
Jul 29 15:10:02 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:10:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:02 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b708fad-ee86-43ad-936b-16ee3f46da3d]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:02 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e581efe3-75c6-4523-9580-065ce7867049 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:10:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:02 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5504c0dc-0786-40af-bf0b-eb648b3e54b3]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:02 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e581efe3-75c6-4523-9580-065ce7867049 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497 (non-flash)
Jul 29 15:10:02 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 15:10:02 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e581efe3-75c6-4523-9580-065ce7867049 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497 (non-flash)
Jul 29 15:10:02 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 15:10:02 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-e581efe3-75c6-4523-9580-065ce7867049 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 15:10:02 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e581efe3-75c6-4523-9580-065ce7867049 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Connected to 172.16.0.220:3260 {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 15:10:02 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-e581efe3-75c6-4523-9580-065ce7867049 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=70924) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 15:10:02 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-e581efe3-75c6-4523-9580-065ce7867049 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70924) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 15:10:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:02 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4ab61c-34ae-4d02-b918-b02c04d34f27]: (4, ('- - 0', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:02 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-e581efe3-75c6-4523-9580-065ce7867049 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 15:10:02 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e581efe3-75c6-4523-9580-065ce7867049 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dvAxLjIc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 15:10:03 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:10:03 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-e581efe3-75c6-4523-9580-065ce7867049 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 15:10:03 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-e581efe3-75c6-4523-9580-065ce7867049 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '23562373138306639', 'path': '/dev/sdb'} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 15:10:03 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e581efe3-75c6-4523-9580-065ce7867049 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23562373138306639', 'path': '/dev/sdb'} {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 15:10:03 user nova-compute[70924]: DEBUG nova.objects.instance [None req-e581efe3-75c6-4523-9580-065ce7867049 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Lazy-loading 'flavor' on Instance uuid 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:10:03 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-e581efe3-75c6-4523-9580-065ce7867049 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] attach device xml: <disk type="block" device="disk">
Jul 29 15:10:03 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 15:10:03 user nova-compute[70924]:   <source dev="/dev/sdb"/>
Jul 29 15:10:03 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 15:10:03 user nova-compute[70924]:   <serial>f96d969f-0a50-439b-ae92-ad66d43b2497</serial>
Jul 29 15:10:03 user nova-compute[70924]: </disk>
Jul 29 15:10:03 user nova-compute[70924]:  {{(pid=70924) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 29 15:10:04 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:10:04 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-e581efe3-75c6-4523-9580-065ce7867049 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 15:10:04 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-e581efe3-75c6-4523-9580-065ce7867049 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 15:10:04 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-e581efe3-75c6-4523-9580-065ce7867049 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] No VIF found with MAC fa:16:3e:31:4f:9d, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 15:10:04 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:10:04 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-e581efe3-75c6-4523-9580-065ce7867049 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Lock "5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.884s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:10:05 user nova-compute[70924]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690643390.8526955, 45a4c141-3b2f-452c-a0ab-be3474f3b953 => Stopped> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 15:10:05 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] VM Stopped (Lifecycle Event)
Jul 29 15:10:05 user nova-compute[70924]: DEBUG nova.compute.manager [None req-e0af3cc2-22fb-4a62-b40c-f3e9a7dc0b01 None None] [instance: 45a4c141-3b2f-452c-a0ab-be3474f3b953] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:10:05 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:10:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-404a3342-c94d-4a58-bcbd-be1febbb34e0 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Acquiring lock "5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:10:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-404a3342-c94d-4a58-bcbd-be1febbb34e0 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Lock "5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:10:07 user nova-compute[70924]: DEBUG nova.objects.instance [None req-404a3342-c94d-4a58-bcbd-be1febbb34e0 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Lazy-loading 'flavor' on Instance uuid 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:10:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-404a3342-c94d-4a58-bcbd-be1febbb34e0 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Lock "5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:10:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-404a3342-c94d-4a58-bcbd-be1febbb34e0 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Acquiring lock "5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:10:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-404a3342-c94d-4a58-bcbd-be1febbb34e0 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Lock "5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:10:07 user nova-compute[70924]: INFO nova.compute.manager [None req-404a3342-c94d-4a58-bcbd-be1febbb34e0 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Attaching volume 722b2c71-be75-47ea-aaa6-cbbf2af8e229 to /dev/vdc
Jul 29 15:10:08 user nova-compute[70924]: DEBUG os_brick.utils [None req-404a3342-c94d-4a58-bcbd-be1febbb34e0 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 15:10:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:08 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56ca0c8-3a5a-429b-a9e9-15412c38f141]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f2127c4a30d9\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:08 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[a703e453-8d0f-4cef-a128-e4b83c18d5e2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:08 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[afcc3aa1-8820-4de6-852d-cd7a481f4938]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:08 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8c4e92-072f-48d7-88a8-a170dd64da71]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-404a3342-c94d-4a58-bcbd-be1febbb34e0 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Running cmd (subprocess): nvme version {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-404a3342-c94d-4a58-bcbd-be1febbb34e0 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] 'nvme version' failed. Not Retrying. {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 15:10:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.nvmeof [None req-404a3342-c94d-4a58-bcbd-be1febbb34e0 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] nvme not present on system {{(pid=70924) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 15:10:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 15:10:08 user nova-compute[70924]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 15:10:08 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[19bcefc7-9863-4406-a872-3899458d02e5]: (4, '') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-404a3342-c94d-4a58-bcbd-be1febbb34e0 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70924) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 15:10:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-404a3342-c94d-4a58-bcbd-be1febbb34e0 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 15:10:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-404a3342-c94d-4a58-bcbd-be1febbb34e0 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] LIGHTOS: no hostnqn found. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 15:10:08 user nova-compute[70924]: DEBUG os_brick.utils [None req-404a3342-c94d-4a58-bcbd-be1febbb34e0 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f2127c4a30d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 15:10:08 user nova-compute[70924]: DEBUG nova.virt.block_device [None req-404a3342-c94d-4a58-bcbd-be1febbb34e0 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Updating existing volume attachment record: 9f8598fb-910c-444f-9348-516ab191fd75 {{(pid=70924) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 15:10:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:10:10 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:10:10 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:10:11 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:10:11 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:10:12 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:10:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:10:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:10:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:10:12 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Auditing locally available compute resources for user (node: user) {{(pid=70924) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 15:10:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0df1b67-aab1-4a27-9ef9-00e02a5dfca5/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0df1b67-aab1-4a27-9ef9-00e02a5dfca5/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0df1b67-aab1-4a27-9ef9-00e02a5dfca5/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0df1b67-aab1-4a27-9ef9-00e02a5dfca5/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:13 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 15:10:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2c25cc-9d79-45a2-9d50-862b7592f7f7/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2c25cc-9d79-45a2-9d50-862b7592f7f7/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2c25cc-9d79-45a2-9d50-862b7592f7f7/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2c25cc-9d79-45a2-9d50-862b7592f7f7/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a8fe938-7ca4-4221-9742-9b043050ba84/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a8fe938-7ca4-4221-9742-9b043050ba84/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a8fe938-7ca4-4221-9742-9b043050ba84/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:13 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a8fe938-7ca4-4221-9742-9b043050ba84/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:14 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:10:14 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:10:14 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Hypervisor/Node resource view: name=user free_ram=8335MB free_disk=25.135440826416016GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70924) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 15:10:14 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:10:14 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:10:14 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 0a8fe938-7ca4-4221-9742-9b043050ba84 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:10:14 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:10:14 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance d0df1b67-aab1-4a27-9ef9-00e02a5dfca5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:10:14 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance fc2c25cc-9d79-45a2-9d50-862b7592f7f7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:10:14 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 15:10:14 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 15:10:14 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:10:14 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:10:14 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Compute_service record updated for user:user {{(pid=70924) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 15:10:14 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.294s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:10:14 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-404a3342-c94d-4a58-bcbd-be1febbb34e0 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Calling os-brick to attach iSCSI Volume {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 15:10:14 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-404a3342-c94d-4a58-bcbd-be1febbb34e0 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:722b2c71-be75-47ea-aaa6-cbbf2af8e229'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZdnWovPq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 15:10:14 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-404a3342-c94d-4a58-bcbd-be1febbb34e0 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 15:10:14 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-404a3342-c94d-4a58-bcbd-be1febbb34e0 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 15:10:14 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-404a3342-c94d-4a58-bcbd-be1febbb34e0 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 15:10:14 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-404a3342-c94d-4a58-bcbd-be1febbb34e0 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 15:10:14 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-404a3342-c94d-4a58-bcbd-be1febbb34e0 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:722b2c71-be75-47ea-aaa6-cbbf2af8e229" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 15:10:14 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-404a3342-c94d-4a58-bcbd-be1febbb34e0 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:722b2c71-be75-47ea-aaa6-cbbf2af8e229" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 15:10:14 user nova-compute[70924]: INFO os_brick.initiator.connectors.iscsi [None req-404a3342-c94d-4a58-bcbd-be1febbb34e0 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 15:10:14 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:722b2c71-be75-47ea-aaa6-cbbf2af8e229 -p 172.16.0.220:3260 {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:14 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:722b2c71-be75-47ea-aaa6-cbbf2af8e229 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:14 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6d622c-0759-4c72-9ce6-962c001d3228]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:14 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-404a3342-c94d-4a58-bcbd-be1febbb34e0 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 15:10:14 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:10:15 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:722b2c71-be75-47ea-aaa6-cbbf2af8e229 -p 172.16.0.220:3260 --interface default --op new {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:15 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:722b2c71-be75-47ea-aaa6-cbbf2af8e229 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:15 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9fb2b0f-b7e7-4ff7-a2a0-a429c6c04433]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:722b2c71-be75-47ea-aaa6-cbbf2af8e229] added\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:15 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-404a3342-c94d-4a58-bcbd-be1febbb34e0 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:722b2c71-be75-47ea-aaa6-cbbf2af8e229] added
Jul 29 15:10:15 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:10:15 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:722b2c71-be75-47ea-aaa6-cbbf2af8e229 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:15 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:722b2c71-be75-47ea-aaa6-cbbf2af8e229 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:15 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9889d5f8-5dfd-4e41-abe1-ef00a86b780d]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:15 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-404a3342-c94d-4a58-bcbd-be1febbb34e0 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:10:15 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:722b2c71-be75-47ea-aaa6-cbbf2af8e229 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:15 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:722b2c71-be75-47ea-aaa6-cbbf2af8e229 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:15 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[44512281-0453-4580-9714-81236d8657e0]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:15 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-404a3342-c94d-4a58-bcbd-be1febbb34e0 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:10:15 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:722b2c71-be75-47ea-aaa6-cbbf2af8e229 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZdnWovPq {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:15 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:722b2c71-be75-47ea-aaa6-cbbf2af8e229 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZdnWovPq" returned: 0 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:15 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[468cd068-5bb9-445b-bc24-eb14d5abab6c]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:15 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-404a3342-c94d-4a58-bcbd-be1febbb34e0 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZdnWovPq'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:10:15 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:722b2c71-be75-47ea-aaa6-cbbf2af8e229 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:15 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:722b2c71-be75-47ea-aaa6-cbbf2af8e229 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:15 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ac53b4-17e4-43f2-bc74-d1efedca089b]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:15 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-404a3342-c94d-4a58-bcbd-be1febbb34e0 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:10:15 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:15 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:15 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[df77590d-a766-4307-b2f1-9e7cabefd68f]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:15 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-404a3342-c94d-4a58-bcbd-be1febbb34e0 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497 (non-flash)
Jul 29 15:10:15 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 15:10:15 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-404a3342-c94d-4a58-bcbd-be1febbb34e0 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497 (non-flash)
Jul 29 15:10:15 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 15:10:15 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:722b2c71-be75-47ea-aaa6-cbbf2af8e229 -p 172.16.0.220:3260 --login {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:15 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:722b2c71-be75-47ea-aaa6-cbbf2af8e229 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:15 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce979c6c-3f95-4310-ae1d-527b03341697]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:722b2c71-be75-47ea-aaa6-cbbf2af8e229, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:722b2c71-be75-47ea-aaa6-cbbf2af8e229, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:15 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-404a3342-c94d-4a58-bcbd-be1febbb34e0 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:722b2c71-be75-47ea-aaa6-cbbf2af8e229, portal: 172.16.0.220,3260]
Jul 29 15:10:15 user nova-compute[70924]: Login to [iface: default, target: iqn.2010-10.org.openstack:722b2c71-be75-47ea-aaa6-cbbf2af8e229, portal: 172.16.0.220,3260] successful.
Jul 29 15:10:15 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:10:15 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:722b2c71-be75-47ea-aaa6-cbbf2af8e229 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:15 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:722b2c71-be75-47ea-aaa6-cbbf2af8e229 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:15 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[125cda50-0b5c-43a1-bf7a-703740857986]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:15 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-404a3342-c94d-4a58-bcbd-be1febbb34e0 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:10:15 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:15 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:15 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d0be70-204a-4585-96f8-48f260c3f652]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:722b2c71-be75-47ea-aaa6-cbbf2af8e229 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:15 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-404a3342-c94d-4a58-bcbd-be1febbb34e0 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497 (non-flash)
Jul 29 15:10:15 user nova-compute[70924]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:722b2c71-be75-47ea-aaa6-cbbf2af8e229 (non-flash)
Jul 29 15:10:15 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 15:10:15 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-404a3342-c94d-4a58-bcbd-be1febbb34e0 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497 (non-flash)
Jul 29 15:10:15 user nova-compute[70924]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:722b2c71-be75-47ea-aaa6-cbbf2af8e229 (non-flash)
Jul 29 15:10:15 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 15:10:15 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-404a3342-c94d-4a58-bcbd-be1febbb34e0 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:722b2c71-be75-47ea-aaa6-cbbf2af8e229" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 15:10:15 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-404a3342-c94d-4a58-bcbd-be1febbb34e0 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Connected to 172.16.0.220:3260 {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 15:10:15 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-404a3342-c94d-4a58-bcbd-be1febbb34e0 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=70924) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 15:10:15 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-404a3342-c94d-4a58-bcbd-be1febbb34e0 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70924) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 15:10:15 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:15 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:15 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d423cb-9f27-4624-bfce-b277372969ce]: (4, ('- - 0', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:15 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-404a3342-c94d-4a58-bcbd-be1febbb34e0 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 15:10:15 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-404a3342-c94d-4a58-bcbd-be1febbb34e0 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZdnWovPq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 15:10:15 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:10:16 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-404a3342-c94d-4a58-bcbd-be1febbb34e0 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 15:10:16 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-404a3342-c94d-4a58-bcbd-be1febbb34e0 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '26261353363646662', 'path': '/dev/sdc'} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 15:10:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-404a3342-c94d-4a58-bcbd-be1febbb34e0 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26261353363646662', 'path': '/dev/sdc'} {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 15:10:16 user nova-compute[70924]: DEBUG nova.objects.instance [None req-404a3342-c94d-4a58-bcbd-be1febbb34e0 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Lazy-loading 'flavor' on Instance uuid 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:10:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-404a3342-c94d-4a58-bcbd-be1febbb34e0 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] attach device xml: <disk type="block" device="disk">
Jul 29 15:10:16 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 15:10:16 user nova-compute[70924]:   <source dev="/dev/sdc"/>
Jul 29 15:10:16 user nova-compute[70924]:   <target dev="vdc" bus="virtio"/>
Jul 29 15:10:16 user nova-compute[70924]:   <serial>722b2c71-be75-47ea-aaa6-cbbf2af8e229</serial>
Jul 29 15:10:16 user nova-compute[70924]: </disk>
Jul 29 15:10:16 user nova-compute[70924]:  {{(pid=70924) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 29 15:10:16 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:10:16 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Starting heal instance info cache {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 15:10:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "refresh_cache-5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:10:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquired lock "refresh_cache-5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:10:16 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Forcefully refreshing network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 29 15:10:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-404a3342-c94d-4a58-bcbd-be1febbb34e0 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 15:10:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-404a3342-c94d-4a58-bcbd-be1febbb34e0 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 15:10:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-404a3342-c94d-4a58-bcbd-be1febbb34e0 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] No BDM found with device name vdc, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 15:10:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-404a3342-c94d-4a58-bcbd-be1febbb34e0 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] No VIF found with MAC fa:16:3e:31:4f:9d, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 15:10:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-404a3342-c94d-4a58-bcbd-be1febbb34e0 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Lock "5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.933s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:10:16 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Updating instance_info_cache with network_info: [{"id": "6a119205-17da-4214-a6dc-6d19712e40f8", "address": "fa:16:3e:31:4f:9d", "network": {"id": "10f0e77e-05d5-4c59-972d-60af9bc958b2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-887718488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40fb0f2b05f34e648ae30bc15758df66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a119205-17", "ovs_interfaceid": "6a119205-17da-4214-a6dc-6d19712e40f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:10:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Releasing lock "refresh_cache-5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:10:16 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Updated the network info_cache for instance {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 29 15:10:16 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:10:16 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70924) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 15:10:17 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:10:17 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-094d651c-a74c-4c9e-9c82-20bbf524d46f tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Acquiring lock "5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:10:17 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-094d651c-a74c-4c9e-9c82-20bbf524d46f tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Lock "5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:10:17 user nova-compute[70924]: INFO nova.compute.manager [None req-094d651c-a74c-4c9e-9c82-20bbf524d46f tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Detaching volume 722b2c71-be75-47ea-aaa6-cbbf2af8e229
Jul 29 15:10:17 user nova-compute[70924]: INFO nova.virt.block_device [None req-094d651c-a74c-4c9e-9c82-20bbf524d46f tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Attempting to driver detach volume 722b2c71-be75-47ea-aaa6-cbbf2af8e229 from mountpoint /dev/vdc
Jul 29 15:10:18 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-094d651c-a74c-4c9e-9c82-20bbf524d46f tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Attempting to detach device vdc from instance 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9 from the persistent domain config. {{(pid=70924) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 29 15:10:18 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-094d651c-a74c-4c9e-9c82-20bbf524d46f tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 15:10:18 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 15:10:18 user nova-compute[70924]:   <source dev="/dev/sdc"/>
Jul 29 15:10:18 user nova-compute[70924]:   <target dev="vdc" bus="virtio"/>
Jul 29 15:10:18 user nova-compute[70924]:   <serial>722b2c71-be75-47ea-aaa6-cbbf2af8e229</serial>
Jul 29 15:10:18 user nova-compute[70924]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 29 15:10:18 user nova-compute[70924]: </disk>
Jul 29 15:10:18 user nova-compute[70924]:  {{(pid=70924) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 15:10:18 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-094d651c-a74c-4c9e-9c82-20bbf524d46f tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Successfully detached device vdc from instance 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9 from the persistent domain config.
Jul 29 15:10:18 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-094d651c-a74c-4c9e-9c82-20bbf524d46f tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9 from the live domain config. {{(pid=70924) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 29 15:10:18 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-094d651c-a74c-4c9e-9c82-20bbf524d46f tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 15:10:18 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 15:10:18 user nova-compute[70924]:   <source dev="/dev/sdc"/>
Jul 29 15:10:18 user nova-compute[70924]:   <target dev="vdc" bus="virtio"/>
Jul 29 15:10:18 user nova-compute[70924]:   <serial>722b2c71-be75-47ea-aaa6-cbbf2af8e229</serial>
Jul 29 15:10:18 user nova-compute[70924]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 29 15:10:18 user nova-compute[70924]: </disk>
Jul 29 15:10:18 user nova-compute[70924]:  {{(pid=70924) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 15:10:18 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Received event <DeviceRemovedEvent: 1690643418.4572265, 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=70924) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 29 15:10:18 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-094d651c-a74c-4c9e-9c82-20bbf524d46f tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9 {{(pid=70924) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 29 15:10:18 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-094d651c-a74c-4c9e-9c82-20bbf524d46f tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Successfully detached device vdc from instance 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9 from the live domain config.
Jul 29 15:10:18 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-094d651c-a74c-4c9e-9c82-20bbf524d46f tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] calling os-brick to detach iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 15:10:18 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-094d651c-a74c-4c9e-9c82-20bbf524d46f tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, {'target_iqns': ['iqn.2010-10.org.openstack:722b2c71-be75-47ea-aaa6-cbbf2af8e229'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZdnWovPq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 15:10:18 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-094d651c-a74c-4c9e-9c82-20bbf524d46f tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 15:10:18 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-094d651c-a74c-4c9e-9c82-20bbf524d46f tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 15:10:18 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-094d651c-a74c-4c9e-9c82-20bbf524d46f tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 15:10:18 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-094d651c-a74c-4c9e-9c82-20bbf524d46f tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:722b2c71-be75-47ea-aaa6-cbbf2af8e229', 0)] {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 15:10:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:18 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[98247ad6-d832-40f9-8203-e30cec81e851]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:722b2c71-be75-47ea-aaa6-cbbf2af8e229\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:18 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac2d70f-4ef9-43f9-adf0-cca4a93730bd]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:722b2c71-be75-47ea-aaa6-cbbf2af8e229 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:18 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-094d651c-a74c-4c9e-9c82-20bbf524d46f tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497 (non-flash)
Jul 29 15:10:18 user nova-compute[70924]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:722b2c71-be75-47ea-aaa6-cbbf2af8e229 (non-flash)
Jul 29 15:10:18 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 15:10:18 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-094d651c-a74c-4c9e-9c82-20bbf524d46f tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497 (non-flash)
Jul 29 15:10:18 user nova-compute[70924]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:722b2c71-be75-47ea-aaa6-cbbf2af8e229 (non-flash)
Jul 29 15:10:18 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 15:10:18 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-094d651c-a74c-4c9e-9c82-20bbf524d46f tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feedc69ea70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:722b2c71-be75-47ea-aaa6-cbbf2af8e229'): ({'sdc'}, set())}) {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 15:10:18 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-094d651c-a74c-4c9e-9c82-20bbf524d46f tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Removing single pathed devices sdc {{(pid=70924) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 15:10:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:18 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e96297-1b51-4b04-b150-1b7c3abe93f1]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:18 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bef09a2-2b59-462a-be7d-ef36d4ea15c1]: (4, ('ok\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:18 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-094d651c-a74c-4c9e-9c82-20bbf524d46f tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Flushing IO for device /dev/sdc {{(pid=70924) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 15:10:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:18 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8dfcd96-5d8f-4cb7-9e22-3634a0d42a57]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:18 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-094d651c-a74c-4c9e-9c82-20bbf524d46f tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70924) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 15:10:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:18 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[753d1d80-d00c-4bcc-ae1b-8791c634c289]: (4, ('1', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:18 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-094d651c-a74c-4c9e-9c82-20bbf524d46f tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 15:10:18 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-094d651c-a74c-4c9e-9c82-20bbf524d46f tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] SCSI volumes sdc have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 15:10:18 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-094d651c-a74c-4c9e-9c82-20bbf524d46f tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:722b2c71-be75-47ea-aaa6-cbbf2af8e229')] {{(pid=70924) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 15:10:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:722b2c71-be75-47ea-aaa6-cbbf2af8e229 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:722b2c71-be75-47ea-aaa6-cbbf2af8e229 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:18 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f6da49-6d5f-4559-98a5-1d67f3f0316a]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:18 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-094d651c-a74c-4c9e-9c82-20bbf524d46f tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:10:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:722b2c71-be75-47ea-aaa6-cbbf2af8e229 -p 172.16.0.220:3260 --logout {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:722b2c71-be75-47ea-aaa6-cbbf2af8e229 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:18 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6296ee44-5c6a-46b0-80f4-cf3d3438d7a2]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:722b2c71-be75-47ea-aaa6-cbbf2af8e229, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:722b2c71-be75-47ea-aaa6-cbbf2af8e229, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:18 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-094d651c-a74c-4c9e-9c82-20bbf524d46f tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:722b2c71-be75-47ea-aaa6-cbbf2af8e229, portal: 172.16.0.220,3260]
Jul 29 15:10:18 user nova-compute[70924]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:722b2c71-be75-47ea-aaa6-cbbf2af8e229, portal: 172.16.0.220,3260] successful.
Jul 29 15:10:18 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:10:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:722b2c71-be75-47ea-aaa6-cbbf2af8e229 -p 172.16.0.220:3260 --op delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:722b2c71-be75-47ea-aaa6-cbbf2af8e229 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:18 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[554a11c5-59af-4e6e-8286-b8de8c73ec92]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:18 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-094d651c-a74c-4c9e-9c82-20bbf524d46f tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:10:18 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-094d651c-a74c-4c9e-9c82-20bbf524d46f tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.270s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 15:10:18 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-094d651c-a74c-4c9e-9c82-20bbf524d46f tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] <== disconnect_volume: return (271ms) None {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 15:10:18 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-094d651c-a74c-4c9e-9c82-20bbf524d46f tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Disconnected iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 15:10:19 user nova-compute[70924]: DEBUG nova.objects.instance [None req-094d651c-a74c-4c9e-9c82-20bbf524d46f tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Lazy-loading 'flavor' on Instance uuid 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:10:19 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-094d651c-a74c-4c9e-9c82-20bbf524d46f tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Lock "5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.596s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:10:20 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:10:25 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:10:29 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:10:30 user nova-compute[70924]: DEBUG nova.compute.manager [req-49bca7d7-cdb9-48c8-a64f-7b6bb9c9df35 req-499aa67e-90c8-4ee0-9d35-9b6af441a2a1 service nova] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Received event network-changed-9993f68e-4ceb-4974-9224-2fd3866899ce {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:10:30 user nova-compute[70924]: DEBUG nova.compute.manager [req-49bca7d7-cdb9-48c8-a64f-7b6bb9c9df35 req-499aa67e-90c8-4ee0-9d35-9b6af441a2a1 service nova] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Refreshing instance network info cache due to event network-changed-9993f68e-4ceb-4974-9224-2fd3866899ce. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 15:10:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-49bca7d7-cdb9-48c8-a64f-7b6bb9c9df35 req-499aa67e-90c8-4ee0-9d35-9b6af441a2a1 service nova] Acquiring lock "refresh_cache-d0df1b67-aab1-4a27-9ef9-00e02a5dfca5" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:10:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-49bca7d7-cdb9-48c8-a64f-7b6bb9c9df35 req-499aa67e-90c8-4ee0-9d35-9b6af441a2a1 service nova] Acquired lock "refresh_cache-d0df1b67-aab1-4a27-9ef9-00e02a5dfca5" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:10:30 user nova-compute[70924]: DEBUG nova.network.neutron [req-49bca7d7-cdb9-48c8-a64f-7b6bb9c9df35 req-499aa67e-90c8-4ee0-9d35-9b6af441a2a1 service nova] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Refreshing network info cache for port 9993f68e-4ceb-4974-9224-2fd3866899ce {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 15:10:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:10:31 user nova-compute[70924]: DEBUG nova.network.neutron [req-49bca7d7-cdb9-48c8-a64f-7b6bb9c9df35 req-499aa67e-90c8-4ee0-9d35-9b6af441a2a1 service nova] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Updated VIF entry in instance network info cache for port 9993f68e-4ceb-4974-9224-2fd3866899ce. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 15:10:31 user nova-compute[70924]: DEBUG nova.network.neutron [req-49bca7d7-cdb9-48c8-a64f-7b6bb9c9df35 req-499aa67e-90c8-4ee0-9d35-9b6af441a2a1 service nova] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Updating instance_info_cache with network_info: [{"id": "9993f68e-4ceb-4974-9224-2fd3866899ce", "address": "fa:16:3e:eb:3b:0c", "network": {"id": "24b90c74-6ebe-42f0-b11f-fc2b23b35188", "bridge": "br-int", "label": "tempest-TestStampPattern-1445459710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "519723b99af84d1b85c40cfbc6518d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9993f68e-4c", "ovs_interfaceid": "9993f68e-4ceb-4974-9224-2fd3866899ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:10:31 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-49bca7d7-cdb9-48c8-a64f-7b6bb9c9df35 req-499aa67e-90c8-4ee0-9d35-9b6af441a2a1 service nova] Releasing lock "refresh_cache-d0df1b67-aab1-4a27-9ef9-00e02a5dfca5" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:10:31 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9665a84f-0d48-4d64-b240-16ccc4fd01ab tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Acquiring lock "d0df1b67-aab1-4a27-9ef9-00e02a5dfca5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:10:31 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9665a84f-0d48-4d64-b240-16ccc4fd01ab tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Lock "d0df1b67-aab1-4a27-9ef9-00e02a5dfca5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:10:31 user nova-compute[70924]: DEBUG nova.objects.instance [None req-9665a84f-0d48-4d64-b240-16ccc4fd01ab tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Lazy-loading 'flavor' on Instance uuid d0df1b67-aab1-4a27-9ef9-00e02a5dfca5 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:10:31 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9665a84f-0d48-4d64-b240-16ccc4fd01ab tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Lock "d0df1b67-aab1-4a27-9ef9-00e02a5dfca5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:10:31 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9665a84f-0d48-4d64-b240-16ccc4fd01ab tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Acquiring lock "d0df1b67-aab1-4a27-9ef9-00e02a5dfca5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:10:31 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9665a84f-0d48-4d64-b240-16ccc4fd01ab tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Lock "d0df1b67-aab1-4a27-9ef9-00e02a5dfca5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:10:31 user nova-compute[70924]: INFO nova.compute.manager [None req-9665a84f-0d48-4d64-b240-16ccc4fd01ab tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Attaching volume 13044967-118e-44af-b5ab-2a99172bb098 to /dev/vdb
Jul 29 15:10:31 user nova-compute[70924]: DEBUG os_brick.utils [None req-9665a84f-0d48-4d64-b240-16ccc4fd01ab tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 15:10:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:31 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd24956-5c72-4125-842c-df1930fa6f57]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f2127c4a30d9\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:31 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a1946b8-7ff0-4093-87eb-588cb3d7ab0e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:31 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9636cb8-58e5-4634-b2cf-778e69c848fc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:31 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f678182c-99ec-4517-8698-a96e87241afc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-9665a84f-0d48-4d64-b240-16ccc4fd01ab tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Running cmd (subprocess): nvme version {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-9665a84f-0d48-4d64-b240-16ccc4fd01ab tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] 'nvme version' failed. Not Retrying. {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 15:10:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9665a84f-0d48-4d64-b240-16ccc4fd01ab tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] nvme not present on system {{(pid=70924) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 15:10:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:31 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 15:10:31 user nova-compute[70924]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 15:10:31 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f75349-6ea7-45c5-a3a3-b1a9f4338e95]: (4, '') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-9665a84f-0d48-4d64-b240-16ccc4fd01ab tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70924) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 15:10:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-9665a84f-0d48-4d64-b240-16ccc4fd01ab tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 15:10:31 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-9665a84f-0d48-4d64-b240-16ccc4fd01ab tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] LIGHTOS: no hostnqn found. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 15:10:31 user nova-compute[70924]: DEBUG os_brick.utils [None req-9665a84f-0d48-4d64-b240-16ccc4fd01ab tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f2127c4a30d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 15:10:31 user nova-compute[70924]: DEBUG nova.virt.block_device [None req-9665a84f-0d48-4d64-b240-16ccc4fd01ab tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Updating existing volume attachment record: 4cac10d9-7946-4faf-8d20-5761fdabe9e0 {{(pid=70924) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 15:10:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:10:35 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:10:38 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9665a84f-0d48-4d64-b240-16ccc4fd01ab tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Calling os-brick to attach iSCSI Volume {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 15:10:38 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-9665a84f-0d48-4d64-b240-16ccc4fd01ab tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:13044967-118e-44af-b5ab-2a99172bb098'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YUismHyP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 15:10:38 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-9665a84f-0d48-4d64-b240-16ccc4fd01ab tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 15:10:38 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-9665a84f-0d48-4d64-b240-16ccc4fd01ab tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 15:10:38 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-9665a84f-0d48-4d64-b240-16ccc4fd01ab tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 15:10:38 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-9665a84f-0d48-4d64-b240-16ccc4fd01ab tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 15:10:38 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-9665a84f-0d48-4d64-b240-16ccc4fd01ab tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13044967-118e-44af-b5ab-2a99172bb098" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 15:10:38 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-9665a84f-0d48-4d64-b240-16ccc4fd01ab tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13044967-118e-44af-b5ab-2a99172bb098" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 15:10:38 user nova-compute[70924]: INFO os_brick.initiator.connectors.iscsi [None req-9665a84f-0d48-4d64-b240-16ccc4fd01ab tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 15:10:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13044967-118e-44af-b5ab-2a99172bb098 -p 172.16.0.220:3260 {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13044967-118e-44af-b5ab-2a99172bb098 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:38 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c34a533-ede7-4aec-bb0e-5b189f753d14]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:38 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-9665a84f-0d48-4d64-b240-16ccc4fd01ab tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 15:10:38 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:10:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13044967-118e-44af-b5ab-2a99172bb098 -p 172.16.0.220:3260 --interface default --op new {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13044967-118e-44af-b5ab-2a99172bb098 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:38 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c216ccc4-1283-496b-8021-5e6fbded7001]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13044967-118e-44af-b5ab-2a99172bb098] added\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:38 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-9665a84f-0d48-4d64-b240-16ccc4fd01ab tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13044967-118e-44af-b5ab-2a99172bb098] added
Jul 29 15:10:38 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:10:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13044967-118e-44af-b5ab-2a99172bb098 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13044967-118e-44af-b5ab-2a99172bb098 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:38 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c140bdd-576a-4d4a-b50b-33a2a1ac60d0]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:38 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-9665a84f-0d48-4d64-b240-16ccc4fd01ab tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:10:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13044967-118e-44af-b5ab-2a99172bb098 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:39 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13044967-118e-44af-b5ab-2a99172bb098 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:39 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f046df64-2fcb-4a62-bc2e-636a42110edc]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:39 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-9665a84f-0d48-4d64-b240-16ccc4fd01ab tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:10:39 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13044967-118e-44af-b5ab-2a99172bb098 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YUismHyP {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:39 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13044967-118e-44af-b5ab-2a99172bb098 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YUismHyP" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:39 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[731662a1-a732-4b82-a997-a73a2c3873d9]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:39 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-9665a84f-0d48-4d64-b240-16ccc4fd01ab tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YUismHyP'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:10:39 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13044967-118e-44af-b5ab-2a99172bb098 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:39 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13044967-118e-44af-b5ab-2a99172bb098 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:39 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ffcbdb-da56-4bc3-82bc-dd8dc12c7003]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:39 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-9665a84f-0d48-4d64-b240-16ccc4fd01ab tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:10:39 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:39 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:39 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba3812f1-b01b-43dd-9dcc-252f650d2af9]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:39 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-9665a84f-0d48-4d64-b240-16ccc4fd01ab tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497 (non-flash)
Jul 29 15:10:39 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 15:10:39 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-9665a84f-0d48-4d64-b240-16ccc4fd01ab tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497 (non-flash)
Jul 29 15:10:39 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 15:10:39 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13044967-118e-44af-b5ab-2a99172bb098 -p 172.16.0.220:3260 --login {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:39 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13044967-118e-44af-b5ab-2a99172bb098 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:39 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[acad3292-d00f-42b2-babb-5f7cf3335576]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:13044967-118e-44af-b5ab-2a99172bb098, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:13044967-118e-44af-b5ab-2a99172bb098, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:39 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-9665a84f-0d48-4d64-b240-16ccc4fd01ab tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:13044967-118e-44af-b5ab-2a99172bb098, portal: 172.16.0.220,3260]
Jul 29 15:10:39 user nova-compute[70924]: Login to [iface: default, target: iqn.2010-10.org.openstack:13044967-118e-44af-b5ab-2a99172bb098, portal: 172.16.0.220,3260] successful.
Jul 29 15:10:39 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:10:39 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13044967-118e-44af-b5ab-2a99172bb098 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:39 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13044967-118e-44af-b5ab-2a99172bb098 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:39 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f396ba-f5c1-49ca-a71c-f9838cdb9cb3]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:39 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-9665a84f-0d48-4d64-b240-16ccc4fd01ab tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:10:39 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:39 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:39 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[7224918c-63a9-47a8-897b-0c4fa02ca8c3]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13044967-118e-44af-b5ab-2a99172bb098 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:39 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-9665a84f-0d48-4d64-b240-16ccc4fd01ab tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497 (non-flash)
Jul 29 15:10:39 user nova-compute[70924]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13044967-118e-44af-b5ab-2a99172bb098 (non-flash)
Jul 29 15:10:39 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 15:10:39 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-9665a84f-0d48-4d64-b240-16ccc4fd01ab tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497 (non-flash)
Jul 29 15:10:39 user nova-compute[70924]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13044967-118e-44af-b5ab-2a99172bb098 (non-flash)
Jul 29 15:10:39 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 15:10:39 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-9665a84f-0d48-4d64-b240-16ccc4fd01ab tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13044967-118e-44af-b5ab-2a99172bb098" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 15:10:39 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-9665a84f-0d48-4d64-b240-16ccc4fd01ab tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Connected to 172.16.0.220:3260 {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 15:10:39 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-9665a84f-0d48-4d64-b240-16ccc4fd01ab tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] HCTL ('34', '-', '-', 0) found on session 55 with lun 0 {{(pid=70924) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 15:10:39 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-9665a84f-0d48-4d64-b240-16ccc4fd01ab tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70924) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 15:10:39 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:39 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:39 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[fabcaf64-3178-4f44-ae07-24e502b344b3]: (4, ('- - 0', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:39 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-9665a84f-0d48-4d64-b240-16ccc4fd01ab tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 15:10:39 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-9665a84f-0d48-4d64-b240-16ccc4fd01ab tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YUismHyP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 15:10:39 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:10:40 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-9665a84f-0d48-4d64-b240-16ccc4fd01ab tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 15:10:40 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-9665a84f-0d48-4d64-b240-16ccc4fd01ab tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '26162363437393333', 'path': '/dev/sdc'} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 15:10:40 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9665a84f-0d48-4d64-b240-16ccc4fd01ab tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26162363437393333', 'path': '/dev/sdc'} {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 15:10:40 user nova-compute[70924]: DEBUG nova.objects.instance [None req-9665a84f-0d48-4d64-b240-16ccc4fd01ab tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Lazy-loading 'flavor' on Instance uuid d0df1b67-aab1-4a27-9ef9-00e02a5dfca5 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:10:40 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-9665a84f-0d48-4d64-b240-16ccc4fd01ab tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] attach device xml: <disk type="block" device="disk">
Jul 29 15:10:40 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 15:10:40 user nova-compute[70924]:   <source dev="/dev/sdc"/>
Jul 29 15:10:40 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 15:10:40 user nova-compute[70924]:   <serial>13044967-118e-44af-b5ab-2a99172bb098</serial>
Jul 29 15:10:40 user nova-compute[70924]: </disk>
Jul 29 15:10:40 user nova-compute[70924]:  {{(pid=70924) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 29 15:10:40 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-9665a84f-0d48-4d64-b240-16ccc4fd01ab tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 15:10:40 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-9665a84f-0d48-4d64-b240-16ccc4fd01ab tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 15:10:40 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-9665a84f-0d48-4d64-b240-16ccc4fd01ab tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] No VIF found with MAC fa:16:3e:eb:3b:0c, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 15:10:40 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-9665a84f-0d48-4d64-b240-16ccc4fd01ab tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Lock "d0df1b67-aab1-4a27-9ef9-00e02a5dfca5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.434s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:10:40 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:10:41 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Acquiring lock "758d9381-32af-4433-8366-9e0aa9699137" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:10:41 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "758d9381-32af-4433-8366-9e0aa9699137" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:10:41 user nova-compute[70924]: DEBUG nova.compute.manager [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Starting instance... {{(pid=70924) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 15:10:41 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:10:41 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:10:41 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70924) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 15:10:41 user nova-compute[70924]: INFO nova.compute.claims [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Claim successful on node user
Jul 29 15:10:42 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:10:42 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:10:42 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.296s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:10:42 user nova-compute[70924]: DEBUG nova.compute.manager [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Start building networks asynchronously for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 15:10:42 user nova-compute[70924]: DEBUG nova.compute.manager [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Allocating IP information in the background. {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 15:10:42 user nova-compute[70924]: DEBUG nova.network.neutron [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 758d9381-32af-4433-8366-9e0aa9699137] allocate_for_instance() {{(pid=70924) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 15:10:42 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 15:10:42 user nova-compute[70924]: DEBUG nova.compute.manager [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Start building block device mappings for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 15:10:42 user nova-compute[70924]: INFO nova.virt.block_device [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Booting with volume 9d7c7925-8381-4bfc-aff1-c1948bbd7490 at /dev/vda
Jul 29 15:10:42 user nova-compute[70924]: DEBUG nova.policy [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'da204646e8f84693ad470ed1d3eadd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a974cbbf734f51897c3e632ae9e45f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70924) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 15:10:42 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ed52b73c-df25-4dd1-81c1-e6d3fc244a67 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Acquiring lock "d0df1b67-aab1-4a27-9ef9-00e02a5dfca5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:10:42 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ed52b73c-df25-4dd1-81c1-e6d3fc244a67 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Lock "d0df1b67-aab1-4a27-9ef9-00e02a5dfca5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:10:42 user nova-compute[70924]: INFO nova.compute.manager [None req-ed52b73c-df25-4dd1-81c1-e6d3fc244a67 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Detaching volume 13044967-118e-44af-b5ab-2a99172bb098
Jul 29 15:10:42 user nova-compute[70924]: DEBUG os_brick.utils [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 15:10:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:42 user nova-compute[70924]: INFO nova.virt.block_device [None req-ed52b73c-df25-4dd1-81c1-e6d3fc244a67 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Attempting to driver detach volume 13044967-118e-44af-b5ab-2a99172bb098 from mountpoint /dev/vdb
Jul 29 15:10:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:42 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0dbb4a0-3391-4fbf-8c42-7a8e6c2624e5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f2127c4a30d9\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:42 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-ed52b73c-df25-4dd1-81c1-e6d3fc244a67 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Attempting to detach device vdb from instance d0df1b67-aab1-4a27-9ef9-00e02a5dfca5 from the persistent domain config. {{(pid=70924) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 29 15:10:42 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-ed52b73c-df25-4dd1-81c1-e6d3fc244a67 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 15:10:42 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 15:10:42 user nova-compute[70924]:   <source dev="/dev/sdc"/>
Jul 29 15:10:42 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 15:10:42 user nova-compute[70924]:   <serial>13044967-118e-44af-b5ab-2a99172bb098</serial>
Jul 29 15:10:42 user nova-compute[70924]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 15:10:42 user nova-compute[70924]: </disk>
Jul 29 15:10:42 user nova-compute[70924]:  {{(pid=70924) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 15:10:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:42 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[84637a85-84e3-4030-adf8-85d79ca63342]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:42 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-ed52b73c-df25-4dd1-81c1-e6d3fc244a67 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Successfully detached device vdb from instance d0df1b67-aab1-4a27-9ef9-00e02a5dfca5 from the persistent domain config.
Jul 29 15:10:42 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-ed52b73c-df25-4dd1-81c1-e6d3fc244a67 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d0df1b67-aab1-4a27-9ef9-00e02a5dfca5 from the live domain config. {{(pid=70924) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 29 15:10:42 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-ed52b73c-df25-4dd1-81c1-e6d3fc244a67 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 15:10:42 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 15:10:42 user nova-compute[70924]:   <source dev="/dev/sdc"/>
Jul 29 15:10:42 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 15:10:42 user nova-compute[70924]:   <serial>13044967-118e-44af-b5ab-2a99172bb098</serial>
Jul 29 15:10:42 user nova-compute[70924]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 15:10:42 user nova-compute[70924]: </disk>
Jul 29 15:10:42 user nova-compute[70924]:  {{(pid=70924) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 15:10:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:42 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[23dc01ee-ea97-4e96-af33-5863c6dcc03b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:42 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[516970d6-f1f2-4bd6-b240-d1e1afff55db]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Running cmd (subprocess): nvme version {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] 'nvme version' failed. Not Retrying. {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 15:10:42 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] nvme not present on system {{(pid=70924) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 15:10:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 15:10:42 user nova-compute[70924]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 15:10:42 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[429d43f7-85d7-440f-9832-65977788beb0]: (4, '') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:42 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70924) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 15:10:42 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 15:10:42 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] LIGHTOS: no hostnqn found. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 15:10:42 user nova-compute[70924]: DEBUG os_brick.utils [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f2127c4a30d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 15:10:42 user nova-compute[70924]: DEBUG nova.virt.block_device [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Updating existing volume attachment record: bf127c8e-c864-4667-8f64-5d15fbec85af {{(pid=70924) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 15:10:42 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-ed52b73c-df25-4dd1-81c1-e6d3fc244a67 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d0df1b67-aab1-4a27-9ef9-00e02a5dfca5 {{(pid=70924) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 29 15:10:42 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Received event <DeviceRemovedEvent: 1690643442.77526, d0df1b67-aab1-4a27-9ef9-00e02a5dfca5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70924) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 29 15:10:42 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-ed52b73c-df25-4dd1-81c1-e6d3fc244a67 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Successfully detached device vdb from instance d0df1b67-aab1-4a27-9ef9-00e02a5dfca5 from the live domain config.
Jul 29 15:10:42 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed52b73c-df25-4dd1-81c1-e6d3fc244a67 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] calling os-brick to detach iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 15:10:42 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed52b73c-df25-4dd1-81c1-e6d3fc244a67 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, {'target_iqns': ['iqn.2010-10.org.openstack:13044967-118e-44af-b5ab-2a99172bb098'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YUismHyP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 15:10:42 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-ed52b73c-df25-4dd1-81c1-e6d3fc244a67 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 15:10:42 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-ed52b73c-df25-4dd1-81c1-e6d3fc244a67 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 15:10:42 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-ed52b73c-df25-4dd1-81c1-e6d3fc244a67 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 15:10:42 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed52b73c-df25-4dd1-81c1-e6d3fc244a67 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13044967-118e-44af-b5ab-2a99172bb098', 0)] {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 15:10:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:42 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bfc0175-4e7f-4efa-953e-c3877a3864a1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13044967-118e-44af-b5ab-2a99172bb098\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:42 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cdc7f69-4066-4bb1-bbab-931a73912cf6]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13044967-118e-44af-b5ab-2a99172bb098 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:42 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed52b73c-df25-4dd1-81c1-e6d3fc244a67 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497 (non-flash)
Jul 29 15:10:42 user nova-compute[70924]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13044967-118e-44af-b5ab-2a99172bb098 (non-flash)
Jul 29 15:10:42 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 15:10:42 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed52b73c-df25-4dd1-81c1-e6d3fc244a67 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497 (non-flash)
Jul 29 15:10:42 user nova-compute[70924]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13044967-118e-44af-b5ab-2a99172bb098 (non-flash)
Jul 29 15:10:42 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 15:10:42 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed52b73c-df25-4dd1-81c1-e6d3fc244a67 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feedc34fe20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13044967-118e-44af-b5ab-2a99172bb098'): ({'sdc'}, set())}) {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 15:10:42 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-ed52b73c-df25-4dd1-81c1-e6d3fc244a67 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Removing single pathed devices sdc {{(pid=70924) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 15:10:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:42 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45b8f40-29cf-4310-9d77-75e0d99bab58]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:42 user nova-compute[70924]: DEBUG nova.network.neutron [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Successfully created port: 590a32f6-52b6-4377-a140-0ff497ec1aad {{(pid=70924) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 15:10:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:42 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f361747-6e16-4b5f-b37e-297781927abd]: (4, ('ok\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:42 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-ed52b73c-df25-4dd1-81c1-e6d3fc244a67 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Flushing IO for device /dev/sdc {{(pid=70924) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 15:10:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:42 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9b846d-ec9d-444a-9ca0-b9c409d74d79]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:42 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-ed52b73c-df25-4dd1-81c1-e6d3fc244a67 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70924) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 15:10:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:42 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7a690e-4111-48af-8014-0792d9b670f2]: (4, ('1', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:42 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-ed52b73c-df25-4dd1-81c1-e6d3fc244a67 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 15:10:42 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-ed52b73c-df25-4dd1-81c1-e6d3fc244a67 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] SCSI volumes sdc have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 15:10:42 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed52b73c-df25-4dd1-81c1-e6d3fc244a67 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13044967-118e-44af-b5ab-2a99172bb098')] {{(pid=70924) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 15:10:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13044967-118e-44af-b5ab-2a99172bb098 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13044967-118e-44af-b5ab-2a99172bb098 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:42 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[04469c24-0374-449e-950a-a6c54a3ca583]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:42 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed52b73c-df25-4dd1-81c1-e6d3fc244a67 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:10:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13044967-118e-44af-b5ab-2a99172bb098 -p 172.16.0.220:3260 --logout {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:43 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13044967-118e-44af-b5ab-2a99172bb098 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:43 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53585a2-1d16-4e17-a2a5-b6a7277d2313]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:13044967-118e-44af-b5ab-2a99172bb098, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:13044967-118e-44af-b5ab-2a99172bb098, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:43 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed52b73c-df25-4dd1-81c1-e6d3fc244a67 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:13044967-118e-44af-b5ab-2a99172bb098, portal: 172.16.0.220,3260]
Jul 29 15:10:43 user nova-compute[70924]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:13044967-118e-44af-b5ab-2a99172bb098, portal: 172.16.0.220,3260] successful.
Jul 29 15:10:43 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:10:43 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13044967-118e-44af-b5ab-2a99172bb098 -p 172.16.0.220:3260 --op delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:43 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13044967-118e-44af-b5ab-2a99172bb098 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:43 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52ad442-f873-4315-94b1-630d2492b93a]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:43 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed52b73c-df25-4dd1-81c1-e6d3fc244a67 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:10:43 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-ed52b73c-df25-4dd1-81c1-e6d3fc244a67 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 15:10:43 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed52b73c-df25-4dd1-81c1-e6d3fc244a67 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] <== disconnect_volume: return (282ms) None {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 15:10:43 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed52b73c-df25-4dd1-81c1-e6d3fc244a67 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Disconnected iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 15:10:43 user nova-compute[70924]: DEBUG nova.objects.instance [None req-ed52b73c-df25-4dd1-81c1-e6d3fc244a67 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Lazy-loading 'flavor' on Instance uuid d0df1b67-aab1-4a27-9ef9-00e02a5dfca5 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:10:43 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ed52b73c-df25-4dd1-81c1-e6d3fc244a67 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Lock "d0df1b67-aab1-4a27-9ef9-00e02a5dfca5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.634s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:10:43 user nova-compute[70924]: DEBUG nova.network.neutron [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Successfully updated port: 590a32f6-52b6-4377-a140-0ff497ec1aad {{(pid=70924) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 15:10:43 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Acquiring lock "refresh_cache-758d9381-32af-4433-8366-9e0aa9699137" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:10:43 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Acquired lock "refresh_cache-758d9381-32af-4433-8366-9e0aa9699137" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:10:43 user nova-compute[70924]: DEBUG nova.network.neutron [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 15:10:43 user nova-compute[70924]: DEBUG nova.compute.manager [req-7a5fd168-1b47-490a-9bf5-27e7005e444a req-97f2cc98-8d87-4c84-b97a-36cf89f8c1d3 service nova] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Received event network-changed-590a32f6-52b6-4377-a140-0ff497ec1aad {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:10:43 user nova-compute[70924]: DEBUG nova.compute.manager [req-7a5fd168-1b47-490a-9bf5-27e7005e444a req-97f2cc98-8d87-4c84-b97a-36cf89f8c1d3 service nova] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Refreshing instance network info cache due to event network-changed-590a32f6-52b6-4377-a140-0ff497ec1aad. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 15:10:43 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-7a5fd168-1b47-490a-9bf5-27e7005e444a req-97f2cc98-8d87-4c84-b97a-36cf89f8c1d3 service nova] Acquiring lock "refresh_cache-758d9381-32af-4433-8366-9e0aa9699137" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:10:44 user nova-compute[70924]: DEBUG nova.network.neutron [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Instance cache missing network info. {{(pid=70924) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 15:10:44 user nova-compute[70924]: DEBUG nova.network.neutron [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Updating instance_info_cache with network_info: [{"id": "590a32f6-52b6-4377-a140-0ff497ec1aad", "address": "fa:16:3e:5c:58:7f", "network": {"id": "c19ed38b-2acd-421a-9e4b-f60df3db2f1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1812407562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a974cbbf734f51897c3e632ae9e45f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap590a32f6-52", "ovs_interfaceid": "590a32f6-52b6-4377-a140-0ff497ec1aad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:10:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Releasing lock "refresh_cache-758d9381-32af-4433-8366-9e0aa9699137" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:10:44 user nova-compute[70924]: DEBUG nova.compute.manager [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Instance network_info: |[{"id": "590a32f6-52b6-4377-a140-0ff497ec1aad", "address": "fa:16:3e:5c:58:7f", "network": {"id": "c19ed38b-2acd-421a-9e4b-f60df3db2f1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1812407562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a974cbbf734f51897c3e632ae9e45f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap590a32f6-52", "ovs_interfaceid": "590a32f6-52b6-4377-a140-0ff497ec1aad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 15:10:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-7a5fd168-1b47-490a-9bf5-27e7005e444a req-97f2cc98-8d87-4c84-b97a-36cf89f8c1d3 service nova] Acquired lock "refresh_cache-758d9381-32af-4433-8366-9e0aa9699137" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:10:44 user nova-compute[70924]: DEBUG nova.network.neutron [req-7a5fd168-1b47-490a-9bf5-27e7005e444a req-97f2cc98-8d87-4c84-b97a-36cf89f8c1d3 service nova] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Refreshing network info cache for port 590a32f6-52b6-4377-a140-0ff497ec1aad {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 15:10:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:10:44 user nova-compute[70924]: DEBUG nova.network.neutron [req-7a5fd168-1b47-490a-9bf5-27e7005e444a req-97f2cc98-8d87-4c84-b97a-36cf89f8c1d3 service nova] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Updated VIF entry in instance network info cache for port 590a32f6-52b6-4377-a140-0ff497ec1aad. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 15:10:44 user nova-compute[70924]: DEBUG nova.network.neutron [req-7a5fd168-1b47-490a-9bf5-27e7005e444a req-97f2cc98-8d87-4c84-b97a-36cf89f8c1d3 service nova] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Updating instance_info_cache with network_info: [{"id": "590a32f6-52b6-4377-a140-0ff497ec1aad", "address": "fa:16:3e:5c:58:7f", "network": {"id": "c19ed38b-2acd-421a-9e4b-f60df3db2f1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1812407562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a974cbbf734f51897c3e632ae9e45f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap590a32f6-52", "ovs_interfaceid": "590a32f6-52b6-4377-a140-0ff497ec1aad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:10:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-7a5fd168-1b47-490a-9bf5-27e7005e444a req-97f2cc98-8d87-4c84-b97a-36cf89f8c1d3 service nova] Releasing lock "refresh_cache-758d9381-32af-4433-8366-9e0aa9699137" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:10:45 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG nova.compute.manager [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Start spawning the instance on the hypervisor. {{(pid=70924) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Creating instance directory {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 15:10:49 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Creating image(s)
Jul 29 15:10:49 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Did not create local disks {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Ensure instance console log exists: /opt/stack/data/nova/instances/758d9381-32af-4433-8366-9e0aa9699137/console.log {{(pid=70924) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Start _get_guest_xml network_info=[{"id": "590a32f6-52b6-4377-a140-0ff497ec1aad", "address": "fa:16:3e:5c:58:7f", "network": {"id": "c19ed38b-2acd-421a-9e4b-f60df3db2f1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1812407562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a974cbbf734f51897c3e632ae9e45f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap590a32f6-52", "ovs_interfaceid": "590a32f6-52b6-4377-a140-0ff497ec1aad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ANSHrCvV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '758d9381-32af-4433-8366-9e0aa9699137', 'attached_at': '', 'detached_at': '', 'volume_id': '9d7c7925-8381-4bfc-aff1-c1948bbd7490', 'serial': '9d7c7925-8381-4bfc-aff1-c1948bbd7490'}, 'attachment_id': 'bf127c8e-c864-4667-8f64-5d15fbec85af', 'volume_type': None} {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 15:10:49 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:10:49 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:10:49 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] CPU controller missing on host. {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] CPU controller found on host. {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70924) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T14:36:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Flavor limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Image limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Flavor pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Image pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Got 1 possible topologies {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Calling os-brick to attach iSCSI Volume {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ANSHrCvV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 15:10:49 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 15:10:49 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 15:10:49 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 15:10:49 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 15:10:49 user nova-compute[70924]: INFO os_brick.initiator.connectors.iscsi [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 15:10:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 -p 172.16.0.220:3260 {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be20f07-9827-4533-bf1e-9e21aa346ec9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 15:10:49 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 -p 172.16.0.220:3260 --interface default --op new {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66b2716-7e40-44c7-95a0-fbd0c0556a26]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490] added\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490] added
Jul 29 15:10:49 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb289c15-41f5-4cc1-a19f-a783518a864f]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb75ece9-fb4d-4bac-bf5b-829774feba0b]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ANSHrCvV {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ANSHrCvV" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[06184739-38a7-4a56-93ab-c96f6f4aa899]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ANSHrCvV'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[79cc9e4a-8d91-48d0-a458-09dfc57aefeb]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9e94c9-7d19-4754-8dbd-25c64fc7149d]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497 (non-flash)
Jul 29 15:10:49 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497 (non-flash)
Jul 29 15:10:49 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 -p 172.16.0.220:3260 --login {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c6fdce-34ab-4306-a6b9-1bec7a4bc118]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490, portal: 172.16.0.220,3260]
Jul 29 15:10:49 user nova-compute[70924]: Login to [iface: default, target: iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490, portal: 172.16.0.220,3260] successful.
Jul 29 15:10:49 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff15a61-8495-48cb-a046-53daedabbbba]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29f030e-5a75-4a42-8de1-460e71bbfef5]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497 (non-flash)
Jul 29 15:10:49 user nova-compute[70924]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 (non-flash)
Jul 29 15:10:49 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497 (non-flash)
Jul 29 15:10:49 user nova-compute[70924]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 (non-flash)
Jul 29 15:10:49 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Connected to 172.16.0.220:3260 {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] HCTL ('34', '-', '-', 0) found on session 56 with lun 0 {{(pid=70924) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70924) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c48970f-0cde-4d43-888d-690c7c3e367b]: (4, ('- - 0', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 15:10:49 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ANSHrCvV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 15:10:50 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:10:50 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 15:10:50 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '23165663864343861', 'path': '/dev/sdc'} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 15:10:50 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165663864343861', 'path': '/dev/sdc'} {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 15:10:51 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T15:10:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1749406435',display_name='tempest-TestVolumeBootPattern-server-1749406435',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1749406435',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ85EoxOcLUTgXe8luwDJdmSAuW16EOphuu0LzU/6Hdmcve8fH6stAD+XoS0+shU7N/jDe0exnSkgWjCon0Br/QYJqNqli+yWYkmG2icNLlmtzdYRBdyLvXLjiH1TkzZOA==',key_name='tempest-TestVolumeBootPattern-447927024',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99a974cbbf734f51897c3e632ae9e45f',ramdisk_id='',reservation_id='r-e6ryxa44',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1030839740',owner_user_name='tempest-TestVolumeBootPattern-1030839740-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T15:10:42Z,user_data=None,user_id='da204646e8f84693ad470ed1d3eadd7c',uuid=758d9381-32af-4433-8366-9e0aa9699137,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "590a32f6-52b6-4377-a140-0ff497ec1aad", "address": "fa:16:3e:5c:58:7f", "network": {"id": "c19ed38b-2acd-421a-9e4b-f60df3db2f1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1812407562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a974cbbf734f51897c3e632ae9e45f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap590a32f6-52", "ovs_interfaceid": "590a32f6-52b6-4377-a140-0ff497ec1aad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 15:10:51 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Converting VIF {"id": "590a32f6-52b6-4377-a140-0ff497ec1aad", "address": "fa:16:3e:5c:58:7f", "network": {"id": "c19ed38b-2acd-421a-9e4b-f60df3db2f1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1812407562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a974cbbf734f51897c3e632ae9e45f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap590a32f6-52", "ovs_interfaceid": "590a32f6-52b6-4377-a140-0ff497ec1aad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 15:10:51 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:58:7f,bridge_name='br-int',has_traffic_filtering=True,id=590a32f6-52b6-4377-a140-0ff497ec1aad,network=Network(c19ed38b-2acd-421a-9e4b-f60df3db2f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap590a32f6-52') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 15:10:51 user nova-compute[70924]: DEBUG nova.objects.instance [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lazy-loading 'pci_devices' on Instance uuid 758d9381-32af-4433-8366-9e0aa9699137 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:10:51 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 758d9381-32af-4433-8366-9e0aa9699137] End _get_guest_xml xml=<domain type="kvm">
Jul 29 15:10:51 user nova-compute[70924]:   <uuid>758d9381-32af-4433-8366-9e0aa9699137</uuid>
Jul 29 15:10:51 user nova-compute[70924]:   <name>instance-00000030</name>
Jul 29 15:10:51 user nova-compute[70924]:   <memory>524288</memory>
Jul 29 15:10:51 user nova-compute[70924]:   <vcpu>1</vcpu>
Jul 29 15:10:51 user nova-compute[70924]:   <metadata>
Jul 29 15:10:51 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 15:10:51 user nova-compute[70924]:       <nova:package version="0.0.0"/>
Jul 29 15:10:51 user nova-compute[70924]:       <nova:name>tempest-TestVolumeBootPattern-server-1749406435</nova:name>
Jul 29 15:10:51 user nova-compute[70924]:       <nova:creationTime>2023-07-29 15:10:49</nova:creationTime>
Jul 29 15:10:51 user nova-compute[70924]:       <nova:flavor name="m1.tiny">
Jul 29 15:10:51 user nova-compute[70924]:         <nova:memory>512</nova:memory>
Jul 29 15:10:51 user nova-compute[70924]:         <nova:disk>1</nova:disk>
Jul 29 15:10:51 user nova-compute[70924]:         <nova:swap>0</nova:swap>
Jul 29 15:10:51 user nova-compute[70924]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 15:10:51 user nova-compute[70924]:         <nova:vcpus>1</nova:vcpus>
Jul 29 15:10:51 user nova-compute[70924]:       </nova:flavor>
Jul 29 15:10:51 user nova-compute[70924]:       <nova:owner>
Jul 29 15:10:51 user nova-compute[70924]:         <nova:user uuid="da204646e8f84693ad470ed1d3eadd7c">tempest-TestVolumeBootPattern-1030839740-project-member</nova:user>
Jul 29 15:10:51 user nova-compute[70924]:         <nova:project uuid="99a974cbbf734f51897c3e632ae9e45f">tempest-TestVolumeBootPattern-1030839740</nova:project>
Jul 29 15:10:51 user nova-compute[70924]:       </nova:owner>
Jul 29 15:10:51 user nova-compute[70924]:       <nova:ports>
Jul 29 15:10:51 user nova-compute[70924]:         <nova:port uuid="590a32f6-52b6-4377-a140-0ff497ec1aad">
Jul 29 15:10:51 user nova-compute[70924]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 29 15:10:51 user nova-compute[70924]:         </nova:port>
Jul 29 15:10:51 user nova-compute[70924]:       </nova:ports>
Jul 29 15:10:51 user nova-compute[70924]:     </nova:instance>
Jul 29 15:10:51 user nova-compute[70924]:   </metadata>
Jul 29 15:10:51 user nova-compute[70924]:   <sysinfo type="smbios">
Jul 29 15:10:51 user nova-compute[70924]:     <system>
Jul 29 15:10:51 user nova-compute[70924]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 15:10:51 user nova-compute[70924]:       <entry name="product">OpenStack Nova</entry>
Jul 29 15:10:51 user nova-compute[70924]:       <entry name="version">0.0.0</entry>
Jul 29 15:10:51 user nova-compute[70924]:       <entry name="serial">758d9381-32af-4433-8366-9e0aa9699137</entry>
Jul 29 15:10:51 user nova-compute[70924]:       <entry name="uuid">758d9381-32af-4433-8366-9e0aa9699137</entry>
Jul 29 15:10:51 user nova-compute[70924]:       <entry name="family">Virtual Machine</entry>
Jul 29 15:10:51 user nova-compute[70924]:     </system>
Jul 29 15:10:51 user nova-compute[70924]:   </sysinfo>
Jul 29 15:10:51 user nova-compute[70924]:   <os>
Jul 29 15:10:51 user nova-compute[70924]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 15:10:51 user nova-compute[70924]:     <boot dev="hd"/>
Jul 29 15:10:51 user nova-compute[70924]:     <smbios mode="sysinfo"/>
Jul 29 15:10:51 user nova-compute[70924]:   </os>
Jul 29 15:10:51 user nova-compute[70924]:   <features>
Jul 29 15:10:51 user nova-compute[70924]:     <acpi/>
Jul 29 15:10:51 user nova-compute[70924]:     <apic/>
Jul 29 15:10:51 user nova-compute[70924]:     <vmcoreinfo/>
Jul 29 15:10:51 user nova-compute[70924]:   </features>
Jul 29 15:10:51 user nova-compute[70924]:   <clock offset="utc">
Jul 29 15:10:51 user nova-compute[70924]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 15:10:51 user nova-compute[70924]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 15:10:51 user nova-compute[70924]:     <timer name="hpet" present="no"/>
Jul 29 15:10:51 user nova-compute[70924]:   </clock>
Jul 29 15:10:51 user nova-compute[70924]:   <cpu mode="custom" match="exact">
Jul 29 15:10:51 user nova-compute[70924]:     <model>Nehalem</model>
Jul 29 15:10:51 user nova-compute[70924]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 15:10:51 user nova-compute[70924]:   </cpu>
Jul 29 15:10:51 user nova-compute[70924]:   <devices>
Jul 29 15:10:51 user nova-compute[70924]:     <disk type="block" device="disk">
Jul 29 15:10:51 user nova-compute[70924]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 15:10:51 user nova-compute[70924]:       <source dev="/dev/sdc"/>
Jul 29 15:10:51 user nova-compute[70924]:       <target dev="vda" bus="virtio"/>
Jul 29 15:10:51 user nova-compute[70924]:       <serial>9d7c7925-8381-4bfc-aff1-c1948bbd7490</serial>
Jul 29 15:10:51 user nova-compute[70924]:     </disk>
Jul 29 15:10:51 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 15:10:51 user nova-compute[70924]:       <mac address="fa:16:3e:5c:58:7f"/>
Jul 29 15:10:51 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 15:10:51 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 15:10:51 user nova-compute[70924]:       <target dev="tap590a32f6-52"/>
Jul 29 15:10:51 user nova-compute[70924]:     </interface>
Jul 29 15:10:51 user nova-compute[70924]:     <serial type="pty">
Jul 29 15:10:51 user nova-compute[70924]:       <log file="/opt/stack/data/nova/instances/758d9381-32af-4433-8366-9e0aa9699137/console.log" append="off"/>
Jul 29 15:10:51 user nova-compute[70924]:     </serial>
Jul 29 15:10:51 user nova-compute[70924]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 15:10:51 user nova-compute[70924]:     <video>
Jul 29 15:10:51 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 15:10:51 user nova-compute[70924]:     </video>
Jul 29 15:10:51 user nova-compute[70924]:     <rng model="virtio">
Jul 29 15:10:51 user nova-compute[70924]:       <backend model="random">/dev/urandom</backend>
Jul 29 15:10:51 user nova-compute[70924]:     </rng>
Jul 29 15:10:51 user nova-compute[70924]:     <controller type="usb" index="0" model="none"/>
Jul 29 15:10:51 user nova-compute[70924]:     <memballoon model="virtio">
Jul 29 15:10:51 user nova-compute[70924]:       <stats period="10"/>
Jul 29 15:10:51 user nova-compute[70924]:     </memballoon>
Jul 29 15:10:51 user nova-compute[70924]:   </devices>
Jul 29 15:10:51 user nova-compute[70924]: </domain>
Jul 29 15:10:51 user nova-compute[70924]:  {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 15:10:51 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T15:10:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1749406435',display_name='tempest-TestVolumeBootPattern-server-1749406435',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1749406435',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ85EoxOcLUTgXe8luwDJdmSAuW16EOphuu0LzU/6Hdmcve8fH6stAD+XoS0+shU7N/jDe0exnSkgWjCon0Br/QYJqNqli+yWYkmG2icNLlmtzdYRBdyLvXLjiH1TkzZOA==',key_name='tempest-TestVolumeBootPattern-447927024',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99a974cbbf734f51897c3e632ae9e45f',ramdisk_id='',reservation_id='r-e6ryxa44',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1030839740',owner_user_name='tempest-TestVolumeBootPattern-1030839740-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T15:10:42Z,user_data=None,user_id='da204646e8f84693ad470ed1d3eadd7c',uuid=758d9381-32af-4433-8366-9e0aa9699137,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "590a32f6-52b6-4377-a140-0ff497ec1aad", "address": "fa:16:3e:5c:58:7f", "network": {"id": "c19ed38b-2acd-421a-9e4b-f60df3db2f1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1812407562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a974cbbf734f51897c3e632ae9e45f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap590a32f6-52", "ovs_interfaceid": "590a32f6-52b6-4377-a140-0ff497ec1aad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 15:10:51 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Converting VIF {"id": "590a32f6-52b6-4377-a140-0ff497ec1aad", "address": "fa:16:3e:5c:58:7f", "network": {"id": "c19ed38b-2acd-421a-9e4b-f60df3db2f1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1812407562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a974cbbf734f51897c3e632ae9e45f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap590a32f6-52", "ovs_interfaceid": "590a32f6-52b6-4377-a140-0ff497ec1aad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 15:10:51 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:58:7f,bridge_name='br-int',has_traffic_filtering=True,id=590a32f6-52b6-4377-a140-0ff497ec1aad,network=Network(c19ed38b-2acd-421a-9e4b-f60df3db2f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap590a32f6-52') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 15:10:51 user nova-compute[70924]: DEBUG os_vif [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:58:7f,bridge_name='br-int',has_traffic_filtering=True,id=590a32f6-52b6-4377-a140-0ff497ec1aad,network=Network(c19ed38b-2acd-421a-9e4b-f60df3db2f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap590a32f6-52') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 15:10:51 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:10:51 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:10:51 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 15:10:51 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:10:51 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap590a32f6-52, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:10:51 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap590a32f6-52, col_values=(('external_ids', {'iface-id': '590a32f6-52b6-4377-a140-0ff497ec1aad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:58:7f', 'vm-uuid': '758d9381-32af-4433-8366-9e0aa9699137'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:10:51 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:10:51 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:10:51 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:10:51 user nova-compute[70924]: INFO os_vif [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:58:7f,bridge_name='br-int',has_traffic_filtering=True,id=590a32f6-52b6-4377-a140-0ff497ec1aad,network=Network(c19ed38b-2acd-421a-9e4b-f60df3db2f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap590a32f6-52')
Jul 29 15:10:51 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 15:10:51 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] No VIF found with MAC fa:16:3e:5c:58:7f, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 15:10:52 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:10:52 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:10:52 user nova-compute[70924]: DEBUG nova.compute.manager [req-6a292ab9-0545-4ff6-b4f4-eb60f0a5d606 req-24b92995-22ea-4e57-9bca-9baa6754daf6 service nova] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Received event network-vif-plugged-590a32f6-52b6-4377-a140-0ff497ec1aad {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:10:52 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-6a292ab9-0545-4ff6-b4f4-eb60f0a5d606 req-24b92995-22ea-4e57-9bca-9baa6754daf6 service nova] Acquiring lock "758d9381-32af-4433-8366-9e0aa9699137-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:10:52 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-6a292ab9-0545-4ff6-b4f4-eb60f0a5d606 req-24b92995-22ea-4e57-9bca-9baa6754daf6 service nova] Lock "758d9381-32af-4433-8366-9e0aa9699137-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:10:52 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-6a292ab9-0545-4ff6-b4f4-eb60f0a5d606 req-24b92995-22ea-4e57-9bca-9baa6754daf6 service nova] Lock "758d9381-32af-4433-8366-9e0aa9699137-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:10:52 user nova-compute[70924]: DEBUG nova.compute.manager [req-6a292ab9-0545-4ff6-b4f4-eb60f0a5d606 req-24b92995-22ea-4e57-9bca-9baa6754daf6 service nova] [instance: 758d9381-32af-4433-8366-9e0aa9699137] No waiting events found dispatching network-vif-plugged-590a32f6-52b6-4377-a140-0ff497ec1aad {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:10:52 user nova-compute[70924]: WARNING nova.compute.manager [req-6a292ab9-0545-4ff6-b4f4-eb60f0a5d606 req-24b92995-22ea-4e57-9bca-9baa6754daf6 service nova] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Received unexpected event network-vif-plugged-590a32f6-52b6-4377-a140-0ff497ec1aad for instance with vm_state building and task_state spawning.
Jul 29 15:10:52 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:10:52 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:10:53 user nova-compute[70924]: DEBUG nova.compute.manager [req-8e314aa6-3c29-43b5-9985-1041b38b86be req-8dbfb12c-6efb-4d72-a6e6-c3c311f92fdc service nova] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] Received event network-changed-4216c4cd-08b6-4e6f-a4f8-9b34c2b42756 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:10:53 user nova-compute[70924]: DEBUG nova.compute.manager [req-8e314aa6-3c29-43b5-9985-1041b38b86be req-8dbfb12c-6efb-4d72-a6e6-c3c311f92fdc service nova] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] Refreshing instance network info cache due to event network-changed-4216c4cd-08b6-4e6f-a4f8-9b34c2b42756. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 15:10:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-8e314aa6-3c29-43b5-9985-1041b38b86be req-8dbfb12c-6efb-4d72-a6e6-c3c311f92fdc service nova] Acquiring lock "refresh_cache-fc2c25cc-9d79-45a2-9d50-862b7592f7f7" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:10:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-8e314aa6-3c29-43b5-9985-1041b38b86be req-8dbfb12c-6efb-4d72-a6e6-c3c311f92fdc service nova] Acquired lock "refresh_cache-fc2c25cc-9d79-45a2-9d50-862b7592f7f7" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:10:53 user nova-compute[70924]: DEBUG nova.network.neutron [req-8e314aa6-3c29-43b5-9985-1041b38b86be req-8dbfb12c-6efb-4d72-a6e6-c3c311f92fdc service nova] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] Refreshing network info cache for port 4216c4cd-08b6-4e6f-a4f8-9b34c2b42756 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 15:10:53 user nova-compute[70924]: DEBUG nova.network.neutron [req-8e314aa6-3c29-43b5-9985-1041b38b86be req-8dbfb12c-6efb-4d72-a6e6-c3c311f92fdc service nova] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] Updated VIF entry in instance network info cache for port 4216c4cd-08b6-4e6f-a4f8-9b34c2b42756. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 15:10:53 user nova-compute[70924]: DEBUG nova.network.neutron [req-8e314aa6-3c29-43b5-9985-1041b38b86be req-8dbfb12c-6efb-4d72-a6e6-c3c311f92fdc service nova] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] Updating instance_info_cache with network_info: [{"id": "4216c4cd-08b6-4e6f-a4f8-9b34c2b42756", "address": "fa:16:3e:6e:a3:e0", "network": {"id": "f80826fa-fada-45b9-b969-fd539fd34fd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-465377443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9aadc9385b3b46eebc6e0d81814521af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4216c4cd-08", "ovs_interfaceid": "4216c4cd-08b6-4e6f-a4f8-9b34c2b42756", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:10:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-8e314aa6-3c29-43b5-9985-1041b38b86be req-8dbfb12c-6efb-4d72-a6e6-c3c311f92fdc service nova] Releasing lock "refresh_cache-fc2c25cc-9d79-45a2-9d50-862b7592f7f7" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:10:54 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:10:54 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690643454.401024, 758d9381-32af-4433-8366-9e0aa9699137 => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 15:10:54 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 758d9381-32af-4433-8366-9e0aa9699137] VM Resumed (Lifecycle Event)
Jul 29 15:10:54 user nova-compute[70924]: DEBUG nova.compute.manager [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Instance event wait completed in 0 seconds for  {{(pid=70924) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 15:10:54 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Guest created on hypervisor {{(pid=70924) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 15:10:54 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Instance spawned successfully.
Jul 29 15:10:54 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 15:10:54 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:10:54 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 15:10:54 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Found default for hw_cdrom_bus of ide {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:10:54 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Found default for hw_disk_bus of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:10:54 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Found default for hw_input_bus of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:10:54 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Found default for hw_pointer_model of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:10:54 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Found default for hw_video_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:10:54 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Found default for hw_vif_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:10:54 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 758d9381-32af-4433-8366-9e0aa9699137] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 15:10:54 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690643454.4018815, 758d9381-32af-4433-8366-9e0aa9699137 => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 15:10:54 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 758d9381-32af-4433-8366-9e0aa9699137] VM Started (Lifecycle Event)
Jul 29 15:10:54 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:10:54 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 15:10:54 user nova-compute[70924]: INFO nova.compute.manager [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Took 4.86 seconds to spawn the instance on the hypervisor.
Jul 29 15:10:54 user nova-compute[70924]: DEBUG nova.compute.manager [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:10:54 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 758d9381-32af-4433-8366-9e0aa9699137] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 15:10:54 user nova-compute[70924]: INFO nova.compute.manager [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Took 12.86 seconds to build instance.
Jul 29 15:10:54 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-f8b36922-50da-42bc-b231-1011d226f848 tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "758d9381-32af-4433-8366-9e0aa9699137" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.985s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:10:54 user nova-compute[70924]: DEBUG nova.compute.manager [req-46f746b1-dd24-410d-b352-2f720f12fbd8 req-6c76c72e-6df0-4502-b121-f0da1f4dbb00 service nova] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Received event network-vif-plugged-590a32f6-52b6-4377-a140-0ff497ec1aad {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:10:54 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-46f746b1-dd24-410d-b352-2f720f12fbd8 req-6c76c72e-6df0-4502-b121-f0da1f4dbb00 service nova] Acquiring lock "758d9381-32af-4433-8366-9e0aa9699137-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:10:54 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-46f746b1-dd24-410d-b352-2f720f12fbd8 req-6c76c72e-6df0-4502-b121-f0da1f4dbb00 service nova] Lock "758d9381-32af-4433-8366-9e0aa9699137-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:10:54 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-46f746b1-dd24-410d-b352-2f720f12fbd8 req-6c76c72e-6df0-4502-b121-f0da1f4dbb00 service nova] Lock "758d9381-32af-4433-8366-9e0aa9699137-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:10:54 user nova-compute[70924]: DEBUG nova.compute.manager [req-46f746b1-dd24-410d-b352-2f720f12fbd8 req-6c76c72e-6df0-4502-b121-f0da1f4dbb00 service nova] [instance: 758d9381-32af-4433-8366-9e0aa9699137] No waiting events found dispatching network-vif-plugged-590a32f6-52b6-4377-a140-0ff497ec1aad {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:10:54 user nova-compute[70924]: WARNING nova.compute.manager [req-46f746b1-dd24-410d-b352-2f720f12fbd8 req-6c76c72e-6df0-4502-b121-f0da1f4dbb00 service nova] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Received unexpected event network-vif-plugged-590a32f6-52b6-4377-a140-0ff497ec1aad for instance with vm_state active and task_state None.
Jul 29 15:10:56 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:10:56 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0034fd2b-2bf9-46c0-a6a7-be5e3dd02959 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Acquiring lock "fc2c25cc-9d79-45a2-9d50-862b7592f7f7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:10:56 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0034fd2b-2bf9-46c0-a6a7-be5e3dd02959 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "fc2c25cc-9d79-45a2-9d50-862b7592f7f7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:10:56 user nova-compute[70924]: DEBUG nova.objects.instance [None req-0034fd2b-2bf9-46c0-a6a7-be5e3dd02959 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lazy-loading 'flavor' on Instance uuid fc2c25cc-9d79-45a2-9d50-862b7592f7f7 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:10:56 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0034fd2b-2bf9-46c0-a6a7-be5e3dd02959 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "fc2c25cc-9d79-45a2-9d50-862b7592f7f7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:10:57 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0034fd2b-2bf9-46c0-a6a7-be5e3dd02959 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Acquiring lock "fc2c25cc-9d79-45a2-9d50-862b7592f7f7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:10:57 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0034fd2b-2bf9-46c0-a6a7-be5e3dd02959 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "fc2c25cc-9d79-45a2-9d50-862b7592f7f7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:10:57 user nova-compute[70924]: INFO nova.compute.manager [None req-0034fd2b-2bf9-46c0-a6a7-be5e3dd02959 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] Attaching volume 0c1f660f-27f5-4549-8c0b-bb0b29584ec0 to /dev/vdb
Jul 29 15:10:57 user nova-compute[70924]: DEBUG os_brick.utils [None req-0034fd2b-2bf9-46c0-a6a7-be5e3dd02959 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 15:10:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:57 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[240a8657-cb7a-413e-9e81-ef265fea59e8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f2127c4a30d9\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:57 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c38c66-8c04-44df-b86b-ee5cfca166d9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:10:57 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d5a0fc-bf67-44a8-a71c-15ae1ad8019d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:57 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c17d62-953b-4beb-832f-60be7cd7c4d0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-0034fd2b-2bf9-46c0-a6a7-be5e3dd02959 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Running cmd (subprocess): nvme version {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-0034fd2b-2bf9-46c0-a6a7-be5e3dd02959 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] 'nvme version' failed. Not Retrying. {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 15:10:57 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0034fd2b-2bf9-46c0-a6a7-be5e3dd02959 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] nvme not present on system {{(pid=70924) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 15:10:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:10:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 15:10:57 user nova-compute[70924]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 15:10:57 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bab79ea-7f3c-4603-af4c-79ede55feeaf]: (4, '') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:10:57 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-0034fd2b-2bf9-46c0-a6a7-be5e3dd02959 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70924) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 15:10:57 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-0034fd2b-2bf9-46c0-a6a7-be5e3dd02959 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 15:10:57 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-0034fd2b-2bf9-46c0-a6a7-be5e3dd02959 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] LIGHTOS: no hostnqn found. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 15:10:57 user nova-compute[70924]: DEBUG os_brick.utils [None req-0034fd2b-2bf9-46c0-a6a7-be5e3dd02959 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f2127c4a30d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 15:10:57 user nova-compute[70924]: DEBUG nova.virt.block_device [None req-0034fd2b-2bf9-46c0-a6a7-be5e3dd02959 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] Updating existing volume attachment record: 538d4a43-381d-4aaf-b9ff-327d6734baa7 {{(pid=70924) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 15:10:59 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:11:01 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:11:03 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:11:04 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0034fd2b-2bf9-46c0-a6a7-be5e3dd02959 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] Calling os-brick to attach iSCSI Volume {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 15:11:04 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-0034fd2b-2bf9-46c0-a6a7-be5e3dd02959 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0c1f660f-27f5-4549-8c0b-bb0b29584ec0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pFCEdLIX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 15:11:04 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-0034fd2b-2bf9-46c0-a6a7-be5e3dd02959 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 15:11:04 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-0034fd2b-2bf9-46c0-a6a7-be5e3dd02959 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 15:11:04 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-0034fd2b-2bf9-46c0-a6a7-be5e3dd02959 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 15:11:04 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-0034fd2b-2bf9-46c0-a6a7-be5e3dd02959 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 15:11:04 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-0034fd2b-2bf9-46c0-a6a7-be5e3dd02959 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c1f660f-27f5-4549-8c0b-bb0b29584ec0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 15:11:04 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-0034fd2b-2bf9-46c0-a6a7-be5e3dd02959 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c1f660f-27f5-4549-8c0b-bb0b29584ec0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 15:11:04 user nova-compute[70924]: INFO os_brick.initiator.connectors.iscsi [None req-0034fd2b-2bf9-46c0-a6a7-be5e3dd02959 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 15:11:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c1f660f-27f5-4549-8c0b-bb0b29584ec0 -p 172.16.0.220:3260 {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:11:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c1f660f-27f5-4549-8c0b-bb0b29584ec0 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:11:04 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71e14b6-2131-45df-a837-e428f12ad9d6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:11:04 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-0034fd2b-2bf9-46c0-a6a7-be5e3dd02959 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 15:11:04 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:11:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c1f660f-27f5-4549-8c0b-bb0b29584ec0 -p 172.16.0.220:3260 --interface default --op new {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:11:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c1f660f-27f5-4549-8c0b-bb0b29584ec0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:11:04 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[30bb940c-5fba-4d76-81f4-ef5e743a2e28]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c1f660f-27f5-4549-8c0b-bb0b29584ec0] added\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:11:04 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-0034fd2b-2bf9-46c0-a6a7-be5e3dd02959 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c1f660f-27f5-4549-8c0b-bb0b29584ec0] added
Jul 29 15:11:04 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:11:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c1f660f-27f5-4549-8c0b-bb0b29584ec0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:11:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c1f660f-27f5-4549-8c0b-bb0b29584ec0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:11:04 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2099990c-ba20-4766-9859-5466e0a82a47]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:11:04 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-0034fd2b-2bf9-46c0-a6a7-be5e3dd02959 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:11:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c1f660f-27f5-4549-8c0b-bb0b29584ec0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:11:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c1f660f-27f5-4549-8c0b-bb0b29584ec0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:11:04 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c079953-216d-4c36-af82-3a1209e1112b]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:11:04 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-0034fd2b-2bf9-46c0-a6a7-be5e3dd02959 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:11:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c1f660f-27f5-4549-8c0b-bb0b29584ec0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pFCEdLIX {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:11:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c1f660f-27f5-4549-8c0b-bb0b29584ec0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pFCEdLIX" returned: 0 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:11:04 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[516261e0-b779-493e-b92a-7ca36403fc9c]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:11:04 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-0034fd2b-2bf9-46c0-a6a7-be5e3dd02959 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pFCEdLIX'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:11:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c1f660f-27f5-4549-8c0b-bb0b29584ec0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:11:04 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:11:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c1f660f-27f5-4549-8c0b-bb0b29584ec0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:11:04 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5ed35e-ed64-417a-9fb6-eb216b14c10f]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:11:04 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-0034fd2b-2bf9-46c0-a6a7-be5e3dd02959 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:11:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:11:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:11:04 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2245969-29d0-47a7-879e-0a234227f267]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:11:04 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-0034fd2b-2bf9-46c0-a6a7-be5e3dd02959 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497 (non-flash)
Jul 29 15:11:04 user nova-compute[70924]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 (non-flash)
Jul 29 15:11:04 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 15:11:04 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-0034fd2b-2bf9-46c0-a6a7-be5e3dd02959 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497 (non-flash)
Jul 29 15:11:04 user nova-compute[70924]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 (non-flash)
Jul 29 15:11:04 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 15:11:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c1f660f-27f5-4549-8c0b-bb0b29584ec0 -p 172.16.0.220:3260 --login {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:11:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c1f660f-27f5-4549-8c0b-bb0b29584ec0 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:11:04 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d316cb75-4d85-428e-96df-e14c0a4452ec]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c1f660f-27f5-4549-8c0b-bb0b29584ec0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0c1f660f-27f5-4549-8c0b-bb0b29584ec0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:11:04 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-0034fd2b-2bf9-46c0-a6a7-be5e3dd02959 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c1f660f-27f5-4549-8c0b-bb0b29584ec0, portal: 172.16.0.220,3260]
Jul 29 15:11:04 user nova-compute[70924]: Login to [iface: default, target: iqn.2010-10.org.openstack:0c1f660f-27f5-4549-8c0b-bb0b29584ec0, portal: 172.16.0.220,3260] successful.
Jul 29 15:11:04 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:11:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c1f660f-27f5-4549-8c0b-bb0b29584ec0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:11:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c1f660f-27f5-4549-8c0b-bb0b29584ec0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:11:04 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[908884bd-db7e-40a2-a5ce-27e57c662025]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:11:04 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-0034fd2b-2bf9-46c0-a6a7-be5e3dd02959 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:11:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:11:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:11:04 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ef419b-7466-48f1-a734-49a25f70f71a]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1f660f-27f5-4549-8c0b-bb0b29584ec0 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:11:04 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-0034fd2b-2bf9-46c0-a6a7-be5e3dd02959 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497 (non-flash)
Jul 29 15:11:04 user nova-compute[70924]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 (non-flash)
Jul 29 15:11:04 user nova-compute[70924]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1f660f-27f5-4549-8c0b-bb0b29584ec0 (non-flash)
Jul 29 15:11:04 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 15:11:04 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-0034fd2b-2bf9-46c0-a6a7-be5e3dd02959 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497 (non-flash)
Jul 29 15:11:04 user nova-compute[70924]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 (non-flash)
Jul 29 15:11:04 user nova-compute[70924]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1f660f-27f5-4549-8c0b-bb0b29584ec0 (non-flash)
Jul 29 15:11:04 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 15:11:04 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-0034fd2b-2bf9-46c0-a6a7-be5e3dd02959 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c1f660f-27f5-4549-8c0b-bb0b29584ec0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 15:11:04 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-0034fd2b-2bf9-46c0-a6a7-be5e3dd02959 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Connected to 172.16.0.220:3260 {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 15:11:04 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-0034fd2b-2bf9-46c0-a6a7-be5e3dd02959 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] HCTL ('35', '-', '-', 0) found on session 57 with lun 0 {{(pid=70924) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 15:11:04 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-0034fd2b-2bf9-46c0-a6a7-be5e3dd02959 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70924) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 15:11:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:11:04 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:11:04 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae832a26-f279-4cdb-92bf-da8e6e69ad79]: (4, ('- - 0', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:11:04 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-0034fd2b-2bf9-46c0-a6a7-be5e3dd02959 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Searching for a device in session 57 and hctl ['35', '*', '*', 0] yield: None {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 15:11:05 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:11:05 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-0034fd2b-2bf9-46c0-a6a7-be5e3dd02959 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Searching for a device in session 57 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 15:11:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-0034fd2b-2bf9-46c0-a6a7-be5e3dd02959 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pFCEdLIX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 15:11:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-0034fd2b-2bf9-46c0-a6a7-be5e3dd02959 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 15:11:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-0034fd2b-2bf9-46c0-a6a7-be5e3dd02959 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '26566633961393265', 'path': '/dev/sdd'} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 15:11:05 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0034fd2b-2bf9-46c0-a6a7-be5e3dd02959 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26566633961393265', 'path': '/dev/sdd'} {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 15:11:05 user nova-compute[70924]: DEBUG nova.objects.instance [None req-0034fd2b-2bf9-46c0-a6a7-be5e3dd02959 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lazy-loading 'flavor' on Instance uuid fc2c25cc-9d79-45a2-9d50-862b7592f7f7 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:11:05 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-0034fd2b-2bf9-46c0-a6a7-be5e3dd02959 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] attach device xml: <disk type="block" device="disk">
Jul 29 15:11:05 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 15:11:05 user nova-compute[70924]:   <source dev="/dev/sdd"/>
Jul 29 15:11:05 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 15:11:05 user nova-compute[70924]:   <serial>0c1f660f-27f5-4549-8c0b-bb0b29584ec0</serial>
Jul 29 15:11:05 user nova-compute[70924]: </disk>
Jul 29 15:11:05 user nova-compute[70924]:  {{(pid=70924) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 29 15:11:05 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0034fd2b-2bf9-46c0-a6a7-be5e3dd02959 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 15:11:05 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0034fd2b-2bf9-46c0-a6a7-be5e3dd02959 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 15:11:05 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-0034fd2b-2bf9-46c0-a6a7-be5e3dd02959 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] No VIF found with MAC fa:16:3e:6e:a3:e0, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 15:11:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:11:06 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-0034fd2b-2bf9-46c0-a6a7-be5e3dd02959 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "fc2c25cc-9d79-45a2-9d50-862b7592f7f7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.130s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:11:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-445478c9-bc1d-4a11-a038-5313038be216 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Acquiring lock "fc2c25cc-9d79-45a2-9d50-862b7592f7f7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:11:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-445478c9-bc1d-4a11-a038-5313038be216 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "fc2c25cc-9d79-45a2-9d50-862b7592f7f7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:11:07 user nova-compute[70924]: INFO nova.compute.manager [None req-445478c9-bc1d-4a11-a038-5313038be216 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] Detaching volume 0c1f660f-27f5-4549-8c0b-bb0b29584ec0
Jul 29 15:11:07 user nova-compute[70924]: INFO nova.virt.block_device [None req-445478c9-bc1d-4a11-a038-5313038be216 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] Attempting to driver detach volume 0c1f660f-27f5-4549-8c0b-bb0b29584ec0 from mountpoint /dev/vdb
Jul 29 15:11:07 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-445478c9-bc1d-4a11-a038-5313038be216 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Attempting to detach device vdb from instance fc2c25cc-9d79-45a2-9d50-862b7592f7f7 from the persistent domain config. {{(pid=70924) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 29 15:11:07 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-445478c9-bc1d-4a11-a038-5313038be216 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 15:11:07 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 15:11:07 user nova-compute[70924]:   <source dev="/dev/sdd"/>
Jul 29 15:11:07 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 15:11:07 user nova-compute[70924]:   <serial>0c1f660f-27f5-4549-8c0b-bb0b29584ec0</serial>
Jul 29 15:11:07 user nova-compute[70924]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 15:11:07 user nova-compute[70924]: </disk>
Jul 29 15:11:07 user nova-compute[70924]:  {{(pid=70924) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 15:11:07 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-445478c9-bc1d-4a11-a038-5313038be216 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Successfully detached device vdb from instance fc2c25cc-9d79-45a2-9d50-862b7592f7f7 from the persistent domain config.
Jul 29 15:11:07 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-445478c9-bc1d-4a11-a038-5313038be216 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fc2c25cc-9d79-45a2-9d50-862b7592f7f7 from the live domain config. {{(pid=70924) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 29 15:11:07 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-445478c9-bc1d-4a11-a038-5313038be216 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 15:11:07 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 15:11:07 user nova-compute[70924]:   <source dev="/dev/sdd"/>
Jul 29 15:11:07 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 15:11:07 user nova-compute[70924]:   <serial>0c1f660f-27f5-4549-8c0b-bb0b29584ec0</serial>
Jul 29 15:11:07 user nova-compute[70924]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 15:11:07 user nova-compute[70924]: </disk>
Jul 29 15:11:07 user nova-compute[70924]:  {{(pid=70924) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 15:11:07 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Received event <DeviceRemovedEvent: 1690643467.645299, fc2c25cc-9d79-45a2-9d50-862b7592f7f7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70924) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 29 15:11:07 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-445478c9-bc1d-4a11-a038-5313038be216 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fc2c25cc-9d79-45a2-9d50-862b7592f7f7 {{(pid=70924) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 29 15:11:07 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-445478c9-bc1d-4a11-a038-5313038be216 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Successfully detached device vdb from instance fc2c25cc-9d79-45a2-9d50-862b7592f7f7 from the live domain config.
Jul 29 15:11:07 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-445478c9-bc1d-4a11-a038-5313038be216 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] calling os-brick to detach iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 15:11:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-445478c9-bc1d-4a11-a038-5313038be216 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, {'target_iqns': ['iqn.2010-10.org.openstack:0c1f660f-27f5-4549-8c0b-bb0b29584ec0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pFCEdLIX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 15:11:07 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-445478c9-bc1d-4a11-a038-5313038be216 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 15:11:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-445478c9-bc1d-4a11-a038-5313038be216 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 15:11:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-445478c9-bc1d-4a11-a038-5313038be216 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 15:11:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-445478c9-bc1d-4a11-a038-5313038be216 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c1f660f-27f5-4549-8c0b-bb0b29584ec0', 0)] {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 15:11:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:11:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:11:07 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f4dc7a-84fa-4c56-84af-b9ecc9f370d6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c1f660f-27f5-4549-8c0b-bb0b29584ec0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:11:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:11:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:11:07 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b28986-2146-4f8e-a5d3-6cebababaf2b]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1f660f-27f5-4549-8c0b-bb0b29584ec0 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:11:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-445478c9-bc1d-4a11-a038-5313038be216 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497 (non-flash)
Jul 29 15:11:07 user nova-compute[70924]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 (non-flash)
Jul 29 15:11:07 user nova-compute[70924]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1f660f-27f5-4549-8c0b-bb0b29584ec0 (non-flash)
Jul 29 15:11:07 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 15:11:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-445478c9-bc1d-4a11-a038-5313038be216 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497 (non-flash)
Jul 29 15:11:07 user nova-compute[70924]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 (non-flash)
Jul 29 15:11:07 user nova-compute[70924]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1f660f-27f5-4549-8c0b-bb0b29584ec0 (non-flash)
Jul 29 15:11:07 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 15:11:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-445478c9-bc1d-4a11-a038-5313038be216 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feee9914940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c1f660f-27f5-4549-8c0b-bb0b29584ec0'): ({'sdd'}, set())}) {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 15:11:07 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-445478c9-bc1d-4a11-a038-5313038be216 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Removing single pathed devices sdd {{(pid=70924) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 15:11:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:11:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:11:07 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[88abc8ce-8a2c-41d1-98bb-632a7409a4b1]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:11:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:11:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:11:07 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9246a26-e05c-4045-aa32-e8f092a41bfd]: (4, ('ok\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:11:07 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-445478c9-bc1d-4a11-a038-5313038be216 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Flushing IO for device /dev/sdd {{(pid=70924) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 15:11:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:11:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:11:07 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8c75a1-3ab8-4f93-99df-78f6994e559c]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:11:07 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-445478c9-bc1d-4a11-a038-5313038be216 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70924) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 15:11:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:11:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.052s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:11:07 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f0b8041-a11a-48eb-a23e-b8d86ba94ba9]: (4, ('1', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:11:07 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-445478c9-bc1d-4a11-a038-5313038be216 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 15:11:07 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-445478c9-bc1d-4a11-a038-5313038be216 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] SCSI volumes sdd have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 15:11:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-445478c9-bc1d-4a11-a038-5313038be216 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c1f660f-27f5-4549-8c0b-bb0b29584ec0')] {{(pid=70924) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 15:11:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c1f660f-27f5-4549-8c0b-bb0b29584ec0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:11:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c1f660f-27f5-4549-8c0b-bb0b29584ec0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:11:07 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[136b6c99-fa27-4053-bce7-619b3f92d619]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:11:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-445478c9-bc1d-4a11-a038-5313038be216 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:11:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c1f660f-27f5-4549-8c0b-bb0b29584ec0 -p 172.16.0.220:3260 --logout {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:11:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c1f660f-27f5-4549-8c0b-bb0b29584ec0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:11:07 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22162f3-e74d-46a0-a450-0960b3ff1f1c]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:0c1f660f-27f5-4549-8c0b-bb0b29584ec0, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:0c1f660f-27f5-4549-8c0b-bb0b29584ec0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:11:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-445478c9-bc1d-4a11-a038-5313038be216 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:0c1f660f-27f5-4549-8c0b-bb0b29584ec0, portal: 172.16.0.220,3260]
Jul 29 15:11:07 user nova-compute[70924]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:0c1f660f-27f5-4549-8c0b-bb0b29584ec0, portal: 172.16.0.220,3260] successful.
Jul 29 15:11:07 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:11:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c1f660f-27f5-4549-8c0b-bb0b29584ec0 -p 172.16.0.220:3260 --op delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:11:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c1f660f-27f5-4549-8c0b-bb0b29584ec0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:11:07 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e04243-edba-46de-8180-9e137df08df0]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:11:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-445478c9-bc1d-4a11-a038-5313038be216 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:11:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-445478c9-bc1d-4a11-a038-5313038be216 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 15:11:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-445478c9-bc1d-4a11-a038-5313038be216 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] <== disconnect_volume: return (291ms) None {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 15:11:07 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-445478c9-bc1d-4a11-a038-5313038be216 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] Disconnected iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 15:11:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-d1f88279-97d9-41b6-911f-8ffe3dd67956 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Acquiring lock "5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:11:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-d1f88279-97d9-41b6-911f-8ffe3dd67956 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Lock "5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:11:08 user nova-compute[70924]: INFO nova.compute.manager [None req-d1f88279-97d9-41b6-911f-8ffe3dd67956 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Detaching volume f96d969f-0a50-439b-ae92-ad66d43b2497
Jul 29 15:11:08 user nova-compute[70924]: INFO nova.virt.block_device [None req-d1f88279-97d9-41b6-911f-8ffe3dd67956 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Attempting to driver detach volume f96d969f-0a50-439b-ae92-ad66d43b2497 from mountpoint /dev/vdb
Jul 29 15:11:08 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-d1f88279-97d9-41b6-911f-8ffe3dd67956 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Attempting to detach device vdb from instance 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9 from the persistent domain config. {{(pid=70924) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 29 15:11:08 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-d1f88279-97d9-41b6-911f-8ffe3dd67956 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 15:11:08 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 15:11:08 user nova-compute[70924]:   <source dev="/dev/sdb"/>
Jul 29 15:11:08 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 15:11:08 user nova-compute[70924]:   <serial>f96d969f-0a50-439b-ae92-ad66d43b2497</serial>
Jul 29 15:11:08 user nova-compute[70924]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 15:11:08 user nova-compute[70924]: </disk>
Jul 29 15:11:08 user nova-compute[70924]:  {{(pid=70924) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 15:11:08 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-d1f88279-97d9-41b6-911f-8ffe3dd67956 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Successfully detached device vdb from instance 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9 from the persistent domain config.
Jul 29 15:11:08 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-d1f88279-97d9-41b6-911f-8ffe3dd67956 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9 from the live domain config. {{(pid=70924) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 29 15:11:08 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-d1f88279-97d9-41b6-911f-8ffe3dd67956 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 15:11:08 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 15:11:08 user nova-compute[70924]:   <source dev="/dev/sdb"/>
Jul 29 15:11:08 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 15:11:08 user nova-compute[70924]:   <serial>f96d969f-0a50-439b-ae92-ad66d43b2497</serial>
Jul 29 15:11:08 user nova-compute[70924]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 15:11:08 user nova-compute[70924]: </disk>
Jul 29 15:11:08 user nova-compute[70924]:  {{(pid=70924) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 15:11:08 user nova-compute[70924]: DEBUG nova.objects.instance [None req-445478c9-bc1d-4a11-a038-5313038be216 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lazy-loading 'flavor' on Instance uuid fc2c25cc-9d79-45a2-9d50-862b7592f7f7 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:11:08 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-445478c9-bc1d-4a11-a038-5313038be216 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "fc2c25cc-9d79-45a2-9d50-862b7592f7f7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.603s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:11:08 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Received event <DeviceRemovedEvent: 1690643468.9777813, 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70924) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 29 15:11:08 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-d1f88279-97d9-41b6-911f-8ffe3dd67956 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9 {{(pid=70924) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 29 15:11:08 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-d1f88279-97d9-41b6-911f-8ffe3dd67956 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Successfully detached device vdb from instance 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9 from the live domain config.
Jul 29 15:11:08 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1f88279-97d9-41b6-911f-8ffe3dd67956 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] calling os-brick to detach iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 15:11:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f88279-97d9-41b6-911f-8ffe3dd67956 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, {'target_iqns': ['iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dvAxLjIc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 15:11:08 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-d1f88279-97d9-41b6-911f-8ffe3dd67956 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 15:11:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-d1f88279-97d9-41b6-911f-8ffe3dd67956 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 15:11:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-d1f88279-97d9-41b6-911f-8ffe3dd67956 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 15:11:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f88279-97d9-41b6-911f-8ffe3dd67956 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497', 0)] {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 15:11:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:11:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:11:09 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21e4a8a-af00-47e0-9629-c8e7dc578066]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:11:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:11:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:11:09 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b316759c-cf4f-45b0-89c0-b42dc8a05c9d]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:11:09 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f88279-97d9-41b6-911f-8ffe3dd67956 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497 (non-flash)
Jul 29 15:11:09 user nova-compute[70924]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 (non-flash)
Jul 29 15:11:09 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 15:11:09 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f88279-97d9-41b6-911f-8ffe3dd67956 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497 (non-flash)
Jul 29 15:11:09 user nova-compute[70924]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 (non-flash)
Jul 29 15:11:09 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 15:11:09 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f88279-97d9-41b6-911f-8ffe3dd67956 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feee9aa8dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497'): ({'sdb'}, set())}) {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 15:11:09 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-d1f88279-97d9-41b6-911f-8ffe3dd67956 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Removing single pathed devices sdb {{(pid=70924) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 15:11:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:11:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:11:09 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f182387b-1fa2-4a9e-bb45-25a3cf079694]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:11:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:11:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:11:09 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[97886942-a91a-4e9c-a08c-062657db6d68]: (4, ('ok\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:11:09 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-d1f88279-97d9-41b6-911f-8ffe3dd67956 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Flushing IO for device /dev/sdb {{(pid=70924) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 15:11:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:11:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:11:09 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[820a4e93-7b18-4831-83bf-021ff98d3ff7]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:11:09 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-d1f88279-97d9-41b6-911f-8ffe3dd67956 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70924) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 15:11:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:11:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:11:09 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d66a1a4-57e8-417e-a26a-0c32003307a7]: (4, ('1', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:11:09 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-d1f88279-97d9-41b6-911f-8ffe3dd67956 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 15:11:09 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-d1f88279-97d9-41b6-911f-8ffe3dd67956 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] SCSI volumes sdb have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 15:11:09 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f88279-97d9-41b6-911f-8ffe3dd67956 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497')] {{(pid=70924) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 15:11:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:11:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:11:09 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2c361a-8bbb-4abc-b68c-5b4b293909be]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:11:09 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f88279-97d9-41b6-911f-8ffe3dd67956 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:11:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497 -p 172.16.0.220:3260 --logout {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:11:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:11:09 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[be100b37-401a-4904-b166-4133c8b75bd6]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:11:09 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f88279-97d9-41b6-911f-8ffe3dd67956 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497, portal: 172.16.0.220,3260]
Jul 29 15:11:09 user nova-compute[70924]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497, portal: 172.16.0.220,3260] successful.
Jul 29 15:11:09 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:11:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497 -p 172.16.0.220:3260 --op delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:11:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f96d969f-0a50-439b-ae92-ad66d43b2497 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:11:09 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2188133-b615-43c5-a4fe-c0924fc3d742]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:11:09 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f88279-97d9-41b6-911f-8ffe3dd67956 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:11:09 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-d1f88279-97d9-41b6-911f-8ffe3dd67956 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.269s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 15:11:09 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f88279-97d9-41b6-911f-8ffe3dd67956 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] <== disconnect_volume: return (270ms) None {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 15:11:09 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1f88279-97d9-41b6-911f-8ffe3dd67956 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Disconnected iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 15:11:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:11:09 user nova-compute[70924]: DEBUG nova.objects.instance [None req-d1f88279-97d9-41b6-911f-8ffe3dd67956 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Lazy-loading 'flavor' on Instance uuid 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:11:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-d1f88279-97d9-41b6-911f-8ffe3dd67956 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Lock "5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.604s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:11:10 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:11:11 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:11:11 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:11:12 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:11:14 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:11:14 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:11:14 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:11:14 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:11:14 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:11:14 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Auditing locally available compute resources for user (node: user) {{(pid=70924) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 15:11:14 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 15:11:14 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0df1b67-aab1-4a27-9ef9-00e02a5dfca5/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:11:14 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0df1b67-aab1-4a27-9ef9-00e02a5dfca5/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:11:14 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0df1b67-aab1-4a27-9ef9-00e02a5dfca5/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:11:14 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0df1b67-aab1-4a27-9ef9-00e02a5dfca5/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:11:14 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:11:14 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:11:14 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:11:15 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:11:15 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2c25cc-9d79-45a2-9d50-862b7592f7f7/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:11:15 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2c25cc-9d79-45a2-9d50-862b7592f7f7/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:11:15 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2c25cc-9d79-45a2-9d50-862b7592f7f7/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:11:15 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2c25cc-9d79-45a2-9d50-862b7592f7f7/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:11:15 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a8fe938-7ca4-4221-9742-9b043050ba84/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:11:15 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a8fe938-7ca4-4221-9742-9b043050ba84/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:11:15 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a8fe938-7ca4-4221-9742-9b043050ba84/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:11:15 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a8fe938-7ca4-4221-9742-9b043050ba84/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:11:16 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:11:16 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:11:16 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:11:16 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Hypervisor/Node resource view: name=user free_ram=8176MB free_disk=25.132328033447266GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70924) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 15:11:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:11:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:11:16 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 0a8fe938-7ca4-4221-9742-9b043050ba84 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:11:16 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:11:16 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance d0df1b67-aab1-4a27-9ef9-00e02a5dfca5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:11:16 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance fc2c25cc-9d79-45a2-9d50-862b7592f7f7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:11:16 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 758d9381-32af-4433-8366-9e0aa9699137 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:11:16 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 15:11:16 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 15:11:16 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:11:16 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:11:16 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Compute_service record updated for user:user {{(pid=70924) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 15:11:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.289s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:11:17 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:11:17 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:11:17 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Starting heal instance info cache {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 15:11:17 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "refresh_cache-d0df1b67-aab1-4a27-9ef9-00e02a5dfca5" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:11:17 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquired lock "refresh_cache-d0df1b67-aab1-4a27-9ef9-00e02a5dfca5" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:11:17 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Forcefully refreshing network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 29 15:11:17 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Updating instance_info_cache with network_info: [{"id": "9993f68e-4ceb-4974-9224-2fd3866899ce", "address": "fa:16:3e:eb:3b:0c", "network": {"id": "24b90c74-6ebe-42f0-b11f-fc2b23b35188", "bridge": "br-int", "label": "tempest-TestStampPattern-1445459710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "519723b99af84d1b85c40cfbc6518d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9993f68e-4c", "ovs_interfaceid": "9993f68e-4ceb-4974-9224-2fd3866899ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:11:18 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Releasing lock "refresh_cache-d0df1b67-aab1-4a27-9ef9-00e02a5dfca5" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:11:18 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Updated the network info_cache for instance {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 29 15:11:18 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:11:18 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70924) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 15:11:18 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:11:19 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:11:21 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:11:24 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:11:26 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:11:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:11:33 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:11:33 user nova-compute[70924]: DEBUG nova.compute.manager [req-69f7cdf8-2417-4e87-86e3-fd3d7a08277a req-300d5b38-18cc-477c-8ad5-b66b2ded1489 service nova] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Received event network-changed-9993f68e-4ceb-4974-9224-2fd3866899ce {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:11:33 user nova-compute[70924]: DEBUG nova.compute.manager [req-69f7cdf8-2417-4e87-86e3-fd3d7a08277a req-300d5b38-18cc-477c-8ad5-b66b2ded1489 service nova] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Refreshing instance network info cache due to event network-changed-9993f68e-4ceb-4974-9224-2fd3866899ce. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 15:11:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-69f7cdf8-2417-4e87-86e3-fd3d7a08277a req-300d5b38-18cc-477c-8ad5-b66b2ded1489 service nova] Acquiring lock "refresh_cache-d0df1b67-aab1-4a27-9ef9-00e02a5dfca5" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:11:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-69f7cdf8-2417-4e87-86e3-fd3d7a08277a req-300d5b38-18cc-477c-8ad5-b66b2ded1489 service nova] Acquired lock "refresh_cache-d0df1b67-aab1-4a27-9ef9-00e02a5dfca5" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:11:33 user nova-compute[70924]: DEBUG nova.network.neutron [req-69f7cdf8-2417-4e87-86e3-fd3d7a08277a req-300d5b38-18cc-477c-8ad5-b66b2ded1489 service nova] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Refreshing network info cache for port 9993f68e-4ceb-4974-9224-2fd3866899ce {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 15:11:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-e7ef35fd-f784-4479-a703-1c950cbb8a99 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Acquiring lock "d0df1b67-aab1-4a27-9ef9-00e02a5dfca5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:11:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-e7ef35fd-f784-4479-a703-1c950cbb8a99 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Lock "d0df1b67-aab1-4a27-9ef9-00e02a5dfca5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:11:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-e7ef35fd-f784-4479-a703-1c950cbb8a99 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Acquiring lock "d0df1b67-aab1-4a27-9ef9-00e02a5dfca5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:11:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-e7ef35fd-f784-4479-a703-1c950cbb8a99 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Lock "d0df1b67-aab1-4a27-9ef9-00e02a5dfca5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:11:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-e7ef35fd-f784-4479-a703-1c950cbb8a99 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Lock "d0df1b67-aab1-4a27-9ef9-00e02a5dfca5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:11:33 user nova-compute[70924]: INFO nova.compute.manager [None req-e7ef35fd-f784-4479-a703-1c950cbb8a99 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Terminating instance
Jul 29 15:11:33 user nova-compute[70924]: DEBUG nova.compute.manager [None req-e7ef35fd-f784-4479-a703-1c950cbb8a99 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Start destroying the instance on the hypervisor. {{(pid=70924) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 15:11:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:11:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:11:34 user nova-compute[70924]: DEBUG nova.compute.manager [req-7a98de13-b92b-43ae-bed8-7e7a97dfa0d6 req-8884253a-42a9-4aa8-80bf-8b6d0ff2f780 service nova] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Received event network-vif-unplugged-9993f68e-4ceb-4974-9224-2fd3866899ce {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:11:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-7a98de13-b92b-43ae-bed8-7e7a97dfa0d6 req-8884253a-42a9-4aa8-80bf-8b6d0ff2f780 service nova] Acquiring lock "d0df1b67-aab1-4a27-9ef9-00e02a5dfca5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:11:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-7a98de13-b92b-43ae-bed8-7e7a97dfa0d6 req-8884253a-42a9-4aa8-80bf-8b6d0ff2f780 service nova] Lock "d0df1b67-aab1-4a27-9ef9-00e02a5dfca5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:11:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-7a98de13-b92b-43ae-bed8-7e7a97dfa0d6 req-8884253a-42a9-4aa8-80bf-8b6d0ff2f780 service nova] Lock "d0df1b67-aab1-4a27-9ef9-00e02a5dfca5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:11:34 user nova-compute[70924]: DEBUG nova.compute.manager [req-7a98de13-b92b-43ae-bed8-7e7a97dfa0d6 req-8884253a-42a9-4aa8-80bf-8b6d0ff2f780 service nova] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] No waiting events found dispatching network-vif-unplugged-9993f68e-4ceb-4974-9224-2fd3866899ce {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:11:34 user nova-compute[70924]: DEBUG nova.compute.manager [req-7a98de13-b92b-43ae-bed8-7e7a97dfa0d6 req-8884253a-42a9-4aa8-80bf-8b6d0ff2f780 service nova] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Received event network-vif-unplugged-9993f68e-4ceb-4974-9224-2fd3866899ce for instance with task_state deleting. {{(pid=70924) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 15:11:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:11:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:11:34 user nova-compute[70924]: DEBUG nova.network.neutron [req-69f7cdf8-2417-4e87-86e3-fd3d7a08277a req-300d5b38-18cc-477c-8ad5-b66b2ded1489 service nova] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Updated VIF entry in instance network info cache for port 9993f68e-4ceb-4974-9224-2fd3866899ce. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 15:11:34 user nova-compute[70924]: DEBUG nova.network.neutron [req-69f7cdf8-2417-4e87-86e3-fd3d7a08277a req-300d5b38-18cc-477c-8ad5-b66b2ded1489 service nova] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Updating instance_info_cache with network_info: [{"id": "9993f68e-4ceb-4974-9224-2fd3866899ce", "address": "fa:16:3e:eb:3b:0c", "network": {"id": "24b90c74-6ebe-42f0-b11f-fc2b23b35188", "bridge": "br-int", "label": "tempest-TestStampPattern-1445459710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "519723b99af84d1b85c40cfbc6518d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9993f68e-4c", "ovs_interfaceid": "9993f68e-4ceb-4974-9224-2fd3866899ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:11:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-69f7cdf8-2417-4e87-86e3-fd3d7a08277a req-300d5b38-18cc-477c-8ad5-b66b2ded1489 service nova] Releasing lock "refresh_cache-d0df1b67-aab1-4a27-9ef9-00e02a5dfca5" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:11:34 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Instance destroyed successfully.
Jul 29 15:11:34 user nova-compute[70924]: DEBUG nova.objects.instance [None req-e7ef35fd-f784-4479-a703-1c950cbb8a99 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Lazy-loading 'resources' on Instance uuid d0df1b67-aab1-4a27-9ef9-00e02a5dfca5 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:11:34 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-e7ef35fd-f784-4479-a703-1c950cbb8a99 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T15:08:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-899471333',display_name='tempest-TestStampPattern-server-899471333',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-899471333',id=46,image_ref='ddd07860-4952-40c2-863c-244e50f8dd39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP9wXXmEpUxSy6sCiiBCVPvhbmxDt3THRKq326W9UvO9W3eISERvSp0FREjZ8D+cDQ7iUcDk1NqJBkukyTT0dSSBRCZHyMnPGsYsEUkqKHShLvimsa51y3TpE3TWdx039g==',key_name='tempest-TestStampPattern-68763195',keypairs=<?>,launch_index=0,launched_at=2023-07-29T15:08:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='519723b99af84d1b85c40cfbc6518d35',ramdisk_id='',reservation_id='r-7sixtjbd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='0a8fe938-7ca4-4221-9742-9b043050ba84',image_min_disk='1',image_min_ram='0',image_owner_id='519723b99af84d1b85c40cfbc6518d35',image_owner_project_name='tempest-TestStampPattern-92673023',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-92673023-project-member',image_user_id='0bab72756da045ccbe725c6ed42df481',owner_project_name='tempest-TestStampPattern-92673023',owner_user_name='tempest-TestStampPattern-92673023-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T15:08:46Z,user_data=None,user_id='0bab72756da045ccbe725c6ed42df481',uuid=d0df1b67-aab1-4a27-9ef9-00e02a5dfca5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9993f68e-4ceb-4974-9224-2fd3866899ce", "address": "fa:16:3e:eb:3b:0c", "network": {"id": "24b90c74-6ebe-42f0-b11f-fc2b23b35188", "bridge": "br-int", "label": "tempest-TestStampPattern-1445459710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "519723b99af84d1b85c40cfbc6518d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9993f68e-4c", "ovs_interfaceid": "9993f68e-4ceb-4974-9224-2fd3866899ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 15:11:34 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-e7ef35fd-f784-4479-a703-1c950cbb8a99 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Converting VIF {"id": "9993f68e-4ceb-4974-9224-2fd3866899ce", "address": "fa:16:3e:eb:3b:0c", "network": {"id": "24b90c74-6ebe-42f0-b11f-fc2b23b35188", "bridge": "br-int", "label": "tempest-TestStampPattern-1445459710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "519723b99af84d1b85c40cfbc6518d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9993f68e-4c", "ovs_interfaceid": "9993f68e-4ceb-4974-9224-2fd3866899ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 15:11:34 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-e7ef35fd-f784-4479-a703-1c950cbb8a99 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:eb:3b:0c,bridge_name='br-int',has_traffic_filtering=True,id=9993f68e-4ceb-4974-9224-2fd3866899ce,network=Network(24b90c74-6ebe-42f0-b11f-fc2b23b35188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9993f68e-4c') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 15:11:34 user nova-compute[70924]: DEBUG os_vif [None req-e7ef35fd-f784-4479-a703-1c950cbb8a99 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:3b:0c,bridge_name='br-int',has_traffic_filtering=True,id=9993f68e-4ceb-4974-9224-2fd3866899ce,network=Network(24b90c74-6ebe-42f0-b11f-fc2b23b35188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9993f68e-4c') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 15:11:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:11:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9993f68e-4c, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:11:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:11:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:11:34 user nova-compute[70924]: INFO os_vif [None req-e7ef35fd-f784-4479-a703-1c950cbb8a99 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:3b:0c,bridge_name='br-int',has_traffic_filtering=True,id=9993f68e-4ceb-4974-9224-2fd3866899ce,network=Network(24b90c74-6ebe-42f0-b11f-fc2b23b35188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9993f68e-4c')
Jul 29 15:11:34 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-e7ef35fd-f784-4479-a703-1c950cbb8a99 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Deleting instance files /opt/stack/data/nova/instances/d0df1b67-aab1-4a27-9ef9-00e02a5dfca5_del
Jul 29 15:11:34 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-e7ef35fd-f784-4479-a703-1c950cbb8a99 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Deletion of /opt/stack/data/nova/instances/d0df1b67-aab1-4a27-9ef9-00e02a5dfca5_del complete
Jul 29 15:11:34 user nova-compute[70924]: INFO nova.compute.manager [None req-e7ef35fd-f784-4479-a703-1c950cbb8a99 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Took 0.85 seconds to destroy the instance on the hypervisor.
Jul 29 15:11:34 user nova-compute[70924]: DEBUG oslo.service.loopingcall [None req-e7ef35fd-f784-4479-a703-1c950cbb8a99 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70924) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 15:11:34 user nova-compute[70924]: DEBUG nova.compute.manager [-] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Deallocating network for instance {{(pid=70924) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 15:11:34 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] deallocate_for_instance() {{(pid=70924) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 15:11:35 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:11:35 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Took 0.45 seconds to deallocate network for instance.
Jul 29 15:11:35 user nova-compute[70924]: DEBUG nova.compute.manager [req-f74ffbf6-cd4f-4e76-a34f-d87b0cf1c508 req-bd9f39b9-5f32-4a24-8930-53cb15eeeb6b service nova] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Received event network-vif-deleted-9993f68e-4ceb-4974-9224-2fd3866899ce {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:11:35 user nova-compute[70924]: INFO nova.compute.manager [req-f74ffbf6-cd4f-4e76-a34f-d87b0cf1c508 req-bd9f39b9-5f32-4a24-8930-53cb15eeeb6b service nova] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Neutron deleted interface 9993f68e-4ceb-4974-9224-2fd3866899ce; detaching it from the instance and deleting it from the info cache
Jul 29 15:11:35 user nova-compute[70924]: DEBUG nova.network.neutron [req-f74ffbf6-cd4f-4e76-a34f-d87b0cf1c508 req-bd9f39b9-5f32-4a24-8930-53cb15eeeb6b service nova] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:11:35 user nova-compute[70924]: DEBUG nova.compute.manager [req-f74ffbf6-cd4f-4e76-a34f-d87b0cf1c508 req-bd9f39b9-5f32-4a24-8930-53cb15eeeb6b service nova] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Detach interface failed, port_id=9993f68e-4ceb-4974-9224-2fd3866899ce, reason: Instance d0df1b67-aab1-4a27-9ef9-00e02a5dfca5 could not be found. {{(pid=70924) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 29 15:11:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-e7ef35fd-f784-4479-a703-1c950cbb8a99 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:11:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-e7ef35fd-f784-4479-a703-1c950cbb8a99 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:11:35 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-e7ef35fd-f784-4479-a703-1c950cbb8a99 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:11:35 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-e7ef35fd-f784-4479-a703-1c950cbb8a99 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:11:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-e7ef35fd-f784-4479-a703-1c950cbb8a99 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.205s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:11:35 user nova-compute[70924]: INFO nova.scheduler.client.report [None req-e7ef35fd-f784-4479-a703-1c950cbb8a99 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Deleted allocations for instance d0df1b67-aab1-4a27-9ef9-00e02a5dfca5
Jul 29 15:11:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-e7ef35fd-f784-4479-a703-1c950cbb8a99 tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Lock "d0df1b67-aab1-4a27-9ef9-00e02a5dfca5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.691s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:11:36 user nova-compute[70924]: DEBUG nova.compute.manager [req-8bb56f43-99b4-4958-8512-590b3931d231 req-b8e9bf58-f354-4b1c-ad53-eded98d0e784 service nova] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Received event network-vif-plugged-9993f68e-4ceb-4974-9224-2fd3866899ce {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:11:36 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-8bb56f43-99b4-4958-8512-590b3931d231 req-b8e9bf58-f354-4b1c-ad53-eded98d0e784 service nova] Acquiring lock "d0df1b67-aab1-4a27-9ef9-00e02a5dfca5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:11:36 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-8bb56f43-99b4-4958-8512-590b3931d231 req-b8e9bf58-f354-4b1c-ad53-eded98d0e784 service nova] Lock "d0df1b67-aab1-4a27-9ef9-00e02a5dfca5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:11:36 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-8bb56f43-99b4-4958-8512-590b3931d231 req-b8e9bf58-f354-4b1c-ad53-eded98d0e784 service nova] Lock "d0df1b67-aab1-4a27-9ef9-00e02a5dfca5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:11:36 user nova-compute[70924]: DEBUG nova.compute.manager [req-8bb56f43-99b4-4958-8512-590b3931d231 req-b8e9bf58-f354-4b1c-ad53-eded98d0e784 service nova] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] No waiting events found dispatching network-vif-plugged-9993f68e-4ceb-4974-9224-2fd3866899ce {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:11:36 user nova-compute[70924]: WARNING nova.compute.manager [req-8bb56f43-99b4-4958-8512-590b3931d231 req-b8e9bf58-f354-4b1c-ad53-eded98d0e784 service nova] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Received unexpected event network-vif-plugged-9993f68e-4ceb-4974-9224-2fd3866899ce for instance with vm_state deleted and task_state None.
Jul 29 15:11:39 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:11:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:11:49 user nova-compute[70924]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690643494.6928594, d0df1b67-aab1-4a27-9ef9-00e02a5dfca5 => Stopped> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 15:11:49 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] VM Stopped (Lifecycle Event)
Jul 29 15:11:49 user nova-compute[70924]: DEBUG nova.compute.manager [None req-dbb17be1-7aa9-4294-8984-e9763828a24e None None] [instance: d0df1b67-aab1-4a27-9ef9-00e02a5dfca5] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:11:49 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:11:54 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:11:57 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-21a815ca-cd46-487a-8aa0-94b61be6fcf4 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Acquiring lock "fc2c25cc-9d79-45a2-9d50-862b7592f7f7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:11:57 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-21a815ca-cd46-487a-8aa0-94b61be6fcf4 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "fc2c25cc-9d79-45a2-9d50-862b7592f7f7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:11:57 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-21a815ca-cd46-487a-8aa0-94b61be6fcf4 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Acquiring lock "fc2c25cc-9d79-45a2-9d50-862b7592f7f7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:11:57 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-21a815ca-cd46-487a-8aa0-94b61be6fcf4 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "fc2c25cc-9d79-45a2-9d50-862b7592f7f7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:11:57 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-21a815ca-cd46-487a-8aa0-94b61be6fcf4 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "fc2c25cc-9d79-45a2-9d50-862b7592f7f7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:11:57 user nova-compute[70924]: INFO nova.compute.manager [None req-21a815ca-cd46-487a-8aa0-94b61be6fcf4 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] Terminating instance
Jul 29 15:11:57 user nova-compute[70924]: DEBUG nova.compute.manager [None req-21a815ca-cd46-487a-8aa0-94b61be6fcf4 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] Start destroying the instance on the hypervisor. {{(pid=70924) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 15:11:57 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:11:57 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:11:57 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:11:57 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:11:57 user nova-compute[70924]: DEBUG nova.compute.manager [req-fc5f5886-0de0-4e0c-8a32-e2f1584c5d61 req-39195601-f83b-4bd6-8356-d2d46fb2ab41 service nova] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] Received event network-vif-unplugged-4216c4cd-08b6-4e6f-a4f8-9b34c2b42756 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:11:57 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-fc5f5886-0de0-4e0c-8a32-e2f1584c5d61 req-39195601-f83b-4bd6-8356-d2d46fb2ab41 service nova] Acquiring lock "fc2c25cc-9d79-45a2-9d50-862b7592f7f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:11:57 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-fc5f5886-0de0-4e0c-8a32-e2f1584c5d61 req-39195601-f83b-4bd6-8356-d2d46fb2ab41 service nova] Lock "fc2c25cc-9d79-45a2-9d50-862b7592f7f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:11:57 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-fc5f5886-0de0-4e0c-8a32-e2f1584c5d61 req-39195601-f83b-4bd6-8356-d2d46fb2ab41 service nova] Lock "fc2c25cc-9d79-45a2-9d50-862b7592f7f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:11:57 user nova-compute[70924]: DEBUG nova.compute.manager [req-fc5f5886-0de0-4e0c-8a32-e2f1584c5d61 req-39195601-f83b-4bd6-8356-d2d46fb2ab41 service nova] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] No waiting events found dispatching network-vif-unplugged-4216c4cd-08b6-4e6f-a4f8-9b34c2b42756 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:11:57 user nova-compute[70924]: DEBUG nova.compute.manager [req-fc5f5886-0de0-4e0c-8a32-e2f1584c5d61 req-39195601-f83b-4bd6-8356-d2d46fb2ab41 service nova] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] Received event network-vif-unplugged-4216c4cd-08b6-4e6f-a4f8-9b34c2b42756 for instance with task_state deleting. {{(pid=70924) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 15:11:58 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] Instance destroyed successfully.
Jul 29 15:11:58 user nova-compute[70924]: DEBUG nova.objects.instance [None req-21a815ca-cd46-487a-8aa0-94b61be6fcf4 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lazy-loading 'resources' on Instance uuid fc2c25cc-9d79-45a2-9d50-862b7592f7f7 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:11:58 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-21a815ca-cd46-487a-8aa0-94b61be6fcf4 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T15:09:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-189645111',display_name='tempest-AttachVolumeNegativeTest-server-189645111',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-189645111',id=47,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpyJkk17R9ToaiZTlPTLuCE4oval1DrBbefLqdKXR4x91mJT/GIXisv97ul11yogu6qVJ9CihjcmkNXyKQsx5OkK7a5HaMkDvAvtb/myOim31HBd7+9lawbcSTd2NCNnQ==',key_name='tempest-keypair-60654091',keypairs=<?>,launch_index=0,launched_at=2023-07-29T15:09:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9aadc9385b3b46eebc6e0d81814521af',ramdisk_id='',reservation_id='r-n2bomhip',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-972203101',owner_user_name='tempest-AttachVolumeNegativeTest-972203101-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T15:09:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='12cb8299e4d24946bc41a86493f4b426',uuid=fc2c25cc-9d79-45a2-9d50-862b7592f7f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4216c4cd-08b6-4e6f-a4f8-9b34c2b42756", "address": "fa:16:3e:6e:a3:e0", "network": {"id": "f80826fa-fada-45b9-b969-fd539fd34fd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-465377443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9aadc9385b3b46eebc6e0d81814521af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4216c4cd-08", "ovs_interfaceid": "4216c4cd-08b6-4e6f-a4f8-9b34c2b42756", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 15:11:58 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-21a815ca-cd46-487a-8aa0-94b61be6fcf4 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Converting VIF {"id": "4216c4cd-08b6-4e6f-a4f8-9b34c2b42756", "address": "fa:16:3e:6e:a3:e0", "network": {"id": "f80826fa-fada-45b9-b969-fd539fd34fd3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-465377443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9aadc9385b3b46eebc6e0d81814521af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4216c4cd-08", "ovs_interfaceid": "4216c4cd-08b6-4e6f-a4f8-9b34c2b42756", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 15:11:58 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-21a815ca-cd46-487a-8aa0-94b61be6fcf4 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:a3:e0,bridge_name='br-int',has_traffic_filtering=True,id=4216c4cd-08b6-4e6f-a4f8-9b34c2b42756,network=Network(f80826fa-fada-45b9-b969-fd539fd34fd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4216c4cd-08') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 15:11:58 user nova-compute[70924]: DEBUG os_vif [None req-21a815ca-cd46-487a-8aa0-94b61be6fcf4 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:a3:e0,bridge_name='br-int',has_traffic_filtering=True,id=4216c4cd-08b6-4e6f-a4f8-9b34c2b42756,network=Network(f80826fa-fada-45b9-b969-fd539fd34fd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4216c4cd-08') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 15:11:58 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:11:58 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4216c4cd-08, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:11:58 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:11:58 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:11:58 user nova-compute[70924]: INFO os_vif [None req-21a815ca-cd46-487a-8aa0-94b61be6fcf4 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:a3:e0,bridge_name='br-int',has_traffic_filtering=True,id=4216c4cd-08b6-4e6f-a4f8-9b34c2b42756,network=Network(f80826fa-fada-45b9-b969-fd539fd34fd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4216c4cd-08')
Jul 29 15:11:58 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-21a815ca-cd46-487a-8aa0-94b61be6fcf4 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] Deleting instance files /opt/stack/data/nova/instances/fc2c25cc-9d79-45a2-9d50-862b7592f7f7_del
Jul 29 15:11:58 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-21a815ca-cd46-487a-8aa0-94b61be6fcf4 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] Deletion of /opt/stack/data/nova/instances/fc2c25cc-9d79-45a2-9d50-862b7592f7f7_del complete
Jul 29 15:11:58 user nova-compute[70924]: INFO nova.compute.manager [None req-21a815ca-cd46-487a-8aa0-94b61be6fcf4 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] Took 0.84 seconds to destroy the instance on the hypervisor.
Jul 29 15:11:58 user nova-compute[70924]: DEBUG oslo.service.loopingcall [None req-21a815ca-cd46-487a-8aa0-94b61be6fcf4 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70924) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 15:11:58 user nova-compute[70924]: DEBUG nova.compute.manager [-] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] Deallocating network for instance {{(pid=70924) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 15:11:58 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] deallocate_for_instance() {{(pid=70924) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 15:11:58 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-c9a38d06-0cdd-4372-aea6-e968367a45d5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Acquiring lock "5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:11:58 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-c9a38d06-0cdd-4372-aea6-e968367a45d5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Lock "5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:11:58 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-c9a38d06-0cdd-4372-aea6-e968367a45d5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Acquiring lock "5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:11:58 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-c9a38d06-0cdd-4372-aea6-e968367a45d5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Lock "5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:11:58 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-c9a38d06-0cdd-4372-aea6-e968367a45d5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Lock "5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:11:58 user nova-compute[70924]: INFO nova.compute.manager [None req-c9a38d06-0cdd-4372-aea6-e968367a45d5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Terminating instance
Jul 29 15:11:58 user nova-compute[70924]: DEBUG nova.compute.manager [None req-c9a38d06-0cdd-4372-aea6-e968367a45d5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Start destroying the instance on the hypervisor. {{(pid=70924) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 15:11:58 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:11:58 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:11:58 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:11:58 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:11:59 user nova-compute[70924]: DEBUG nova.compute.manager [req-a0302ba8-4285-46cf-8337-9788f8e3c1de req-b62a8c6d-13de-43b3-9203-caf1fa7da957 service nova] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Received event network-vif-unplugged-6a119205-17da-4214-a6dc-6d19712e40f8 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:11:59 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a0302ba8-4285-46cf-8337-9788f8e3c1de req-b62a8c6d-13de-43b3-9203-caf1fa7da957 service nova] Acquiring lock "5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:11:59 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a0302ba8-4285-46cf-8337-9788f8e3c1de req-b62a8c6d-13de-43b3-9203-caf1fa7da957 service nova] Lock "5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:11:59 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a0302ba8-4285-46cf-8337-9788f8e3c1de req-b62a8c6d-13de-43b3-9203-caf1fa7da957 service nova] Lock "5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:11:59 user nova-compute[70924]: DEBUG nova.compute.manager [req-a0302ba8-4285-46cf-8337-9788f8e3c1de req-b62a8c6d-13de-43b3-9203-caf1fa7da957 service nova] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] No waiting events found dispatching network-vif-unplugged-6a119205-17da-4214-a6dc-6d19712e40f8 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:11:59 user nova-compute[70924]: DEBUG nova.compute.manager [req-a0302ba8-4285-46cf-8337-9788f8e3c1de req-b62a8c6d-13de-43b3-9203-caf1fa7da957 service nova] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Received event network-vif-unplugged-6a119205-17da-4214-a6dc-6d19712e40f8 for instance with task_state deleting. {{(pid=70924) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 15:11:59 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:11:59 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] Took 1.13 seconds to deallocate network for instance.
Jul 29 15:11:59 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-21a815ca-cd46-487a-8aa0-94b61be6fcf4 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:11:59 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-21a815ca-cd46-487a-8aa0-94b61be6fcf4 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:11:59 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Instance destroyed successfully.
Jul 29 15:11:59 user nova-compute[70924]: DEBUG nova.objects.instance [None req-c9a38d06-0cdd-4372-aea6-e968367a45d5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Lazy-loading 'resources' on Instance uuid 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:11:59 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-c9a38d06-0cdd-4372-aea6-e968367a45d5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T15:08:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2010148558',display_name='tempest-TestServerVolumeAttachmentScenario-server-2010148558',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-2010148558',id=45,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLt99YqumusuTAjRBX9WbVgyzUc6lRH7yHU9R7lt65UH/4XS6rVqP5GqU01p7p153P9jMphLDkXYlmIKEfXbxr+QTGOcUcPHeWTZMYn5Vya2yRTPclYaHBG3soqiqvzGwA==',key_name='tempest-keypair-1890991636',keypairs=<?>,launch_index=0,launched_at=2023-07-29T15:08:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='40fb0f2b05f34e648ae30bc15758df66',ramdisk_id='',reservation_id='r-0xmwjqy0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1208562195',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1208562195-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T15:08:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5bbd4e5383b45539992fc66c28c11f7',uuid=5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6a119205-17da-4214-a6dc-6d19712e40f8", "address": "fa:16:3e:31:4f:9d", "network": {"id": "10f0e77e-05d5-4c59-972d-60af9bc958b2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-887718488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40fb0f2b05f34e648ae30bc15758df66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a119205-17", "ovs_interfaceid": "6a119205-17da-4214-a6dc-6d19712e40f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 15:11:59 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-c9a38d06-0cdd-4372-aea6-e968367a45d5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Converting VIF {"id": "6a119205-17da-4214-a6dc-6d19712e40f8", "address": "fa:16:3e:31:4f:9d", "network": {"id": "10f0e77e-05d5-4c59-972d-60af9bc958b2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-887718488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40fb0f2b05f34e648ae30bc15758df66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a119205-17", "ovs_interfaceid": "6a119205-17da-4214-a6dc-6d19712e40f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 15:11:59 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-c9a38d06-0cdd-4372-aea6-e968367a45d5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:4f:9d,bridge_name='br-int',has_traffic_filtering=True,id=6a119205-17da-4214-a6dc-6d19712e40f8,network=Network(10f0e77e-05d5-4c59-972d-60af9bc958b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a119205-17') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 15:11:59 user nova-compute[70924]: DEBUG os_vif [None req-c9a38d06-0cdd-4372-aea6-e968367a45d5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:4f:9d,bridge_name='br-int',has_traffic_filtering=True,id=6a119205-17da-4214-a6dc-6d19712e40f8,network=Network(10f0e77e-05d5-4c59-972d-60af9bc958b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a119205-17') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 15:11:59 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:11:59 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6a119205-17, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:11:59 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:11:59 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:11:59 user nova-compute[70924]: INFO os_vif [None req-c9a38d06-0cdd-4372-aea6-e968367a45d5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:4f:9d,bridge_name='br-int',has_traffic_filtering=True,id=6a119205-17da-4214-a6dc-6d19712e40f8,network=Network(10f0e77e-05d5-4c59-972d-60af9bc958b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a119205-17')
Jul 29 15:11:59 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-c9a38d06-0cdd-4372-aea6-e968367a45d5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Deleting instance files /opt/stack/data/nova/instances/5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9_del
Jul 29 15:11:59 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-c9a38d06-0cdd-4372-aea6-e968367a45d5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Deletion of /opt/stack/data/nova/instances/5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9_del complete
Jul 29 15:11:59 user nova-compute[70924]: INFO nova.compute.manager [None req-c9a38d06-0cdd-4372-aea6-e968367a45d5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Took 0.85 seconds to destroy the instance on the hypervisor.
Jul 29 15:11:59 user nova-compute[70924]: DEBUG oslo.service.loopingcall [None req-c9a38d06-0cdd-4372-aea6-e968367a45d5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70924) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 15:11:59 user nova-compute[70924]: DEBUG nova.compute.manager [-] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Deallocating network for instance {{(pid=70924) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 15:11:59 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] deallocate_for_instance() {{(pid=70924) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 15:11:59 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-21a815ca-cd46-487a-8aa0-94b61be6fcf4 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:11:59 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-21a815ca-cd46-487a-8aa0-94b61be6fcf4 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:11:59 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-21a815ca-cd46-487a-8aa0-94b61be6fcf4 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.176s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:11:59 user nova-compute[70924]: INFO nova.scheduler.client.report [None req-21a815ca-cd46-487a-8aa0-94b61be6fcf4 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Deleted allocations for instance fc2c25cc-9d79-45a2-9d50-862b7592f7f7
Jul 29 15:11:59 user nova-compute[70924]: DEBUG nova.compute.manager [req-3cce5507-f170-42c6-925a-a7f983ba31a3 req-00449eb4-b07c-4271-b153-4d0450492f9d service nova] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] Received event network-vif-plugged-4216c4cd-08b6-4e6f-a4f8-9b34c2b42756 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:11:59 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-3cce5507-f170-42c6-925a-a7f983ba31a3 req-00449eb4-b07c-4271-b153-4d0450492f9d service nova] Acquiring lock "fc2c25cc-9d79-45a2-9d50-862b7592f7f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:11:59 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-3cce5507-f170-42c6-925a-a7f983ba31a3 req-00449eb4-b07c-4271-b153-4d0450492f9d service nova] Lock "fc2c25cc-9d79-45a2-9d50-862b7592f7f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:11:59 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-3cce5507-f170-42c6-925a-a7f983ba31a3 req-00449eb4-b07c-4271-b153-4d0450492f9d service nova] Lock "fc2c25cc-9d79-45a2-9d50-862b7592f7f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:11:59 user nova-compute[70924]: DEBUG nova.compute.manager [req-3cce5507-f170-42c6-925a-a7f983ba31a3 req-00449eb4-b07c-4271-b153-4d0450492f9d service nova] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] No waiting events found dispatching network-vif-plugged-4216c4cd-08b6-4e6f-a4f8-9b34c2b42756 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:11:59 user nova-compute[70924]: WARNING nova.compute.manager [req-3cce5507-f170-42c6-925a-a7f983ba31a3 req-00449eb4-b07c-4271-b153-4d0450492f9d service nova] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] Received unexpected event network-vif-plugged-4216c4cd-08b6-4e6f-a4f8-9b34c2b42756 for instance with vm_state deleted and task_state None.
Jul 29 15:11:59 user nova-compute[70924]: DEBUG nova.compute.manager [req-3cce5507-f170-42c6-925a-a7f983ba31a3 req-00449eb4-b07c-4271-b153-4d0450492f9d service nova] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] Received event network-vif-deleted-4216c4cd-08b6-4e6f-a4f8-9b34c2b42756 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:11:59 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-21a815ca-cd46-487a-8aa0-94b61be6fcf4 tempest-AttachVolumeNegativeTest-972203101 tempest-AttachVolumeNegativeTest-972203101-project-member] Lock "fc2c25cc-9d79-45a2-9d50-862b7592f7f7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.383s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:12:00 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:12:00 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Took 1.06 seconds to deallocate network for instance.
Jul 29 15:12:00 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-c9a38d06-0cdd-4372-aea6-e968367a45d5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:12:00 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-c9a38d06-0cdd-4372-aea6-e968367a45d5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:12:00 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-c9a38d06-0cdd-4372-aea6-e968367a45d5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:12:00 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-c9a38d06-0cdd-4372-aea6-e968367a45d5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:12:00 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-c9a38d06-0cdd-4372-aea6-e968367a45d5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.171s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:12:01 user nova-compute[70924]: INFO nova.scheduler.client.report [None req-c9a38d06-0cdd-4372-aea6-e968367a45d5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Deleted allocations for instance 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9
Jul 29 15:12:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-c9a38d06-0cdd-4372-aea6-e968367a45d5 tempest-TestServerVolumeAttachmentScenario-1208562195 tempest-TestServerVolumeAttachmentScenario-1208562195-project-member] Lock "5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.283s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:12:01 user nova-compute[70924]: DEBUG nova.compute.manager [req-beadf308-339e-430b-9eb8-a56a3ce5eaef req-451994a4-c093-4e3c-938f-5fae0c286397 service nova] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Received event network-vif-plugged-6a119205-17da-4214-a6dc-6d19712e40f8 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:12:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-beadf308-339e-430b-9eb8-a56a3ce5eaef req-451994a4-c093-4e3c-938f-5fae0c286397 service nova] Acquiring lock "5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:12:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-beadf308-339e-430b-9eb8-a56a3ce5eaef req-451994a4-c093-4e3c-938f-5fae0c286397 service nova] Lock "5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:12:01 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-beadf308-339e-430b-9eb8-a56a3ce5eaef req-451994a4-c093-4e3c-938f-5fae0c286397 service nova] Lock "5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:12:01 user nova-compute[70924]: DEBUG nova.compute.manager [req-beadf308-339e-430b-9eb8-a56a3ce5eaef req-451994a4-c093-4e3c-938f-5fae0c286397 service nova] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] No waiting events found dispatching network-vif-plugged-6a119205-17da-4214-a6dc-6d19712e40f8 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:12:01 user nova-compute[70924]: WARNING nova.compute.manager [req-beadf308-339e-430b-9eb8-a56a3ce5eaef req-451994a4-c093-4e3c-938f-5fae0c286397 service nova] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Received unexpected event network-vif-plugged-6a119205-17da-4214-a6dc-6d19712e40f8 for instance with vm_state deleted and task_state None.
Jul 29 15:12:02 user nova-compute[70924]: DEBUG nova.compute.manager [req-e24b45a8-5020-4292-b99c-c6d8497b74b9 req-500b8908-6201-47e7-a08e-9c23d4d271b6 service nova] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Received event network-vif-deleted-6a119205-17da-4214-a6dc-6d19712e40f8 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:12:03 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:12:04 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:12:04 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Cleaning up deleted instances {{(pid=70924) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 29 15:12:04 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] There are 0 instances to clean {{(pid=70924) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 29 15:12:04 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:12:05 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:12:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:12:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:12:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70924) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 29 15:12:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70924) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 15:12:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70924) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 15:12:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:12:10 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:12:12 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:12:12 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:12:13 user nova-compute[70924]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690643518.2872088, fc2c25cc-9d79-45a2-9d50-862b7592f7f7 => Stopped> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 15:12:13 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] VM Stopped (Lifecycle Event)
Jul 29 15:12:13 user nova-compute[70924]: DEBUG nova.compute.manager [None req-3e2c5c0d-d092-4281-8035-5295948136d4 None None] [instance: fc2c25cc-9d79-45a2-9d50-862b7592f7f7] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:12:13 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:12:14 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:12:14 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:12:14 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:12:14 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:12:14 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Auditing locally available compute resources for user (node: user) {{(pid=70924) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 15:12:14 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 15:12:14 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a8fe938-7ca4-4221-9742-9b043050ba84/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:12:14 user nova-compute[70924]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690643519.5736709, 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9 => Stopped> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 15:12:14 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] VM Stopped (Lifecycle Event)
Jul 29 15:12:14 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:12:14 user nova-compute[70924]: DEBUG nova.compute.manager [None req-cf750cf2-5ca6-427d-871c-88571ea0c924 None None] [instance: 5e5b3c7d-d920-4fd1-a5d1-944cdf37c7e9] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:12:14 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a8fe938-7ca4-4221-9742-9b043050ba84/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:12:14 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a8fe938-7ca4-4221-9742-9b043050ba84/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:12:14 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a8fe938-7ca4-4221-9742-9b043050ba84/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:12:15 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:12:15 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:12:15 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Hypervisor/Node resource view: name=user free_ram=8556MB free_disk=25.188350677490234GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70924) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 15:12:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:12:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:12:15 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 0a8fe938-7ca4-4221-9742-9b043050ba84 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:12:15 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 758d9381-32af-4433-8366-9e0aa9699137 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:12:15 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 15:12:15 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 15:12:15 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:12:15 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:12:15 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Compute_service record updated for user:user {{(pid=70924) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 15:12:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.233s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:12:17 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:12:17 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Starting heal instance info cache {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 15:12:17 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Didn't find any instances for network info cache update. {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 29 15:12:17 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:12:17 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70924) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 15:12:19 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:12:20 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:12:24 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:12:29 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:12:29 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Cleaning up deleted instances with incomplete migration  {{(pid=70924) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 29 15:12:29 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:12:29 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:12:29 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70924) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 29 15:12:29 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70924) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 15:12:29 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70924) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 15:12:29 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:12:33 user nova-compute[70924]: DEBUG nova.compute.manager [req-abe78b64-13d3-4128-9623-94711bb9bd42 req-33c03a7d-0ed8-45ba-b16c-671fa49352b8 service nova] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Received event network-changed-590a32f6-52b6-4377-a140-0ff497ec1aad {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:12:33 user nova-compute[70924]: DEBUG nova.compute.manager [req-abe78b64-13d3-4128-9623-94711bb9bd42 req-33c03a7d-0ed8-45ba-b16c-671fa49352b8 service nova] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Refreshing instance network info cache due to event network-changed-590a32f6-52b6-4377-a140-0ff497ec1aad. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 15:12:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-abe78b64-13d3-4128-9623-94711bb9bd42 req-33c03a7d-0ed8-45ba-b16c-671fa49352b8 service nova] Acquiring lock "refresh_cache-758d9381-32af-4433-8366-9e0aa9699137" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:12:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-abe78b64-13d3-4128-9623-94711bb9bd42 req-33c03a7d-0ed8-45ba-b16c-671fa49352b8 service nova] Acquired lock "refresh_cache-758d9381-32af-4433-8366-9e0aa9699137" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:12:33 user nova-compute[70924]: DEBUG nova.network.neutron [req-abe78b64-13d3-4128-9623-94711bb9bd42 req-33c03a7d-0ed8-45ba-b16c-671fa49352b8 service nova] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Refreshing network info cache for port 590a32f6-52b6-4377-a140-0ff497ec1aad {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 15:12:34 user nova-compute[70924]: DEBUG nova.network.neutron [req-abe78b64-13d3-4128-9623-94711bb9bd42 req-33c03a7d-0ed8-45ba-b16c-671fa49352b8 service nova] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Updated VIF entry in instance network info cache for port 590a32f6-52b6-4377-a140-0ff497ec1aad. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 15:12:34 user nova-compute[70924]: DEBUG nova.network.neutron [req-abe78b64-13d3-4128-9623-94711bb9bd42 req-33c03a7d-0ed8-45ba-b16c-671fa49352b8 service nova] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Updating instance_info_cache with network_info: [{"id": "590a32f6-52b6-4377-a140-0ff497ec1aad", "address": "fa:16:3e:5c:58:7f", "network": {"id": "c19ed38b-2acd-421a-9e4b-f60df3db2f1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1812407562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a974cbbf734f51897c3e632ae9e45f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap590a32f6-52", "ovs_interfaceid": "590a32f6-52b6-4377-a140-0ff497ec1aad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:12:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-abe78b64-13d3-4128-9623-94711bb9bd42 req-33c03a7d-0ed8-45ba-b16c-671fa49352b8 service nova] Releasing lock "refresh_cache-758d9381-32af-4433-8366-9e0aa9699137" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:12:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:12:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:12:37 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:12:37 user nova-compute[70924]: DEBUG nova.compute.manager [req-477ffb36-3efb-4651-a243-4b9b3c2469b1 req-7a8eb760-2931-46e6-8623-4246749af1ba service nova] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Received event network-changed-0f6e2258-37e5-4786-898b-d11796a410e7 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:12:37 user nova-compute[70924]: DEBUG nova.compute.manager [req-477ffb36-3efb-4651-a243-4b9b3c2469b1 req-7a8eb760-2931-46e6-8623-4246749af1ba service nova] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Refreshing instance network info cache due to event network-changed-0f6e2258-37e5-4786-898b-d11796a410e7. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 15:12:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-477ffb36-3efb-4651-a243-4b9b3c2469b1 req-7a8eb760-2931-46e6-8623-4246749af1ba service nova] Acquiring lock "refresh_cache-0a8fe938-7ca4-4221-9742-9b043050ba84" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:12:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-477ffb36-3efb-4651-a243-4b9b3c2469b1 req-7a8eb760-2931-46e6-8623-4246749af1ba service nova] Acquired lock "refresh_cache-0a8fe938-7ca4-4221-9742-9b043050ba84" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:12:37 user nova-compute[70924]: DEBUG nova.network.neutron [req-477ffb36-3efb-4651-a243-4b9b3c2469b1 req-7a8eb760-2931-46e6-8623-4246749af1ba service nova] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Refreshing network info cache for port 0f6e2258-37e5-4786-898b-d11796a410e7 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 15:12:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5730d118-0723-4b04-82d4-c588a3f4feec tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Acquiring lock "0a8fe938-7ca4-4221-9742-9b043050ba84" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:12:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5730d118-0723-4b04-82d4-c588a3f4feec tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Lock "0a8fe938-7ca4-4221-9742-9b043050ba84" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:12:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5730d118-0723-4b04-82d4-c588a3f4feec tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Acquiring lock "0a8fe938-7ca4-4221-9742-9b043050ba84-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:12:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5730d118-0723-4b04-82d4-c588a3f4feec tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Lock "0a8fe938-7ca4-4221-9742-9b043050ba84-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:12:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5730d118-0723-4b04-82d4-c588a3f4feec tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Lock "0a8fe938-7ca4-4221-9742-9b043050ba84-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:12:37 user nova-compute[70924]: INFO nova.compute.manager [None req-5730d118-0723-4b04-82d4-c588a3f4feec tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Terminating instance
Jul 29 15:12:37 user nova-compute[70924]: DEBUG nova.compute.manager [None req-5730d118-0723-4b04-82d4-c588a3f4feec tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Start destroying the instance on the hypervisor. {{(pid=70924) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 15:12:37 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:12:37 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:12:37 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:12:37 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:12:37 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:12:37 user nova-compute[70924]: DEBUG nova.compute.manager [req-dbf71df8-6ac3-43c4-9c2c-c8480ba657db req-5684e933-9e57-4bb1-8394-e60e3dac06df service nova] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Received event network-vif-unplugged-0f6e2258-37e5-4786-898b-d11796a410e7 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:12:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-dbf71df8-6ac3-43c4-9c2c-c8480ba657db req-5684e933-9e57-4bb1-8394-e60e3dac06df service nova] Acquiring lock "0a8fe938-7ca4-4221-9742-9b043050ba84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:12:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-dbf71df8-6ac3-43c4-9c2c-c8480ba657db req-5684e933-9e57-4bb1-8394-e60e3dac06df service nova] Lock "0a8fe938-7ca4-4221-9742-9b043050ba84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:12:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-dbf71df8-6ac3-43c4-9c2c-c8480ba657db req-5684e933-9e57-4bb1-8394-e60e3dac06df service nova] Lock "0a8fe938-7ca4-4221-9742-9b043050ba84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:12:37 user nova-compute[70924]: DEBUG nova.compute.manager [req-dbf71df8-6ac3-43c4-9c2c-c8480ba657db req-5684e933-9e57-4bb1-8394-e60e3dac06df service nova] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] No waiting events found dispatching network-vif-unplugged-0f6e2258-37e5-4786-898b-d11796a410e7 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:12:37 user nova-compute[70924]: DEBUG nova.compute.manager [req-dbf71df8-6ac3-43c4-9c2c-c8480ba657db req-5684e933-9e57-4bb1-8394-e60e3dac06df service nova] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Received event network-vif-unplugged-0f6e2258-37e5-4786-898b-d11796a410e7 for instance with task_state deleting. {{(pid=70924) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 15:12:38 user nova-compute[70924]: DEBUG nova.network.neutron [req-477ffb36-3efb-4651-a243-4b9b3c2469b1 req-7a8eb760-2931-46e6-8623-4246749af1ba service nova] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Updated VIF entry in instance network info cache for port 0f6e2258-37e5-4786-898b-d11796a410e7. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 15:12:38 user nova-compute[70924]: DEBUG nova.network.neutron [req-477ffb36-3efb-4651-a243-4b9b3c2469b1 req-7a8eb760-2931-46e6-8623-4246749af1ba service nova] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Updating instance_info_cache with network_info: [{"id": "0f6e2258-37e5-4786-898b-d11796a410e7", "address": "fa:16:3e:0c:50:9c", "network": {"id": "24b90c74-6ebe-42f0-b11f-fc2b23b35188", "bridge": "br-int", "label": "tempest-TestStampPattern-1445459710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "519723b99af84d1b85c40cfbc6518d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f6e2258-37", "ovs_interfaceid": "0f6e2258-37e5-4786-898b-d11796a410e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:12:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-477ffb36-3efb-4651-a243-4b9b3c2469b1 req-7a8eb760-2931-46e6-8623-4246749af1ba service nova] Releasing lock "refresh_cache-0a8fe938-7ca4-4221-9742-9b043050ba84" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:12:38 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:12:38 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Instance destroyed successfully.
Jul 29 15:12:38 user nova-compute[70924]: DEBUG nova.objects.instance [None req-5730d118-0723-4b04-82d4-c588a3f4feec tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Lazy-loading 'resources' on Instance uuid 0a8fe938-7ca4-4221-9742-9b043050ba84 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:12:38 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-5730d118-0723-4b04-82d4-c588a3f4feec tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T15:05:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1498343891',display_name='tempest-TestStampPattern-server-1498343891',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1498343891',id=43,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP9wXXmEpUxSy6sCiiBCVPvhbmxDt3THRKq326W9UvO9W3eISERvSp0FREjZ8D+cDQ7iUcDk1NqJBkukyTT0dSSBRCZHyMnPGsYsEUkqKHShLvimsa51y3TpE3TWdx039g==',key_name='tempest-TestStampPattern-68763195',keypairs=<?>,launch_index=0,launched_at=2023-07-29T15:05:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='519723b99af84d1b85c40cfbc6518d35',ramdisk_id='',reservation_id='r-z56ldml2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-92673023',owner_user_name='tempest-TestStampPattern-92673023-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T15:08:37Z,user_data=None,user_id='0bab72756da045ccbe725c6ed42df481',uuid=0a8fe938-7ca4-4221-9742-9b043050ba84,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0f6e2258-37e5-4786-898b-d11796a410e7", "address": "fa:16:3e:0c:50:9c", "network": {"id": "24b90c74-6ebe-42f0-b11f-fc2b23b35188", "bridge": "br-int", "label": "tempest-TestStampPattern-1445459710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "519723b99af84d1b85c40cfbc6518d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f6e2258-37", "ovs_interfaceid": "0f6e2258-37e5-4786-898b-d11796a410e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 15:12:38 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-5730d118-0723-4b04-82d4-c588a3f4feec tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Converting VIF {"id": "0f6e2258-37e5-4786-898b-d11796a410e7", "address": "fa:16:3e:0c:50:9c", "network": {"id": "24b90c74-6ebe-42f0-b11f-fc2b23b35188", "bridge": "br-int", "label": "tempest-TestStampPattern-1445459710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "519723b99af84d1b85c40cfbc6518d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f6e2258-37", "ovs_interfaceid": "0f6e2258-37e5-4786-898b-d11796a410e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 15:12:38 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-5730d118-0723-4b04-82d4-c588a3f4feec tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:50:9c,bridge_name='br-int',has_traffic_filtering=True,id=0f6e2258-37e5-4786-898b-d11796a410e7,network=Network(24b90c74-6ebe-42f0-b11f-fc2b23b35188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f6e2258-37') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 15:12:38 user nova-compute[70924]: DEBUG os_vif [None req-5730d118-0723-4b04-82d4-c588a3f4feec tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:50:9c,bridge_name='br-int',has_traffic_filtering=True,id=0f6e2258-37e5-4786-898b-d11796a410e7,network=Network(24b90c74-6ebe-42f0-b11f-fc2b23b35188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f6e2258-37') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 15:12:38 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:12:38 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0f6e2258-37, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:12:38 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:12:38 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:12:38 user nova-compute[70924]: INFO os_vif [None req-5730d118-0723-4b04-82d4-c588a3f4feec tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:50:9c,bridge_name='br-int',has_traffic_filtering=True,id=0f6e2258-37e5-4786-898b-d11796a410e7,network=Network(24b90c74-6ebe-42f0-b11f-fc2b23b35188),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f6e2258-37')
Jul 29 15:12:38 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-5730d118-0723-4b04-82d4-c588a3f4feec tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Deleting instance files /opt/stack/data/nova/instances/0a8fe938-7ca4-4221-9742-9b043050ba84_del
Jul 29 15:12:38 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-5730d118-0723-4b04-82d4-c588a3f4feec tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Deletion of /opt/stack/data/nova/instances/0a8fe938-7ca4-4221-9742-9b043050ba84_del complete
Jul 29 15:12:38 user nova-compute[70924]: INFO nova.compute.manager [None req-5730d118-0723-4b04-82d4-c588a3f4feec tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Took 0.86 seconds to destroy the instance on the hypervisor.
Jul 29 15:12:38 user nova-compute[70924]: DEBUG oslo.service.loopingcall [None req-5730d118-0723-4b04-82d4-c588a3f4feec tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70924) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 15:12:38 user nova-compute[70924]: DEBUG nova.compute.manager [-] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Deallocating network for instance {{(pid=70924) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 15:12:38 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] deallocate_for_instance() {{(pid=70924) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 15:12:38 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:12:38 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Took 0.54 seconds to deallocate network for instance.
Jul 29 15:12:39 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5730d118-0723-4b04-82d4-c588a3f4feec tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:12:39 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5730d118-0723-4b04-82d4-c588a3f4feec tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:12:39 user nova-compute[70924]: DEBUG nova.compute.manager [req-d36bd1ab-84cf-4132-958d-31df3283218e req-c1973558-5341-4447-8c37-01fb58207552 service nova] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Received event network-vif-deleted-0f6e2258-37e5-4786-898b-d11796a410e7 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:12:39 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-5730d118-0723-4b04-82d4-c588a3f4feec tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:12:39 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-5730d118-0723-4b04-82d4-c588a3f4feec tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:12:39 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5730d118-0723-4b04-82d4-c588a3f4feec tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.163s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:12:39 user nova-compute[70924]: INFO nova.scheduler.client.report [None req-5730d118-0723-4b04-82d4-c588a3f4feec tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Deleted allocations for instance 0a8fe938-7ca4-4221-9742-9b043050ba84
Jul 29 15:12:39 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-5730d118-0723-4b04-82d4-c588a3f4feec tempest-TestStampPattern-92673023 tempest-TestStampPattern-92673023-project-member] Lock "0a8fe938-7ca4-4221-9742-9b043050ba84" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.777s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:12:39 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:12:39 user nova-compute[70924]: DEBUG nova.compute.manager [req-5aa686c9-1f50-451e-8bca-37e7578d6800 req-4495aa48-8866-45e4-87db-9957b023d3a2 service nova] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Received event network-vif-plugged-0f6e2258-37e5-4786-898b-d11796a410e7 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:12:39 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-5aa686c9-1f50-451e-8bca-37e7578d6800 req-4495aa48-8866-45e4-87db-9957b023d3a2 service nova] Acquiring lock "0a8fe938-7ca4-4221-9742-9b043050ba84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:12:39 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-5aa686c9-1f50-451e-8bca-37e7578d6800 req-4495aa48-8866-45e4-87db-9957b023d3a2 service nova] Lock "0a8fe938-7ca4-4221-9742-9b043050ba84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:12:39 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-5aa686c9-1f50-451e-8bca-37e7578d6800 req-4495aa48-8866-45e4-87db-9957b023d3a2 service nova] Lock "0a8fe938-7ca4-4221-9742-9b043050ba84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:12:39 user nova-compute[70924]: DEBUG nova.compute.manager [req-5aa686c9-1f50-451e-8bca-37e7578d6800 req-4495aa48-8866-45e4-87db-9957b023d3a2 service nova] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] No waiting events found dispatching network-vif-plugged-0f6e2258-37e5-4786-898b-d11796a410e7 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:12:39 user nova-compute[70924]: WARNING nova.compute.manager [req-5aa686c9-1f50-451e-8bca-37e7578d6800 req-4495aa48-8866-45e4-87db-9957b023d3a2 service nova] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Received unexpected event network-vif-plugged-0f6e2258-37e5-4786-898b-d11796a410e7 for instance with vm_state deleted and task_state None.
Jul 29 15:12:42 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Acquiring lock "a1380b9d-f31a-4c49-8f1d-27d156e72f56" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:12:42 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "a1380b9d-f31a-4c49-8f1d-27d156e72f56" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:12:42 user nova-compute[70924]: DEBUG nova.compute.manager [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Starting instance... {{(pid=70924) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 15:12:42 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:12:42 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:12:42 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70924) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 15:12:42 user nova-compute[70924]: INFO nova.compute.claims [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Claim successful on node user
Jul 29 15:12:42 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:12:42 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:12:42 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.208s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:12:42 user nova-compute[70924]: DEBUG nova.compute.manager [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Start building networks asynchronously for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 15:12:42 user nova-compute[70924]: DEBUG nova.compute.manager [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Allocating IP information in the background. {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 15:12:42 user nova-compute[70924]: DEBUG nova.network.neutron [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] allocate_for_instance() {{(pid=70924) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 15:12:42 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 15:12:42 user nova-compute[70924]: DEBUG nova.compute.manager [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Start building block device mappings for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 15:12:42 user nova-compute[70924]: INFO nova.virt.block_device [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Booting with volume cb3e837e-7306-4f92-b641-dc081c379b85 at /dev/vda
Jul 29 15:12:42 user nova-compute[70924]: DEBUG nova.policy [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'da204646e8f84693ad470ed1d3eadd7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a974cbbf734f51897c3e632ae9e45f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70924) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 15:12:42 user nova-compute[70924]: DEBUG os_brick.utils [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 15:12:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:12:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:12:42 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c6bbcd-a2e8-477e-9347-08d5958c88ba]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f2127c4a30d9\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:12:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:12:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:12:42 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[684d7010-109c-4177-ac46-d4d859576b9d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:12:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:12:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:12:42 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2faada3f-d74a-4f6f-abfc-c68e6469b256]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:12:42 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3e973e-8790-4409-966e-cf35a3dbaaea]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:12:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Running cmd (subprocess): nvme version {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:12:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] 'nvme version' failed. Not Retrying. {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 15:12:42 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.nvmeof [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] nvme not present on system {{(pid=70924) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 15:12:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:12:42 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 15:12:42 user nova-compute[70924]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 15:12:42 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b72a30-292b-468e-a96a-5ed555c60c0d]: (4, '') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:12:42 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70924) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 15:12:42 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 15:12:42 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] LIGHTOS: no hostnqn found. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 15:12:42 user nova-compute[70924]: DEBUG os_brick.utils [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f2127c4a30d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 15:12:42 user nova-compute[70924]: DEBUG nova.virt.block_device [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Updating existing volume attachment record: 8c8ae79d-9bbf-4ea8-9a1f-ced6678e4ad6 {{(pid=70924) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 15:12:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:12:43 user nova-compute[70924]: DEBUG nova.network.neutron [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Successfully created port: 402a09b0-1130-4f4a-88d4-89668aa9386d {{(pid=70924) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 15:12:44 user nova-compute[70924]: DEBUG nova.network.neutron [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Successfully updated port: 402a09b0-1130-4f4a-88d4-89668aa9386d {{(pid=70924) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 15:12:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Acquiring lock "refresh_cache-a1380b9d-f31a-4c49-8f1d-27d156e72f56" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:12:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Acquired lock "refresh_cache-a1380b9d-f31a-4c49-8f1d-27d156e72f56" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:12:44 user nova-compute[70924]: DEBUG nova.network.neutron [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 15:12:44 user nova-compute[70924]: DEBUG nova.compute.manager [req-367c1928-c04f-4b19-b0a2-aa54d0c437b7 req-76b6afaa-1a1a-490a-aa8c-04524ca1bc36 service nova] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Received event network-changed-402a09b0-1130-4f4a-88d4-89668aa9386d {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:12:44 user nova-compute[70924]: DEBUG nova.compute.manager [req-367c1928-c04f-4b19-b0a2-aa54d0c437b7 req-76b6afaa-1a1a-490a-aa8c-04524ca1bc36 service nova] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Refreshing instance network info cache due to event network-changed-402a09b0-1130-4f4a-88d4-89668aa9386d. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 15:12:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-367c1928-c04f-4b19-b0a2-aa54d0c437b7 req-76b6afaa-1a1a-490a-aa8c-04524ca1bc36 service nova] Acquiring lock "refresh_cache-a1380b9d-f31a-4c49-8f1d-27d156e72f56" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:12:44 user nova-compute[70924]: DEBUG nova.network.neutron [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Instance cache missing network info. {{(pid=70924) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 15:12:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:12:44 user nova-compute[70924]: DEBUG nova.network.neutron [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Updating instance_info_cache with network_info: [{"id": "402a09b0-1130-4f4a-88d4-89668aa9386d", "address": "fa:16:3e:c6:38:ef", "network": {"id": "c19ed38b-2acd-421a-9e4b-f60df3db2f1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1812407562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a974cbbf734f51897c3e632ae9e45f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap402a09b0-11", "ovs_interfaceid": "402a09b0-1130-4f4a-88d4-89668aa9386d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:12:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Releasing lock "refresh_cache-a1380b9d-f31a-4c49-8f1d-27d156e72f56" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:12:44 user nova-compute[70924]: DEBUG nova.compute.manager [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Instance network_info: |[{"id": "402a09b0-1130-4f4a-88d4-89668aa9386d", "address": "fa:16:3e:c6:38:ef", "network": {"id": "c19ed38b-2acd-421a-9e4b-f60df3db2f1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1812407562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a974cbbf734f51897c3e632ae9e45f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap402a09b0-11", "ovs_interfaceid": "402a09b0-1130-4f4a-88d4-89668aa9386d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 15:12:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-367c1928-c04f-4b19-b0a2-aa54d0c437b7 req-76b6afaa-1a1a-490a-aa8c-04524ca1bc36 service nova] Acquired lock "refresh_cache-a1380b9d-f31a-4c49-8f1d-27d156e72f56" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:12:44 user nova-compute[70924]: DEBUG nova.network.neutron [req-367c1928-c04f-4b19-b0a2-aa54d0c437b7 req-76b6afaa-1a1a-490a-aa8c-04524ca1bc36 service nova] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Refreshing network info cache for port 402a09b0-1130-4f4a-88d4-89668aa9386d {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 15:12:44 user nova-compute[70924]: DEBUG nova.network.neutron [req-367c1928-c04f-4b19-b0a2-aa54d0c437b7 req-76b6afaa-1a1a-490a-aa8c-04524ca1bc36 service nova] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Updated VIF entry in instance network info cache for port 402a09b0-1130-4f4a-88d4-89668aa9386d. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 15:12:44 user nova-compute[70924]: DEBUG nova.network.neutron [req-367c1928-c04f-4b19-b0a2-aa54d0c437b7 req-76b6afaa-1a1a-490a-aa8c-04524ca1bc36 service nova] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Updating instance_info_cache with network_info: [{"id": "402a09b0-1130-4f4a-88d4-89668aa9386d", "address": "fa:16:3e:c6:38:ef", "network": {"id": "c19ed38b-2acd-421a-9e4b-f60df3db2f1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1812407562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a974cbbf734f51897c3e632ae9e45f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap402a09b0-11", "ovs_interfaceid": "402a09b0-1130-4f4a-88d4-89668aa9386d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:12:44 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-367c1928-c04f-4b19-b0a2-aa54d0c437b7 req-76b6afaa-1a1a-490a-aa8c-04524ca1bc36 service nova] Releasing lock "refresh_cache-a1380b9d-f31a-4c49-8f1d-27d156e72f56" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:12:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:12:49 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG nova.compute.manager [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Start spawning the instance on the hypervisor. {{(pid=70924) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Creating instance directory {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 15:12:50 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Creating image(s)
Jul 29 15:12:50 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Did not create local disks {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Ensure instance console log exists: /opt/stack/data/nova/instances/a1380b9d-f31a-4c49-8f1d-27d156e72f56/console.log {{(pid=70924) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Start _get_guest_xml network_info=[{"id": "402a09b0-1130-4f4a-88d4-89668aa9386d", "address": "fa:16:3e:c6:38:ef", "network": {"id": "c19ed38b-2acd-421a-9e4b-f60df3db2f1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1812407562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a974cbbf734f51897c3e632ae9e45f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap402a09b0-11", "ovs_interfaceid": "402a09b0-1130-4f4a-88d4-89668aa9386d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:cb3e837e-7306-4f92-b641-dc081c379b85'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fAJInTBh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a1380b9d-f31a-4c49-8f1d-27d156e72f56', 'attached_at': '', 'detached_at': '', 'volume_id': 'cb3e837e-7306-4f92-b641-dc081c379b85', 'serial': 'cb3e837e-7306-4f92-b641-dc081c379b85'}, 'attachment_id': '8c8ae79d-9bbf-4ea8-9a1f-ced6678e4ad6', 'volume_type': None} {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 15:12:50 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:12:50 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:12:50 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] CPU controller missing on host. {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] CPU controller found on host. {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70924) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T14:36:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Flavor limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Image limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Flavor pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Image pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Got 1 possible topologies {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Calling os-brick to attach iSCSI Volume {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cb3e837e-7306-4f92-b641-dc081c379b85'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fAJInTBh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 15:12:50 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 15:12:50 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 15:12:50 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 15:12:50 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb3e837e-7306-4f92-b641-dc081c379b85" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb3e837e-7306-4f92-b641-dc081c379b85" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 15:12:50 user nova-compute[70924]: INFO os_brick.initiator.connectors.iscsi [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 15:12:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb3e837e-7306-4f92-b641-dc081c379b85 -p 172.16.0.220:3260 {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb3e837e-7306-4f92-b641-dc081c379b85 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c2475b9-73ee-470a-9dd0-564c58b9f4c2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 15:12:50 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb3e837e-7306-4f92-b641-dc081c379b85 -p 172.16.0.220:3260 --interface default --op new {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb3e837e-7306-4f92-b641-dc081c379b85 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[72152a52-a8ab-431a-b605-9ba1569d636f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cb3e837e-7306-4f92-b641-dc081c379b85] added\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cb3e837e-7306-4f92-b641-dc081c379b85] added
Jul 29 15:12:50 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb3e837e-7306-4f92-b641-dc081c379b85 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb3e837e-7306-4f92-b641-dc081c379b85 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b802bd09-f6bc-4f4a-9ede-14a69ef2eacd]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb3e837e-7306-4f92-b641-dc081c379b85 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb3e837e-7306-4f92-b641-dc081c379b85 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[3572d3b0-15cd-46e2-a0db-84079ec69523]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb3e837e-7306-4f92-b641-dc081c379b85 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fAJInTBh {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb3e837e-7306-4f92-b641-dc081c379b85 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fAJInTBh" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26bf228-c069-4d5e-8839-43f81aa8831f]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fAJInTBh'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb3e837e-7306-4f92-b641-dc081c379b85 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb3e837e-7306-4f92-b641-dc081c379b85 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0366476-859c-4fca-a3a4-b4bf78027ecc]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a34629d-306a-4aa7-81be-b6c750070588]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 (non-flash)
Jul 29 15:12:50 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 (non-flash)
Jul 29 15:12:50 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb3e837e-7306-4f92-b641-dc081c379b85 -p 172.16.0.220:3260 --login {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb3e837e-7306-4f92-b641-dc081c379b85 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d668d75b-c169-48ae-88ae-59bfa5e6eaa2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cb3e837e-7306-4f92-b641-dc081c379b85, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cb3e837e-7306-4f92-b641-dc081c379b85, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cb3e837e-7306-4f92-b641-dc081c379b85, portal: 172.16.0.220,3260]
Jul 29 15:12:50 user nova-compute[70924]: Login to [iface: default, target: iqn.2010-10.org.openstack:cb3e837e-7306-4f92-b641-dc081c379b85, portal: 172.16.0.220,3260] successful.
Jul 29 15:12:50 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb3e837e-7306-4f92-b641-dc081c379b85 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb3e837e-7306-4f92-b641-dc081c379b85 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[68572f9b-08d3-434a-9958-c72c331ecfb0]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d15b08-f5d9-40cc-aeda-0af190c60cbf]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3e837e-7306-4f92-b641-dc081c379b85 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 (non-flash)
Jul 29 15:12:50 user nova-compute[70924]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3e837e-7306-4f92-b641-dc081c379b85 (non-flash)
Jul 29 15:12:50 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 (non-flash)
Jul 29 15:12:50 user nova-compute[70924]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3e837e-7306-4f92-b641-dc081c379b85 (non-flash)
Jul 29 15:12:50 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb3e837e-7306-4f92-b641-dc081c379b85" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Connected to 172.16.0.220:3260 {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=70924) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70924) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c718cf39-8a15-40d8-8d29-ef50bdf73aa3]: (4, ('- - 0', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 15:12:50 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fAJInTBh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 15:12:51 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 15:12:51 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '23331396436666465', 'path': '/dev/sdb'} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 15:12:51 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23331396436666465', 'path': '/dev/sdb'} {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 15:12:51 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T15:12:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-331958999',display_name='tempest-TestVolumeBootPattern-server-331958999',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-331958999',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ85EoxOcLUTgXe8luwDJdmSAuW16EOphuu0LzU/6Hdmcve8fH6stAD+XoS0+shU7N/jDe0exnSkgWjCon0Br/QYJqNqli+yWYkmG2icNLlmtzdYRBdyLvXLjiH1TkzZOA==',key_name='tempest-TestVolumeBootPattern-447927024',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99a974cbbf734f51897c3e632ae9e45f',ramdisk_id='',reservation_id='r-8t15ebc6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1030839740',owner_user_name='tempest-TestVolumeBootPattern-1030839740-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T15:12:43Z,user_data=None,user_id='da204646e8f84693ad470ed1d3eadd7c',uuid=a1380b9d-f31a-4c49-8f1d-27d156e72f56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "402a09b0-1130-4f4a-88d4-89668aa9386d", "address": "fa:16:3e:c6:38:ef", "network": {"id": "c19ed38b-2acd-421a-9e4b-f60df3db2f1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1812407562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a974cbbf734f51897c3e632ae9e45f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap402a09b0-11", "ovs_interfaceid": "402a09b0-1130-4f4a-88d4-89668aa9386d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 15:12:51 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Converting VIF {"id": "402a09b0-1130-4f4a-88d4-89668aa9386d", "address": "fa:16:3e:c6:38:ef", "network": {"id": "c19ed38b-2acd-421a-9e4b-f60df3db2f1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1812407562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a974cbbf734f51897c3e632ae9e45f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap402a09b0-11", "ovs_interfaceid": "402a09b0-1130-4f4a-88d4-89668aa9386d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 15:12:51 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:38:ef,bridge_name='br-int',has_traffic_filtering=True,id=402a09b0-1130-4f4a-88d4-89668aa9386d,network=Network(c19ed38b-2acd-421a-9e4b-f60df3db2f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap402a09b0-11') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 15:12:51 user nova-compute[70924]: DEBUG nova.objects.instance [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lazy-loading 'pci_devices' on Instance uuid a1380b9d-f31a-4c49-8f1d-27d156e72f56 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:12:51 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] End _get_guest_xml xml=<domain type="kvm">
Jul 29 15:12:51 user nova-compute[70924]:   <uuid>a1380b9d-f31a-4c49-8f1d-27d156e72f56</uuid>
Jul 29 15:12:51 user nova-compute[70924]:   <name>instance-00000031</name>
Jul 29 15:12:51 user nova-compute[70924]:   <memory>524288</memory>
Jul 29 15:12:51 user nova-compute[70924]:   <vcpu>1</vcpu>
Jul 29 15:12:51 user nova-compute[70924]:   <metadata>
Jul 29 15:12:51 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 15:12:51 user nova-compute[70924]:       <nova:package version="0.0.0"/>
Jul 29 15:12:51 user nova-compute[70924]:       <nova:name>tempest-TestVolumeBootPattern-server-331958999</nova:name>
Jul 29 15:12:51 user nova-compute[70924]:       <nova:creationTime>2023-07-29 15:12:50</nova:creationTime>
Jul 29 15:12:51 user nova-compute[70924]:       <nova:flavor name="m1.tiny">
Jul 29 15:12:51 user nova-compute[70924]:         <nova:memory>512</nova:memory>
Jul 29 15:12:51 user nova-compute[70924]:         <nova:disk>1</nova:disk>
Jul 29 15:12:51 user nova-compute[70924]:         <nova:swap>0</nova:swap>
Jul 29 15:12:51 user nova-compute[70924]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 15:12:51 user nova-compute[70924]:         <nova:vcpus>1</nova:vcpus>
Jul 29 15:12:51 user nova-compute[70924]:       </nova:flavor>
Jul 29 15:12:51 user nova-compute[70924]:       <nova:owner>
Jul 29 15:12:51 user nova-compute[70924]:         <nova:user uuid="da204646e8f84693ad470ed1d3eadd7c">tempest-TestVolumeBootPattern-1030839740-project-member</nova:user>
Jul 29 15:12:51 user nova-compute[70924]:         <nova:project uuid="99a974cbbf734f51897c3e632ae9e45f">tempest-TestVolumeBootPattern-1030839740</nova:project>
Jul 29 15:12:51 user nova-compute[70924]:       </nova:owner>
Jul 29 15:12:51 user nova-compute[70924]:       <nova:ports>
Jul 29 15:12:51 user nova-compute[70924]:         <nova:port uuid="402a09b0-1130-4f4a-88d4-89668aa9386d">
Jul 29 15:12:51 user nova-compute[70924]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 29 15:12:51 user nova-compute[70924]:         </nova:port>
Jul 29 15:12:51 user nova-compute[70924]:       </nova:ports>
Jul 29 15:12:51 user nova-compute[70924]:     </nova:instance>
Jul 29 15:12:51 user nova-compute[70924]:   </metadata>
Jul 29 15:12:51 user nova-compute[70924]:   <sysinfo type="smbios">
Jul 29 15:12:51 user nova-compute[70924]:     <system>
Jul 29 15:12:51 user nova-compute[70924]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 15:12:51 user nova-compute[70924]:       <entry name="product">OpenStack Nova</entry>
Jul 29 15:12:51 user nova-compute[70924]:       <entry name="version">0.0.0</entry>
Jul 29 15:12:51 user nova-compute[70924]:       <entry name="serial">a1380b9d-f31a-4c49-8f1d-27d156e72f56</entry>
Jul 29 15:12:51 user nova-compute[70924]:       <entry name="uuid">a1380b9d-f31a-4c49-8f1d-27d156e72f56</entry>
Jul 29 15:12:51 user nova-compute[70924]:       <entry name="family">Virtual Machine</entry>
Jul 29 15:12:51 user nova-compute[70924]:     </system>
Jul 29 15:12:51 user nova-compute[70924]:   </sysinfo>
Jul 29 15:12:51 user nova-compute[70924]:   <os>
Jul 29 15:12:51 user nova-compute[70924]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 15:12:51 user nova-compute[70924]:     <boot dev="hd"/>
Jul 29 15:12:51 user nova-compute[70924]:     <smbios mode="sysinfo"/>
Jul 29 15:12:51 user nova-compute[70924]:   </os>
Jul 29 15:12:51 user nova-compute[70924]:   <features>
Jul 29 15:12:51 user nova-compute[70924]:     <acpi/>
Jul 29 15:12:51 user nova-compute[70924]:     <apic/>
Jul 29 15:12:51 user nova-compute[70924]:     <vmcoreinfo/>
Jul 29 15:12:51 user nova-compute[70924]:   </features>
Jul 29 15:12:51 user nova-compute[70924]:   <clock offset="utc">
Jul 29 15:12:51 user nova-compute[70924]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 15:12:51 user nova-compute[70924]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 15:12:51 user nova-compute[70924]:     <timer name="hpet" present="no"/>
Jul 29 15:12:51 user nova-compute[70924]:   </clock>
Jul 29 15:12:51 user nova-compute[70924]:   <cpu mode="custom" match="exact">
Jul 29 15:12:51 user nova-compute[70924]:     <model>Nehalem</model>
Jul 29 15:12:51 user nova-compute[70924]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 15:12:51 user nova-compute[70924]:   </cpu>
Jul 29 15:12:51 user nova-compute[70924]:   <devices>
Jul 29 15:12:51 user nova-compute[70924]:     <disk type="block" device="disk">
Jul 29 15:12:51 user nova-compute[70924]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 15:12:51 user nova-compute[70924]:       <source dev="/dev/sdb"/>
Jul 29 15:12:51 user nova-compute[70924]:       <target dev="vda" bus="virtio"/>
Jul 29 15:12:51 user nova-compute[70924]:       <serial>cb3e837e-7306-4f92-b641-dc081c379b85</serial>
Jul 29 15:12:51 user nova-compute[70924]:     </disk>
Jul 29 15:12:51 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 15:12:51 user nova-compute[70924]:       <mac address="fa:16:3e:c6:38:ef"/>
Jul 29 15:12:51 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 15:12:51 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 15:12:51 user nova-compute[70924]:       <target dev="tap402a09b0-11"/>
Jul 29 15:12:51 user nova-compute[70924]:     </interface>
Jul 29 15:12:51 user nova-compute[70924]:     <serial type="pty">
Jul 29 15:12:51 user nova-compute[70924]:       <log file="/opt/stack/data/nova/instances/a1380b9d-f31a-4c49-8f1d-27d156e72f56/console.log" append="off"/>
Jul 29 15:12:51 user nova-compute[70924]:     </serial>
Jul 29 15:12:51 user nova-compute[70924]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 15:12:51 user nova-compute[70924]:     <video>
Jul 29 15:12:51 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 15:12:51 user nova-compute[70924]:     </video>
Jul 29 15:12:51 user nova-compute[70924]:     <rng model="virtio">
Jul 29 15:12:51 user nova-compute[70924]:       <backend model="random">/dev/urandom</backend>
Jul 29 15:12:51 user nova-compute[70924]:     </rng>
Jul 29 15:12:51 user nova-compute[70924]:     <controller type="usb" index="0" model="none"/>
Jul 29 15:12:51 user nova-compute[70924]:     <memballoon model="virtio">
Jul 29 15:12:51 user nova-compute[70924]:       <stats period="10"/>
Jul 29 15:12:51 user nova-compute[70924]:     </memballoon>
Jul 29 15:12:51 user nova-compute[70924]:   </devices>
Jul 29 15:12:51 user nova-compute[70924]: </domain>
Jul 29 15:12:51 user nova-compute[70924]:  {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 15:12:51 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T15:12:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-331958999',display_name='tempest-TestVolumeBootPattern-server-331958999',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-331958999',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ85EoxOcLUTgXe8luwDJdmSAuW16EOphuu0LzU/6Hdmcve8fH6stAD+XoS0+shU7N/jDe0exnSkgWjCon0Br/QYJqNqli+yWYkmG2icNLlmtzdYRBdyLvXLjiH1TkzZOA==',key_name='tempest-TestVolumeBootPattern-447927024',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99a974cbbf734f51897c3e632ae9e45f',ramdisk_id='',reservation_id='r-8t15ebc6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1030839740',owner_user_name='tempest-TestVolumeBootPattern-1030839740-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T15:12:43Z,user_data=None,user_id='da204646e8f84693ad470ed1d3eadd7c',uuid=a1380b9d-f31a-4c49-8f1d-27d156e72f56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "402a09b0-1130-4f4a-88d4-89668aa9386d", "address": "fa:16:3e:c6:38:ef", "network": {"id": "c19ed38b-2acd-421a-9e4b-f60df3db2f1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1812407562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a974cbbf734f51897c3e632ae9e45f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap402a09b0-11", "ovs_interfaceid": "402a09b0-1130-4f4a-88d4-89668aa9386d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 15:12:51 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Converting VIF {"id": "402a09b0-1130-4f4a-88d4-89668aa9386d", "address": "fa:16:3e:c6:38:ef", "network": {"id": "c19ed38b-2acd-421a-9e4b-f60df3db2f1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1812407562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a974cbbf734f51897c3e632ae9e45f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap402a09b0-11", "ovs_interfaceid": "402a09b0-1130-4f4a-88d4-89668aa9386d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 15:12:51 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:38:ef,bridge_name='br-int',has_traffic_filtering=True,id=402a09b0-1130-4f4a-88d4-89668aa9386d,network=Network(c19ed38b-2acd-421a-9e4b-f60df3db2f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap402a09b0-11') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 15:12:51 user nova-compute[70924]: DEBUG os_vif [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:38:ef,bridge_name='br-int',has_traffic_filtering=True,id=402a09b0-1130-4f4a-88d4-89668aa9386d,network=Network(c19ed38b-2acd-421a-9e4b-f60df3db2f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap402a09b0-11') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 15:12:51 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:12:51 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:12:51 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 15:12:51 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:12:51 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap402a09b0-11, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:12:51 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap402a09b0-11, col_values=(('external_ids', {'iface-id': '402a09b0-1130-4f4a-88d4-89668aa9386d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:38:ef', 'vm-uuid': 'a1380b9d-f31a-4c49-8f1d-27d156e72f56'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:12:51 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:12:51 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:12:51 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:12:51 user nova-compute[70924]: INFO os_vif [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:38:ef,bridge_name='br-int',has_traffic_filtering=True,id=402a09b0-1130-4f4a-88d4-89668aa9386d,network=Network(c19ed38b-2acd-421a-9e4b-f60df3db2f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap402a09b0-11')
Jul 29 15:12:51 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 15:12:51 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] No VIF found with MAC fa:16:3e:c6:38:ef, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 15:12:52 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:12:52 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:12:52 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:12:52 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:12:53 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:12:53 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:12:53 user nova-compute[70924]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690643558.2784119, 0a8fe938-7ca4-4221-9742-9b043050ba84 => Stopped> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 15:12:53 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] VM Stopped (Lifecycle Event)
Jul 29 15:12:53 user nova-compute[70924]: DEBUG nova.compute.manager [None req-7f496b4c-7e0b-4c68-b1aa-76fda5a65f28 None None] [instance: 0a8fe938-7ca4-4221-9742-9b043050ba84] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:12:53 user nova-compute[70924]: DEBUG nova.compute.manager [req-b15375e3-81ce-459e-89fb-6e8d42a198ef req-1ac5785d-c18c-47ea-8f73-8e56fa536c20 service nova] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Received event network-vif-plugged-402a09b0-1130-4f4a-88d4-89668aa9386d {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:12:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b15375e3-81ce-459e-89fb-6e8d42a198ef req-1ac5785d-c18c-47ea-8f73-8e56fa536c20 service nova] Acquiring lock "a1380b9d-f31a-4c49-8f1d-27d156e72f56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:12:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b15375e3-81ce-459e-89fb-6e8d42a198ef req-1ac5785d-c18c-47ea-8f73-8e56fa536c20 service nova] Lock "a1380b9d-f31a-4c49-8f1d-27d156e72f56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:12:53 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b15375e3-81ce-459e-89fb-6e8d42a198ef req-1ac5785d-c18c-47ea-8f73-8e56fa536c20 service nova] Lock "a1380b9d-f31a-4c49-8f1d-27d156e72f56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:12:53 user nova-compute[70924]: DEBUG nova.compute.manager [req-b15375e3-81ce-459e-89fb-6e8d42a198ef req-1ac5785d-c18c-47ea-8f73-8e56fa536c20 service nova] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] No waiting events found dispatching network-vif-plugged-402a09b0-1130-4f4a-88d4-89668aa9386d {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:12:53 user nova-compute[70924]: WARNING nova.compute.manager [req-b15375e3-81ce-459e-89fb-6e8d42a198ef req-1ac5785d-c18c-47ea-8f73-8e56fa536c20 service nova] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Received unexpected event network-vif-plugged-402a09b0-1130-4f4a-88d4-89668aa9386d for instance with vm_state building and task_state spawning.
Jul 29 15:12:54 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:12:55 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690643575.0282252, a1380b9d-f31a-4c49-8f1d-27d156e72f56 => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 15:12:55 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] VM Resumed (Lifecycle Event)
Jul 29 15:12:55 user nova-compute[70924]: DEBUG nova.compute.manager [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Instance event wait completed in 0 seconds for  {{(pid=70924) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 15:12:55 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Guest created on hypervisor {{(pid=70924) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 15:12:55 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Instance spawned successfully.
Jul 29 15:12:55 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 15:12:55 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:12:55 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 15:12:55 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Found default for hw_cdrom_bus of ide {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:12:55 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Found default for hw_disk_bus of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:12:55 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Found default for hw_input_bus of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:12:55 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Found default for hw_pointer_model of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:12:55 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Found default for hw_video_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:12:55 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Found default for hw_vif_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:12:55 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 15:12:55 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690643575.0298667, a1380b9d-f31a-4c49-8f1d-27d156e72f56 => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 15:12:55 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] VM Started (Lifecycle Event)
Jul 29 15:12:55 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:12:55 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 15:12:55 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 15:12:55 user nova-compute[70924]: INFO nova.compute.manager [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Took 4.93 seconds to spawn the instance on the hypervisor.
Jul 29 15:12:55 user nova-compute[70924]: DEBUG nova.compute.manager [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:12:55 user nova-compute[70924]: INFO nova.compute.manager [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Took 12.93 seconds to build instance.
Jul 29 15:12:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-020bd372-f5ea-4cd9-a5ff-6d901aec224a tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "a1380b9d-f31a-4c49-8f1d-27d156e72f56" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.038s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:12:55 user nova-compute[70924]: DEBUG nova.compute.manager [req-608359c3-5ec4-4d51-97d0-92f6ad189575 req-adda56e4-0c04-4f1a-aa75-d1a0b32feff6 service nova] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Received event network-vif-plugged-402a09b0-1130-4f4a-88d4-89668aa9386d {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:12:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-608359c3-5ec4-4d51-97d0-92f6ad189575 req-adda56e4-0c04-4f1a-aa75-d1a0b32feff6 service nova] Acquiring lock "a1380b9d-f31a-4c49-8f1d-27d156e72f56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:12:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-608359c3-5ec4-4d51-97d0-92f6ad189575 req-adda56e4-0c04-4f1a-aa75-d1a0b32feff6 service nova] Lock "a1380b9d-f31a-4c49-8f1d-27d156e72f56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:12:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-608359c3-5ec4-4d51-97d0-92f6ad189575 req-adda56e4-0c04-4f1a-aa75-d1a0b32feff6 service nova] Lock "a1380b9d-f31a-4c49-8f1d-27d156e72f56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:12:55 user nova-compute[70924]: DEBUG nova.compute.manager [req-608359c3-5ec4-4d51-97d0-92f6ad189575 req-adda56e4-0c04-4f1a-aa75-d1a0b32feff6 service nova] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] No waiting events found dispatching network-vif-plugged-402a09b0-1130-4f4a-88d4-89668aa9386d {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:12:55 user nova-compute[70924]: WARNING nova.compute.manager [req-608359c3-5ec4-4d51-97d0-92f6ad189575 req-adda56e4-0c04-4f1a-aa75-d1a0b32feff6 service nova] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Received unexpected event network-vif-plugged-402a09b0-1130-4f4a-88d4-89668aa9386d for instance with vm_state active and task_state None.
Jul 29 15:12:56 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:13:01 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:13:04 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:13:04 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:13:04 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:13:05 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:13:06 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:13:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:13:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:13:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:13:11 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:13:11 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:13:12 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:13:13 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:13:14 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:13:15 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:13:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:13:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:13:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:13:15 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Auditing locally available compute resources for user (node: user) {{(pid=70924) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 15:13:15 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 15:13:15 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 15:13:15 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:13:15 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:13:15 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Hypervisor/Node resource view: name=user free_ram=8492MB free_disk=25.302181243896484GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70924) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 15:13:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:13:15 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:13:16 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 758d9381-32af-4433-8366-9e0aa9699137 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:13:16 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance a1380b9d-f31a-4c49-8f1d-27d156e72f56 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:13:16 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 15:13:16 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 15:13:16 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Refreshing inventories for resource provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 29 15:13:16 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Updating ProviderTree inventory for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 29 15:13:16 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Updating inventory in ProviderTree for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 29 15:13:16 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Refreshing aggregate associations for resource provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832, aggregates: None {{(pid=70924) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 29 15:13:16 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Refreshing trait associations for resource provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832, traits: COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=70924) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 29 15:13:16 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:13:16 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:13:16 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Compute_service record updated for user:user {{(pid=70924) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 15:13:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.467s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:13:16 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:13:18 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:13:18 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70924) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 15:13:18 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:13:18 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:13:18 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Starting heal instance info cache {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 15:13:18 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Rebuilding the list of instances to heal {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 29 15:13:18 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "refresh_cache-758d9381-32af-4433-8366-9e0aa9699137" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:13:18 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquired lock "refresh_cache-758d9381-32af-4433-8366-9e0aa9699137" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:13:18 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Forcefully refreshing network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 29 15:13:18 user nova-compute[70924]: DEBUG nova.objects.instance [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lazy-loading 'info_cache' on Instance uuid 758d9381-32af-4433-8366-9e0aa9699137 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:13:18 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Updating instance_info_cache with network_info: [{"id": "590a32f6-52b6-4377-a140-0ff497ec1aad", "address": "fa:16:3e:5c:58:7f", "network": {"id": "c19ed38b-2acd-421a-9e4b-f60df3db2f1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1812407562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a974cbbf734f51897c3e632ae9e45f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap590a32f6-52", "ovs_interfaceid": "590a32f6-52b6-4377-a140-0ff497ec1aad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:13:18 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Releasing lock "refresh_cache-758d9381-32af-4433-8366-9e0aa9699137" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:13:18 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Updated the network info_cache for instance {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 29 15:13:19 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:13:21 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:13:21 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:13:24 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:13:26 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:13:29 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:13:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:13:36 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:13:37 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:13:40 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:13:40 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:13:41 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:13:46 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:13:51 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:13:51 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:13:51 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70924) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 29 15:13:51 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70924) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 15:13:51 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70924) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 15:13:51 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:13:56 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:14:01 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:14:05 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:14:06 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:14:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:14:11 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:14:11 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:14:11 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70924) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 29 15:14:11 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70924) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 15:14:11 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70924) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 15:14:11 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:14:12 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:14:14 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:14:15 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:14:16 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:14:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:14:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:14:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:14:16 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Auditing locally available compute resources for user (node: user) {{(pid=70924) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 15:14:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 15:14:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 15:14:16 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:14:16 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:14:16 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:14:16 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Hypervisor/Node resource view: name=user free_ram=8621MB free_disk=25.290393829345703GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70924) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 15:14:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:14:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:14:17 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 758d9381-32af-4433-8366-9e0aa9699137 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:14:17 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance a1380b9d-f31a-4c49-8f1d-27d156e72f56 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:14:17 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 15:14:17 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 15:14:17 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:14:17 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:14:17 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Compute_service record updated for user:user {{(pid=70924) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 15:14:17 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.218s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:14:19 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:14:19 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70924) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 15:14:19 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:14:19 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Starting heal instance info cache {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 15:14:19 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "refresh_cache-a1380b9d-f31a-4c49-8f1d-27d156e72f56" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:14:19 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquired lock "refresh_cache-a1380b9d-f31a-4c49-8f1d-27d156e72f56" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:14:19 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Forcefully refreshing network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 29 15:14:19 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Updating instance_info_cache with network_info: [{"id": "402a09b0-1130-4f4a-88d4-89668aa9386d", "address": "fa:16:3e:c6:38:ef", "network": {"id": "c19ed38b-2acd-421a-9e4b-f60df3db2f1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1812407562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a974cbbf734f51897c3e632ae9e45f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap402a09b0-11", "ovs_interfaceid": "402a09b0-1130-4f4a-88d4-89668aa9386d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:14:19 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Releasing lock "refresh_cache-a1380b9d-f31a-4c49-8f1d-27d156e72f56" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:14:19 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Updated the network info_cache for instance {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 29 15:14:21 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:14:22 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:14:26 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:14:31 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:14:34 user nova-compute[70924]: DEBUG nova.compute.manager [req-fd3c73ca-ac09-4be8-8961-1496e665229b req-188b87e7-ed33-4fe3-b380-2d9d62dd924a service nova] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Received event network-changed-402a09b0-1130-4f4a-88d4-89668aa9386d {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:14:34 user nova-compute[70924]: DEBUG nova.compute.manager [req-fd3c73ca-ac09-4be8-8961-1496e665229b req-188b87e7-ed33-4fe3-b380-2d9d62dd924a service nova] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Refreshing instance network info cache due to event network-changed-402a09b0-1130-4f4a-88d4-89668aa9386d. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 15:14:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-fd3c73ca-ac09-4be8-8961-1496e665229b req-188b87e7-ed33-4fe3-b380-2d9d62dd924a service nova] Acquiring lock "refresh_cache-a1380b9d-f31a-4c49-8f1d-27d156e72f56" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:14:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-fd3c73ca-ac09-4be8-8961-1496e665229b req-188b87e7-ed33-4fe3-b380-2d9d62dd924a service nova] Acquired lock "refresh_cache-a1380b9d-f31a-4c49-8f1d-27d156e72f56" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:14:34 user nova-compute[70924]: DEBUG nova.network.neutron [req-fd3c73ca-ac09-4be8-8961-1496e665229b req-188b87e7-ed33-4fe3-b380-2d9d62dd924a service nova] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Refreshing network info cache for port 402a09b0-1130-4f4a-88d4-89668aa9386d {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 15:14:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:14:34 user nova-compute[70924]: DEBUG nova.network.neutron [req-fd3c73ca-ac09-4be8-8961-1496e665229b req-188b87e7-ed33-4fe3-b380-2d9d62dd924a service nova] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Updated VIF entry in instance network info cache for port 402a09b0-1130-4f4a-88d4-89668aa9386d. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 15:14:34 user nova-compute[70924]: DEBUG nova.network.neutron [req-fd3c73ca-ac09-4be8-8961-1496e665229b req-188b87e7-ed33-4fe3-b380-2d9d62dd924a service nova] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Updating instance_info_cache with network_info: [{"id": "402a09b0-1130-4f4a-88d4-89668aa9386d", "address": "fa:16:3e:c6:38:ef", "network": {"id": "c19ed38b-2acd-421a-9e4b-f60df3db2f1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1812407562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a974cbbf734f51897c3e632ae9e45f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap402a09b0-11", "ovs_interfaceid": "402a09b0-1130-4f4a-88d4-89668aa9386d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:14:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-fd3c73ca-ac09-4be8-8961-1496e665229b req-188b87e7-ed33-4fe3-b380-2d9d62dd924a service nova] Releasing lock "refresh_cache-a1380b9d-f31a-4c49-8f1d-27d156e72f56" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:14:35 user nova-compute[70924]: DEBUG nova.compute.manager [req-d0bc06e4-a192-4d21-b921-f33adebda5a4 req-5207c3be-470f-4c8c-b78a-5e2005266dd7 service nova] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Received event network-changed-402a09b0-1130-4f4a-88d4-89668aa9386d {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:14:35 user nova-compute[70924]: DEBUG nova.compute.manager [req-d0bc06e4-a192-4d21-b921-f33adebda5a4 req-5207c3be-470f-4c8c-b78a-5e2005266dd7 service nova] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Refreshing instance network info cache due to event network-changed-402a09b0-1130-4f4a-88d4-89668aa9386d. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 15:14:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-d0bc06e4-a192-4d21-b921-f33adebda5a4 req-5207c3be-470f-4c8c-b78a-5e2005266dd7 service nova] Acquiring lock "refresh_cache-a1380b9d-f31a-4c49-8f1d-27d156e72f56" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:14:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-d0bc06e4-a192-4d21-b921-f33adebda5a4 req-5207c3be-470f-4c8c-b78a-5e2005266dd7 service nova] Acquired lock "refresh_cache-a1380b9d-f31a-4c49-8f1d-27d156e72f56" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:14:35 user nova-compute[70924]: DEBUG nova.network.neutron [req-d0bc06e4-a192-4d21-b921-f33adebda5a4 req-5207c3be-470f-4c8c-b78a-5e2005266dd7 service nova] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Refreshing network info cache for port 402a09b0-1130-4f4a-88d4-89668aa9386d {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 15:14:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-6afe2910-01b3-4da2-9789-1b0ea3cbd44b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Acquiring lock "a1380b9d-f31a-4c49-8f1d-27d156e72f56" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:14:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-6afe2910-01b3-4da2-9789-1b0ea3cbd44b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "a1380b9d-f31a-4c49-8f1d-27d156e72f56" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:14:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-6afe2910-01b3-4da2-9789-1b0ea3cbd44b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Acquiring lock "a1380b9d-f31a-4c49-8f1d-27d156e72f56-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:14:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-6afe2910-01b3-4da2-9789-1b0ea3cbd44b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "a1380b9d-f31a-4c49-8f1d-27d156e72f56-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:14:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-6afe2910-01b3-4da2-9789-1b0ea3cbd44b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "a1380b9d-f31a-4c49-8f1d-27d156e72f56-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:14:35 user nova-compute[70924]: INFO nova.compute.manager [None req-6afe2910-01b3-4da2-9789-1b0ea3cbd44b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Terminating instance
Jul 29 15:14:35 user nova-compute[70924]: DEBUG nova.compute.manager [None req-6afe2910-01b3-4da2-9789-1b0ea3cbd44b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Start destroying the instance on the hypervisor. {{(pid=70924) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 15:14:35 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:14:35 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:14:35 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:14:35 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:14:35 user nova-compute[70924]: DEBUG nova.network.neutron [req-d0bc06e4-a192-4d21-b921-f33adebda5a4 req-5207c3be-470f-4c8c-b78a-5e2005266dd7 service nova] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Updated VIF entry in instance network info cache for port 402a09b0-1130-4f4a-88d4-89668aa9386d. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 15:14:35 user nova-compute[70924]: DEBUG nova.network.neutron [req-d0bc06e4-a192-4d21-b921-f33adebda5a4 req-5207c3be-470f-4c8c-b78a-5e2005266dd7 service nova] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Updating instance_info_cache with network_info: [{"id": "402a09b0-1130-4f4a-88d4-89668aa9386d", "address": "fa:16:3e:c6:38:ef", "network": {"id": "c19ed38b-2acd-421a-9e4b-f60df3db2f1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1812407562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a974cbbf734f51897c3e632ae9e45f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap402a09b0-11", "ovs_interfaceid": "402a09b0-1130-4f4a-88d4-89668aa9386d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:14:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-d0bc06e4-a192-4d21-b921-f33adebda5a4 req-5207c3be-470f-4c8c-b78a-5e2005266dd7 service nova] Releasing lock "refresh_cache-a1380b9d-f31a-4c49-8f1d-27d156e72f56" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:14:36 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Instance destroyed successfully.
Jul 29 15:14:36 user nova-compute[70924]: DEBUG nova.objects.instance [None req-6afe2910-01b3-4da2-9789-1b0ea3cbd44b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lazy-loading 'resources' on Instance uuid a1380b9d-f31a-4c49-8f1d-27d156e72f56 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:14:36 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-6afe2910-01b3-4da2-9789-1b0ea3cbd44b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T15:12:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-331958999',display_name='tempest-TestVolumeBootPattern-server-331958999',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-331958999',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ85EoxOcLUTgXe8luwDJdmSAuW16EOphuu0LzU/6Hdmcve8fH6stAD+XoS0+shU7N/jDe0exnSkgWjCon0Br/QYJqNqli+yWYkmG2icNLlmtzdYRBdyLvXLjiH1TkzZOA==',key_name='tempest-TestVolumeBootPattern-447927024',keypairs=<?>,launch_index=0,launched_at=2023-07-29T15:12:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='99a974cbbf734f51897c3e632ae9e45f',ramdisk_id='',reservation_id='r-8t15ebc6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1030839740',owner_user_name='tempest-TestVolumeBootPattern-1030839740-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T15:12:55Z,user_data=None,user_id='da204646e8f84693ad470ed1d3eadd7c',uuid=a1380b9d-f31a-4c49-8f1d-27d156e72f56,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "402a09b0-1130-4f4a-88d4-89668aa9386d", "address": "fa:16:3e:c6:38:ef", "network": {"id": "c19ed38b-2acd-421a-9e4b-f60df3db2f1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1812407562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a974cbbf734f51897c3e632ae9e45f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap402a09b0-11", "ovs_interfaceid": "402a09b0-1130-4f4a-88d4-89668aa9386d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 15:14:36 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-6afe2910-01b3-4da2-9789-1b0ea3cbd44b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Converting VIF {"id": "402a09b0-1130-4f4a-88d4-89668aa9386d", "address": "fa:16:3e:c6:38:ef", "network": {"id": "c19ed38b-2acd-421a-9e4b-f60df3db2f1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1812407562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a974cbbf734f51897c3e632ae9e45f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap402a09b0-11", "ovs_interfaceid": "402a09b0-1130-4f4a-88d4-89668aa9386d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 15:14:36 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-6afe2910-01b3-4da2-9789-1b0ea3cbd44b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:38:ef,bridge_name='br-int',has_traffic_filtering=True,id=402a09b0-1130-4f4a-88d4-89668aa9386d,network=Network(c19ed38b-2acd-421a-9e4b-f60df3db2f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap402a09b0-11') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 15:14:36 user nova-compute[70924]: DEBUG os_vif [None req-6afe2910-01b3-4da2-9789-1b0ea3cbd44b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:38:ef,bridge_name='br-int',has_traffic_filtering=True,id=402a09b0-1130-4f4a-88d4-89668aa9386d,network=Network(c19ed38b-2acd-421a-9e4b-f60df3db2f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap402a09b0-11') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 15:14:36 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:14:36 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap402a09b0-11, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:14:36 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:14:36 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:14:36 user nova-compute[70924]: INFO os_vif [None req-6afe2910-01b3-4da2-9789-1b0ea3cbd44b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:38:ef,bridge_name='br-int',has_traffic_filtering=True,id=402a09b0-1130-4f4a-88d4-89668aa9386d,network=Network(c19ed38b-2acd-421a-9e4b-f60df3db2f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap402a09b0-11')
Jul 29 15:14:36 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6afe2910-01b3-4da2-9789-1b0ea3cbd44b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] calling os-brick to detach iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 15:14:36 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afe2910-01b3-4da2-9789-1b0ea3cbd44b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, {'target_iqns': ['iqn.2010-10.org.openstack:cb3e837e-7306-4f92-b641-dc081c379b85'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fAJInTBh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 15:14:36 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-6afe2910-01b3-4da2-9789-1b0ea3cbd44b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 15:14:36 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-6afe2910-01b3-4da2-9789-1b0ea3cbd44b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 15:14:36 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-6afe2910-01b3-4da2-9789-1b0ea3cbd44b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 15:14:36 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afe2910-01b3-4da2-9789-1b0ea3cbd44b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb3e837e-7306-4f92-b641-dc081c379b85', 0)] {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 15:14:36 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:14:36 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:14:36 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f388c250-a48a-4ac9-a318-d0c7bf461bed]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb3e837e-7306-4f92-b641-dc081c379b85\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:14:36 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:14:36 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:14:36 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[79661d8f-8a85-4674-97f7-5184b9f672aa]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3e837e-7306-4f92-b641-dc081c379b85 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:14:36 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afe2910-01b3-4da2-9789-1b0ea3cbd44b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 (non-flash)
Jul 29 15:14:36 user nova-compute[70924]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3e837e-7306-4f92-b641-dc081c379b85 (non-flash)
Jul 29 15:14:36 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 15:14:36 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afe2910-01b3-4da2-9789-1b0ea3cbd44b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 (non-flash)
Jul 29 15:14:36 user nova-compute[70924]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb3e837e-7306-4f92-b641-dc081c379b85 (non-flash)
Jul 29 15:14:36 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 15:14:36 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afe2910-01b3-4da2-9789-1b0ea3cbd44b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feedc448d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb3e837e-7306-4f92-b641-dc081c379b85'): ({'sdb'}, set())}) {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 15:14:36 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-6afe2910-01b3-4da2-9789-1b0ea3cbd44b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Removing single pathed devices sdb {{(pid=70924) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 15:14:36 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:14:36 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:14:36 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[90354a9d-4aa6-4c77-8943-2e4c53599cc8]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:14:36 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:14:36 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:14:36 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1edf30eb-25aa-4bad-92c6-6ede44624b54]: (4, ('ok\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:14:36 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-6afe2910-01b3-4da2-9789-1b0ea3cbd44b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Flushing IO for device /dev/sdb {{(pid=70924) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 15:14:36 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:14:36 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:14:36 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9fd842d-53d0-44d1-a0d1-4a103c4c5a09]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:14:36 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-6afe2910-01b3-4da2-9789-1b0ea3cbd44b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70924) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 15:14:36 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:14:36 user nova-compute[70924]: DEBUG nova.compute.manager [req-c8495c1d-0bb1-42cd-bb6f-5fdd0bae9479 req-94273a7a-554f-4367-9037-321b02507cb6 service nova] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Received event network-vif-unplugged-402a09b0-1130-4f4a-88d4-89668aa9386d {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:14:36 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c8495c1d-0bb1-42cd-bb6f-5fdd0bae9479 req-94273a7a-554f-4367-9037-321b02507cb6 service nova] Acquiring lock "a1380b9d-f31a-4c49-8f1d-27d156e72f56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:14:36 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c8495c1d-0bb1-42cd-bb6f-5fdd0bae9479 req-94273a7a-554f-4367-9037-321b02507cb6 service nova] Lock "a1380b9d-f31a-4c49-8f1d-27d156e72f56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:14:36 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c8495c1d-0bb1-42cd-bb6f-5fdd0bae9479 req-94273a7a-554f-4367-9037-321b02507cb6 service nova] Lock "a1380b9d-f31a-4c49-8f1d-27d156e72f56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:14:36 user nova-compute[70924]: DEBUG nova.compute.manager [req-c8495c1d-0bb1-42cd-bb6f-5fdd0bae9479 req-94273a7a-554f-4367-9037-321b02507cb6 service nova] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] No waiting events found dispatching network-vif-unplugged-402a09b0-1130-4f4a-88d4-89668aa9386d {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:14:36 user nova-compute[70924]: DEBUG nova.compute.manager [req-c8495c1d-0bb1-42cd-bb6f-5fdd0bae9479 req-94273a7a-554f-4367-9037-321b02507cb6 service nova] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Received event network-vif-unplugged-402a09b0-1130-4f4a-88d4-89668aa9386d for instance with task_state deleting. {{(pid=70924) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 15:14:36 user nova-compute[70924]: DEBUG nova.compute.manager [req-c8495c1d-0bb1-42cd-bb6f-5fdd0bae9479 req-94273a7a-554f-4367-9037-321b02507cb6 service nova] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Received event network-vif-plugged-402a09b0-1130-4f4a-88d4-89668aa9386d {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:14:36 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c8495c1d-0bb1-42cd-bb6f-5fdd0bae9479 req-94273a7a-554f-4367-9037-321b02507cb6 service nova] Acquiring lock "a1380b9d-f31a-4c49-8f1d-27d156e72f56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:14:36 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c8495c1d-0bb1-42cd-bb6f-5fdd0bae9479 req-94273a7a-554f-4367-9037-321b02507cb6 service nova] Lock "a1380b9d-f31a-4c49-8f1d-27d156e72f56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:14:36 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c8495c1d-0bb1-42cd-bb6f-5fdd0bae9479 req-94273a7a-554f-4367-9037-321b02507cb6 service nova] Lock "a1380b9d-f31a-4c49-8f1d-27d156e72f56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:14:36 user nova-compute[70924]: DEBUG nova.compute.manager [req-c8495c1d-0bb1-42cd-bb6f-5fdd0bae9479 req-94273a7a-554f-4367-9037-321b02507cb6 service nova] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] No waiting events found dispatching network-vif-plugged-402a09b0-1130-4f4a-88d4-89668aa9386d {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:14:36 user nova-compute[70924]: WARNING nova.compute.manager [req-c8495c1d-0bb1-42cd-bb6f-5fdd0bae9479 req-94273a7a-554f-4367-9037-321b02507cb6 service nova] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Received unexpected event network-vif-plugged-402a09b0-1130-4f4a-88d4-89668aa9386d for instance with vm_state active and task_state deleting.
Jul 29 15:14:36 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.076s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:14:36 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5ad56d-0cd2-4ef1-9de7-846a76a05845]: (4, ('1', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:14:36 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-6afe2910-01b3-4da2-9789-1b0ea3cbd44b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 15:14:36 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-6afe2910-01b3-4da2-9789-1b0ea3cbd44b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] SCSI volumes sdb have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 15:14:36 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afe2910-01b3-4da2-9789-1b0ea3cbd44b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb3e837e-7306-4f92-b641-dc081c379b85')] {{(pid=70924) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 15:14:36 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb3e837e-7306-4f92-b641-dc081c379b85 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:14:36 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb3e837e-7306-4f92-b641-dc081c379b85 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:14:36 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a40893-b626-4674-88d3-63221efdb473]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:14:36 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afe2910-01b3-4da2-9789-1b0ea3cbd44b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:14:36 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb3e837e-7306-4f92-b641-dc081c379b85 -p 172.16.0.220:3260 --logout {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:14:36 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb3e837e-7306-4f92-b641-dc081c379b85 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:14:36 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c5fea6-26ad-4fa1-bd28-9cf104bc957f]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:cb3e837e-7306-4f92-b641-dc081c379b85, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:cb3e837e-7306-4f92-b641-dc081c379b85, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:14:36 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afe2910-01b3-4da2-9789-1b0ea3cbd44b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:cb3e837e-7306-4f92-b641-dc081c379b85, portal: 172.16.0.220,3260]
Jul 29 15:14:36 user nova-compute[70924]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:cb3e837e-7306-4f92-b641-dc081c379b85, portal: 172.16.0.220,3260] successful.
Jul 29 15:14:36 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:14:36 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb3e837e-7306-4f92-b641-dc081c379b85 -p 172.16.0.220:3260 --op delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:14:36 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb3e837e-7306-4f92-b641-dc081c379b85 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:14:36 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[121609ed-231d-4aaa-b1ac-8c1a3f6b0b49]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:14:36 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afe2910-01b3-4da2-9789-1b0ea3cbd44b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:14:36 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-6afe2910-01b3-4da2-9789-1b0ea3cbd44b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 15:14:36 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afe2910-01b3-4da2-9789-1b0ea3cbd44b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] <== disconnect_volume: return (334ms) None {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 15:14:36 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6afe2910-01b3-4da2-9789-1b0ea3cbd44b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Disconnected iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 15:14:36 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-6afe2910-01b3-4da2-9789-1b0ea3cbd44b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Deleting instance files /opt/stack/data/nova/instances/a1380b9d-f31a-4c49-8f1d-27d156e72f56_del
Jul 29 15:14:36 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-6afe2910-01b3-4da2-9789-1b0ea3cbd44b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Deletion of /opt/stack/data/nova/instances/a1380b9d-f31a-4c49-8f1d-27d156e72f56_del complete
Jul 29 15:14:36 user nova-compute[70924]: INFO nova.compute.manager [None req-6afe2910-01b3-4da2-9789-1b0ea3cbd44b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Took 1.20 seconds to destroy the instance on the hypervisor.
Jul 29 15:14:36 user nova-compute[70924]: DEBUG oslo.service.loopingcall [None req-6afe2910-01b3-4da2-9789-1b0ea3cbd44b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70924) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 15:14:36 user nova-compute[70924]: DEBUG nova.compute.manager [-] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Deallocating network for instance {{(pid=70924) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 15:14:36 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] deallocate_for_instance() {{(pid=70924) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 15:14:37 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:14:37 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Took 0.48 seconds to deallocate network for instance.
Jul 29 15:14:37 user nova-compute[70924]: DEBUG nova.compute.manager [req-e4e98152-8c7b-48b5-b3eb-ae417d85fa71 req-a6ec2ab1-b5ae-412a-946a-cf52843fc61d service nova] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Received event network-vif-deleted-402a09b0-1130-4f4a-88d4-89668aa9386d {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:14:37 user nova-compute[70924]: INFO nova.compute.manager [None req-6afe2910-01b3-4da2-9789-1b0ea3cbd44b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Took 0.76 seconds to detach 1 volumes for instance.
Jul 29 15:14:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-6afe2910-01b3-4da2-9789-1b0ea3cbd44b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:14:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-6afe2910-01b3-4da2-9789-1b0ea3cbd44b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:14:37 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-6afe2910-01b3-4da2-9789-1b0ea3cbd44b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:14:38 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-6afe2910-01b3-4da2-9789-1b0ea3cbd44b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:14:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-6afe2910-01b3-4da2-9789-1b0ea3cbd44b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.142s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:14:38 user nova-compute[70924]: INFO nova.scheduler.client.report [None req-6afe2910-01b3-4da2-9789-1b0ea3cbd44b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Deleted allocations for instance a1380b9d-f31a-4c49-8f1d-27d156e72f56
Jul 29 15:14:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-6afe2910-01b3-4da2-9789-1b0ea3cbd44b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "a1380b9d-f31a-4c49-8f1d-27d156e72f56" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.795s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:14:39 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:14:41 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:14:46 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:14:49 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:14:51 user nova-compute[70924]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690643676.1077406, a1380b9d-f31a-4c49-8f1d-27d156e72f56 => Stopped> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 15:14:51 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] VM Stopped (Lifecycle Event)
Jul 29 15:14:51 user nova-compute[70924]: DEBUG nova.compute.manager [None req-19377cdd-7b88-4606-9cf6-9b815c39b405 None None] [instance: a1380b9d-f31a-4c49-8f1d-27d156e72f56] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:14:51 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:14:54 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:14:56 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:14:57 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:14:59 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:15:01 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:15:04 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:15:05 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:15:06 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:15:06 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:15:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Acquiring lock "063ab57f-77b7-419e-9e23-74ef5ecb1de3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:15:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lock "063ab57f-77b7-419e-9e23-74ef5ecb1de3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:15:10 user nova-compute[70924]: DEBUG nova.compute.manager [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Starting instance... {{(pid=70924) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 15:15:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:15:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:15:10 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70924) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 15:15:10 user nova-compute[70924]: INFO nova.compute.claims [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Claim successful on node user
Jul 29 15:15:10 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:15:10 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:15:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.233s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:15:11 user nova-compute[70924]: DEBUG nova.compute.manager [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Start building networks asynchronously for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 15:15:11 user nova-compute[70924]: DEBUG nova.compute.manager [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Allocating IP information in the background. {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 15:15:11 user nova-compute[70924]: DEBUG nova.network.neutron [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] allocate_for_instance() {{(pid=70924) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 15:15:11 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 15:15:11 user nova-compute[70924]: DEBUG nova.compute.manager [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Start building block device mappings for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 15:15:11 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:15:11 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:15:11 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70924) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 29 15:15:11 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70924) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 15:15:11 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70924) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 15:15:11 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:15:11 user nova-compute[70924]: DEBUG nova.policy [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '69d9320bdf72435c95bfc51f1e363798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '009f7913a4294d0da1582ce7b2ef0e4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70924) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 15:15:11 user nova-compute[70924]: DEBUG nova.compute.manager [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Start spawning the instance on the hypervisor. {{(pid=70924) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 15:15:11 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Creating instance directory {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 15:15:11 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Creating image(s)
Jul 29 15:15:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Acquiring lock "/opt/stack/data/nova/instances/063ab57f-77b7-419e-9e23-74ef5ecb1de3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:15:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lock "/opt/stack/data/nova/instances/063ab57f-77b7-419e-9e23-74ef5ecb1de3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:15:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lock "/opt/stack/data/nova/instances/063ab57f-77b7-419e-9e23-74ef5ecb1de3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:15:11 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:15:11 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.151s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:15:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Acquiring lock "bd72453517468710f1de26b27fb0ea28688e9009" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:15:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:15:11 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:15:11 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.138s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:15:11 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/063ab57f-77b7-419e-9e23-74ef5ecb1de3/disk 1073741824 {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:15:11 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/063ab57f-77b7-419e-9e23-74ef5ecb1de3/disk 1073741824" returned: 0 in 0.049s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:15:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:15:11 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:15:11 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.136s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:15:11 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Checking if we can resize image /opt/stack/data/nova/instances/063ab57f-77b7-419e-9e23-74ef5ecb1de3/disk. size=1073741824 {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 15:15:11 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063ab57f-77b7-419e-9e23-74ef5ecb1de3/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:15:11 user nova-compute[70924]: DEBUG nova.network.neutron [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Successfully created port: a14a157c-3d01-4e33-8f27-bb3b34a6d0f7 {{(pid=70924) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 15:15:11 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063ab57f-77b7-419e-9e23-74ef5ecb1de3/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:15:11 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Cannot resize image /opt/stack/data/nova/instances/063ab57f-77b7-419e-9e23-74ef5ecb1de3/disk to a smaller size. {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 15:15:11 user nova-compute[70924]: DEBUG nova.objects.instance [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lazy-loading 'migration_context' on Instance uuid 063ab57f-77b7-419e-9e23-74ef5ecb1de3 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:15:11 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Created local disks {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 15:15:11 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Ensure instance console log exists: /opt/stack/data/nova/instances/063ab57f-77b7-419e-9e23-74ef5ecb1de3/console.log {{(pid=70924) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 15:15:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:15:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:15:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:15:12 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:15:12 user nova-compute[70924]: DEBUG nova.network.neutron [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Successfully updated port: a14a157c-3d01-4e33-8f27-bb3b34a6d0f7 {{(pid=70924) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 15:15:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Acquiring lock "refresh_cache-063ab57f-77b7-419e-9e23-74ef5ecb1de3" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:15:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Acquired lock "refresh_cache-063ab57f-77b7-419e-9e23-74ef5ecb1de3" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:15:12 user nova-compute[70924]: DEBUG nova.network.neutron [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 15:15:12 user nova-compute[70924]: DEBUG nova.compute.manager [req-ac3fb7dc-5bb5-4510-8c53-2853656595b3 req-fbb40f20-ae67-4a14-94d8-6ba7dae7acef service nova] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Received event network-changed-a14a157c-3d01-4e33-8f27-bb3b34a6d0f7 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:15:12 user nova-compute[70924]: DEBUG nova.compute.manager [req-ac3fb7dc-5bb5-4510-8c53-2853656595b3 req-fbb40f20-ae67-4a14-94d8-6ba7dae7acef service nova] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Refreshing instance network info cache due to event network-changed-a14a157c-3d01-4e33-8f27-bb3b34a6d0f7. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 15:15:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-ac3fb7dc-5bb5-4510-8c53-2853656595b3 req-fbb40f20-ae67-4a14-94d8-6ba7dae7acef service nova] Acquiring lock "refresh_cache-063ab57f-77b7-419e-9e23-74ef5ecb1de3" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:15:12 user nova-compute[70924]: DEBUG nova.network.neutron [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Instance cache missing network info. {{(pid=70924) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 15:15:12 user nova-compute[70924]: DEBUG nova.network.neutron [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Updating instance_info_cache with network_info: [{"id": "a14a157c-3d01-4e33-8f27-bb3b34a6d0f7", "address": "fa:16:3e:ca:89:58", "network": {"id": "fc6d0dd4-9152-40b4-a4ae-dedc25ef961d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1563810370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "009f7913a4294d0da1582ce7b2ef0e4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa14a157c-3d", "ovs_interfaceid": "a14a157c-3d01-4e33-8f27-bb3b34a6d0f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:15:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Releasing lock "refresh_cache-063ab57f-77b7-419e-9e23-74ef5ecb1de3" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:15:12 user nova-compute[70924]: DEBUG nova.compute.manager [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Instance network_info: |[{"id": "a14a157c-3d01-4e33-8f27-bb3b34a6d0f7", "address": "fa:16:3e:ca:89:58", "network": {"id": "fc6d0dd4-9152-40b4-a4ae-dedc25ef961d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1563810370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "009f7913a4294d0da1582ce7b2ef0e4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa14a157c-3d", "ovs_interfaceid": "a14a157c-3d01-4e33-8f27-bb3b34a6d0f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 15:15:12 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-ac3fb7dc-5bb5-4510-8c53-2853656595b3 req-fbb40f20-ae67-4a14-94d8-6ba7dae7acef service nova] Acquired lock "refresh_cache-063ab57f-77b7-419e-9e23-74ef5ecb1de3" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:15:12 user nova-compute[70924]: DEBUG nova.network.neutron [req-ac3fb7dc-5bb5-4510-8c53-2853656595b3 req-fbb40f20-ae67-4a14-94d8-6ba7dae7acef service nova] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Refreshing network info cache for port a14a157c-3d01-4e33-8f27-bb3b34a6d0f7 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 15:15:12 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Start _get_guest_xml network_info=[{"id": "a14a157c-3d01-4e33-8f27-bb3b34a6d0f7", "address": "fa:16:3e:ca:89:58", "network": {"id": "fc6d0dd4-9152-40b4-a4ae-dedc25ef961d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1563810370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "009f7913a4294d0da1582ce7b2ef0e4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa14a157c-3d", "ovs_interfaceid": "a14a157c-3d01-4e33-8f27-bb3b34a6d0f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '3aba2e73-6832-404b-8bd0-d0503ce82b8c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 15:15:12 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:15:12 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:15:12 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 15:15:12 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] CPU controller missing on host. {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 15:15:12 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 15:15:12 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] CPU controller found on host. {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 15:15:12 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70924) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 15:15:12 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T14:36:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 15:15:12 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Flavor limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 15:15:12 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Image limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 15:15:12 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Flavor pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 15:15:12 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Image pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 15:15:12 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 15:15:12 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 15:15:12 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 15:15:12 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Got 1 possible topologies {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 15:15:12 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 15:15:12 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 15:15:13 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T15:15:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2055722909',display_name='tempest-VolumesSnapshotTestJSON-instance-2055722909',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2055722909',id=50,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP6oi0iLTL3qeXSYK4pZdnUBueY0ncovUUCQgm6Dj4GyWI1X9m+ZMUd25A9sUdVl5Eu/AngqHlo5wE6dWiZI5fEIftc2q5blmRnB0gk2YZ/Qn1m/axo/xgm5S/wrZ9tLXA==',key_name='tempest-keypair-2095820806',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='009f7913a4294d0da1582ce7b2ef0e4e',ramdisk_id='',reservation_id='r-nrjkkilc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-92776344',owner_user_name='tempest-VolumesSnapshotTestJSON-92776344-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T15:15:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='69d9320bdf72435c95bfc51f1e363798',uuid=063ab57f-77b7-419e-9e23-74ef5ecb1de3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a14a157c-3d01-4e33-8f27-bb3b34a6d0f7", "address": "fa:16:3e:ca:89:58", "network": {"id": "fc6d0dd4-9152-40b4-a4ae-dedc25ef961d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1563810370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "009f7913a4294d0da1582ce7b2ef0e4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa14a157c-3d", "ovs_interfaceid": "a14a157c-3d01-4e33-8f27-bb3b34a6d0f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 15:15:13 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Converting VIF {"id": "a14a157c-3d01-4e33-8f27-bb3b34a6d0f7", "address": "fa:16:3e:ca:89:58", "network": {"id": "fc6d0dd4-9152-40b4-a4ae-dedc25ef961d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1563810370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "009f7913a4294d0da1582ce7b2ef0e4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa14a157c-3d", "ovs_interfaceid": "a14a157c-3d01-4e33-8f27-bb3b34a6d0f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 15:15:13 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:89:58,bridge_name='br-int',has_traffic_filtering=True,id=a14a157c-3d01-4e33-8f27-bb3b34a6d0f7,network=Network(fc6d0dd4-9152-40b4-a4ae-dedc25ef961d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa14a157c-3d') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 15:15:13 user nova-compute[70924]: DEBUG nova.objects.instance [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lazy-loading 'pci_devices' on Instance uuid 063ab57f-77b7-419e-9e23-74ef5ecb1de3 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:15:13 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] End _get_guest_xml xml=<domain type="kvm">
Jul 29 15:15:13 user nova-compute[70924]:   <uuid>063ab57f-77b7-419e-9e23-74ef5ecb1de3</uuid>
Jul 29 15:15:13 user nova-compute[70924]:   <name>instance-00000032</name>
Jul 29 15:15:13 user nova-compute[70924]:   <memory>524288</memory>
Jul 29 15:15:13 user nova-compute[70924]:   <vcpu>1</vcpu>
Jul 29 15:15:13 user nova-compute[70924]:   <metadata>
Jul 29 15:15:13 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 15:15:13 user nova-compute[70924]:       <nova:package version="0.0.0"/>
Jul 29 15:15:13 user nova-compute[70924]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-2055722909</nova:name>
Jul 29 15:15:13 user nova-compute[70924]:       <nova:creationTime>2023-07-29 15:15:12</nova:creationTime>
Jul 29 15:15:13 user nova-compute[70924]:       <nova:flavor name="m1.tiny">
Jul 29 15:15:13 user nova-compute[70924]:         <nova:memory>512</nova:memory>
Jul 29 15:15:13 user nova-compute[70924]:         <nova:disk>1</nova:disk>
Jul 29 15:15:13 user nova-compute[70924]:         <nova:swap>0</nova:swap>
Jul 29 15:15:13 user nova-compute[70924]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 15:15:13 user nova-compute[70924]:         <nova:vcpus>1</nova:vcpus>
Jul 29 15:15:13 user nova-compute[70924]:       </nova:flavor>
Jul 29 15:15:13 user nova-compute[70924]:       <nova:owner>
Jul 29 15:15:13 user nova-compute[70924]:         <nova:user uuid="69d9320bdf72435c95bfc51f1e363798">tempest-VolumesSnapshotTestJSON-92776344-project-member</nova:user>
Jul 29 15:15:13 user nova-compute[70924]:         <nova:project uuid="009f7913a4294d0da1582ce7b2ef0e4e">tempest-VolumesSnapshotTestJSON-92776344</nova:project>
Jul 29 15:15:13 user nova-compute[70924]:       </nova:owner>
Jul 29 15:15:13 user nova-compute[70924]:       <nova:root type="image" uuid="3aba2e73-6832-404b-8bd0-d0503ce82b8c"/>
Jul 29 15:15:13 user nova-compute[70924]:       <nova:ports>
Jul 29 15:15:13 user nova-compute[70924]:         <nova:port uuid="a14a157c-3d01-4e33-8f27-bb3b34a6d0f7">
Jul 29 15:15:13 user nova-compute[70924]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 29 15:15:13 user nova-compute[70924]:         </nova:port>
Jul 29 15:15:13 user nova-compute[70924]:       </nova:ports>
Jul 29 15:15:13 user nova-compute[70924]:     </nova:instance>
Jul 29 15:15:13 user nova-compute[70924]:   </metadata>
Jul 29 15:15:13 user nova-compute[70924]:   <sysinfo type="smbios">
Jul 29 15:15:13 user nova-compute[70924]:     <system>
Jul 29 15:15:13 user nova-compute[70924]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 15:15:13 user nova-compute[70924]:       <entry name="product">OpenStack Nova</entry>
Jul 29 15:15:13 user nova-compute[70924]:       <entry name="version">0.0.0</entry>
Jul 29 15:15:13 user nova-compute[70924]:       <entry name="serial">063ab57f-77b7-419e-9e23-74ef5ecb1de3</entry>
Jul 29 15:15:13 user nova-compute[70924]:       <entry name="uuid">063ab57f-77b7-419e-9e23-74ef5ecb1de3</entry>
Jul 29 15:15:13 user nova-compute[70924]:       <entry name="family">Virtual Machine</entry>
Jul 29 15:15:13 user nova-compute[70924]:     </system>
Jul 29 15:15:13 user nova-compute[70924]:   </sysinfo>
Jul 29 15:15:13 user nova-compute[70924]:   <os>
Jul 29 15:15:13 user nova-compute[70924]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 15:15:13 user nova-compute[70924]:     <boot dev="hd"/>
Jul 29 15:15:13 user nova-compute[70924]:     <smbios mode="sysinfo"/>
Jul 29 15:15:13 user nova-compute[70924]:   </os>
Jul 29 15:15:13 user nova-compute[70924]:   <features>
Jul 29 15:15:13 user nova-compute[70924]:     <acpi/>
Jul 29 15:15:13 user nova-compute[70924]:     <apic/>
Jul 29 15:15:13 user nova-compute[70924]:     <vmcoreinfo/>
Jul 29 15:15:13 user nova-compute[70924]:   </features>
Jul 29 15:15:13 user nova-compute[70924]:   <clock offset="utc">
Jul 29 15:15:13 user nova-compute[70924]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 15:15:13 user nova-compute[70924]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 15:15:13 user nova-compute[70924]:     <timer name="hpet" present="no"/>
Jul 29 15:15:13 user nova-compute[70924]:   </clock>
Jul 29 15:15:13 user nova-compute[70924]:   <cpu mode="custom" match="exact">
Jul 29 15:15:13 user nova-compute[70924]:     <model>Nehalem</model>
Jul 29 15:15:13 user nova-compute[70924]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 15:15:13 user nova-compute[70924]:   </cpu>
Jul 29 15:15:13 user nova-compute[70924]:   <devices>
Jul 29 15:15:13 user nova-compute[70924]:     <disk type="file" device="disk">
Jul 29 15:15:13 user nova-compute[70924]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 15:15:13 user nova-compute[70924]:       <source file="/opt/stack/data/nova/instances/063ab57f-77b7-419e-9e23-74ef5ecb1de3/disk"/>
Jul 29 15:15:13 user nova-compute[70924]:       <target dev="vda" bus="virtio"/>
Jul 29 15:15:13 user nova-compute[70924]:     </disk>
Jul 29 15:15:13 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 15:15:13 user nova-compute[70924]:       <mac address="fa:16:3e:ca:89:58"/>
Jul 29 15:15:13 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 15:15:13 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 15:15:13 user nova-compute[70924]:       <target dev="tapa14a157c-3d"/>
Jul 29 15:15:13 user nova-compute[70924]:     </interface>
Jul 29 15:15:13 user nova-compute[70924]:     <serial type="pty">
Jul 29 15:15:13 user nova-compute[70924]:       <log file="/opt/stack/data/nova/instances/063ab57f-77b7-419e-9e23-74ef5ecb1de3/console.log" append="off"/>
Jul 29 15:15:13 user nova-compute[70924]:     </serial>
Jul 29 15:15:13 user nova-compute[70924]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 15:15:13 user nova-compute[70924]:     <video>
Jul 29 15:15:13 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 15:15:13 user nova-compute[70924]:     </video>
Jul 29 15:15:13 user nova-compute[70924]:     <rng model="virtio">
Jul 29 15:15:13 user nova-compute[70924]:       <backend model="random">/dev/urandom</backend>
Jul 29 15:15:13 user nova-compute[70924]:     </rng>
Jul 29 15:15:13 user nova-compute[70924]:     <controller type="usb" index="0" model="none"/>
Jul 29 15:15:13 user nova-compute[70924]:     <memballoon model="virtio">
Jul 29 15:15:13 user nova-compute[70924]:       <stats period="10"/>
Jul 29 15:15:13 user nova-compute[70924]:     </memballoon>
Jul 29 15:15:13 user nova-compute[70924]:   </devices>
Jul 29 15:15:13 user nova-compute[70924]: </domain>
Jul 29 15:15:13 user nova-compute[70924]:  {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 15:15:13 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T15:15:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2055722909',display_name='tempest-VolumesSnapshotTestJSON-instance-2055722909',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2055722909',id=50,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP6oi0iLTL3qeXSYK4pZdnUBueY0ncovUUCQgm6Dj4GyWI1X9m+ZMUd25A9sUdVl5Eu/AngqHlo5wE6dWiZI5fEIftc2q5blmRnB0gk2YZ/Qn1m/axo/xgm5S/wrZ9tLXA==',key_name='tempest-keypair-2095820806',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='009f7913a4294d0da1582ce7b2ef0e4e',ramdisk_id='',reservation_id='r-nrjkkilc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-92776344',owner_user_name='tempest-VolumesSnapshotTestJSON-92776344-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T15:15:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='69d9320bdf72435c95bfc51f1e363798',uuid=063ab57f-77b7-419e-9e23-74ef5ecb1de3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a14a157c-3d01-4e33-8f27-bb3b34a6d0f7", "address": "fa:16:3e:ca:89:58", "network": {"id": "fc6d0dd4-9152-40b4-a4ae-dedc25ef961d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1563810370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "009f7913a4294d0da1582ce7b2ef0e4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa14a157c-3d", "ovs_interfaceid": "a14a157c-3d01-4e33-8f27-bb3b34a6d0f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 15:15:13 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Converting VIF {"id": "a14a157c-3d01-4e33-8f27-bb3b34a6d0f7", "address": "fa:16:3e:ca:89:58", "network": {"id": "fc6d0dd4-9152-40b4-a4ae-dedc25ef961d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1563810370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "009f7913a4294d0da1582ce7b2ef0e4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa14a157c-3d", "ovs_interfaceid": "a14a157c-3d01-4e33-8f27-bb3b34a6d0f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 15:15:13 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:89:58,bridge_name='br-int',has_traffic_filtering=True,id=a14a157c-3d01-4e33-8f27-bb3b34a6d0f7,network=Network(fc6d0dd4-9152-40b4-a4ae-dedc25ef961d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa14a157c-3d') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 15:15:13 user nova-compute[70924]: DEBUG os_vif [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:89:58,bridge_name='br-int',has_traffic_filtering=True,id=a14a157c-3d01-4e33-8f27-bb3b34a6d0f7,network=Network(fc6d0dd4-9152-40b4-a4ae-dedc25ef961d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa14a157c-3d') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 15:15:13 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:15:13 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:15:13 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 15:15:13 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:15:13 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa14a157c-3d, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:15:13 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa14a157c-3d, col_values=(('external_ids', {'iface-id': 'a14a157c-3d01-4e33-8f27-bb3b34a6d0f7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:89:58', 'vm-uuid': '063ab57f-77b7-419e-9e23-74ef5ecb1de3'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:15:13 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:15:13 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:15:13 user nova-compute[70924]: INFO os_vif [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:89:58,bridge_name='br-int',has_traffic_filtering=True,id=a14a157c-3d01-4e33-8f27-bb3b34a6d0f7,network=Network(fc6d0dd4-9152-40b4-a4ae-dedc25ef961d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa14a157c-3d')
Jul 29 15:15:13 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 15:15:13 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] No VIF found with MAC fa:16:3e:ca:89:58, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 15:15:13 user nova-compute[70924]: DEBUG nova.network.neutron [req-ac3fb7dc-5bb5-4510-8c53-2853656595b3 req-fbb40f20-ae67-4a14-94d8-6ba7dae7acef service nova] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Updated VIF entry in instance network info cache for port a14a157c-3d01-4e33-8f27-bb3b34a6d0f7. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 15:15:13 user nova-compute[70924]: DEBUG nova.network.neutron [req-ac3fb7dc-5bb5-4510-8c53-2853656595b3 req-fbb40f20-ae67-4a14-94d8-6ba7dae7acef service nova] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Updating instance_info_cache with network_info: [{"id": "a14a157c-3d01-4e33-8f27-bb3b34a6d0f7", "address": "fa:16:3e:ca:89:58", "network": {"id": "fc6d0dd4-9152-40b4-a4ae-dedc25ef961d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1563810370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "009f7913a4294d0da1582ce7b2ef0e4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa14a157c-3d", "ovs_interfaceid": "a14a157c-3d01-4e33-8f27-bb3b34a6d0f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:15:13 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-ac3fb7dc-5bb5-4510-8c53-2853656595b3 req-fbb40f20-ae67-4a14-94d8-6ba7dae7acef service nova] Releasing lock "refresh_cache-063ab57f-77b7-419e-9e23-74ef5ecb1de3" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:15:14 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:15:14 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:15:14 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:15:14 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:15:14 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:15:14 user nova-compute[70924]: DEBUG nova.compute.manager [req-a04af992-c44b-4fa3-9d8c-b239bda61e83 req-7877dadc-7697-40ce-8552-0bc029b711f6 service nova] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Received event network-vif-plugged-a14a157c-3d01-4e33-8f27-bb3b34a6d0f7 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:15:14 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a04af992-c44b-4fa3-9d8c-b239bda61e83 req-7877dadc-7697-40ce-8552-0bc029b711f6 service nova] Acquiring lock "063ab57f-77b7-419e-9e23-74ef5ecb1de3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:15:14 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a04af992-c44b-4fa3-9d8c-b239bda61e83 req-7877dadc-7697-40ce-8552-0bc029b711f6 service nova] Lock "063ab57f-77b7-419e-9e23-74ef5ecb1de3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:15:14 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a04af992-c44b-4fa3-9d8c-b239bda61e83 req-7877dadc-7697-40ce-8552-0bc029b711f6 service nova] Lock "063ab57f-77b7-419e-9e23-74ef5ecb1de3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:15:14 user nova-compute[70924]: DEBUG nova.compute.manager [req-a04af992-c44b-4fa3-9d8c-b239bda61e83 req-7877dadc-7697-40ce-8552-0bc029b711f6 service nova] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] No waiting events found dispatching network-vif-plugged-a14a157c-3d01-4e33-8f27-bb3b34a6d0f7 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:15:14 user nova-compute[70924]: WARNING nova.compute.manager [req-a04af992-c44b-4fa3-9d8c-b239bda61e83 req-7877dadc-7697-40ce-8552-0bc029b711f6 service nova] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Received unexpected event network-vif-plugged-a14a157c-3d01-4e33-8f27-bb3b34a6d0f7 for instance with vm_state building and task_state spawning.
Jul 29 15:15:15 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:15:15 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:15:15 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:15:16 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:15:16 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:15:16 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690643716.735519, 063ab57f-77b7-419e-9e23-74ef5ecb1de3 => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 15:15:16 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] VM Resumed (Lifecycle Event)
Jul 29 15:15:16 user nova-compute[70924]: DEBUG nova.compute.manager [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Instance event wait completed in 0 seconds for  {{(pid=70924) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 15:15:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Guest created on hypervisor {{(pid=70924) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 15:15:16 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Instance spawned successfully.
Jul 29 15:15:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 15:15:16 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:15:16 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 15:15:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Found default for hw_cdrom_bus of ide {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:15:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Found default for hw_disk_bus of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:15:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Found default for hw_input_bus of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:15:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Found default for hw_pointer_model of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:15:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Found default for hw_video_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:15:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Found default for hw_vif_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:15:16 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 15:15:16 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690643716.7369037, 063ab57f-77b7-419e-9e23-74ef5ecb1de3 => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 15:15:16 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] VM Started (Lifecycle Event)
Jul 29 15:15:16 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:15:16 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 15:15:16 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 15:15:16 user nova-compute[70924]: INFO nova.compute.manager [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Took 5.67 seconds to spawn the instance on the hypervisor.
Jul 29 15:15:16 user nova-compute[70924]: DEBUG nova.compute.manager [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:15:16 user nova-compute[70924]: DEBUG nova.compute.manager [req-c7cd6da9-4cb3-48f5-a60c-83c50289fd3b req-592e0469-c66a-42fc-8bf9-8b8595849fe5 service nova] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Received event network-vif-plugged-a14a157c-3d01-4e33-8f27-bb3b34a6d0f7 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:15:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c7cd6da9-4cb3-48f5-a60c-83c50289fd3b req-592e0469-c66a-42fc-8bf9-8b8595849fe5 service nova] Acquiring lock "063ab57f-77b7-419e-9e23-74ef5ecb1de3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:15:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c7cd6da9-4cb3-48f5-a60c-83c50289fd3b req-592e0469-c66a-42fc-8bf9-8b8595849fe5 service nova] Lock "063ab57f-77b7-419e-9e23-74ef5ecb1de3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:15:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-c7cd6da9-4cb3-48f5-a60c-83c50289fd3b req-592e0469-c66a-42fc-8bf9-8b8595849fe5 service nova] Lock "063ab57f-77b7-419e-9e23-74ef5ecb1de3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:15:16 user nova-compute[70924]: DEBUG nova.compute.manager [req-c7cd6da9-4cb3-48f5-a60c-83c50289fd3b req-592e0469-c66a-42fc-8bf9-8b8595849fe5 service nova] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] No waiting events found dispatching network-vif-plugged-a14a157c-3d01-4e33-8f27-bb3b34a6d0f7 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:15:16 user nova-compute[70924]: WARNING nova.compute.manager [req-c7cd6da9-4cb3-48f5-a60c-83c50289fd3b req-592e0469-c66a-42fc-8bf9-8b8595849fe5 service nova] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Received unexpected event network-vif-plugged-a14a157c-3d01-4e33-8f27-bb3b34a6d0f7 for instance with vm_state building and task_state spawning.
Jul 29 15:15:16 user nova-compute[70924]: INFO nova.compute.manager [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Took 6.25 seconds to build instance.
Jul 29 15:15:17 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-97afe4cf-686f-47eb-bfd7-daf3b98f24c0 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lock "063ab57f-77b7-419e-9e23-74ef5ecb1de3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.350s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:15:18 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:15:18 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:15:18 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70924) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 15:15:18 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:15:18 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:15:18 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:15:18 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:15:18 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Auditing locally available compute resources for user (node: user) {{(pid=70924) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 15:15:18 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 15:15:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063ab57f-77b7-419e-9e23-74ef5ecb1de3/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:15:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063ab57f-77b7-419e-9e23-74ef5ecb1de3/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:15:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063ab57f-77b7-419e-9e23-74ef5ecb1de3/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:15:18 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063ab57f-77b7-419e-9e23-74ef5ecb1de3/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:15:19 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:15:19 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:15:19 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Hypervisor/Node resource view: name=user free_ram=8596MB free_disk=25.285888671875GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70924) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 15:15:19 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:15:19 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:15:19 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 758d9381-32af-4433-8366-9e0aa9699137 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:15:19 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 063ab57f-77b7-419e-9e23-74ef5ecb1de3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:15:19 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 15:15:19 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 15:15:19 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:15:19 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:15:19 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:15:19 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Compute_service record updated for user:user {{(pid=70924) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 15:15:19 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.232s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:15:22 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:15:22 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:15:22 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Starting heal instance info cache {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 15:15:22 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Rebuilding the list of instances to heal {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 29 15:15:22 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "refresh_cache-758d9381-32af-4433-8366-9e0aa9699137" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:15:22 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquired lock "refresh_cache-758d9381-32af-4433-8366-9e0aa9699137" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:15:22 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Forcefully refreshing network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 29 15:15:22 user nova-compute[70924]: DEBUG nova.objects.instance [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lazy-loading 'info_cache' on Instance uuid 758d9381-32af-4433-8366-9e0aa9699137 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:15:23 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:15:23 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Updating instance_info_cache with network_info: [{"id": "590a32f6-52b6-4377-a140-0ff497ec1aad", "address": "fa:16:3e:5c:58:7f", "network": {"id": "c19ed38b-2acd-421a-9e4b-f60df3db2f1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1812407562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a974cbbf734f51897c3e632ae9e45f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap590a32f6-52", "ovs_interfaceid": "590a32f6-52b6-4377-a140-0ff497ec1aad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:15:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Releasing lock "refresh_cache-758d9381-32af-4433-8366-9e0aa9699137" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:15:23 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Updated the network info_cache for instance {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 29 15:15:23 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:15:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:15:29 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:15:33 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:15:34 user nova-compute[70924]: DEBUG nova.compute.manager [req-31cfdd6f-047c-4685-9b27-de58ef50c477 req-914ca649-6020-4cff-8224-3904618a3e1f service nova] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Received event network-changed-590a32f6-52b6-4377-a140-0ff497ec1aad {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:15:34 user nova-compute[70924]: DEBUG nova.compute.manager [req-31cfdd6f-047c-4685-9b27-de58ef50c477 req-914ca649-6020-4cff-8224-3904618a3e1f service nova] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Refreshing instance network info cache due to event network-changed-590a32f6-52b6-4377-a140-0ff497ec1aad. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 15:15:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-31cfdd6f-047c-4685-9b27-de58ef50c477 req-914ca649-6020-4cff-8224-3904618a3e1f service nova] Acquiring lock "refresh_cache-758d9381-32af-4433-8366-9e0aa9699137" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:15:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-31cfdd6f-047c-4685-9b27-de58ef50c477 req-914ca649-6020-4cff-8224-3904618a3e1f service nova] Acquired lock "refresh_cache-758d9381-32af-4433-8366-9e0aa9699137" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:15:34 user nova-compute[70924]: DEBUG nova.network.neutron [req-31cfdd6f-047c-4685-9b27-de58ef50c477 req-914ca649-6020-4cff-8224-3904618a3e1f service nova] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Refreshing network info cache for port 590a32f6-52b6-4377-a140-0ff497ec1aad {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 15:15:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:15:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1302c562-b258-445e-ba45-8ee4e9f9cc1b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Acquiring lock "758d9381-32af-4433-8366-9e0aa9699137" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:15:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1302c562-b258-445e-ba45-8ee4e9f9cc1b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "758d9381-32af-4433-8366-9e0aa9699137" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:15:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1302c562-b258-445e-ba45-8ee4e9f9cc1b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Acquiring lock "758d9381-32af-4433-8366-9e0aa9699137-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:15:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1302c562-b258-445e-ba45-8ee4e9f9cc1b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "758d9381-32af-4433-8366-9e0aa9699137-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:15:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1302c562-b258-445e-ba45-8ee4e9f9cc1b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "758d9381-32af-4433-8366-9e0aa9699137-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:15:34 user nova-compute[70924]: INFO nova.compute.manager [None req-1302c562-b258-445e-ba45-8ee4e9f9cc1b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Terminating instance
Jul 29 15:15:34 user nova-compute[70924]: DEBUG nova.compute.manager [None req-1302c562-b258-445e-ba45-8ee4e9f9cc1b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Start destroying the instance on the hypervisor. {{(pid=70924) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 15:15:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:15:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:15:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:15:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:15:35 user nova-compute[70924]: DEBUG nova.compute.manager [req-e9729e8f-96a2-43bd-be71-8dceadbcc35f req-05be8ae6-09c1-4b61-b294-3f49203d2680 service nova] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Received event network-vif-unplugged-590a32f6-52b6-4377-a140-0ff497ec1aad {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:15:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-e9729e8f-96a2-43bd-be71-8dceadbcc35f req-05be8ae6-09c1-4b61-b294-3f49203d2680 service nova] Acquiring lock "758d9381-32af-4433-8366-9e0aa9699137-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:15:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-e9729e8f-96a2-43bd-be71-8dceadbcc35f req-05be8ae6-09c1-4b61-b294-3f49203d2680 service nova] Lock "758d9381-32af-4433-8366-9e0aa9699137-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:15:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-e9729e8f-96a2-43bd-be71-8dceadbcc35f req-05be8ae6-09c1-4b61-b294-3f49203d2680 service nova] Lock "758d9381-32af-4433-8366-9e0aa9699137-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:15:35 user nova-compute[70924]: DEBUG nova.compute.manager [req-e9729e8f-96a2-43bd-be71-8dceadbcc35f req-05be8ae6-09c1-4b61-b294-3f49203d2680 service nova] [instance: 758d9381-32af-4433-8366-9e0aa9699137] No waiting events found dispatching network-vif-unplugged-590a32f6-52b6-4377-a140-0ff497ec1aad {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:15:35 user nova-compute[70924]: DEBUG nova.compute.manager [req-e9729e8f-96a2-43bd-be71-8dceadbcc35f req-05be8ae6-09c1-4b61-b294-3f49203d2680 service nova] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Received event network-vif-unplugged-590a32f6-52b6-4377-a140-0ff497ec1aad for instance with task_state deleting. {{(pid=70924) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 15:15:35 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Instance destroyed successfully.
Jul 29 15:15:35 user nova-compute[70924]: DEBUG nova.objects.instance [None req-1302c562-b258-445e-ba45-8ee4e9f9cc1b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lazy-loading 'resources' on Instance uuid 758d9381-32af-4433-8366-9e0aa9699137 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:15:35 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-1302c562-b258-445e-ba45-8ee4e9f9cc1b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T15:10:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1749406435',display_name='tempest-TestVolumeBootPattern-server-1749406435',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1749406435',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ85EoxOcLUTgXe8luwDJdmSAuW16EOphuu0LzU/6Hdmcve8fH6stAD+XoS0+shU7N/jDe0exnSkgWjCon0Br/QYJqNqli+yWYkmG2icNLlmtzdYRBdyLvXLjiH1TkzZOA==',key_name='tempest-TestVolumeBootPattern-447927024',keypairs=<?>,launch_index=0,launched_at=2023-07-29T15:10:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='99a974cbbf734f51897c3e632ae9e45f',ramdisk_id='',reservation_id='r-e6ryxa44',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1030839740',owner_user_name='tempest-TestVolumeBootPattern-1030839740-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T15:10:55Z,user_data=None,user_id='da204646e8f84693ad470ed1d3eadd7c',uuid=758d9381-32af-4433-8366-9e0aa9699137,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "590a32f6-52b6-4377-a140-0ff497ec1aad", "address": "fa:16:3e:5c:58:7f", "network": {"id": "c19ed38b-2acd-421a-9e4b-f60df3db2f1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1812407562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a974cbbf734f51897c3e632ae9e45f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap590a32f6-52", "ovs_interfaceid": "590a32f6-52b6-4377-a140-0ff497ec1aad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 15:15:35 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-1302c562-b258-445e-ba45-8ee4e9f9cc1b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Converting VIF {"id": "590a32f6-52b6-4377-a140-0ff497ec1aad", "address": "fa:16:3e:5c:58:7f", "network": {"id": "c19ed38b-2acd-421a-9e4b-f60df3db2f1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1812407562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a974cbbf734f51897c3e632ae9e45f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap590a32f6-52", "ovs_interfaceid": "590a32f6-52b6-4377-a140-0ff497ec1aad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 15:15:35 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-1302c562-b258-445e-ba45-8ee4e9f9cc1b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:58:7f,bridge_name='br-int',has_traffic_filtering=True,id=590a32f6-52b6-4377-a140-0ff497ec1aad,network=Network(c19ed38b-2acd-421a-9e4b-f60df3db2f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap590a32f6-52') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 15:15:35 user nova-compute[70924]: DEBUG os_vif [None req-1302c562-b258-445e-ba45-8ee4e9f9cc1b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:58:7f,bridge_name='br-int',has_traffic_filtering=True,id=590a32f6-52b6-4377-a140-0ff497ec1aad,network=Network(c19ed38b-2acd-421a-9e4b-f60df3db2f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap590a32f6-52') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 15:15:35 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:15:35 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap590a32f6-52, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:15:35 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:15:35 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:15:35 user nova-compute[70924]: INFO os_vif [None req-1302c562-b258-445e-ba45-8ee4e9f9cc1b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:58:7f,bridge_name='br-int',has_traffic_filtering=True,id=590a32f6-52b6-4377-a140-0ff497ec1aad,network=Network(c19ed38b-2acd-421a-9e4b-f60df3db2f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap590a32f6-52')
Jul 29 15:15:35 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1302c562-b258-445e-ba45-8ee4e9f9cc1b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 758d9381-32af-4433-8366-9e0aa9699137] calling os-brick to detach iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 15:15:35 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-1302c562-b258-445e-ba45-8ee4e9f9cc1b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, {'target_iqns': ['iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ANSHrCvV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 15:15:35 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-1302c562-b258-445e-ba45-8ee4e9f9cc1b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 15:15:35 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-1302c562-b258-445e-ba45-8ee4e9f9cc1b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 15:15:35 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-1302c562-b258-445e-ba45-8ee4e9f9cc1b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 15:15:35 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-1302c562-b258-445e-ba45-8ee4e9f9cc1b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490', 0)] {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 15:15:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:15:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:15:35 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f578230c-33aa-4e0e-999d-5a44ec5062df]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:15:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:15:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:15:35 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17c1b05-4348-43e2-8f33-2ebdc2369a8a]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:15:35 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-1302c562-b258-445e-ba45-8ee4e9f9cc1b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 (non-flash)
Jul 29 15:15:35 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 15:15:35 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-1302c562-b258-445e-ba45-8ee4e9f9cc1b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 (non-flash)
Jul 29 15:15:35 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 15:15:35 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-1302c562-b258-445e-ba45-8ee4e9f9cc1b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feedc34fd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490'): ({'sdc'}, set())}) {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 15:15:35 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-1302c562-b258-445e-ba45-8ee4e9f9cc1b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Removing single pathed devices sdc {{(pid=70924) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 15:15:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:15:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:15:35 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0577f800-dafe-4db7-9279-da31b3180496]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:15:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:15:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:15:35 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[302387f6-1fd5-481c-8112-1df2b4c909da]: (4, ('ok\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:15:35 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-1302c562-b258-445e-ba45-8ee4e9f9cc1b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Flushing IO for device /dev/sdc {{(pid=70924) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 15:15:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:15:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:15:35 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b769cf52-ea08-4270-8da3-c7b7c093b4e4]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:15:35 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-1302c562-b258-445e-ba45-8ee4e9f9cc1b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70924) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 15:15:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:15:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:15:35 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc1d25fe-a88a-4ed2-8743-8a585946057e]: (4, ('1', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:15:35 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-1302c562-b258-445e-ba45-8ee4e9f9cc1b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 15:15:35 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-1302c562-b258-445e-ba45-8ee4e9f9cc1b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] SCSI volumes sdc have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 15:15:35 user nova-compute[70924]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23165663864343861', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_3895041a', '/dev/disk/by-id/scsi-1SCST_BIO3895041a-1ef8d48a9950cecd') {{(pid=81998) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 29 15:15:35 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b385aef-123b-490a-8809-f652bdba5f62]: (4, None) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:15:35 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-1302c562-b258-445e-ba45-8ee4e9f9cc1b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490')] {{(pid=70924) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 15:15:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:15:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:15:35 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[daed4dc5-8f53-418c-813c-4d629fa730f6]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:15:35 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-1302c562-b258-445e-ba45-8ee4e9f9cc1b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:15:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 -p 172.16.0.220:3260 --logout {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:15:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:15:35 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1cd5fe-c257-4a5e-8b23-eabc627bc8a3]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:15:35 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-1302c562-b258-445e-ba45-8ee4e9f9cc1b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490, portal: 172.16.0.220,3260]
Jul 29 15:15:35 user nova-compute[70924]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490, portal: 172.16.0.220,3260] successful.
Jul 29 15:15:35 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:15:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 -p 172.16.0.220:3260 --op delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:15:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d7c7925-8381-4bfc-aff1-c1948bbd7490 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.075s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:15:35 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b3de8e-b23b-427d-89c4-c64e3e52bc96]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:15:35 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-1302c562-b258-445e-ba45-8ee4e9f9cc1b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:15:35 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-1302c562-b258-445e-ba45-8ee4e9f9cc1b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 15:15:35 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-1302c562-b258-445e-ba45-8ee4e9f9cc1b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] <== disconnect_volume: return (344ms) None {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 15:15:35 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1302c562-b258-445e-ba45-8ee4e9f9cc1b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Disconnected iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 15:15:35 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-1302c562-b258-445e-ba45-8ee4e9f9cc1b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Deleting instance files /opt/stack/data/nova/instances/758d9381-32af-4433-8366-9e0aa9699137_del
Jul 29 15:15:35 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-1302c562-b258-445e-ba45-8ee4e9f9cc1b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Deletion of /opt/stack/data/nova/instances/758d9381-32af-4433-8366-9e0aa9699137_del complete
Jul 29 15:15:35 user nova-compute[70924]: INFO nova.compute.manager [None req-1302c562-b258-445e-ba45-8ee4e9f9cc1b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Took 1.21 seconds to destroy the instance on the hypervisor.
Jul 29 15:15:35 user nova-compute[70924]: DEBUG oslo.service.loopingcall [None req-1302c562-b258-445e-ba45-8ee4e9f9cc1b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70924) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 15:15:35 user nova-compute[70924]: DEBUG nova.compute.manager [-] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Deallocating network for instance {{(pid=70924) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 15:15:35 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: 758d9381-32af-4433-8366-9e0aa9699137] deallocate_for_instance() {{(pid=70924) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 15:15:35 user nova-compute[70924]: DEBUG nova.network.neutron [req-31cfdd6f-047c-4685-9b27-de58ef50c477 req-914ca649-6020-4cff-8224-3904618a3e1f service nova] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Updated VIF entry in instance network info cache for port 590a32f6-52b6-4377-a140-0ff497ec1aad. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 15:15:35 user nova-compute[70924]: DEBUG nova.network.neutron [req-31cfdd6f-047c-4685-9b27-de58ef50c477 req-914ca649-6020-4cff-8224-3904618a3e1f service nova] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Updating instance_info_cache with network_info: [{"id": "590a32f6-52b6-4377-a140-0ff497ec1aad", "address": "fa:16:3e:5c:58:7f", "network": {"id": "c19ed38b-2acd-421a-9e4b-f60df3db2f1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1812407562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99a974cbbf734f51897c3e632ae9e45f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap590a32f6-52", "ovs_interfaceid": "590a32f6-52b6-4377-a140-0ff497ec1aad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:15:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-31cfdd6f-047c-4685-9b27-de58ef50c477 req-914ca649-6020-4cff-8224-3904618a3e1f service nova] Releasing lock "refresh_cache-758d9381-32af-4433-8366-9e0aa9699137" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:15:36 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:15:36 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:15:36 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Took 0.61 seconds to deallocate network for instance.
Jul 29 15:15:37 user nova-compute[70924]: INFO nova.compute.manager [None req-1302c562-b258-445e-ba45-8ee4e9f9cc1b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Took 0.78 seconds to detach 1 volumes for instance.
Jul 29 15:15:37 user nova-compute[70924]: DEBUG nova.compute.manager [req-51fba81e-10e3-4e06-9d16-15c31a890eaa req-5477a06f-cb63-4918-bcbe-d699cea6748e service nova] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Received event network-vif-plugged-590a32f6-52b6-4377-a140-0ff497ec1aad {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:15:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-51fba81e-10e3-4e06-9d16-15c31a890eaa req-5477a06f-cb63-4918-bcbe-d699cea6748e service nova] Acquiring lock "758d9381-32af-4433-8366-9e0aa9699137-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:15:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-51fba81e-10e3-4e06-9d16-15c31a890eaa req-5477a06f-cb63-4918-bcbe-d699cea6748e service nova] Lock "758d9381-32af-4433-8366-9e0aa9699137-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:15:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-51fba81e-10e3-4e06-9d16-15c31a890eaa req-5477a06f-cb63-4918-bcbe-d699cea6748e service nova] Lock "758d9381-32af-4433-8366-9e0aa9699137-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:15:37 user nova-compute[70924]: DEBUG nova.compute.manager [req-51fba81e-10e3-4e06-9d16-15c31a890eaa req-5477a06f-cb63-4918-bcbe-d699cea6748e service nova] [instance: 758d9381-32af-4433-8366-9e0aa9699137] No waiting events found dispatching network-vif-plugged-590a32f6-52b6-4377-a140-0ff497ec1aad {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:15:37 user nova-compute[70924]: WARNING nova.compute.manager [req-51fba81e-10e3-4e06-9d16-15c31a890eaa req-5477a06f-cb63-4918-bcbe-d699cea6748e service nova] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Received unexpected event network-vif-plugged-590a32f6-52b6-4377-a140-0ff497ec1aad for instance with vm_state active and task_state deleting.
Jul 29 15:15:37 user nova-compute[70924]: DEBUG nova.compute.manager [req-51fba81e-10e3-4e06-9d16-15c31a890eaa req-5477a06f-cb63-4918-bcbe-d699cea6748e service nova] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Received event network-vif-deleted-590a32f6-52b6-4377-a140-0ff497ec1aad {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:15:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1302c562-b258-445e-ba45-8ee4e9f9cc1b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:15:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1302c562-b258-445e-ba45-8ee4e9f9cc1b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:15:37 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-1302c562-b258-445e-ba45-8ee4e9f9cc1b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:15:37 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-1302c562-b258-445e-ba45-8ee4e9f9cc1b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:15:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1302c562-b258-445e-ba45-8ee4e9f9cc1b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.144s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:15:37 user nova-compute[70924]: INFO nova.scheduler.client.report [None req-1302c562-b258-445e-ba45-8ee4e9f9cc1b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Deleted allocations for instance 758d9381-32af-4433-8366-9e0aa9699137
Jul 29 15:15:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1302c562-b258-445e-ba45-8ee4e9f9cc1b tempest-TestVolumeBootPattern-1030839740 tempest-TestVolumeBootPattern-1030839740-project-member] Lock "758d9381-32af-4433-8366-9e0aa9699137" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.945s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:15:39 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:15:40 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:15:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:15:45 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:15:49 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:15:50 user nova-compute[70924]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690643735.2592628, 758d9381-32af-4433-8366-9e0aa9699137 => Stopped> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 15:15:50 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: 758d9381-32af-4433-8366-9e0aa9699137] VM Stopped (Lifecycle Event)
Jul 29 15:15:50 user nova-compute[70924]: DEBUG nova.compute.manager [None req-1cee1814-ccbf-4fce-81d7-04bceafb8f69 None None] [instance: 758d9381-32af-4433-8366-9e0aa9699137] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:15:50 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:15:55 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:16:00 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:16:05 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:16:07 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:16:08 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:16:10 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:16:12 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:16:15 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:16:17 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:16:17 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:16:19 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:16:19 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:16:19 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:16:19 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:16:19 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Auditing locally available compute resources for user (node: user) {{(pid=70924) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 15:16:19 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063ab57f-77b7-419e-9e23-74ef5ecb1de3/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:16:19 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063ab57f-77b7-419e-9e23-74ef5ecb1de3/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:16:19 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063ab57f-77b7-419e-9e23-74ef5ecb1de3/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:16:19 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063ab57f-77b7-419e-9e23-74ef5ecb1de3/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:16:20 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:16:20 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:16:20 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Hypervisor/Node resource view: name=user free_ram=8726MB free_disk=25.256702423095703GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70924) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 15:16:20 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:16:20 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:16:20 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 063ab57f-77b7-419e-9e23-74ef5ecb1de3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:16:20 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 15:16:20 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 15:16:20 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:16:20 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:16:20 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:16:20 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Compute_service record updated for user:user {{(pid=70924) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 15:16:20 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.222s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:16:21 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:16:21 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70924) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 15:16:23 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:16:23 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Starting heal instance info cache {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 15:16:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "refresh_cache-063ab57f-77b7-419e-9e23-74ef5ecb1de3" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:16:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquired lock "refresh_cache-063ab57f-77b7-419e-9e23-74ef5ecb1de3" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:16:23 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Forcefully refreshing network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 29 15:16:24 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Updating instance_info_cache with network_info: [{"id": "a14a157c-3d01-4e33-8f27-bb3b34a6d0f7", "address": "fa:16:3e:ca:89:58", "network": {"id": "fc6d0dd4-9152-40b4-a4ae-dedc25ef961d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1563810370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "009f7913a4294d0da1582ce7b2ef0e4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa14a157c-3d", "ovs_interfaceid": "a14a157c-3d01-4e33-8f27-bb3b34a6d0f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:16:24 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Releasing lock "refresh_cache-063ab57f-77b7-419e-9e23-74ef5ecb1de3" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:16:24 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Updated the network info_cache for instance {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 29 15:16:24 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:16:25 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:16:25 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:16:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:16:32 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:16:35 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:16:36 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:16:38 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:16:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:16:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:16:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:16:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:16:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:16:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:16:38 user nova-compute[70924]: DEBUG nova.virt.libvirt.imagecache [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Verify base images {{(pid=70924) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Jul 29 15:16:38 user nova-compute[70924]: DEBUG nova.virt.libvirt.imagecache [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Image id 3aba2e73-6832-404b-8bd0-d0503ce82b8c yields fingerprint bd72453517468710f1de26b27fb0ea28688e9009 {{(pid=70924) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Jul 29 15:16:38 user nova-compute[70924]: INFO nova.virt.libvirt.imagecache [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] image 3aba2e73-6832-404b-8bd0-d0503ce82b8c at (/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009): checking
Jul 29 15:16:38 user nova-compute[70924]: DEBUG nova.virt.libvirt.imagecache [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] image 3aba2e73-6832-404b-8bd0-d0503ce82b8c at (/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009): image is in use {{(pid=70924) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Jul 29 15:16:38 user nova-compute[70924]: DEBUG nova.virt.libvirt.imagecache [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=70924) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Jul 29 15:16:38 user nova-compute[70924]: DEBUG nova.virt.libvirt.imagecache [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] 063ab57f-77b7-419e-9e23-74ef5ecb1de3 is a valid instance name {{(pid=70924) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Jul 29 15:16:38 user nova-compute[70924]: DEBUG nova.virt.libvirt.imagecache [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] 063ab57f-77b7-419e-9e23-74ef5ecb1de3 has a disk file {{(pid=70924) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Jul 29 15:16:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063ab57f-77b7-419e-9e23-74ef5ecb1de3/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:16:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063ab57f-77b7-419e-9e23-74ef5ecb1de3/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:16:38 user nova-compute[70924]: DEBUG nova.virt.libvirt.imagecache [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 063ab57f-77b7-419e-9e23-74ef5ecb1de3 is backed by bd72453517468710f1de26b27fb0ea28688e9009 {{(pid=70924) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Jul 29 15:16:38 user nova-compute[70924]: WARNING nova.virt.libvirt.imagecache [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Unknown base file: /opt/stack/data/nova/instances/_base/b951c8f52057d68d8167817c7f7db7055dbe020a
Jul 29 15:16:38 user nova-compute[70924]: WARNING nova.virt.libvirt.imagecache [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Unknown base file: /opt/stack/data/nova/instances/_base/79cee0a79aaddda984afe8d28281e9c556228c3f
Jul 29 15:16:38 user nova-compute[70924]: WARNING nova.virt.libvirt.imagecache [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Unknown base file: /opt/stack/data/nova/instances/_base/5a4ae6046779fbcd27dd45012e98584ad882af3a
Jul 29 15:16:38 user nova-compute[70924]: WARNING nova.virt.libvirt.imagecache [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Unknown base file: /opt/stack/data/nova/instances/_base/437cd5e9c37eaf16a52af89493aa78388f349830
Jul 29 15:16:38 user nova-compute[70924]: WARNING nova.virt.libvirt.imagecache [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Unknown base file: /opt/stack/data/nova/instances/_base/c325354c6f96ae6ca58201cc6312f0237ea2d2bf
Jul 29 15:16:38 user nova-compute[70924]: WARNING nova.virt.libvirt.imagecache [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Unknown base file: /opt/stack/data/nova/instances/_base/404bd66c04051371b804393710c50ebf87c0b4e5
Jul 29 15:16:38 user nova-compute[70924]: WARNING nova.virt.libvirt.imagecache [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Unknown base file: /opt/stack/data/nova/instances/_base/517f9f18b87237442c9e82ec23fe9ab83c72ff21
Jul 29 15:16:38 user nova-compute[70924]: WARNING nova.virt.libvirt.imagecache [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Unknown base file: /opt/stack/data/nova/instances/_base/56cdab891b70ac73db8f1f2fc90cacf2adc01345
Jul 29 15:16:38 user nova-compute[70924]: WARNING nova.virt.libvirt.imagecache [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Unknown base file: /opt/stack/data/nova/instances/_base/487dc6b53db6d4d9f29443c756b9825cfa0de0f6
Jul 29 15:16:38 user nova-compute[70924]: INFO nova.virt.libvirt.imagecache [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Active base files: /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009
Jul 29 15:16:38 user nova-compute[70924]: INFO nova.virt.libvirt.imagecache [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Removable base files: /opt/stack/data/nova/instances/_base/b951c8f52057d68d8167817c7f7db7055dbe020a /opt/stack/data/nova/instances/_base/79cee0a79aaddda984afe8d28281e9c556228c3f /opt/stack/data/nova/instances/_base/5a4ae6046779fbcd27dd45012e98584ad882af3a /opt/stack/data/nova/instances/_base/437cd5e9c37eaf16a52af89493aa78388f349830 /opt/stack/data/nova/instances/_base/c325354c6f96ae6ca58201cc6312f0237ea2d2bf /opt/stack/data/nova/instances/_base/404bd66c04051371b804393710c50ebf87c0b4e5 /opt/stack/data/nova/instances/_base/517f9f18b87237442c9e82ec23fe9ab83c72ff21 /opt/stack/data/nova/instances/_base/56cdab891b70ac73db8f1f2fc90cacf2adc01345 /opt/stack/data/nova/instances/_base/487dc6b53db6d4d9f29443c756b9825cfa0de0f6
Jul 29 15:16:38 user nova-compute[70924]: INFO nova.virt.libvirt.imagecache [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b951c8f52057d68d8167817c7f7db7055dbe020a
Jul 29 15:16:38 user nova-compute[70924]: INFO nova.virt.libvirt.imagecache [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/79cee0a79aaddda984afe8d28281e9c556228c3f
Jul 29 15:16:38 user nova-compute[70924]: INFO nova.virt.libvirt.imagecache [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5a4ae6046779fbcd27dd45012e98584ad882af3a
Jul 29 15:16:38 user nova-compute[70924]: INFO nova.virt.libvirt.imagecache [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/437cd5e9c37eaf16a52af89493aa78388f349830
Jul 29 15:16:38 user nova-compute[70924]: INFO nova.virt.libvirt.imagecache [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c325354c6f96ae6ca58201cc6312f0237ea2d2bf
Jul 29 15:16:38 user nova-compute[70924]: INFO nova.virt.libvirt.imagecache [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/404bd66c04051371b804393710c50ebf87c0b4e5
Jul 29 15:16:38 user nova-compute[70924]: INFO nova.virt.libvirt.imagecache [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/517f9f18b87237442c9e82ec23fe9ab83c72ff21
Jul 29 15:16:38 user nova-compute[70924]: INFO nova.virt.libvirt.imagecache [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/56cdab891b70ac73db8f1f2fc90cacf2adc01345
Jul 29 15:16:38 user nova-compute[70924]: INFO nova.virt.libvirt.imagecache [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/487dc6b53db6d4d9f29443c756b9825cfa0de0f6
Jul 29 15:16:38 user nova-compute[70924]: DEBUG nova.virt.libvirt.imagecache [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Verification complete {{(pid=70924) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Jul 29 15:16:38 user nova-compute[70924]: DEBUG nova.virt.libvirt.imagecache [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Verify swap images {{(pid=70924) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Jul 29 15:16:38 user nova-compute[70924]: DEBUG nova.virt.libvirt.imagecache [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Verify ephemeral images {{(pid=70924) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Jul 29 15:16:40 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:16:45 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:16:50 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:16:55 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:17:00 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:17:02 user nova-compute[70924]: DEBUG nova.compute.manager [req-6dcfe4db-56f4-4add-8910-139111f6009c req-d27f5708-a219-4ae6-a9bb-9d403bbbe7d0 service nova] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Received event network-changed-a14a157c-3d01-4e33-8f27-bb3b34a6d0f7 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:17:02 user nova-compute[70924]: DEBUG nova.compute.manager [req-6dcfe4db-56f4-4add-8910-139111f6009c req-d27f5708-a219-4ae6-a9bb-9d403bbbe7d0 service nova] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Refreshing instance network info cache due to event network-changed-a14a157c-3d01-4e33-8f27-bb3b34a6d0f7. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 15:17:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-6dcfe4db-56f4-4add-8910-139111f6009c req-d27f5708-a219-4ae6-a9bb-9d403bbbe7d0 service nova] Acquiring lock "refresh_cache-063ab57f-77b7-419e-9e23-74ef5ecb1de3" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:17:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-6dcfe4db-56f4-4add-8910-139111f6009c req-d27f5708-a219-4ae6-a9bb-9d403bbbe7d0 service nova] Acquired lock "refresh_cache-063ab57f-77b7-419e-9e23-74ef5ecb1de3" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:17:02 user nova-compute[70924]: DEBUG nova.network.neutron [req-6dcfe4db-56f4-4add-8910-139111f6009c req-d27f5708-a219-4ae6-a9bb-9d403bbbe7d0 service nova] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Refreshing network info cache for port a14a157c-3d01-4e33-8f27-bb3b34a6d0f7 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 15:17:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-74b9fbf0-07ec-4414-91e1-1423d5929c64 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Acquiring lock "063ab57f-77b7-419e-9e23-74ef5ecb1de3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:17:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-74b9fbf0-07ec-4414-91e1-1423d5929c64 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lock "063ab57f-77b7-419e-9e23-74ef5ecb1de3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:17:02 user nova-compute[70924]: DEBUG nova.objects.instance [None req-74b9fbf0-07ec-4414-91e1-1423d5929c64 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lazy-loading 'flavor' on Instance uuid 063ab57f-77b7-419e-9e23-74ef5ecb1de3 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:17:02 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-74b9fbf0-07ec-4414-91e1-1423d5929c64 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Ignoring supplied device name: /dev/vdb
Jul 29 15:17:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-74b9fbf0-07ec-4414-91e1-1423d5929c64 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lock "063ab57f-77b7-419e-9e23-74ef5ecb1de3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:17:02 user nova-compute[70924]: DEBUG nova.network.neutron [req-6dcfe4db-56f4-4add-8910-139111f6009c req-d27f5708-a219-4ae6-a9bb-9d403bbbe7d0 service nova] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Updated VIF entry in instance network info cache for port a14a157c-3d01-4e33-8f27-bb3b34a6d0f7. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 15:17:02 user nova-compute[70924]: DEBUG nova.network.neutron [req-6dcfe4db-56f4-4add-8910-139111f6009c req-d27f5708-a219-4ae6-a9bb-9d403bbbe7d0 service nova] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Updating instance_info_cache with network_info: [{"id": "a14a157c-3d01-4e33-8f27-bb3b34a6d0f7", "address": "fa:16:3e:ca:89:58", "network": {"id": "fc6d0dd4-9152-40b4-a4ae-dedc25ef961d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1563810370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "009f7913a4294d0da1582ce7b2ef0e4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa14a157c-3d", "ovs_interfaceid": "a14a157c-3d01-4e33-8f27-bb3b34a6d0f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:17:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-6dcfe4db-56f4-4add-8910-139111f6009c req-d27f5708-a219-4ae6-a9bb-9d403bbbe7d0 service nova] Releasing lock "refresh_cache-063ab57f-77b7-419e-9e23-74ef5ecb1de3" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:17:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-74b9fbf0-07ec-4414-91e1-1423d5929c64 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Acquiring lock "063ab57f-77b7-419e-9e23-74ef5ecb1de3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:17:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-74b9fbf0-07ec-4414-91e1-1423d5929c64 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lock "063ab57f-77b7-419e-9e23-74ef5ecb1de3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:17:02 user nova-compute[70924]: INFO nova.compute.manager [None req-74b9fbf0-07ec-4414-91e1-1423d5929c64 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Attaching volume 244d03fa-f683-491b-8bdc-579828d0c192 to /dev/vdb
Jul 29 15:17:02 user nova-compute[70924]: DEBUG os_brick.utils [None req-74b9fbf0-07ec-4414-91e1-1423d5929c64 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 15:17:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:17:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:17:02 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[beeb7f3f-039e-4865-a091-afe669d5c79e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f2127c4a30d9\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:17:02 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:17:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:17:03 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34f3f9f-6fca-449e-b62f-7f2ed5462579]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:17:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:17:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:17:03 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0a90f7-0560-454b-959b-be2d1c2eb35d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:17:03 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4e1e9f-2673-4f1c-bcc9-2d829d588edf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:17:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-74b9fbf0-07ec-4414-91e1-1423d5929c64 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Running cmd (subprocess): nvme version {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:17:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-74b9fbf0-07ec-4414-91e1-1423d5929c64 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] 'nvme version' failed. Not Retrying. {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 15:17:03 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.nvmeof [None req-74b9fbf0-07ec-4414-91e1-1423d5929c64 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] nvme not present on system {{(pid=70924) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 15:17:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:17:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 15:17:03 user nova-compute[70924]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 15:17:03 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0130bbad-8bba-4ae1-892a-b6cb49ae0723]: (4, '') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:17:03 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-74b9fbf0-07ec-4414-91e1-1423d5929c64 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70924) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 15:17:03 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-74b9fbf0-07ec-4414-91e1-1423d5929c64 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 15:17:03 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-74b9fbf0-07ec-4414-91e1-1423d5929c64 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] LIGHTOS: no hostnqn found. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 15:17:03 user nova-compute[70924]: DEBUG os_brick.utils [None req-74b9fbf0-07ec-4414-91e1-1423d5929c64 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f2127c4a30d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 15:17:03 user nova-compute[70924]: DEBUG nova.virt.block_device [None req-74b9fbf0-07ec-4414-91e1-1423d5929c64 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Updating existing volume attachment record: 43a5478e-9591-4d71-a9af-14087e74b452 {{(pid=70924) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 15:17:04 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:17:05 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:17:06 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:17:06 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Cleaning up deleted instances {{(pid=70924) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 29 15:17:06 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] There are 0 instances to clean {{(pid=70924) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 29 15:17:08 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:17:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:17:09 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74b9fbf0-07ec-4414-91e1-1423d5929c64 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Calling os-brick to attach iSCSI Volume {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 15:17:09 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-74b9fbf0-07ec-4414-91e1-1423d5929c64 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:244d03fa-f683-491b-8bdc-579828d0c192'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YFdlSRiO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 15:17:09 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-74b9fbf0-07ec-4414-91e1-1423d5929c64 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 15:17:09 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-74b9fbf0-07ec-4414-91e1-1423d5929c64 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 15:17:09 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-74b9fbf0-07ec-4414-91e1-1423d5929c64 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 15:17:09 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-74b9fbf0-07ec-4414-91e1-1423d5929c64 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 15:17:09 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-74b9fbf0-07ec-4414-91e1-1423d5929c64 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:244d03fa-f683-491b-8bdc-579828d0c192" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 15:17:09 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-74b9fbf0-07ec-4414-91e1-1423d5929c64 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:244d03fa-f683-491b-8bdc-579828d0c192" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 15:17:09 user nova-compute[70924]: INFO os_brick.initiator.connectors.iscsi [None req-74b9fbf0-07ec-4414-91e1-1423d5929c64 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 15:17:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:244d03fa-f683-491b-8bdc-579828d0c192 -p 172.16.0.220:3260 {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:17:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:244d03fa-f683-491b-8bdc-579828d0c192 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:17:09 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee81199-7d2f-4e98-b7de-fdae31d09b63]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:17:09 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-74b9fbf0-07ec-4414-91e1-1423d5929c64 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 15:17:09 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:17:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:244d03fa-f683-491b-8bdc-579828d0c192 -p 172.16.0.220:3260 --interface default --op new {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:17:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:244d03fa-f683-491b-8bdc-579828d0c192 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:17:09 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a51552-b5ee-460e-92a5-9d78a8fb1dba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:244d03fa-f683-491b-8bdc-579828d0c192] added\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:17:09 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-74b9fbf0-07ec-4414-91e1-1423d5929c64 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:244d03fa-f683-491b-8bdc-579828d0c192] added
Jul 29 15:17:09 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:17:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:244d03fa-f683-491b-8bdc-579828d0c192 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:17:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:244d03fa-f683-491b-8bdc-579828d0c192 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:17:09 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ef54e7-860a-446e-9c56-7c7b45a1fe8c]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:17:09 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-74b9fbf0-07ec-4414-91e1-1423d5929c64 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:17:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:244d03fa-f683-491b-8bdc-579828d0c192 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:17:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:244d03fa-f683-491b-8bdc-579828d0c192 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:17:09 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c45f32-f94c-4543-aaca-be2b6814e3b4]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:17:09 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-74b9fbf0-07ec-4414-91e1-1423d5929c64 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:17:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:244d03fa-f683-491b-8bdc-579828d0c192 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YFdlSRiO {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:17:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:244d03fa-f683-491b-8bdc-579828d0c192 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YFdlSRiO" returned: 0 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:17:09 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90f8cd6-f930-421a-ac6d-fa693e6c2118]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:17:09 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-74b9fbf0-07ec-4414-91e1-1423d5929c64 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YFdlSRiO'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:17:09 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:244d03fa-f683-491b-8bdc-579828d0c192 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:17:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:244d03fa-f683-491b-8bdc-579828d0c192 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:17:10 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc69dc13-d4aa-4c3b-96ee-3c801376e803]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:17:10 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-74b9fbf0-07ec-4414-91e1-1423d5929c64 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:17:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:17:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:17:10 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b725fb7e-a006-4e69-a1c0-a314b217cd2a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:17:10 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-74b9fbf0-07ec-4414-91e1-1423d5929c64 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 29 15:17:10 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 15:17:10 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-74b9fbf0-07ec-4414-91e1-1423d5929c64 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 29 15:17:10 user nova-compute[70924]:  {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 15:17:10 user nova-compute[70924]: WARNING os_brick.initiator.connectors.iscsi [None req-74b9fbf0-07ec-4414-91e1-1423d5929c64 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 29 15:17:10 user nova-compute[70924]: 
Jul 29 15:17:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:244d03fa-f683-491b-8bdc-579828d0c192 -p 172.16.0.220:3260 --login {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:17:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:244d03fa-f683-491b-8bdc-579828d0c192 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:17:10 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c2387c-ea2e-45f5-81cf-dd4b5aa53c8b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:244d03fa-f683-491b-8bdc-579828d0c192, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:244d03fa-f683-491b-8bdc-579828d0c192, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:17:10 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-74b9fbf0-07ec-4414-91e1-1423d5929c64 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:244d03fa-f683-491b-8bdc-579828d0c192, portal: 172.16.0.220,3260]
Jul 29 15:17:10 user nova-compute[70924]: Login to [iface: default, target: iqn.2010-10.org.openstack:244d03fa-f683-491b-8bdc-579828d0c192, portal: 172.16.0.220,3260] successful.
Jul 29 15:17:10 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:17:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:244d03fa-f683-491b-8bdc-579828d0c192 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:17:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:244d03fa-f683-491b-8bdc-579828d0c192 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:17:10 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef11df4d-3f4f-410d-a83e-0e2bdbb1a087]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:17:10 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-74b9fbf0-07ec-4414-91e1-1423d5929c64 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:17:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:17:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:17:10 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27f4047-06f1-4b99-a6ec-268d32c839ab]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:244d03fa-f683-491b-8bdc-579828d0c192 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:17:10 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-74b9fbf0-07ec-4414-91e1-1423d5929c64 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:244d03fa-f683-491b-8bdc-579828d0c192 (non-flash)
Jul 29 15:17:10 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 15:17:10 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-74b9fbf0-07ec-4414-91e1-1423d5929c64 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:244d03fa-f683-491b-8bdc-579828d0c192 (non-flash)
Jul 29 15:17:10 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 15:17:10 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-74b9fbf0-07ec-4414-91e1-1423d5929c64 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:244d03fa-f683-491b-8bdc-579828d0c192" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 15:17:10 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-74b9fbf0-07ec-4414-91e1-1423d5929c64 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Connected to 172.16.0.220:3260 {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 15:17:10 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-74b9fbf0-07ec-4414-91e1-1423d5929c64 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=70924) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 15:17:10 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-74b9fbf0-07ec-4414-91e1-1423d5929c64 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70924) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 15:17:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:17:10 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:17:10 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5510537-71e5-4d5c-9abd-8d4e373f0c35]: (4, ('- - 0', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:17:10 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-74b9fbf0-07ec-4414-91e1-1423d5929c64 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 15:17:10 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-74b9fbf0-07ec-4414-91e1-1423d5929c64 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YFdlSRiO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 15:17:10 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:17:10 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:17:11 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-74b9fbf0-07ec-4414-91e1-1423d5929c64 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 15:17:11 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-74b9fbf0-07ec-4414-91e1-1423d5929c64 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '26661383664643131', 'path': '/dev/sdb'} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 15:17:11 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74b9fbf0-07ec-4414-91e1-1423d5929c64 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661383664643131', 'path': '/dev/sdb'} {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 15:17:11 user nova-compute[70924]: DEBUG nova.objects.instance [None req-74b9fbf0-07ec-4414-91e1-1423d5929c64 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lazy-loading 'flavor' on Instance uuid 063ab57f-77b7-419e-9e23-74ef5ecb1de3 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:17:11 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-74b9fbf0-07ec-4414-91e1-1423d5929c64 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] attach device xml: <disk type="block" device="disk">
Jul 29 15:17:11 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 15:17:11 user nova-compute[70924]:   <source dev="/dev/sdb"/>
Jul 29 15:17:11 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 15:17:11 user nova-compute[70924]:   <serial>244d03fa-f683-491b-8bdc-579828d0c192</serial>
Jul 29 15:17:11 user nova-compute[70924]: </disk>
Jul 29 15:17:11 user nova-compute[70924]:  {{(pid=70924) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 29 15:17:11 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-74b9fbf0-07ec-4414-91e1-1423d5929c64 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 15:17:11 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-74b9fbf0-07ec-4414-91e1-1423d5929c64 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 15:17:11 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-74b9fbf0-07ec-4414-91e1-1423d5929c64 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] No VIF found with MAC fa:16:3e:ca:89:58, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 15:17:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-74b9fbf0-07ec-4414-91e1-1423d5929c64 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lock "063ab57f-77b7-419e-9e23-74ef5ecb1de3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.933s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:17:12 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:17:15 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:17:17 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:17:19 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:17:19 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:17:20 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:17:20 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:17:20 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:17:20 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:17:20 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:17:20 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Auditing locally available compute resources for user (node: user) {{(pid=70924) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 15:17:20 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063ab57f-77b7-419e-9e23-74ef5ecb1de3/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:17:20 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063ab57f-77b7-419e-9e23-74ef5ecb1de3/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:17:20 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063ab57f-77b7-419e-9e23-74ef5ecb1de3/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:17:20 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/063ab57f-77b7-419e-9e23-74ef5ecb1de3/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:17:20 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70924) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 15:17:21 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:17:21 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:17:21 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Hypervisor/Node resource view: name=user free_ram=8797MB free_disk=25.24721908569336GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70924) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 15:17:21 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:17:21 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:17:21 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 063ab57f-77b7-419e-9e23-74ef5ecb1de3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:17:21 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 15:17:21 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 15:17:21 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:17:21 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:17:21 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Compute_service record updated for user:user {{(pid=70924) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 15:17:21 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.170s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:17:22 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:17:22 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70924) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 15:17:22 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:17:24 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:17:25 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:17:25 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:17:25 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:17:25 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Starting heal instance info cache {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 15:17:25 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Rebuilding the list of instances to heal {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 29 15:17:25 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "refresh_cache-063ab57f-77b7-419e-9e23-74ef5ecb1de3" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:17:25 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquired lock "refresh_cache-063ab57f-77b7-419e-9e23-74ef5ecb1de3" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:17:25 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Forcefully refreshing network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 29 15:17:25 user nova-compute[70924]: DEBUG nova.objects.instance [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lazy-loading 'info_cache' on Instance uuid 063ab57f-77b7-419e-9e23-74ef5ecb1de3 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:17:25 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Updating instance_info_cache with network_info: [{"id": "a14a157c-3d01-4e33-8f27-bb3b34a6d0f7", "address": "fa:16:3e:ca:89:58", "network": {"id": "fc6d0dd4-9152-40b4-a4ae-dedc25ef961d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1563810370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "009f7913a4294d0da1582ce7b2ef0e4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa14a157c-3d", "ovs_interfaceid": "a14a157c-3d01-4e33-8f27-bb3b34a6d0f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:17:25 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Releasing lock "refresh_cache-063ab57f-77b7-419e-9e23-74ef5ecb1de3" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:17:25 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Updated the network info_cache for instance {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 29 15:17:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:17:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:17:35 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:17:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-33a9d190-cb50-42d0-a1bf-90e34629038d tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Acquiring lock "063ab57f-77b7-419e-9e23-74ef5ecb1de3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:17:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-33a9d190-cb50-42d0-a1bf-90e34629038d tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lock "063ab57f-77b7-419e-9e23-74ef5ecb1de3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:17:35 user nova-compute[70924]: INFO nova.compute.manager [None req-33a9d190-cb50-42d0-a1bf-90e34629038d tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Detaching volume 244d03fa-f683-491b-8bdc-579828d0c192
Jul 29 15:17:35 user nova-compute[70924]: INFO nova.virt.block_device [None req-33a9d190-cb50-42d0-a1bf-90e34629038d tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Attempting to driver detach volume 244d03fa-f683-491b-8bdc-579828d0c192 from mountpoint /dev/vdb
Jul 29 15:17:35 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-33a9d190-cb50-42d0-a1bf-90e34629038d tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Attempting to detach device vdb from instance 063ab57f-77b7-419e-9e23-74ef5ecb1de3 from the persistent domain config. {{(pid=70924) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 29 15:17:35 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-33a9d190-cb50-42d0-a1bf-90e34629038d tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 15:17:35 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 15:17:35 user nova-compute[70924]:   <source dev="/dev/sdb"/>
Jul 29 15:17:35 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 15:17:35 user nova-compute[70924]:   <serial>244d03fa-f683-491b-8bdc-579828d0c192</serial>
Jul 29 15:17:35 user nova-compute[70924]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 15:17:35 user nova-compute[70924]: </disk>
Jul 29 15:17:35 user nova-compute[70924]:  {{(pid=70924) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 15:17:35 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-33a9d190-cb50-42d0-a1bf-90e34629038d tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Successfully detached device vdb from instance 063ab57f-77b7-419e-9e23-74ef5ecb1de3 from the persistent domain config.
Jul 29 15:17:35 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-33a9d190-cb50-42d0-a1bf-90e34629038d tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 063ab57f-77b7-419e-9e23-74ef5ecb1de3 from the live domain config. {{(pid=70924) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 29 15:17:35 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-33a9d190-cb50-42d0-a1bf-90e34629038d tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 15:17:35 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 15:17:35 user nova-compute[70924]:   <source dev="/dev/sdb"/>
Jul 29 15:17:35 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 15:17:35 user nova-compute[70924]:   <serial>244d03fa-f683-491b-8bdc-579828d0c192</serial>
Jul 29 15:17:35 user nova-compute[70924]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 15:17:35 user nova-compute[70924]: </disk>
Jul 29 15:17:35 user nova-compute[70924]:  {{(pid=70924) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 15:17:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-f8bc2d4a-0c6b-4232-b2fd-36126d042413 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Acquiring lock "063ab57f-77b7-419e-9e23-74ef5ecb1de3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:17:36 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Received event <DeviceRemovedEvent: 1690643856.0198824, 063ab57f-77b7-419e-9e23-74ef5ecb1de3 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70924) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 29 15:17:36 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-33a9d190-cb50-42d0-a1bf-90e34629038d tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 063ab57f-77b7-419e-9e23-74ef5ecb1de3 {{(pid=70924) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 29 15:17:36 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-33a9d190-cb50-42d0-a1bf-90e34629038d tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Successfully detached device vdb from instance 063ab57f-77b7-419e-9e23-74ef5ecb1de3 from the live domain config.
Jul 29 15:17:36 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33a9d190-cb50-42d0-a1bf-90e34629038d tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] calling os-brick to detach iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 15:17:36 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-33a9d190-cb50-42d0-a1bf-90e34629038d tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, {'target_iqns': ['iqn.2010-10.org.openstack:244d03fa-f683-491b-8bdc-579828d0c192'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YFdlSRiO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 15:17:36 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-33a9d190-cb50-42d0-a1bf-90e34629038d tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 15:17:36 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-33a9d190-cb50-42d0-a1bf-90e34629038d tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 15:17:36 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-33a9d190-cb50-42d0-a1bf-90e34629038d tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 15:17:36 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-33a9d190-cb50-42d0-a1bf-90e34629038d tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:244d03fa-f683-491b-8bdc-579828d0c192', 0)] {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 15:17:36 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:17:36 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:17:36 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4481c04-a1b6-46d6-93aa-3fdb322ccc5e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:244d03fa-f683-491b-8bdc-579828d0c192\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:17:36 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:17:36 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:17:36 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b0d6df4-22e6-467f-a107-10e621d6b0d7]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:244d03fa-f683-491b-8bdc-579828d0c192 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:17:36 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-33a9d190-cb50-42d0-a1bf-90e34629038d tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:244d03fa-f683-491b-8bdc-579828d0c192 (non-flash)
Jul 29 15:17:36 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 15:17:36 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-33a9d190-cb50-42d0-a1bf-90e34629038d tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:244d03fa-f683-491b-8bdc-579828d0c192 (non-flash)
Jul 29 15:17:36 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 15:17:36 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-33a9d190-cb50-42d0-a1bf-90e34629038d tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feedc3a1d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:244d03fa-f683-491b-8bdc-579828d0c192'): ({'sdb'}, set())}) {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 15:17:36 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-33a9d190-cb50-42d0-a1bf-90e34629038d tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Removing single pathed devices sdb {{(pid=70924) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 15:17:36 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:17:36 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:17:36 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0b917a-942a-4f36-8eb8-61bfa87c5ee0]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:17:36 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:17:36 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:17:36 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc20e21d-643b-4bbb-ad79-4c0de2361694]: (4, ('ok\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:17:36 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-33a9d190-cb50-42d0-a1bf-90e34629038d tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Flushing IO for device /dev/sdb {{(pid=70924) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 15:17:36 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:17:36 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:17:36 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93ac715-0150-4b73-a6cb-5fb33166ccac]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:17:36 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-33a9d190-cb50-42d0-a1bf-90e34629038d tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70924) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 15:17:36 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:17:36 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:17:36 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd265cf-5193-46cb-ba1d-191a3616afef]: (4, ('1', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:17:36 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-33a9d190-cb50-42d0-a1bf-90e34629038d tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 15:17:36 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-33a9d190-cb50-42d0-a1bf-90e34629038d tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] SCSI volumes sdb have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 15:17:36 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-33a9d190-cb50-42d0-a1bf-90e34629038d tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:244d03fa-f683-491b-8bdc-579828d0c192')] {{(pid=70924) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 15:17:36 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:244d03fa-f683-491b-8bdc-579828d0c192 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:17:36 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:244d03fa-f683-491b-8bdc-579828d0c192 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:17:36 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[489ad17a-158a-4996-ab8f-d37f63e776c4]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:17:36 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-33a9d190-cb50-42d0-a1bf-90e34629038d tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:17:36 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:244d03fa-f683-491b-8bdc-579828d0c192 -p 172.16.0.220:3260 --logout {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:17:36 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:244d03fa-f683-491b-8bdc-579828d0c192 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:17:36 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b3e7cb1-4b9b-4f94-b9f8-abdcab1ac1e5]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:244d03fa-f683-491b-8bdc-579828d0c192, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:244d03fa-f683-491b-8bdc-579828d0c192, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:17:36 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-33a9d190-cb50-42d0-a1bf-90e34629038d tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:244d03fa-f683-491b-8bdc-579828d0c192, portal: 172.16.0.220,3260]
Jul 29 15:17:36 user nova-compute[70924]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:244d03fa-f683-491b-8bdc-579828d0c192, portal: 172.16.0.220,3260] successful.
Jul 29 15:17:36 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:17:36 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:244d03fa-f683-491b-8bdc-579828d0c192 -p 172.16.0.220:3260 --op delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:17:36 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:244d03fa-f683-491b-8bdc-579828d0c192 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:17:36 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce2c6c6-0c70-40b2-b353-7a55e3ff129c]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:17:36 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-33a9d190-cb50-42d0-a1bf-90e34629038d tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:17:36 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-33a9d190-cb50-42d0-a1bf-90e34629038d tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.265s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 15:17:36 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-33a9d190-cb50-42d0-a1bf-90e34629038d tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] <== disconnect_volume: return (266ms) None {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 15:17:36 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33a9d190-cb50-42d0-a1bf-90e34629038d tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Disconnected iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 15:17:37 user nova-compute[70924]: DEBUG nova.objects.instance [None req-33a9d190-cb50-42d0-a1bf-90e34629038d tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lazy-loading 'flavor' on Instance uuid 063ab57f-77b7-419e-9e23-74ef5ecb1de3 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:17:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-33a9d190-cb50-42d0-a1bf-90e34629038d tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lock "063ab57f-77b7-419e-9e23-74ef5ecb1de3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.773s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:17:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-f8bc2d4a-0c6b-4232-b2fd-36126d042413 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lock "063ab57f-77b7-419e-9e23-74ef5ecb1de3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.623s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:17:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-f8bc2d4a-0c6b-4232-b2fd-36126d042413 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Acquiring lock "063ab57f-77b7-419e-9e23-74ef5ecb1de3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:17:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-f8bc2d4a-0c6b-4232-b2fd-36126d042413 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lock "063ab57f-77b7-419e-9e23-74ef5ecb1de3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:17:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-f8bc2d4a-0c6b-4232-b2fd-36126d042413 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lock "063ab57f-77b7-419e-9e23-74ef5ecb1de3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:17:37 user nova-compute[70924]: INFO nova.compute.manager [None req-f8bc2d4a-0c6b-4232-b2fd-36126d042413 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Terminating instance
Jul 29 15:17:37 user nova-compute[70924]: DEBUG nova.compute.manager [None req-f8bc2d4a-0c6b-4232-b2fd-36126d042413 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Start destroying the instance on the hypervisor. {{(pid=70924) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 15:17:37 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:17:37 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:17:37 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:17:37 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:17:37 user nova-compute[70924]: DEBUG nova.compute.manager [req-7c85b049-a257-4414-89bd-96df00c0cac7 req-3ead2ec2-6b9a-41d3-a92e-136e01663631 service nova] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Received event network-vif-unplugged-a14a157c-3d01-4e33-8f27-bb3b34a6d0f7 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:17:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-7c85b049-a257-4414-89bd-96df00c0cac7 req-3ead2ec2-6b9a-41d3-a92e-136e01663631 service nova] Acquiring lock "063ab57f-77b7-419e-9e23-74ef5ecb1de3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:17:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-7c85b049-a257-4414-89bd-96df00c0cac7 req-3ead2ec2-6b9a-41d3-a92e-136e01663631 service nova] Lock "063ab57f-77b7-419e-9e23-74ef5ecb1de3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:17:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-7c85b049-a257-4414-89bd-96df00c0cac7 req-3ead2ec2-6b9a-41d3-a92e-136e01663631 service nova] Lock "063ab57f-77b7-419e-9e23-74ef5ecb1de3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:17:37 user nova-compute[70924]: DEBUG nova.compute.manager [req-7c85b049-a257-4414-89bd-96df00c0cac7 req-3ead2ec2-6b9a-41d3-a92e-136e01663631 service nova] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] No waiting events found dispatching network-vif-unplugged-a14a157c-3d01-4e33-8f27-bb3b34a6d0f7 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:17:37 user nova-compute[70924]: DEBUG nova.compute.manager [req-7c85b049-a257-4414-89bd-96df00c0cac7 req-3ead2ec2-6b9a-41d3-a92e-136e01663631 service nova] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Received event network-vif-unplugged-a14a157c-3d01-4e33-8f27-bb3b34a6d0f7 for instance with task_state deleting. {{(pid=70924) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 15:17:37 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:17:37 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Instance destroyed successfully.
Jul 29 15:17:37 user nova-compute[70924]: DEBUG nova.objects.instance [None req-f8bc2d4a-0c6b-4232-b2fd-36126d042413 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lazy-loading 'resources' on Instance uuid 063ab57f-77b7-419e-9e23-74ef5ecb1de3 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:17:37 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-f8bc2d4a-0c6b-4232-b2fd-36126d042413 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T15:15:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2055722909',display_name='tempest-VolumesSnapshotTestJSON-instance-2055722909',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2055722909',id=50,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP6oi0iLTL3qeXSYK4pZdnUBueY0ncovUUCQgm6Dj4GyWI1X9m+ZMUd25A9sUdVl5Eu/AngqHlo5wE6dWiZI5fEIftc2q5blmRnB0gk2YZ/Qn1m/axo/xgm5S/wrZ9tLXA==',key_name='tempest-keypair-2095820806',keypairs=<?>,launch_index=0,launched_at=2023-07-29T15:15:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='009f7913a4294d0da1582ce7b2ef0e4e',ramdisk_id='',reservation_id='r-nrjkkilc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-92776344',owner_user_name='tempest-VolumesSnapshotTestJSON-92776344-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T15:15:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='69d9320bdf72435c95bfc51f1e363798',uuid=063ab57f-77b7-419e-9e23-74ef5ecb1de3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a14a157c-3d01-4e33-8f27-bb3b34a6d0f7", "address": "fa:16:3e:ca:89:58", "network": {"id": "fc6d0dd4-9152-40b4-a4ae-dedc25ef961d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1563810370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "009f7913a4294d0da1582ce7b2ef0e4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa14a157c-3d", "ovs_interfaceid": "a14a157c-3d01-4e33-8f27-bb3b34a6d0f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 15:17:37 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-f8bc2d4a-0c6b-4232-b2fd-36126d042413 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Converting VIF {"id": "a14a157c-3d01-4e33-8f27-bb3b34a6d0f7", "address": "fa:16:3e:ca:89:58", "network": {"id": "fc6d0dd4-9152-40b4-a4ae-dedc25ef961d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1563810370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "009f7913a4294d0da1582ce7b2ef0e4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa14a157c-3d", "ovs_interfaceid": "a14a157c-3d01-4e33-8f27-bb3b34a6d0f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 15:17:37 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-f8bc2d4a-0c6b-4232-b2fd-36126d042413 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ca:89:58,bridge_name='br-int',has_traffic_filtering=True,id=a14a157c-3d01-4e33-8f27-bb3b34a6d0f7,network=Network(fc6d0dd4-9152-40b4-a4ae-dedc25ef961d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa14a157c-3d') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 15:17:37 user nova-compute[70924]: DEBUG os_vif [None req-f8bc2d4a-0c6b-4232-b2fd-36126d042413 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:89:58,bridge_name='br-int',has_traffic_filtering=True,id=a14a157c-3d01-4e33-8f27-bb3b34a6d0f7,network=Network(fc6d0dd4-9152-40b4-a4ae-dedc25ef961d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa14a157c-3d') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 15:17:37 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:17:37 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa14a157c-3d, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:17:37 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:17:37 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:17:38 user nova-compute[70924]: INFO os_vif [None req-f8bc2d4a-0c6b-4232-b2fd-36126d042413 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:89:58,bridge_name='br-int',has_traffic_filtering=True,id=a14a157c-3d01-4e33-8f27-bb3b34a6d0f7,network=Network(fc6d0dd4-9152-40b4-a4ae-dedc25ef961d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa14a157c-3d')
Jul 29 15:17:38 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8bc2d4a-0c6b-4232-b2fd-36126d042413 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] calling os-brick to detach iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 15:17:38 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8bc2d4a-0c6b-4232-b2fd-36126d042413 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, {'target_iqns': ['iqn.2010-10.org.openstack:244d03fa-f683-491b-8bdc-579828d0c192'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YFdlSRiO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 15:17:38 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-f8bc2d4a-0c6b-4232-b2fd-36126d042413 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 15:17:38 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-f8bc2d4a-0c6b-4232-b2fd-36126d042413 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 15:17:38 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-f8bc2d4a-0c6b-4232-b2fd-36126d042413 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 15:17:38 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8bc2d4a-0c6b-4232-b2fd-36126d042413 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:244d03fa-f683-491b-8bdc-579828d0c192', 0)] {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 15:17:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:17:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 21 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:17:38 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[511d6fe7-a0b4-4800-a646-7d91e8b5980a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:17:38 user nova-compute[70924]: WARNING os_brick.initiator.connectors.iscsi [None req-f8bc2d4a-0c6b-4232-b2fd-36126d042413 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Couldn't find iSCSI nodes because iscsiadm err: iscsiadm: No records found
Jul 29 15:17:38 user nova-compute[70924]: 
Jul 29 15:17:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:17:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:17:38 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[802c938b-7600-4da2-aaed-34e1b2e552e1]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:17:38 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8bc2d4a-0c6b-4232-b2fd-36126d042413 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 29 15:17:38 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 15:17:38 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8bc2d4a-0c6b-4232-b2fd-36126d042413 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 29 15:17:38 user nova-compute[70924]:  {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 15:17:38 user nova-compute[70924]: WARNING os_brick.initiator.connectors.iscsi [None req-f8bc2d4a-0c6b-4232-b2fd-36126d042413 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 29 15:17:38 user nova-compute[70924]: 
Jul 29 15:17:38 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8bc2d4a-0c6b-4232-b2fd-36126d042413 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feecc3dcdc0>, {}) {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 15:17:38 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8bc2d4a-0c6b-4232-b2fd-36126d042413 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Disconnecting from: [] {{(pid=70924) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 15:17:38 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-f8bc2d4a-0c6b-4232-b2fd-36126d042413 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.040s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 15:17:38 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8bc2d4a-0c6b-4232-b2fd-36126d042413 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] <== disconnect_volume: return (41ms) None {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 15:17:38 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8bc2d4a-0c6b-4232-b2fd-36126d042413 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Disconnected iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 15:17:38 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-f8bc2d4a-0c6b-4232-b2fd-36126d042413 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Deleting instance files /opt/stack/data/nova/instances/063ab57f-77b7-419e-9e23-74ef5ecb1de3_del
Jul 29 15:17:38 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-f8bc2d4a-0c6b-4232-b2fd-36126d042413 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Deletion of /opt/stack/data/nova/instances/063ab57f-77b7-419e-9e23-74ef5ecb1de3_del complete
Jul 29 15:17:38 user nova-compute[70924]: INFO nova.compute.manager [None req-f8bc2d4a-0c6b-4232-b2fd-36126d042413 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Took 0.91 seconds to destroy the instance on the hypervisor.
Jul 29 15:17:38 user nova-compute[70924]: DEBUG oslo.service.loopingcall [None req-f8bc2d4a-0c6b-4232-b2fd-36126d042413 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70924) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 15:17:38 user nova-compute[70924]: DEBUG nova.compute.manager [-] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Deallocating network for instance {{(pid=70924) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 15:17:38 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] deallocate_for_instance() {{(pid=70924) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 15:17:39 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:17:39 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Took 1.12 seconds to deallocate network for instance.
Jul 29 15:17:39 user nova-compute[70924]: WARNING nova.volume.cinder [None req-f8bc2d4a-0c6b-4232-b2fd-36126d042413 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Attachment 43a5478e-9591-4d71-a9af-14087e74b452 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 43a5478e-9591-4d71-a9af-14087e74b452. (HTTP 404) (Request-ID: req-c0bda77d-526d-43d0-ae5d-49915d6ba024)
Jul 29 15:17:39 user nova-compute[70924]: INFO nova.compute.manager [None req-f8bc2d4a-0c6b-4232-b2fd-36126d042413 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Took 0.02 seconds to detach 1 volumes for instance.
Jul 29 15:17:39 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-f8bc2d4a-0c6b-4232-b2fd-36126d042413 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:17:39 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-f8bc2d4a-0c6b-4232-b2fd-36126d042413 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:17:39 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-f8bc2d4a-0c6b-4232-b2fd-36126d042413 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:17:39 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-f8bc2d4a-0c6b-4232-b2fd-36126d042413 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:17:39 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-f8bc2d4a-0c6b-4232-b2fd-36126d042413 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.185s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:17:39 user nova-compute[70924]: INFO nova.scheduler.client.report [None req-f8bc2d4a-0c6b-4232-b2fd-36126d042413 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Deleted allocations for instance 063ab57f-77b7-419e-9e23-74ef5ecb1de3
Jul 29 15:17:39 user nova-compute[70924]: DEBUG nova.compute.manager [req-d16edd2a-d7fe-4bd3-869d-050214cefe03 req-19c7bffe-d264-4744-acf1-6ce03872cdc1 service nova] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Received event network-vif-plugged-a14a157c-3d01-4e33-8f27-bb3b34a6d0f7 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:17:39 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-d16edd2a-d7fe-4bd3-869d-050214cefe03 req-19c7bffe-d264-4744-acf1-6ce03872cdc1 service nova] Acquiring lock "063ab57f-77b7-419e-9e23-74ef5ecb1de3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:17:39 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-d16edd2a-d7fe-4bd3-869d-050214cefe03 req-19c7bffe-d264-4744-acf1-6ce03872cdc1 service nova] Lock "063ab57f-77b7-419e-9e23-74ef5ecb1de3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:17:39 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-d16edd2a-d7fe-4bd3-869d-050214cefe03 req-19c7bffe-d264-4744-acf1-6ce03872cdc1 service nova] Lock "063ab57f-77b7-419e-9e23-74ef5ecb1de3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:17:39 user nova-compute[70924]: DEBUG nova.compute.manager [req-d16edd2a-d7fe-4bd3-869d-050214cefe03 req-19c7bffe-d264-4744-acf1-6ce03872cdc1 service nova] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] No waiting events found dispatching network-vif-plugged-a14a157c-3d01-4e33-8f27-bb3b34a6d0f7 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:17:39 user nova-compute[70924]: WARNING nova.compute.manager [req-d16edd2a-d7fe-4bd3-869d-050214cefe03 req-19c7bffe-d264-4744-acf1-6ce03872cdc1 service nova] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Received unexpected event network-vif-plugged-a14a157c-3d01-4e33-8f27-bb3b34a6d0f7 for instance with vm_state deleted and task_state None.
Jul 29 15:17:39 user nova-compute[70924]: DEBUG nova.compute.manager [req-d16edd2a-d7fe-4bd3-869d-050214cefe03 req-19c7bffe-d264-4744-acf1-6ce03872cdc1 service nova] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Received event network-vif-deleted-a14a157c-3d01-4e33-8f27-bb3b34a6d0f7 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:17:39 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-f8bc2d4a-0c6b-4232-b2fd-36126d042413 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lock "063ab57f-77b7-419e-9e23-74ef5ecb1de3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.476s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:17:41 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:17:41 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Cleaning up deleted instances with incomplete migration  {{(pid=70924) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 29 15:17:42 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:17:47 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:17:51 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._sync_power_states {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:17:52 user nova-compute[70924]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690643857.965582, 063ab57f-77b7-419e-9e23-74ef5ecb1de3 => Stopped> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 15:17:52 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] VM Stopped (Lifecycle Event)
Jul 29 15:17:52 user nova-compute[70924]: DEBUG nova.compute.manager [None req-190900d5-e13d-4bb3-a13c-d7694448bd6b None None] [instance: 063ab57f-77b7-419e-9e23-74ef5ecb1de3] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:17:52 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:17:52 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:17:52 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70924) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 29 15:17:52 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70924) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 15:17:52 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70924) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 15:17:53 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:17:58 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:18:03 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:18:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:18:10 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:18:12 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:18:13 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:18:13 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:18:17 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:18:18 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:18:20 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:18:21 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:18:21 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70924) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 15:18:21 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:18:21 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:18:21 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:18:21 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:18:21 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Auditing locally available compute resources for user (node: user) {{(pid=70924) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 15:18:21 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:18:21 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:18:21 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Hypervisor/Node resource view: name=user free_ram=8946MB free_disk=25.274150848388672GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70924) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 15:18:21 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:18:21 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:18:22 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 15:18:22 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 15:18:22 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Refreshing inventories for resource provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 29 15:18:22 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Updating ProviderTree inventory for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 29 15:18:22 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Updating inventory in ProviderTree for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 29 15:18:22 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Refreshing aggregate associations for resource provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832, aggregates: None {{(pid=70924) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 29 15:18:22 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Refreshing trait associations for resource provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832, traits: COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=70924) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 29 15:18:22 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:18:22 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:18:22 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Compute_service record updated for user:user {{(pid=70924) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 15:18:22 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.474s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:18:23 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:18:25 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:18:25 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:18:25 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Starting heal instance info cache {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 15:18:25 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Rebuilding the list of instances to heal {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 29 15:18:25 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Didn't find any instances for network info cache update. {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 29 15:18:26 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:18:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:18:33 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:18:38 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:18:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:18:45 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Acquiring lock "a492c090-d932-4b35-80d8-0283d75f5de7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:18:45 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lock "a492c090-d932-4b35-80d8-0283d75f5de7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:18:45 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Starting instance... {{(pid=70924) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 15:18:45 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:18:45 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:18:45 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70924) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 15:18:45 user nova-compute[70924]: INFO nova.compute.claims [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Claim successful on node user
Jul 29 15:18:45 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:18:45 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:18:45 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.196s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:18:45 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Start building networks asynchronously for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 15:18:45 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Allocating IP information in the background. {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 15:18:45 user nova-compute[70924]: DEBUG nova.network.neutron [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] allocate_for_instance() {{(pid=70924) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 15:18:45 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 15:18:45 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Start building block device mappings for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 15:18:46 user nova-compute[70924]: DEBUG nova.policy [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '69d9320bdf72435c95bfc51f1e363798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '009f7913a4294d0da1582ce7b2ef0e4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70924) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 15:18:46 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Start spawning the instance on the hypervisor. {{(pid=70924) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 15:18:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Creating instance directory {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 15:18:46 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Creating image(s)
Jul 29 15:18:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Acquiring lock "/opt/stack/data/nova/instances/a492c090-d932-4b35-80d8-0283d75f5de7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:18:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lock "/opt/stack/data/nova/instances/a492c090-d932-4b35-80d8-0283d75f5de7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:18:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lock "/opt/stack/data/nova/instances/a492c090-d932-4b35-80d8-0283d75f5de7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:18:46 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:18:46 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.135s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:18:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Acquiring lock "bd72453517468710f1de26b27fb0ea28688e9009" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:18:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:18:46 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:18:46 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.140s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:18:46 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/a492c090-d932-4b35-80d8-0283d75f5de7/disk 1073741824 {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:18:46 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/a492c090-d932-4b35-80d8-0283d75f5de7/disk 1073741824" returned: 0 in 0.059s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:18:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.207s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:18:46 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:18:46 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.141s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:18:46 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a492c090-d932-4b35-80d8-0283d75f5de7/disk. size=1073741824 {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 15:18:46 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a492c090-d932-4b35-80d8-0283d75f5de7/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:18:46 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a492c090-d932-4b35-80d8-0283d75f5de7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:18:46 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Cannot resize image /opt/stack/data/nova/instances/a492c090-d932-4b35-80d8-0283d75f5de7/disk to a smaller size. {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 15:18:46 user nova-compute[70924]: DEBUG nova.objects.instance [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lazy-loading 'migration_context' on Instance uuid a492c090-d932-4b35-80d8-0283d75f5de7 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:18:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Created local disks {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 15:18:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Ensure instance console log exists: /opt/stack/data/nova/instances/a492c090-d932-4b35-80d8-0283d75f5de7/console.log {{(pid=70924) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 15:18:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:18:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:18:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:18:46 user nova-compute[70924]: DEBUG nova.network.neutron [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Successfully created port: d9bcb0de-3a95-4a43-b334-f69ddbb792e1 {{(pid=70924) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 15:18:47 user nova-compute[70924]: DEBUG nova.network.neutron [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Successfully updated port: d9bcb0de-3a95-4a43-b334-f69ddbb792e1 {{(pid=70924) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 15:18:47 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Acquiring lock "refresh_cache-a492c090-d932-4b35-80d8-0283d75f5de7" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:18:47 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Acquired lock "refresh_cache-a492c090-d932-4b35-80d8-0283d75f5de7" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:18:47 user nova-compute[70924]: DEBUG nova.network.neutron [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 15:18:47 user nova-compute[70924]: DEBUG nova.compute.manager [req-05d6f56f-11bf-4680-a201-60cf90fb4b09 req-e505c906-5b61-4c2e-b5a0-957eac01689f service nova] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Received event network-changed-d9bcb0de-3a95-4a43-b334-f69ddbb792e1 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:18:47 user nova-compute[70924]: DEBUG nova.compute.manager [req-05d6f56f-11bf-4680-a201-60cf90fb4b09 req-e505c906-5b61-4c2e-b5a0-957eac01689f service nova] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Refreshing instance network info cache due to event network-changed-d9bcb0de-3a95-4a43-b334-f69ddbb792e1. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 15:18:47 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-05d6f56f-11bf-4680-a201-60cf90fb4b09 req-e505c906-5b61-4c2e-b5a0-957eac01689f service nova] Acquiring lock "refresh_cache-a492c090-d932-4b35-80d8-0283d75f5de7" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:18:47 user nova-compute[70924]: DEBUG nova.network.neutron [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Instance cache missing network info. {{(pid=70924) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 15:18:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:18:48 user nova-compute[70924]: DEBUG nova.network.neutron [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Updating instance_info_cache with network_info: [{"id": "d9bcb0de-3a95-4a43-b334-f69ddbb792e1", "address": "fa:16:3e:ec:b1:c8", "network": {"id": "fc6d0dd4-9152-40b4-a4ae-dedc25ef961d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1563810370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "009f7913a4294d0da1582ce7b2ef0e4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9bcb0de-3a", "ovs_interfaceid": "d9bcb0de-3a95-4a43-b334-f69ddbb792e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:18:48 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Releasing lock "refresh_cache-a492c090-d932-4b35-80d8-0283d75f5de7" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:18:48 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Instance network_info: |[{"id": "d9bcb0de-3a95-4a43-b334-f69ddbb792e1", "address": "fa:16:3e:ec:b1:c8", "network": {"id": "fc6d0dd4-9152-40b4-a4ae-dedc25ef961d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1563810370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "009f7913a4294d0da1582ce7b2ef0e4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9bcb0de-3a", "ovs_interfaceid": "d9bcb0de-3a95-4a43-b334-f69ddbb792e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 15:18:48 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-05d6f56f-11bf-4680-a201-60cf90fb4b09 req-e505c906-5b61-4c2e-b5a0-957eac01689f service nova] Acquired lock "refresh_cache-a492c090-d932-4b35-80d8-0283d75f5de7" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:18:48 user nova-compute[70924]: DEBUG nova.network.neutron [req-05d6f56f-11bf-4680-a201-60cf90fb4b09 req-e505c906-5b61-4c2e-b5a0-957eac01689f service nova] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Refreshing network info cache for port d9bcb0de-3a95-4a43-b334-f69ddbb792e1 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 15:18:48 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Start _get_guest_xml network_info=[{"id": "d9bcb0de-3a95-4a43-b334-f69ddbb792e1", "address": "fa:16:3e:ec:b1:c8", "network": {"id": "fc6d0dd4-9152-40b4-a4ae-dedc25ef961d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1563810370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "009f7913a4294d0da1582ce7b2ef0e4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9bcb0de-3a", "ovs_interfaceid": "d9bcb0de-3a95-4a43-b334-f69ddbb792e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '3aba2e73-6832-404b-8bd0-d0503ce82b8c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 15:18:48 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:18:48 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:18:48 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 15:18:48 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] CPU controller missing on host. {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 15:18:48 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 15:18:48 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] CPU controller found on host. {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 15:18:48 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70924) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 15:18:48 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T14:36:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 15:18:48 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Flavor limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 15:18:48 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Image limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 15:18:48 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Flavor pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 15:18:48 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Image pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 15:18:48 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 15:18:48 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 15:18:48 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 15:18:48 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Got 1 possible topologies {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 15:18:48 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 15:18:48 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 15:18:48 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T15:18:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-622866001',display_name='tempest-VolumesSnapshotTestJSON-instance-622866001',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-622866001',id=51,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLAy2uul/Rqgm746ZeaX4p7+j3S6t4+OigFlz440m/SuywlTgEbsgjBJFV/1cro8pPtfmNgnr+h+ZvKYDDlrysT2l609975swWUwAmEzeYOn1HgBOFranT3dNrTRfySEnA==',key_name='tempest-keypair-161037423',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='009f7913a4294d0da1582ce7b2ef0e4e',ramdisk_id='',reservation_id='r-r7rxjbss',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-92776344',owner_user_name='tempest-VolumesSnapshotTestJSON-92776344-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T15:18:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='69d9320bdf72435c95bfc51f1e363798',uuid=a492c090-d932-4b35-80d8-0283d75f5de7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9bcb0de-3a95-4a43-b334-f69ddbb792e1", "address": "fa:16:3e:ec:b1:c8", "network": {"id": "fc6d0dd4-9152-40b4-a4ae-dedc25ef961d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1563810370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "009f7913a4294d0da1582ce7b2ef0e4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9bcb0de-3a", "ovs_interfaceid": "d9bcb0de-3a95-4a43-b334-f69ddbb792e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 15:18:48 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Converting VIF {"id": "d9bcb0de-3a95-4a43-b334-f69ddbb792e1", "address": "fa:16:3e:ec:b1:c8", "network": {"id": "fc6d0dd4-9152-40b4-a4ae-dedc25ef961d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1563810370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "009f7913a4294d0da1582ce7b2ef0e4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9bcb0de-3a", "ovs_interfaceid": "d9bcb0de-3a95-4a43-b334-f69ddbb792e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 15:18:48 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:b1:c8,bridge_name='br-int',has_traffic_filtering=True,id=d9bcb0de-3a95-4a43-b334-f69ddbb792e1,network=Network(fc6d0dd4-9152-40b4-a4ae-dedc25ef961d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9bcb0de-3a') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 15:18:48 user nova-compute[70924]: DEBUG nova.objects.instance [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lazy-loading 'pci_devices' on Instance uuid a492c090-d932-4b35-80d8-0283d75f5de7 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:18:48 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] End _get_guest_xml xml=<domain type="kvm">
Jul 29 15:18:48 user nova-compute[70924]:   <uuid>a492c090-d932-4b35-80d8-0283d75f5de7</uuid>
Jul 29 15:18:48 user nova-compute[70924]:   <name>instance-00000033</name>
Jul 29 15:18:48 user nova-compute[70924]:   <memory>524288</memory>
Jul 29 15:18:48 user nova-compute[70924]:   <vcpu>1</vcpu>
Jul 29 15:18:48 user nova-compute[70924]:   <metadata>
Jul 29 15:18:48 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 15:18:48 user nova-compute[70924]:       <nova:package version="0.0.0"/>
Jul 29 15:18:48 user nova-compute[70924]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-622866001</nova:name>
Jul 29 15:18:48 user nova-compute[70924]:       <nova:creationTime>2023-07-29 15:18:48</nova:creationTime>
Jul 29 15:18:48 user nova-compute[70924]:       <nova:flavor name="m1.tiny">
Jul 29 15:18:48 user nova-compute[70924]:         <nova:memory>512</nova:memory>
Jul 29 15:18:48 user nova-compute[70924]:         <nova:disk>1</nova:disk>
Jul 29 15:18:48 user nova-compute[70924]:         <nova:swap>0</nova:swap>
Jul 29 15:18:48 user nova-compute[70924]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 15:18:48 user nova-compute[70924]:         <nova:vcpus>1</nova:vcpus>
Jul 29 15:18:48 user nova-compute[70924]:       </nova:flavor>
Jul 29 15:18:48 user nova-compute[70924]:       <nova:owner>
Jul 29 15:18:48 user nova-compute[70924]:         <nova:user uuid="69d9320bdf72435c95bfc51f1e363798">tempest-VolumesSnapshotTestJSON-92776344-project-member</nova:user>
Jul 29 15:18:48 user nova-compute[70924]:         <nova:project uuid="009f7913a4294d0da1582ce7b2ef0e4e">tempest-VolumesSnapshotTestJSON-92776344</nova:project>
Jul 29 15:18:48 user nova-compute[70924]:       </nova:owner>
Jul 29 15:18:48 user nova-compute[70924]:       <nova:root type="image" uuid="3aba2e73-6832-404b-8bd0-d0503ce82b8c"/>
Jul 29 15:18:48 user nova-compute[70924]:       <nova:ports>
Jul 29 15:18:48 user nova-compute[70924]:         <nova:port uuid="d9bcb0de-3a95-4a43-b334-f69ddbb792e1">
Jul 29 15:18:48 user nova-compute[70924]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 29 15:18:48 user nova-compute[70924]:         </nova:port>
Jul 29 15:18:48 user nova-compute[70924]:       </nova:ports>
Jul 29 15:18:48 user nova-compute[70924]:     </nova:instance>
Jul 29 15:18:48 user nova-compute[70924]:   </metadata>
Jul 29 15:18:48 user nova-compute[70924]:   <sysinfo type="smbios">
Jul 29 15:18:48 user nova-compute[70924]:     <system>
Jul 29 15:18:48 user nova-compute[70924]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 15:18:48 user nova-compute[70924]:       <entry name="product">OpenStack Nova</entry>
Jul 29 15:18:48 user nova-compute[70924]:       <entry name="version">0.0.0</entry>
Jul 29 15:18:48 user nova-compute[70924]:       <entry name="serial">a492c090-d932-4b35-80d8-0283d75f5de7</entry>
Jul 29 15:18:48 user nova-compute[70924]:       <entry name="uuid">a492c090-d932-4b35-80d8-0283d75f5de7</entry>
Jul 29 15:18:48 user nova-compute[70924]:       <entry name="family">Virtual Machine</entry>
Jul 29 15:18:48 user nova-compute[70924]:     </system>
Jul 29 15:18:48 user nova-compute[70924]:   </sysinfo>
Jul 29 15:18:48 user nova-compute[70924]:   <os>
Jul 29 15:18:48 user nova-compute[70924]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 15:18:48 user nova-compute[70924]:     <boot dev="hd"/>
Jul 29 15:18:48 user nova-compute[70924]:     <smbios mode="sysinfo"/>
Jul 29 15:18:48 user nova-compute[70924]:   </os>
Jul 29 15:18:48 user nova-compute[70924]:   <features>
Jul 29 15:18:48 user nova-compute[70924]:     <acpi/>
Jul 29 15:18:48 user nova-compute[70924]:     <apic/>
Jul 29 15:18:48 user nova-compute[70924]:     <vmcoreinfo/>
Jul 29 15:18:48 user nova-compute[70924]:   </features>
Jul 29 15:18:48 user nova-compute[70924]:   <clock offset="utc">
Jul 29 15:18:48 user nova-compute[70924]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 15:18:48 user nova-compute[70924]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 15:18:48 user nova-compute[70924]:     <timer name="hpet" present="no"/>
Jul 29 15:18:48 user nova-compute[70924]:   </clock>
Jul 29 15:18:48 user nova-compute[70924]:   <cpu mode="custom" match="exact">
Jul 29 15:18:48 user nova-compute[70924]:     <model>Nehalem</model>
Jul 29 15:18:48 user nova-compute[70924]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 15:18:48 user nova-compute[70924]:   </cpu>
Jul 29 15:18:48 user nova-compute[70924]:   <devices>
Jul 29 15:18:48 user nova-compute[70924]:     <disk type="file" device="disk">
Jul 29 15:18:48 user nova-compute[70924]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 15:18:48 user nova-compute[70924]:       <source file="/opt/stack/data/nova/instances/a492c090-d932-4b35-80d8-0283d75f5de7/disk"/>
Jul 29 15:18:48 user nova-compute[70924]:       <target dev="vda" bus="virtio"/>
Jul 29 15:18:48 user nova-compute[70924]:     </disk>
Jul 29 15:18:48 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 15:18:48 user nova-compute[70924]:       <mac address="fa:16:3e:ec:b1:c8"/>
Jul 29 15:18:48 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 15:18:48 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 15:18:48 user nova-compute[70924]:       <target dev="tapd9bcb0de-3a"/>
Jul 29 15:18:48 user nova-compute[70924]:     </interface>
Jul 29 15:18:48 user nova-compute[70924]:     <serial type="pty">
Jul 29 15:18:48 user nova-compute[70924]:       <log file="/opt/stack/data/nova/instances/a492c090-d932-4b35-80d8-0283d75f5de7/console.log" append="off"/>
Jul 29 15:18:48 user nova-compute[70924]:     </serial>
Jul 29 15:18:48 user nova-compute[70924]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 15:18:48 user nova-compute[70924]:     <video>
Jul 29 15:18:48 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 15:18:48 user nova-compute[70924]:     </video>
Jul 29 15:18:48 user nova-compute[70924]:     <rng model="virtio">
Jul 29 15:18:48 user nova-compute[70924]:       <backend model="random">/dev/urandom</backend>
Jul 29 15:18:48 user nova-compute[70924]:     </rng>
Jul 29 15:18:48 user nova-compute[70924]:     <controller type="usb" index="0" model="none"/>
Jul 29 15:18:48 user nova-compute[70924]:     <memballoon model="virtio">
Jul 29 15:18:48 user nova-compute[70924]:       <stats period="10"/>
Jul 29 15:18:48 user nova-compute[70924]:     </memballoon>
Jul 29 15:18:48 user nova-compute[70924]:   </devices>
Jul 29 15:18:48 user nova-compute[70924]: </domain>
Jul 29 15:18:48 user nova-compute[70924]:  {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 15:18:48 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T15:18:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-622866001',display_name='tempest-VolumesSnapshotTestJSON-instance-622866001',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-622866001',id=51,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLAy2uul/Rqgm746ZeaX4p7+j3S6t4+OigFlz440m/SuywlTgEbsgjBJFV/1cro8pPtfmNgnr+h+ZvKYDDlrysT2l609975swWUwAmEzeYOn1HgBOFranT3dNrTRfySEnA==',key_name='tempest-keypair-161037423',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='009f7913a4294d0da1582ce7b2ef0e4e',ramdisk_id='',reservation_id='r-r7rxjbss',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-92776344',owner_user_name='tempest-VolumesSnapshotTestJSON-92776344-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T15:18:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='69d9320bdf72435c95bfc51f1e363798',uuid=a492c090-d932-4b35-80d8-0283d75f5de7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9bcb0de-3a95-4a43-b334-f69ddbb792e1", "address": "fa:16:3e:ec:b1:c8", "network": {"id": "fc6d0dd4-9152-40b4-a4ae-dedc25ef961d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1563810370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "009f7913a4294d0da1582ce7b2ef0e4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9bcb0de-3a", "ovs_interfaceid": "d9bcb0de-3a95-4a43-b334-f69ddbb792e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 15:18:48 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Converting VIF {"id": "d9bcb0de-3a95-4a43-b334-f69ddbb792e1", "address": "fa:16:3e:ec:b1:c8", "network": {"id": "fc6d0dd4-9152-40b4-a4ae-dedc25ef961d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1563810370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "009f7913a4294d0da1582ce7b2ef0e4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9bcb0de-3a", "ovs_interfaceid": "d9bcb0de-3a95-4a43-b334-f69ddbb792e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 15:18:48 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:b1:c8,bridge_name='br-int',has_traffic_filtering=True,id=d9bcb0de-3a95-4a43-b334-f69ddbb792e1,network=Network(fc6d0dd4-9152-40b4-a4ae-dedc25ef961d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9bcb0de-3a') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 15:18:48 user nova-compute[70924]: DEBUG os_vif [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:b1:c8,bridge_name='br-int',has_traffic_filtering=True,id=d9bcb0de-3a95-4a43-b334-f69ddbb792e1,network=Network(fc6d0dd4-9152-40b4-a4ae-dedc25ef961d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9bcb0de-3a') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 15:18:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:18:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:18:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 15:18:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:18:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd9bcb0de-3a, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:18:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd9bcb0de-3a, col_values=(('external_ids', {'iface-id': 'd9bcb0de-3a95-4a43-b334-f69ddbb792e1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:b1:c8', 'vm-uuid': 'a492c090-d932-4b35-80d8-0283d75f5de7'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:18:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:18:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:18:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:18:48 user nova-compute[70924]: INFO os_vif [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:b1:c8,bridge_name='br-int',has_traffic_filtering=True,id=d9bcb0de-3a95-4a43-b334-f69ddbb792e1,network=Network(fc6d0dd4-9152-40b4-a4ae-dedc25ef961d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9bcb0de-3a')
Jul 29 15:18:48 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 15:18:48 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] No VIF found with MAC fa:16:3e:ec:b1:c8, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 15:18:48 user nova-compute[70924]: DEBUG nova.network.neutron [req-05d6f56f-11bf-4680-a201-60cf90fb4b09 req-e505c906-5b61-4c2e-b5a0-957eac01689f service nova] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Updated VIF entry in instance network info cache for port d9bcb0de-3a95-4a43-b334-f69ddbb792e1. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 15:18:48 user nova-compute[70924]: DEBUG nova.network.neutron [req-05d6f56f-11bf-4680-a201-60cf90fb4b09 req-e505c906-5b61-4c2e-b5a0-957eac01689f service nova] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Updating instance_info_cache with network_info: [{"id": "d9bcb0de-3a95-4a43-b334-f69ddbb792e1", "address": "fa:16:3e:ec:b1:c8", "network": {"id": "fc6d0dd4-9152-40b4-a4ae-dedc25ef961d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1563810370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "009f7913a4294d0da1582ce7b2ef0e4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9bcb0de-3a", "ovs_interfaceid": "d9bcb0de-3a95-4a43-b334-f69ddbb792e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:18:48 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-05d6f56f-11bf-4680-a201-60cf90fb4b09 req-e505c906-5b61-4c2e-b5a0-957eac01689f service nova] Releasing lock "refresh_cache-a492c090-d932-4b35-80d8-0283d75f5de7" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:18:49 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:18:49 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:18:49 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:18:49 user nova-compute[70924]: DEBUG nova.compute.manager [req-a8912625-e948-4af1-86be-e468f8974d32 req-3bee0b45-8ea1-4060-afcc-b2075feea7d9 service nova] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Received event network-vif-plugged-d9bcb0de-3a95-4a43-b334-f69ddbb792e1 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:18:49 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a8912625-e948-4af1-86be-e468f8974d32 req-3bee0b45-8ea1-4060-afcc-b2075feea7d9 service nova] Acquiring lock "a492c090-d932-4b35-80d8-0283d75f5de7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:18:49 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a8912625-e948-4af1-86be-e468f8974d32 req-3bee0b45-8ea1-4060-afcc-b2075feea7d9 service nova] Lock "a492c090-d932-4b35-80d8-0283d75f5de7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:18:49 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-a8912625-e948-4af1-86be-e468f8974d32 req-3bee0b45-8ea1-4060-afcc-b2075feea7d9 service nova] Lock "a492c090-d932-4b35-80d8-0283d75f5de7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:18:49 user nova-compute[70924]: DEBUG nova.compute.manager [req-a8912625-e948-4af1-86be-e468f8974d32 req-3bee0b45-8ea1-4060-afcc-b2075feea7d9 service nova] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] No waiting events found dispatching network-vif-plugged-d9bcb0de-3a95-4a43-b334-f69ddbb792e1 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:18:49 user nova-compute[70924]: WARNING nova.compute.manager [req-a8912625-e948-4af1-86be-e468f8974d32 req-3bee0b45-8ea1-4060-afcc-b2075feea7d9 service nova] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Received unexpected event network-vif-plugged-d9bcb0de-3a95-4a43-b334-f69ddbb792e1 for instance with vm_state building and task_state spawning.
Jul 29 15:18:50 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:18:50 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:18:50 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:18:51 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690643931.721076, a492c090-d932-4b35-80d8-0283d75f5de7 => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 15:18:51 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] VM Resumed (Lifecycle Event)
Jul 29 15:18:51 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Instance event wait completed in 0 seconds for  {{(pid=70924) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 15:18:51 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Guest created on hypervisor {{(pid=70924) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 15:18:51 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Instance spawned successfully.
Jul 29 15:18:51 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 15:18:51 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:18:51 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Found default for hw_cdrom_bus of ide {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:18:51 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Found default for hw_disk_bus of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:18:51 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Found default for hw_input_bus of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:18:51 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Found default for hw_pointer_model of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:18:51 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Found default for hw_video_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:18:51 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Found default for hw_vif_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:18:51 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 15:18:51 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 15:18:51 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690643931.7253716, a492c090-d932-4b35-80d8-0283d75f5de7 => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 15:18:51 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] VM Started (Lifecycle Event)
Jul 29 15:18:51 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:18:51 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 15:18:51 user nova-compute[70924]: INFO nova.compute.manager [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Took 5.73 seconds to spawn the instance on the hypervisor.
Jul 29 15:18:51 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:18:51 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 15:18:51 user nova-compute[70924]: INFO nova.compute.manager [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Took 6.27 seconds to build instance.
Jul 29 15:18:51 user nova-compute[70924]: DEBUG nova.compute.manager [req-664aa997-20d9-4dc8-a35d-4ddabfcb9b65 req-d0a16518-21be-4f67-a9b4-4b62a1eda200 service nova] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Received event network-vif-plugged-d9bcb0de-3a95-4a43-b334-f69ddbb792e1 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:18:51 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-664aa997-20d9-4dc8-a35d-4ddabfcb9b65 req-d0a16518-21be-4f67-a9b4-4b62a1eda200 service nova] Acquiring lock "a492c090-d932-4b35-80d8-0283d75f5de7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:18:51 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-664aa997-20d9-4dc8-a35d-4ddabfcb9b65 req-d0a16518-21be-4f67-a9b4-4b62a1eda200 service nova] Lock "a492c090-d932-4b35-80d8-0283d75f5de7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:18:51 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-664aa997-20d9-4dc8-a35d-4ddabfcb9b65 req-d0a16518-21be-4f67-a9b4-4b62a1eda200 service nova] Lock "a492c090-d932-4b35-80d8-0283d75f5de7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:18:51 user nova-compute[70924]: DEBUG nova.compute.manager [req-664aa997-20d9-4dc8-a35d-4ddabfcb9b65 req-d0a16518-21be-4f67-a9b4-4b62a1eda200 service nova] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] No waiting events found dispatching network-vif-plugged-d9bcb0de-3a95-4a43-b334-f69ddbb792e1 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:18:51 user nova-compute[70924]: WARNING nova.compute.manager [req-664aa997-20d9-4dc8-a35d-4ddabfcb9b65 req-d0a16518-21be-4f67-a9b4-4b62a1eda200 service nova] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Received unexpected event network-vif-plugged-d9bcb0de-3a95-4a43-b334-f69ddbb792e1 for instance with vm_state active and task_state None.
Jul 29 15:18:51 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-d5ccf2c6-3fe8-4e1d-9cc7-41c317c5b350 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lock "a492c090-d932-4b35-80d8-0283d75f5de7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.374s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:18:53 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:18:54 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:18:58 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:19:03 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:19:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:19:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:19:11 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:19:13 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:19:13 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:19:14 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:19:14 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:19:17 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:19:18 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:19:19 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:19:22 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:19:22 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:19:22 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70924) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 15:19:23 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:19:23 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:19:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:19:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:19:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:19:23 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Auditing locally available compute resources for user (node: user) {{(pid=70924) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 15:19:23 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a492c090-d932-4b35-80d8-0283d75f5de7/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:19:23 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a492c090-d932-4b35-80d8-0283d75f5de7/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:19:23 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a492c090-d932-4b35-80d8-0283d75f5de7/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:19:23 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a492c090-d932-4b35-80d8-0283d75f5de7/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:19:24 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:19:24 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:19:24 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Hypervisor/Node resource view: name=user free_ram=8774MB free_disk=25.244064331054688GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70924) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 15:19:24 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:19:24 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:19:24 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance a492c090-d932-4b35-80d8-0283d75f5de7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:19:24 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 15:19:24 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 15:19:24 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:19:24 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:19:24 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Compute_service record updated for user:user {{(pid=70924) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 15:19:24 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.202s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:19:26 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:19:26 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:19:26 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Starting heal instance info cache {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 15:19:26 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Rebuilding the list of instances to heal {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 29 15:19:26 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "refresh_cache-a492c090-d932-4b35-80d8-0283d75f5de7" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:19:26 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquired lock "refresh_cache-a492c090-d932-4b35-80d8-0283d75f5de7" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:19:26 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Forcefully refreshing network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 29 15:19:26 user nova-compute[70924]: DEBUG nova.objects.instance [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lazy-loading 'info_cache' on Instance uuid a492c090-d932-4b35-80d8-0283d75f5de7 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:19:26 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Updating instance_info_cache with network_info: [{"id": "d9bcb0de-3a95-4a43-b334-f69ddbb792e1", "address": "fa:16:3e:ec:b1:c8", "network": {"id": "fc6d0dd4-9152-40b4-a4ae-dedc25ef961d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1563810370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "009f7913a4294d0da1582ce7b2ef0e4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9bcb0de-3a", "ovs_interfaceid": "d9bcb0de-3a95-4a43-b334-f69ddbb792e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:19:26 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Releasing lock "refresh_cache-a492c090-d932-4b35-80d8-0283d75f5de7" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:19:26 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Updated the network info_cache for instance {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 29 15:19:26 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:19:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:19:33 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:19:38 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:19:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:19:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:19:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:19:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70924) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 29 15:19:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70924) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 15:19:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70924) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 15:19:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:19:53 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:19:58 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:20:03 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:20:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:20:11 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:20:13 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:20:15 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:20:15 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:20:17 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:20:18 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:20:23 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:20:23 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:20:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:20:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:20:23 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:20:23 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Auditing locally available compute resources for user (node: user) {{(pid=70924) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 15:20:23 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a492c090-d932-4b35-80d8-0283d75f5de7/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:20:23 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a492c090-d932-4b35-80d8-0283d75f5de7/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:20:23 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a492c090-d932-4b35-80d8-0283d75f5de7/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:20:23 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a492c090-d932-4b35-80d8-0283d75f5de7/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:20:24 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:20:24 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:20:24 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Hypervisor/Node resource view: name=user free_ram=8824MB free_disk=25.243484497070312GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70924) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 15:20:24 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:20:24 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.003s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:20:24 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance a492c090-d932-4b35-80d8-0283d75f5de7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:20:24 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 15:20:24 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 15:20:24 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:20:24 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:20:24 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Compute_service record updated for user:user {{(pid=70924) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 15:20:24 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.203s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:20:25 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:20:25 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:20:25 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70924) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 15:20:26 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:20:27 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:20:27 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Starting heal instance info cache {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 15:20:27 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Rebuilding the list of instances to heal {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 29 15:20:27 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "refresh_cache-a492c090-d932-4b35-80d8-0283d75f5de7" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:20:27 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquired lock "refresh_cache-a492c090-d932-4b35-80d8-0283d75f5de7" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:20:27 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Forcefully refreshing network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 29 15:20:27 user nova-compute[70924]: DEBUG nova.objects.instance [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lazy-loading 'info_cache' on Instance uuid a492c090-d932-4b35-80d8-0283d75f5de7 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:20:27 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Updating instance_info_cache with network_info: [{"id": "d9bcb0de-3a95-4a43-b334-f69ddbb792e1", "address": "fa:16:3e:ec:b1:c8", "network": {"id": "fc6d0dd4-9152-40b4-a4ae-dedc25ef961d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1563810370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "009f7913a4294d0da1582ce7b2ef0e4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9bcb0de-3a", "ovs_interfaceid": "d9bcb0de-3a95-4a43-b334-f69ddbb792e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:20:27 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Releasing lock "refresh_cache-a492c090-d932-4b35-80d8-0283d75f5de7" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:20:27 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Updated the network info_cache for instance {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 29 15:20:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:20:33 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:20:36 user nova-compute[70924]: DEBUG nova.compute.manager [req-21efcb9b-cb8c-4286-a844-0e105e7dd808 req-fa253df8-8f57-4dd5-ad73-b762daffd435 service nova] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Received event network-changed-d9bcb0de-3a95-4a43-b334-f69ddbb792e1 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:20:36 user nova-compute[70924]: DEBUG nova.compute.manager [req-21efcb9b-cb8c-4286-a844-0e105e7dd808 req-fa253df8-8f57-4dd5-ad73-b762daffd435 service nova] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Refreshing instance network info cache due to event network-changed-d9bcb0de-3a95-4a43-b334-f69ddbb792e1. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 15:20:36 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-21efcb9b-cb8c-4286-a844-0e105e7dd808 req-fa253df8-8f57-4dd5-ad73-b762daffd435 service nova] Acquiring lock "refresh_cache-a492c090-d932-4b35-80d8-0283d75f5de7" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:20:36 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-21efcb9b-cb8c-4286-a844-0e105e7dd808 req-fa253df8-8f57-4dd5-ad73-b762daffd435 service nova] Acquired lock "refresh_cache-a492c090-d932-4b35-80d8-0283d75f5de7" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:20:36 user nova-compute[70924]: DEBUG nova.network.neutron [req-21efcb9b-cb8c-4286-a844-0e105e7dd808 req-fa253df8-8f57-4dd5-ad73-b762daffd435 service nova] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Refreshing network info cache for port d9bcb0de-3a95-4a43-b334-f69ddbb792e1 {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 15:20:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-53a10d74-2f1a-4075-ab5b-374c591e8051 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Acquiring lock "a492c090-d932-4b35-80d8-0283d75f5de7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:20:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-53a10d74-2f1a-4075-ab5b-374c591e8051 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lock "a492c090-d932-4b35-80d8-0283d75f5de7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:20:37 user nova-compute[70924]: DEBUG nova.objects.instance [None req-53a10d74-2f1a-4075-ab5b-374c591e8051 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lazy-loading 'flavor' on Instance uuid a492c090-d932-4b35-80d8-0283d75f5de7 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:20:37 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-53a10d74-2f1a-4075-ab5b-374c591e8051 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Ignoring supplied device name: /dev/vdb
Jul 29 15:20:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-53a10d74-2f1a-4075-ab5b-374c591e8051 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lock "a492c090-d932-4b35-80d8-0283d75f5de7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:20:37 user nova-compute[70924]: DEBUG nova.network.neutron [req-21efcb9b-cb8c-4286-a844-0e105e7dd808 req-fa253df8-8f57-4dd5-ad73-b762daffd435 service nova] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Updated VIF entry in instance network info cache for port d9bcb0de-3a95-4a43-b334-f69ddbb792e1. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 15:20:37 user nova-compute[70924]: DEBUG nova.network.neutron [req-21efcb9b-cb8c-4286-a844-0e105e7dd808 req-fa253df8-8f57-4dd5-ad73-b762daffd435 service nova] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Updating instance_info_cache with network_info: [{"id": "d9bcb0de-3a95-4a43-b334-f69ddbb792e1", "address": "fa:16:3e:ec:b1:c8", "network": {"id": "fc6d0dd4-9152-40b4-a4ae-dedc25ef961d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1563810370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "009f7913a4294d0da1582ce7b2ef0e4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9bcb0de-3a", "ovs_interfaceid": "d9bcb0de-3a95-4a43-b334-f69ddbb792e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:20:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-21efcb9b-cb8c-4286-a844-0e105e7dd808 req-fa253df8-8f57-4dd5-ad73-b762daffd435 service nova] Releasing lock "refresh_cache-a492c090-d932-4b35-80d8-0283d75f5de7" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:20:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-53a10d74-2f1a-4075-ab5b-374c591e8051 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Acquiring lock "a492c090-d932-4b35-80d8-0283d75f5de7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:20:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-53a10d74-2f1a-4075-ab5b-374c591e8051 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lock "a492c090-d932-4b35-80d8-0283d75f5de7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:20:38 user nova-compute[70924]: INFO nova.compute.manager [None req-53a10d74-2f1a-4075-ab5b-374c591e8051 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Attaching volume cabcce4d-f277-4ab3-80a0-d3c539a07f15 to /dev/vdb
Jul 29 15:20:38 user nova-compute[70924]: DEBUG os_brick.utils [None req-53a10d74-2f1a-4075-ab5b-374c591e8051 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 15:20:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:20:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:20:38 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[821d0baf-5a55-4895-a064-df7594bd0ebd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f2127c4a30d9\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:20:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:20:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:20:38 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[939f53fd-d2a2-45bf-998c-7702fd6f6e8c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:20:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:20:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:20:38 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63cf4fd-3f89-49d6-a9cc-9eefba82cd38]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:20:38 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a6b314c-c8dc-4744-9a32-96e61de0ec8b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:20:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-53a10d74-2f1a-4075-ab5b-374c591e8051 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Running cmd (subprocess): nvme version {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:20:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-53a10d74-2f1a-4075-ab5b-374c591e8051 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] 'nvme version' failed. Not Retrying. {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 15:20:38 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.nvmeof [None req-53a10d74-2f1a-4075-ab5b-374c591e8051 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] nvme not present on system {{(pid=70924) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 15:20:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:20:38 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 15:20:38 user nova-compute[70924]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 15:20:38 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87aff2b-9d53-4373-b537-abd295a7c9b9]: (4, '') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:20:38 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-53a10d74-2f1a-4075-ab5b-374c591e8051 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70924) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 15:20:38 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-53a10d74-2f1a-4075-ab5b-374c591e8051 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 15:20:38 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-53a10d74-2f1a-4075-ab5b-374c591e8051 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] LIGHTOS: no hostnqn found. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 15:20:38 user nova-compute[70924]: DEBUG os_brick.utils [None req-53a10d74-2f1a-4075-ab5b-374c591e8051 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f2127c4a30d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 15:20:38 user nova-compute[70924]: DEBUG nova.virt.block_device [None req-53a10d74-2f1a-4075-ab5b-374c591e8051 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Updating existing volume attachment record: 7a366206-4a56-4c22-86b9-e61cdb3be9c0 {{(pid=70924) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 15:20:38 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:20:39 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:20:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:20:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:20:44 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53a10d74-2f1a-4075-ab5b-374c591e8051 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Calling os-brick to attach iSCSI Volume {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 15:20:44 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-53a10d74-2f1a-4075-ab5b-374c591e8051 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cabcce4d-f277-4ab3-80a0-d3c539a07f15'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'enLKbfay', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 15:20:44 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-53a10d74-2f1a-4075-ab5b-374c591e8051 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 15:20:44 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-53a10d74-2f1a-4075-ab5b-374c591e8051 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 15:20:44 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-53a10d74-2f1a-4075-ab5b-374c591e8051 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 15:20:44 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-53a10d74-2f1a-4075-ab5b-374c591e8051 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 15:20:44 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-53a10d74-2f1a-4075-ab5b-374c591e8051 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cabcce4d-f277-4ab3-80a0-d3c539a07f15" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 15:20:44 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-53a10d74-2f1a-4075-ab5b-374c591e8051 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cabcce4d-f277-4ab3-80a0-d3c539a07f15" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 15:20:44 user nova-compute[70924]: INFO os_brick.initiator.connectors.iscsi [None req-53a10d74-2f1a-4075-ab5b-374c591e8051 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 15:20:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cabcce4d-f277-4ab3-80a0-d3c539a07f15 -p 172.16.0.220:3260 {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:20:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cabcce4d-f277-4ab3-80a0-d3c539a07f15 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:20:44 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[765063c2-5cb3-4848-a154-cd8ca1256739]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:20:44 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-53a10d74-2f1a-4075-ab5b-374c591e8051 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 15:20:44 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:20:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cabcce4d-f277-4ab3-80a0-d3c539a07f15 -p 172.16.0.220:3260 --interface default --op new {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:20:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cabcce4d-f277-4ab3-80a0-d3c539a07f15 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:20:44 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec0c7b9a-75ac-4793-a56b-6166b39b3b0f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cabcce4d-f277-4ab3-80a0-d3c539a07f15] added\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:20:44 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-53a10d74-2f1a-4075-ab5b-374c591e8051 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cabcce4d-f277-4ab3-80a0-d3c539a07f15] added
Jul 29 15:20:44 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:20:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cabcce4d-f277-4ab3-80a0-d3c539a07f15 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:20:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cabcce4d-f277-4ab3-80a0-d3c539a07f15 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:20:44 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f20532a-11ba-46bf-9d73-35d14ba9d96e]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:20:44 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-53a10d74-2f1a-4075-ab5b-374c591e8051 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:20:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cabcce4d-f277-4ab3-80a0-d3c539a07f15 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:20:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cabcce4d-f277-4ab3-80a0-d3c539a07f15 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:20:44 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[939a6445-0ec3-4344-b0db-f35d24df6207]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:20:44 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-53a10d74-2f1a-4075-ab5b-374c591e8051 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:20:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cabcce4d-f277-4ab3-80a0-d3c539a07f15 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v enLKbfay {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:20:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cabcce4d-f277-4ab3-80a0-d3c539a07f15 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v enLKbfay" returned: 0 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:20:44 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0a7f56-8518-4733-8ccc-e0b98a07794e]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:20:44 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-53a10d74-2f1a-4075-ab5b-374c591e8051 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'enLKbfay'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:20:44 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cabcce4d-f277-4ab3-80a0-d3c539a07f15 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:20:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cabcce4d-f277-4ab3-80a0-d3c539a07f15 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:20:45 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[925930ac-0292-4c29-b4a0-b9f89ed98b56]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:20:45 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-53a10d74-2f1a-4075-ab5b-374c591e8051 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:20:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:20:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:20:45 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae207fd-18d3-424d-ad60-a6e24abac41a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:20:45 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-53a10d74-2f1a-4075-ab5b-374c591e8051 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 29 15:20:45 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 15:20:45 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-53a10d74-2f1a-4075-ab5b-374c591e8051 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 29 15:20:45 user nova-compute[70924]:  {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 15:20:45 user nova-compute[70924]: WARNING os_brick.initiator.connectors.iscsi [None req-53a10d74-2f1a-4075-ab5b-374c591e8051 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 29 15:20:45 user nova-compute[70924]: 
Jul 29 15:20:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cabcce4d-f277-4ab3-80a0-d3c539a07f15 -p 172.16.0.220:3260 --login {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:20:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cabcce4d-f277-4ab3-80a0-d3c539a07f15 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:20:45 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c40b872-e2fa-43d2-8641-3f10df8a7629]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cabcce4d-f277-4ab3-80a0-d3c539a07f15, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cabcce4d-f277-4ab3-80a0-d3c539a07f15, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:20:45 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-53a10d74-2f1a-4075-ab5b-374c591e8051 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cabcce4d-f277-4ab3-80a0-d3c539a07f15, portal: 172.16.0.220,3260]
Jul 29 15:20:45 user nova-compute[70924]: Login to [iface: default, target: iqn.2010-10.org.openstack:cabcce4d-f277-4ab3-80a0-d3c539a07f15, portal: 172.16.0.220,3260] successful.
Jul 29 15:20:45 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:20:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cabcce4d-f277-4ab3-80a0-d3c539a07f15 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:20:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cabcce4d-f277-4ab3-80a0-d3c539a07f15 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:20:45 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[57452cf5-6607-44f8-9a3e-997b91afd73a]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:20:45 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-53a10d74-2f1a-4075-ab5b-374c591e8051 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:20:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:20:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:20:45 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2634a480-39a2-4eb4-8fdd-a5864dcca13f]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cabcce4d-f277-4ab3-80a0-d3c539a07f15 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:20:45 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-53a10d74-2f1a-4075-ab5b-374c591e8051 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cabcce4d-f277-4ab3-80a0-d3c539a07f15 (non-flash)
Jul 29 15:20:45 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 15:20:45 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-53a10d74-2f1a-4075-ab5b-374c591e8051 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cabcce4d-f277-4ab3-80a0-d3c539a07f15 (non-flash)
Jul 29 15:20:45 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 15:20:45 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-53a10d74-2f1a-4075-ab5b-374c591e8051 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cabcce4d-f277-4ab3-80a0-d3c539a07f15" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 15:20:45 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-53a10d74-2f1a-4075-ab5b-374c591e8051 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Connected to 172.16.0.220:3260 {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 15:20:45 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-53a10d74-2f1a-4075-ab5b-374c591e8051 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=70924) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 15:20:45 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-53a10d74-2f1a-4075-ab5b-374c591e8051 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70924) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 15:20:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:20:45 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.026s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:20:45 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57566ca-2f0a-4e8a-8bcb-33e6eda0a780]: (4, ('- - 0', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:20:45 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-53a10d74-2f1a-4075-ab5b-374c591e8051 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: None {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 15:20:46 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-53a10d74-2f1a-4075-ab5b-374c591e8051 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 15:20:46 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-53a10d74-2f1a-4075-ab5b-374c591e8051 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'enLKbfay', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 15:20:46 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-53a10d74-2f1a-4075-ab5b-374c591e8051 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 15:20:46 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-53a10d74-2f1a-4075-ab5b-374c591e8051 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23662343766623566', 'path': '/dev/sdb'} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 15:20:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53a10d74-2f1a-4075-ab5b-374c591e8051 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662343766623566', 'path': '/dev/sdb'} {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 15:20:46 user nova-compute[70924]: DEBUG nova.objects.instance [None req-53a10d74-2f1a-4075-ab5b-374c591e8051 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lazy-loading 'flavor' on Instance uuid a492c090-d932-4b35-80d8-0283d75f5de7 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:20:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-53a10d74-2f1a-4075-ab5b-374c591e8051 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] attach device xml: <disk type="block" device="disk">
Jul 29 15:20:46 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 15:20:46 user nova-compute[70924]:   <source dev="/dev/sdb"/>
Jul 29 15:20:46 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 15:20:46 user nova-compute[70924]:   <serial>cabcce4d-f277-4ab3-80a0-d3c539a07f15</serial>
Jul 29 15:20:46 user nova-compute[70924]: </disk>
Jul 29 15:20:46 user nova-compute[70924]:  {{(pid=70924) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 29 15:20:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-53a10d74-2f1a-4075-ab5b-374c591e8051 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 15:20:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-53a10d74-2f1a-4075-ab5b-374c591e8051 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 15:20:46 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-53a10d74-2f1a-4075-ab5b-374c591e8051 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] No VIF found with MAC fa:16:3e:ec:b1:c8, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 15:20:46 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-53a10d74-2f1a-4075-ab5b-374c591e8051 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lock "a492c090-d932-4b35-80d8-0283d75f5de7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.804s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:20:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:20:53 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:20:54 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:20:58 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:21:03 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:21:05 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-bb322fb3-f158-4553-969e-f8c25f8b3f60 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Acquiring lock "a492c090-d932-4b35-80d8-0283d75f5de7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:21:05 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-bb322fb3-f158-4553-969e-f8c25f8b3f60 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lock "a492c090-d932-4b35-80d8-0283d75f5de7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:21:06 user nova-compute[70924]: INFO nova.compute.manager [None req-bb322fb3-f158-4553-969e-f8c25f8b3f60 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Detaching volume cabcce4d-f277-4ab3-80a0-d3c539a07f15
Jul 29 15:21:06 user nova-compute[70924]: INFO nova.virt.block_device [None req-bb322fb3-f158-4553-969e-f8c25f8b3f60 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Attempting to driver detach volume cabcce4d-f277-4ab3-80a0-d3c539a07f15 from mountpoint /dev/vdb
Jul 29 15:21:06 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-bb322fb3-f158-4553-969e-f8c25f8b3f60 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Attempting to detach device vdb from instance a492c090-d932-4b35-80d8-0283d75f5de7 from the persistent domain config. {{(pid=70924) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 29 15:21:06 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-bb322fb3-f158-4553-969e-f8c25f8b3f60 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 15:21:06 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 15:21:06 user nova-compute[70924]:   <source dev="/dev/sdb"/>
Jul 29 15:21:06 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 15:21:06 user nova-compute[70924]:   <serial>cabcce4d-f277-4ab3-80a0-d3c539a07f15</serial>
Jul 29 15:21:06 user nova-compute[70924]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 15:21:06 user nova-compute[70924]: </disk>
Jul 29 15:21:06 user nova-compute[70924]:  {{(pid=70924) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 15:21:06 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-bb322fb3-f158-4553-969e-f8c25f8b3f60 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Successfully detached device vdb from instance a492c090-d932-4b35-80d8-0283d75f5de7 from the persistent domain config.
Jul 29 15:21:06 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-bb322fb3-f158-4553-969e-f8c25f8b3f60 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a492c090-d932-4b35-80d8-0283d75f5de7 from the live domain config. {{(pid=70924) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 29 15:21:06 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-bb322fb3-f158-4553-969e-f8c25f8b3f60 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 15:21:06 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 15:21:06 user nova-compute[70924]:   <source dev="/dev/sdb"/>
Jul 29 15:21:06 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 15:21:06 user nova-compute[70924]:   <serial>cabcce4d-f277-4ab3-80a0-d3c539a07f15</serial>
Jul 29 15:21:06 user nova-compute[70924]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 15:21:06 user nova-compute[70924]: </disk>
Jul 29 15:21:06 user nova-compute[70924]:  {{(pid=70924) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 15:21:06 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-716aa684-9e39-4956-b0b6-b8399553e218 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Acquiring lock "a492c090-d932-4b35-80d8-0283d75f5de7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:21:06 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Received event <DeviceRemovedEvent: 1690644066.5459802, a492c090-d932-4b35-80d8-0283d75f5de7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70924) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 29 15:21:06 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-bb322fb3-f158-4553-969e-f8c25f8b3f60 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a492c090-d932-4b35-80d8-0283d75f5de7 {{(pid=70924) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 29 15:21:06 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-bb322fb3-f158-4553-969e-f8c25f8b3f60 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Successfully detached device vdb from instance a492c090-d932-4b35-80d8-0283d75f5de7 from the live domain config.
Jul 29 15:21:06 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb322fb3-f158-4553-969e-f8c25f8b3f60 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] calling os-brick to detach iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 15:21:06 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb322fb3-f158-4553-969e-f8c25f8b3f60 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, {'target_iqns': ['iqn.2010-10.org.openstack:cabcce4d-f277-4ab3-80a0-d3c539a07f15'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'enLKbfay', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 15:21:06 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-bb322fb3-f158-4553-969e-f8c25f8b3f60 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 15:21:06 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-bb322fb3-f158-4553-969e-f8c25f8b3f60 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 15:21:06 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-bb322fb3-f158-4553-969e-f8c25f8b3f60 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 15:21:06 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb322fb3-f158-4553-969e-f8c25f8b3f60 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cabcce4d-f277-4ab3-80a0-d3c539a07f15', 0)] {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 15:21:06 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:21:06 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:21:06 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[10edc228-4741-49b7-8141-a2ffbc25acb9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cabcce4d-f277-4ab3-80a0-d3c539a07f15\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:21:06 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:21:06 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:21:06 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2cdb39c-0637-4cfc-a096-1832945f7371]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cabcce4d-f277-4ab3-80a0-d3c539a07f15 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:21:06 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb322fb3-f158-4553-969e-f8c25f8b3f60 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cabcce4d-f277-4ab3-80a0-d3c539a07f15 (non-flash)
Jul 29 15:21:06 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 15:21:06 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb322fb3-f158-4553-969e-f8c25f8b3f60 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cabcce4d-f277-4ab3-80a0-d3c539a07f15 (non-flash)
Jul 29 15:21:06 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 15:21:06 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb322fb3-f158-4553-969e-f8c25f8b3f60 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feedc3891b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cabcce4d-f277-4ab3-80a0-d3c539a07f15'): ({'sdb'}, set())}) {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 15:21:06 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-bb322fb3-f158-4553-969e-f8c25f8b3f60 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Removing single pathed devices sdb {{(pid=70924) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 15:21:06 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:21:06 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:21:06 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0829d930-c10b-4609-9603-57e89c97decf]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:21:06 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:21:06 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:21:06 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e133c53-ce24-4db4-a1ad-db81498cd198]: (4, ('ok\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:21:06 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-bb322fb3-f158-4553-969e-f8c25f8b3f60 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Flushing IO for device /dev/sdb {{(pid=70924) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 15:21:06 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:21:06 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:21:06 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d6b87a-1509-4b7f-b9bc-0a48a7bd37a2]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:21:06 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-bb322fb3-f158-4553-969e-f8c25f8b3f60 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70924) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 15:21:06 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:21:06 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:21:06 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0403c4e-51f1-421b-84b0-5561eda16356]: (4, ('1', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:21:06 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-bb322fb3-f158-4553-969e-f8c25f8b3f60 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 15:21:06 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-bb322fb3-f158-4553-969e-f8c25f8b3f60 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] SCSI volumes sdb have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 15:21:06 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb322fb3-f158-4553-969e-f8c25f8b3f60 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cabcce4d-f277-4ab3-80a0-d3c539a07f15')] {{(pid=70924) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 15:21:06 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cabcce4d-f277-4ab3-80a0-d3c539a07f15 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:21:06 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cabcce4d-f277-4ab3-80a0-d3c539a07f15 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:21:06 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[971ed221-95a9-49d2-90b6-cce3b954cb21]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:21:06 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb322fb3-f158-4553-969e-f8c25f8b3f60 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:21:06 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cabcce4d-f277-4ab3-80a0-d3c539a07f15 -p 172.16.0.220:3260 --logout {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:21:06 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cabcce4d-f277-4ab3-80a0-d3c539a07f15 -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:21:06 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[58fbeb55-6020-44c8-be75-754af172a6d1]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:cabcce4d-f277-4ab3-80a0-d3c539a07f15, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:cabcce4d-f277-4ab3-80a0-d3c539a07f15, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:21:06 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb322fb3-f158-4553-969e-f8c25f8b3f60 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:cabcce4d-f277-4ab3-80a0-d3c539a07f15, portal: 172.16.0.220,3260]
Jul 29 15:21:06 user nova-compute[70924]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:cabcce4d-f277-4ab3-80a0-d3c539a07f15, portal: 172.16.0.220,3260] successful.
Jul 29 15:21:06 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:21:06 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cabcce4d-f277-4ab3-80a0-d3c539a07f15 -p 172.16.0.220:3260 --op delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:21:06 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cabcce4d-f277-4ab3-80a0-d3c539a07f15 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:21:06 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b00d80c-e8de-42fa-b508-30867f25d80b]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:21:06 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb322fb3-f158-4553-969e-f8c25f8b3f60 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:21:06 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-bb322fb3-f158-4553-969e-f8c25f8b3f60 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 15:21:06 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb322fb3-f158-4553-969e-f8c25f8b3f60 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] <== disconnect_volume: return (287ms) None {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 15:21:06 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb322fb3-f158-4553-969e-f8c25f8b3f60 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Disconnected iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 15:21:07 user nova-compute[70924]: DEBUG nova.objects.instance [None req-bb322fb3-f158-4553-969e-f8c25f8b3f60 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lazy-loading 'flavor' on Instance uuid a492c090-d932-4b35-80d8-0283d75f5de7 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:21:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-bb322fb3-f158-4553-969e-f8c25f8b3f60 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lock "a492c090-d932-4b35-80d8-0283d75f5de7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.606s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:21:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-716aa684-9e39-4956-b0b6-b8399553e218 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lock "a492c090-d932-4b35-80d8-0283d75f5de7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.483s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:21:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-716aa684-9e39-4956-b0b6-b8399553e218 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Acquiring lock "a492c090-d932-4b35-80d8-0283d75f5de7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:21:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-716aa684-9e39-4956-b0b6-b8399553e218 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lock "a492c090-d932-4b35-80d8-0283d75f5de7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:21:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-716aa684-9e39-4956-b0b6-b8399553e218 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lock "a492c090-d932-4b35-80d8-0283d75f5de7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:21:07 user nova-compute[70924]: INFO nova.compute.manager [None req-716aa684-9e39-4956-b0b6-b8399553e218 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Terminating instance
Jul 29 15:21:07 user nova-compute[70924]: DEBUG nova.compute.manager [None req-716aa684-9e39-4956-b0b6-b8399553e218 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Start destroying the instance on the hypervisor. {{(pid=70924) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 15:21:07 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:21:07 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:21:07 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:21:07 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:21:07 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:21:07 user nova-compute[70924]: DEBUG nova.compute.manager [req-f297ed83-1217-462d-990d-8aac28fd0c45 req-d3b3dcfe-c003-4348-9368-b0402724a11f service nova] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Received event network-vif-unplugged-d9bcb0de-3a95-4a43-b334-f69ddbb792e1 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:21:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-f297ed83-1217-462d-990d-8aac28fd0c45 req-d3b3dcfe-c003-4348-9368-b0402724a11f service nova] Acquiring lock "a492c090-d932-4b35-80d8-0283d75f5de7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:21:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-f297ed83-1217-462d-990d-8aac28fd0c45 req-d3b3dcfe-c003-4348-9368-b0402724a11f service nova] Lock "a492c090-d932-4b35-80d8-0283d75f5de7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:21:07 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-f297ed83-1217-462d-990d-8aac28fd0c45 req-d3b3dcfe-c003-4348-9368-b0402724a11f service nova] Lock "a492c090-d932-4b35-80d8-0283d75f5de7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:21:07 user nova-compute[70924]: DEBUG nova.compute.manager [req-f297ed83-1217-462d-990d-8aac28fd0c45 req-d3b3dcfe-c003-4348-9368-b0402724a11f service nova] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] No waiting events found dispatching network-vif-unplugged-d9bcb0de-3a95-4a43-b334-f69ddbb792e1 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:21:07 user nova-compute[70924]: DEBUG nova.compute.manager [req-f297ed83-1217-462d-990d-8aac28fd0c45 req-d3b3dcfe-c003-4348-9368-b0402724a11f service nova] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Received event network-vif-unplugged-d9bcb0de-3a95-4a43-b334-f69ddbb792e1 for instance with task_state deleting. {{(pid=70924) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 15:21:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:21:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:21:08 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Instance destroyed successfully.
Jul 29 15:21:08 user nova-compute[70924]: DEBUG nova.objects.instance [None req-716aa684-9e39-4956-b0b6-b8399553e218 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lazy-loading 'resources' on Instance uuid a492c090-d932-4b35-80d8-0283d75f5de7 {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:21:08 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-716aa684-9e39-4956-b0b6-b8399553e218 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T15:18:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-622866001',display_name='tempest-VolumesSnapshotTestJSON-instance-622866001',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-622866001',id=51,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLAy2uul/Rqgm746ZeaX4p7+j3S6t4+OigFlz440m/SuywlTgEbsgjBJFV/1cro8pPtfmNgnr+h+ZvKYDDlrysT2l609975swWUwAmEzeYOn1HgBOFranT3dNrTRfySEnA==',key_name='tempest-keypair-161037423',keypairs=<?>,launch_index=0,launched_at=2023-07-29T15:18:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='009f7913a4294d0da1582ce7b2ef0e4e',ramdisk_id='',reservation_id='r-r7rxjbss',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-92776344',owner_user_name='tempest-VolumesSnapshotTestJSON-92776344-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T15:18:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='69d9320bdf72435c95bfc51f1e363798',uuid=a492c090-d932-4b35-80d8-0283d75f5de7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d9bcb0de-3a95-4a43-b334-f69ddbb792e1", "address": "fa:16:3e:ec:b1:c8", "network": {"id": "fc6d0dd4-9152-40b4-a4ae-dedc25ef961d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1563810370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "009f7913a4294d0da1582ce7b2ef0e4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9bcb0de-3a", "ovs_interfaceid": "d9bcb0de-3a95-4a43-b334-f69ddbb792e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 15:21:08 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-716aa684-9e39-4956-b0b6-b8399553e218 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Converting VIF {"id": "d9bcb0de-3a95-4a43-b334-f69ddbb792e1", "address": "fa:16:3e:ec:b1:c8", "network": {"id": "fc6d0dd4-9152-40b4-a4ae-dedc25ef961d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1563810370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "009f7913a4294d0da1582ce7b2ef0e4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9bcb0de-3a", "ovs_interfaceid": "d9bcb0de-3a95-4a43-b334-f69ddbb792e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 15:21:08 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-716aa684-9e39-4956-b0b6-b8399553e218 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:b1:c8,bridge_name='br-int',has_traffic_filtering=True,id=d9bcb0de-3a95-4a43-b334-f69ddbb792e1,network=Network(fc6d0dd4-9152-40b4-a4ae-dedc25ef961d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9bcb0de-3a') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 15:21:08 user nova-compute[70924]: DEBUG os_vif [None req-716aa684-9e39-4956-b0b6-b8399553e218 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:b1:c8,bridge_name='br-int',has_traffic_filtering=True,id=d9bcb0de-3a95-4a43-b334-f69ddbb792e1,network=Network(fc6d0dd4-9152-40b4-a4ae-dedc25ef961d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9bcb0de-3a') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 15:21:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:21:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd9bcb0de-3a, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:21:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:21:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:21:08 user nova-compute[70924]: INFO os_vif [None req-716aa684-9e39-4956-b0b6-b8399553e218 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:b1:c8,bridge_name='br-int',has_traffic_filtering=True,id=d9bcb0de-3a95-4a43-b334-f69ddbb792e1,network=Network(fc6d0dd4-9152-40b4-a4ae-dedc25ef961d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9bcb0de-3a')
Jul 29 15:21:08 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-716aa684-9e39-4956-b0b6-b8399553e218 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] calling os-brick to detach iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 15:21:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-716aa684-9e39-4956-b0b6-b8399553e218 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, {'target_iqns': ['iqn.2010-10.org.openstack:cabcce4d-f277-4ab3-80a0-d3c539a07f15'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'enLKbfay', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 15:21:08 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-716aa684-9e39-4956-b0b6-b8399553e218 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 15:21:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-716aa684-9e39-4956-b0b6-b8399553e218 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 15:21:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-716aa684-9e39-4956-b0b6-b8399553e218 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 15:21:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-716aa684-9e39-4956-b0b6-b8399553e218 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cabcce4d-f277-4ab3-80a0-d3c539a07f15', 0)] {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 15:21:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:21:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 21 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:21:08 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[56413273-d1c7-4601-b9e4-35442cb8ec29]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:21:08 user nova-compute[70924]: WARNING os_brick.initiator.connectors.iscsi [None req-716aa684-9e39-4956-b0b6-b8399553e218 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Couldn't find iSCSI nodes because iscsiadm err: iscsiadm: No records found
Jul 29 15:21:08 user nova-compute[70924]: 
Jul 29 15:21:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:21:08 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:21:08 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d884c6f-4fb8-4ad9-81f3-ed10d59d19dd]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:21:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-716aa684-9e39-4956-b0b6-b8399553e218 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 29 15:21:08 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 15:21:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-716aa684-9e39-4956-b0b6-b8399553e218 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 29 15:21:08 user nova-compute[70924]:  {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 15:21:08 user nova-compute[70924]: WARNING os_brick.initiator.connectors.iscsi [None req-716aa684-9e39-4956-b0b6-b8399553e218 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 29 15:21:08 user nova-compute[70924]: 
Jul 29 15:21:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-716aa684-9e39-4956-b0b6-b8399553e218 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feedc3b3520>, {}) {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 15:21:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-716aa684-9e39-4956-b0b6-b8399553e218 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Disconnecting from: [] {{(pid=70924) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 15:21:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-716aa684-9e39-4956-b0b6-b8399553e218 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.046s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 15:21:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-716aa684-9e39-4956-b0b6-b8399553e218 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] <== disconnect_volume: return (47ms) None {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 15:21:08 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-716aa684-9e39-4956-b0b6-b8399553e218 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Disconnected iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 15:21:08 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-716aa684-9e39-4956-b0b6-b8399553e218 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Deleting instance files /opt/stack/data/nova/instances/a492c090-d932-4b35-80d8-0283d75f5de7_del
Jul 29 15:21:08 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-716aa684-9e39-4956-b0b6-b8399553e218 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Deletion of /opt/stack/data/nova/instances/a492c090-d932-4b35-80d8-0283d75f5de7_del complete
Jul 29 15:21:08 user nova-compute[70924]: INFO nova.compute.manager [None req-716aa684-9e39-4956-b0b6-b8399553e218 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Took 0.94 seconds to destroy the instance on the hypervisor.
Jul 29 15:21:08 user nova-compute[70924]: DEBUG oslo.service.loopingcall [None req-716aa684-9e39-4956-b0b6-b8399553e218 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70924) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 15:21:08 user nova-compute[70924]: DEBUG nova.compute.manager [-] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Deallocating network for instance {{(pid=70924) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 15:21:08 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] deallocate_for_instance() {{(pid=70924) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 15:21:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:21:09 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:21:09 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Took 1.34 seconds to deallocate network for instance.
Jul 29 15:21:09 user nova-compute[70924]: DEBUG nova.compute.manager [req-8c3a01fe-cc8b-48f6-ae65-c1a025e30b14 req-b5eb43e2-3570-426b-a69f-70f0afbe8b8b service nova] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Received event network-vif-plugged-d9bcb0de-3a95-4a43-b334-f69ddbb792e1 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:21:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-8c3a01fe-cc8b-48f6-ae65-c1a025e30b14 req-b5eb43e2-3570-426b-a69f-70f0afbe8b8b service nova] Acquiring lock "a492c090-d932-4b35-80d8-0283d75f5de7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:21:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-8c3a01fe-cc8b-48f6-ae65-c1a025e30b14 req-b5eb43e2-3570-426b-a69f-70f0afbe8b8b service nova] Lock "a492c090-d932-4b35-80d8-0283d75f5de7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:21:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-8c3a01fe-cc8b-48f6-ae65-c1a025e30b14 req-b5eb43e2-3570-426b-a69f-70f0afbe8b8b service nova] Lock "a492c090-d932-4b35-80d8-0283d75f5de7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:21:09 user nova-compute[70924]: DEBUG nova.compute.manager [req-8c3a01fe-cc8b-48f6-ae65-c1a025e30b14 req-b5eb43e2-3570-426b-a69f-70f0afbe8b8b service nova] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] No waiting events found dispatching network-vif-plugged-d9bcb0de-3a95-4a43-b334-f69ddbb792e1 {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:21:09 user nova-compute[70924]: WARNING nova.compute.manager [req-8c3a01fe-cc8b-48f6-ae65-c1a025e30b14 req-b5eb43e2-3570-426b-a69f-70f0afbe8b8b service nova] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Received unexpected event network-vif-plugged-d9bcb0de-3a95-4a43-b334-f69ddbb792e1 for instance with vm_state active and task_state deleting.
Jul 29 15:21:09 user nova-compute[70924]: DEBUG nova.compute.manager [req-f54593eb-9f5a-4624-85cf-a4bac34746ed req-850b6ee3-176e-43ed-813f-4cd95b942e80 service nova] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Received event network-vif-deleted-d9bcb0de-3a95-4a43-b334-f69ddbb792e1 {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:21:09 user nova-compute[70924]: WARNING nova.volume.cinder [None req-716aa684-9e39-4956-b0b6-b8399553e218 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Attachment 7a366206-4a56-4c22-86b9-e61cdb3be9c0 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 7a366206-4a56-4c22-86b9-e61cdb3be9c0. (HTTP 404) (Request-ID: req-bd3ea9ef-dcb4-40c2-817b-028a26d9a56b)
Jul 29 15:21:09 user nova-compute[70924]: INFO nova.compute.manager [None req-716aa684-9e39-4956-b0b6-b8399553e218 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Took 0.03 seconds to detach 1 volumes for instance.
Jul 29 15:21:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-716aa684-9e39-4956-b0b6-b8399553e218 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:21:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-716aa684-9e39-4956-b0b6-b8399553e218 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:21:10 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-716aa684-9e39-4956-b0b6-b8399553e218 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:21:10 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-716aa684-9e39-4956-b0b6-b8399553e218 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:21:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-716aa684-9e39-4956-b0b6-b8399553e218 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.118s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:21:10 user nova-compute[70924]: INFO nova.scheduler.client.report [None req-716aa684-9e39-4956-b0b6-b8399553e218 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Deleted allocations for instance a492c090-d932-4b35-80d8-0283d75f5de7
Jul 29 15:21:10 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-716aa684-9e39-4956-b0b6-b8399553e218 tempest-VolumesSnapshotTestJSON-92776344 tempest-VolumesSnapshotTestJSON-92776344-project-member] Lock "a492c090-d932-4b35-80d8-0283d75f5de7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.606s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:21:13 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:21:13 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:21:15 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:21:16 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:21:17 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:21:18 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:21:23 user nova-compute[70924]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690644068.3734913, a492c090-d932-4b35-80d8-0283d75f5de7 => Stopped> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 15:21:23 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] VM Stopped (Lifecycle Event)
Jul 29 15:21:23 user nova-compute[70924]: DEBUG nova.compute.manager [None req-fd6dc154-cd7f-430f-bd16-b27ac3c03f85 None None] [instance: a492c090-d932-4b35-80d8-0283d75f5de7] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:21:23 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:21:23 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:21:23 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70924) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 29 15:21:23 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70924) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 15:21:23 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70924) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 15:21:23 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:21:25 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:21:25 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70924) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 15:21:25 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:21:25 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:21:25 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:21:25 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:21:25 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Auditing locally available compute resources for user (node: user) {{(pid=70924) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 15:21:25 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:21:25 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:21:25 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Hypervisor/Node resource view: name=user free_ram=8943MB free_disk=25.270050048828125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70924) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 15:21:25 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:21:25 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:21:25 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 15:21:25 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 15:21:25 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:21:25 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:21:25 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Compute_service record updated for user:user {{(pid=70924) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 15:21:25 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.145s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:21:26 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:21:26 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:21:27 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:21:27 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Starting heal instance info cache {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 15:21:27 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Rebuilding the list of instances to heal {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 29 15:21:27 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Didn't find any instances for network info cache update. {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 29 15:21:28 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:21:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:21:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:21:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70924) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 29 15:21:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70924) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 15:21:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70924) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 15:21:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:21:33 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:21:38 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:21:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:21:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:21:53 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:21:56 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:21:58 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:22:03 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:22:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:22:10 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:22:10 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Cleaning up deleted instances {{(pid=70924) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 29 15:22:10 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] There are 0 instances to clean {{(pid=70924) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 29 15:22:13 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:22:14 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:22:16 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:22:18 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:22:18 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:22:18 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:22:18 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70924) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 29 15:22:18 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70924) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 15:22:18 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70924) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 15:22:18 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:22:19 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:22:23 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:22:25 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:22:25 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:22:25 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:22:25 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:22:25 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Auditing locally available compute resources for user (node: user) {{(pid=70924) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 15:22:25 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:22:25 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:22:25 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Hypervisor/Node resource view: name=user free_ram=8964MB free_disk=25.26876449584961GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70924) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 15:22:25 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:22:25 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:22:25 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 15:22:25 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 15:22:25 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:22:25 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:22:25 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Compute_service record updated for user:user {{(pid=70924) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 15:22:25 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.104s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:22:26 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:22:26 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:22:26 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70924) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 15:22:27 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:22:27 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Starting heal instance info cache {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 15:22:27 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Rebuilding the list of instances to heal {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 29 15:22:27 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Didn't find any instances for network info cache update. {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 29 15:22:27 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:22:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:22:29 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:22:33 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:22:38 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:22:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:22:48 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:22:48 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Cleaning up deleted instances with incomplete migration  {{(pid=70924) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 29 15:22:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:22:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:22:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70924) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 29 15:22:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70924) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 15:22:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70924) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 15:22:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:22:50 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:22:50 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:22:53 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:22:58 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:23:03 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:23:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:23:13 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:23:14 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:23:16 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:23:17 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:23:18 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:23:18 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:23:19 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:23:21 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:23:21 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:23:23 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:23:24 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:23:26 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:23:26 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:23:26 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:23:26 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:23:26 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:23:26 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Auditing locally available compute resources for user (node: user) {{(pid=70924) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 15:23:26 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:23:26 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:23:26 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Hypervisor/Node resource view: name=user free_ram=8634MB free_disk=25.256038665771484GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70924) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 15:23:26 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:23:26 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:23:27 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 15:23:27 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 15:23:27 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Refreshing inventories for resource provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 29 15:23:27 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Updating ProviderTree inventory for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 29 15:23:27 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Updating inventory in ProviderTree for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 29 15:23:27 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Refreshing aggregate associations for resource provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832, aggregates: None {{(pid=70924) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 29 15:23:27 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Refreshing trait associations for resource provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832, traits: COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=70924) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 29 15:23:27 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:23:27 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:23:27 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Compute_service record updated for user:user {{(pid=70924) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 15:23:27 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.648s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:23:28 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:23:28 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Starting heal instance info cache {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 15:23:28 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Rebuilding the list of instances to heal {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 29 15:23:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:23:28 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Didn't find any instances for network info cache update. {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 29 15:23:28 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:23:28 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:23:28 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70924) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 15:23:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:23:29 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:23:29 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:23:31 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:23:33 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:23:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:23:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Acquiring lock "7e326df4-7ada-40c0-9a1b-36f7ed021e4f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:23:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lock "7e326df4-7ada-40c0-9a1b-36f7ed021e4f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:23:34 user nova-compute[70924]: DEBUG nova.compute.manager [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Starting instance... {{(pid=70924) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 15:23:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:23:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:23:34 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70924) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 15:23:34 user nova-compute[70924]: INFO nova.compute.claims [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Claim successful on node user
Jul 29 15:23:35 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:23:35 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:23:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.327s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:23:35 user nova-compute[70924]: DEBUG nova.compute.manager [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Start building networks asynchronously for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 15:23:35 user nova-compute[70924]: DEBUG nova.compute.manager [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Allocating IP information in the background. {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 15:23:35 user nova-compute[70924]: DEBUG nova.network.neutron [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] allocate_for_instance() {{(pid=70924) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 15:23:35 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 15:23:35 user nova-compute[70924]: DEBUG nova.compute.manager [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Start building block device mappings for instance. {{(pid=70924) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 15:23:35 user nova-compute[70924]: DEBUG nova.compute.manager [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Start spawning the instance on the hypervisor. {{(pid=70924) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 15:23:35 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Creating instance directory {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 15:23:35 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Creating image(s)
Jul 29 15:23:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Acquiring lock "/opt/stack/data/nova/instances/7e326df4-7ada-40c0-9a1b-36f7ed021e4f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:23:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lock "/opt/stack/data/nova/instances/7e326df4-7ada-40c0-9a1b-36f7ed021e4f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:23:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lock "/opt/stack/data/nova/instances/7e326df4-7ada-40c0-9a1b-36f7ed021e4f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:23:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:23:35 user nova-compute[70924]: DEBUG nova.policy [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1d3ace4aae2946dd9b2fe01faf1dd5ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12083dc5cce2499ba433abb39e4372cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70924) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 15:23:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.195s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:23:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Acquiring lock "bd72453517468710f1de26b27fb0ea28688e9009" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:23:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:23:35 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:23:36 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.142s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:23:36 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/7e326df4-7ada-40c0-9a1b-36f7ed021e4f/disk 1073741824 {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:23:36 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009,backing_fmt=raw /opt/stack/data/nova/instances/7e326df4-7ada-40c0-9a1b-36f7ed021e4f/disk 1073741824" returned: 0 in 0.059s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:23:36 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lock "bd72453517468710f1de26b27fb0ea28688e9009" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.209s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:23:36 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:23:36 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd72453517468710f1de26b27fb0ea28688e9009 --force-share --output=json" returned: 0 in 0.152s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:23:36 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7e326df4-7ada-40c0-9a1b-36f7ed021e4f/disk. size=1073741824 {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 15:23:36 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e326df4-7ada-40c0-9a1b-36f7ed021e4f/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:23:36 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e326df4-7ada-40c0-9a1b-36f7ed021e4f/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:23:36 user nova-compute[70924]: DEBUG nova.virt.disk.api [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Cannot resize image /opt/stack/data/nova/instances/7e326df4-7ada-40c0-9a1b-36f7ed021e4f/disk to a smaller size. {{(pid=70924) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 15:23:36 user nova-compute[70924]: DEBUG nova.objects.instance [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lazy-loading 'migration_context' on Instance uuid 7e326df4-7ada-40c0-9a1b-36f7ed021e4f {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:23:36 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Created local disks {{(pid=70924) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 15:23:36 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Ensure instance console log exists: /opt/stack/data/nova/instances/7e326df4-7ada-40c0-9a1b-36f7ed021e4f/console.log {{(pid=70924) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 15:23:36 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:23:36 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:23:36 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:23:36 user nova-compute[70924]: DEBUG nova.network.neutron [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Successfully created port: c66d9f39-371c-4a66-80d1-d97246e223ee {{(pid=70924) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 15:23:37 user nova-compute[70924]: DEBUG nova.network.neutron [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Successfully updated port: c66d9f39-371c-4a66-80d1-d97246e223ee {{(pid=70924) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 15:23:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Acquiring lock "refresh_cache-7e326df4-7ada-40c0-9a1b-36f7ed021e4f" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:23:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Acquired lock "refresh_cache-7e326df4-7ada-40c0-9a1b-36f7ed021e4f" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:23:37 user nova-compute[70924]: DEBUG nova.network.neutron [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Building network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 15:23:37 user nova-compute[70924]: DEBUG nova.network.neutron [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Instance cache missing network info. {{(pid=70924) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 15:23:37 user nova-compute[70924]: DEBUG nova.compute.manager [req-f00d9598-520f-4c7a-bcf8-021c5a4dabe6 req-b5b902c3-acfd-4a67-9f05-95aef2f7619c service nova] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Received event network-changed-c66d9f39-371c-4a66-80d1-d97246e223ee {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:23:37 user nova-compute[70924]: DEBUG nova.compute.manager [req-f00d9598-520f-4c7a-bcf8-021c5a4dabe6 req-b5b902c3-acfd-4a67-9f05-95aef2f7619c service nova] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Refreshing instance network info cache due to event network-changed-c66d9f39-371c-4a66-80d1-d97246e223ee. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 15:23:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-f00d9598-520f-4c7a-bcf8-021c5a4dabe6 req-b5b902c3-acfd-4a67-9f05-95aef2f7619c service nova] Acquiring lock "refresh_cache-7e326df4-7ada-40c0-9a1b-36f7ed021e4f" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:23:38 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:23:38 user nova-compute[70924]: DEBUG nova.network.neutron [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Updating instance_info_cache with network_info: [{"id": "c66d9f39-371c-4a66-80d1-d97246e223ee", "address": "fa:16:3e:ba:bb:dc", "network": {"id": "03aa753f-617e-49dd-a516-0daa709c41a3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-295275043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12083dc5cce2499ba433abb39e4372cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66d9f39-37", "ovs_interfaceid": "c66d9f39-371c-4a66-80d1-d97246e223ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:23:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Releasing lock "refresh_cache-7e326df4-7ada-40c0-9a1b-36f7ed021e4f" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:23:38 user nova-compute[70924]: DEBUG nova.compute.manager [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Instance network_info: |[{"id": "c66d9f39-371c-4a66-80d1-d97246e223ee", "address": "fa:16:3e:ba:bb:dc", "network": {"id": "03aa753f-617e-49dd-a516-0daa709c41a3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-295275043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12083dc5cce2499ba433abb39e4372cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66d9f39-37", "ovs_interfaceid": "c66d9f39-371c-4a66-80d1-d97246e223ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70924) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 15:23:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-f00d9598-520f-4c7a-bcf8-021c5a4dabe6 req-b5b902c3-acfd-4a67-9f05-95aef2f7619c service nova] Acquired lock "refresh_cache-7e326df4-7ada-40c0-9a1b-36f7ed021e4f" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:23:38 user nova-compute[70924]: DEBUG nova.network.neutron [req-f00d9598-520f-4c7a-bcf8-021c5a4dabe6 req-b5b902c3-acfd-4a67-9f05-95aef2f7619c service nova] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Refreshing network info cache for port c66d9f39-371c-4a66-80d1-d97246e223ee {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 15:23:38 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Start _get_guest_xml network_info=[{"id": "c66d9f39-371c-4a66-80d1-d97246e223ee", "address": "fa:16:3e:ba:bb:dc", "network": {"id": "03aa753f-617e-49dd-a516-0daa709c41a3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-295275043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12083dc5cce2499ba433abb39e4372cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66d9f39-37", "ovs_interfaceid": "c66d9f39-371c-4a66-80d1-d97246e223ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'guest_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'image_id': '3aba2e73-6832-404b-8bd0-d0503ce82b8c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 15:23:38 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:23:38 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:23:38 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 15:23:38 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] CPU controller missing on host. {{(pid=70924) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 15:23:38 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 15:23:38 user nova-compute[70924]: DEBUG nova.virt.libvirt.host [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] CPU controller found on host. {{(pid=70924) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 15:23:38 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70924) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 15:23:38 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T14:36:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T14:37:07Z,direct_url=<?>,disk_format='qcow2',id=3aba2e73-6832-404b-8bd0-d0503ce82b8c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2256057123ba4f7181829a5b453f36be',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T14:37:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 15:23:38 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Flavor limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 15:23:38 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Image limits 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 15:23:38 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Flavor pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 15:23:38 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Image pref 0:0:0 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 15:23:38 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 15:23:38 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 15:23:38 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 15:23:38 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Got 1 possible topologies {{(pid=70924) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 15:23:38 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 15:23:38 user nova-compute[70924]: DEBUG nova.virt.hardware [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70924) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 15:23:38 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T15:23:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-768596180',display_name='tempest-SnapshotDataIntegrityTests-server-768596180',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-768596180',id=52,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMBW/D1TywWI3V4hgD9tRCrM4JOmUL0LIiYwIIlXEvGL9jslionyS74c+lv2/7VckACRTqeDcZTKykQScisoEYi6TOLSVkKWws046Ngk572/G8KgJvNi7IpcYKuYcjUkRA==',key_name='tempest-keypair-1101403743',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12083dc5cce2499ba433abb39e4372cf',ramdisk_id='',reservation_id='r-owrwxshr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1888206088',owner_user_name='tempest-SnapshotDataIntegrityTests-1888206088-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T15:23:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1d3ace4aae2946dd9b2fe01faf1dd5ff',uuid=7e326df4-7ada-40c0-9a1b-36f7ed021e4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c66d9f39-371c-4a66-80d1-d97246e223ee", "address": "fa:16:3e:ba:bb:dc", "network": {"id": "03aa753f-617e-49dd-a516-0daa709c41a3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-295275043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12083dc5cce2499ba433abb39e4372cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66d9f39-37", "ovs_interfaceid": "c66d9f39-371c-4a66-80d1-d97246e223ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70924) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 15:23:38 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Converting VIF {"id": "c66d9f39-371c-4a66-80d1-d97246e223ee", "address": "fa:16:3e:ba:bb:dc", "network": {"id": "03aa753f-617e-49dd-a516-0daa709c41a3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-295275043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12083dc5cce2499ba433abb39e4372cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66d9f39-37", "ovs_interfaceid": "c66d9f39-371c-4a66-80d1-d97246e223ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 15:23:38 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:bb:dc,bridge_name='br-int',has_traffic_filtering=True,id=c66d9f39-371c-4a66-80d1-d97246e223ee,network=Network(03aa753f-617e-49dd-a516-0daa709c41a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66d9f39-37') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 15:23:38 user nova-compute[70924]: DEBUG nova.objects.instance [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lazy-loading 'pci_devices' on Instance uuid 7e326df4-7ada-40c0-9a1b-36f7ed021e4f {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:23:38 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] End _get_guest_xml xml=<domain type="kvm">
Jul 29 15:23:38 user nova-compute[70924]:   <uuid>7e326df4-7ada-40c0-9a1b-36f7ed021e4f</uuid>
Jul 29 15:23:38 user nova-compute[70924]:   <name>instance-00000034</name>
Jul 29 15:23:38 user nova-compute[70924]:   <memory>524288</memory>
Jul 29 15:23:38 user nova-compute[70924]:   <vcpu>1</vcpu>
Jul 29 15:23:38 user nova-compute[70924]:   <metadata>
Jul 29 15:23:38 user nova-compute[70924]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 15:23:38 user nova-compute[70924]:       <nova:package version="0.0.0"/>
Jul 29 15:23:38 user nova-compute[70924]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-768596180</nova:name>
Jul 29 15:23:38 user nova-compute[70924]:       <nova:creationTime>2023-07-29 15:23:38</nova:creationTime>
Jul 29 15:23:38 user nova-compute[70924]:       <nova:flavor name="m1.tiny">
Jul 29 15:23:38 user nova-compute[70924]:         <nova:memory>512</nova:memory>
Jul 29 15:23:38 user nova-compute[70924]:         <nova:disk>1</nova:disk>
Jul 29 15:23:38 user nova-compute[70924]:         <nova:swap>0</nova:swap>
Jul 29 15:23:38 user nova-compute[70924]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 15:23:38 user nova-compute[70924]:         <nova:vcpus>1</nova:vcpus>
Jul 29 15:23:38 user nova-compute[70924]:       </nova:flavor>
Jul 29 15:23:38 user nova-compute[70924]:       <nova:owner>
Jul 29 15:23:38 user nova-compute[70924]:         <nova:user uuid="1d3ace4aae2946dd9b2fe01faf1dd5ff">tempest-SnapshotDataIntegrityTests-1888206088-project-member</nova:user>
Jul 29 15:23:38 user nova-compute[70924]:         <nova:project uuid="12083dc5cce2499ba433abb39e4372cf">tempest-SnapshotDataIntegrityTests-1888206088</nova:project>
Jul 29 15:23:38 user nova-compute[70924]:       </nova:owner>
Jul 29 15:23:38 user nova-compute[70924]:       <nova:root type="image" uuid="3aba2e73-6832-404b-8bd0-d0503ce82b8c"/>
Jul 29 15:23:38 user nova-compute[70924]:       <nova:ports>
Jul 29 15:23:38 user nova-compute[70924]:         <nova:port uuid="c66d9f39-371c-4a66-80d1-d97246e223ee">
Jul 29 15:23:38 user nova-compute[70924]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 29 15:23:38 user nova-compute[70924]:         </nova:port>
Jul 29 15:23:38 user nova-compute[70924]:       </nova:ports>
Jul 29 15:23:38 user nova-compute[70924]:     </nova:instance>
Jul 29 15:23:38 user nova-compute[70924]:   </metadata>
Jul 29 15:23:38 user nova-compute[70924]:   <sysinfo type="smbios">
Jul 29 15:23:38 user nova-compute[70924]:     <system>
Jul 29 15:23:38 user nova-compute[70924]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 15:23:38 user nova-compute[70924]:       <entry name="product">OpenStack Nova</entry>
Jul 29 15:23:38 user nova-compute[70924]:       <entry name="version">0.0.0</entry>
Jul 29 15:23:38 user nova-compute[70924]:       <entry name="serial">7e326df4-7ada-40c0-9a1b-36f7ed021e4f</entry>
Jul 29 15:23:38 user nova-compute[70924]:       <entry name="uuid">7e326df4-7ada-40c0-9a1b-36f7ed021e4f</entry>
Jul 29 15:23:38 user nova-compute[70924]:       <entry name="family">Virtual Machine</entry>
Jul 29 15:23:38 user nova-compute[70924]:     </system>
Jul 29 15:23:38 user nova-compute[70924]:   </sysinfo>
Jul 29 15:23:38 user nova-compute[70924]:   <os>
Jul 29 15:23:38 user nova-compute[70924]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 15:23:38 user nova-compute[70924]:     <boot dev="hd"/>
Jul 29 15:23:38 user nova-compute[70924]:     <smbios mode="sysinfo"/>
Jul 29 15:23:38 user nova-compute[70924]:   </os>
Jul 29 15:23:38 user nova-compute[70924]:   <features>
Jul 29 15:23:38 user nova-compute[70924]:     <acpi/>
Jul 29 15:23:38 user nova-compute[70924]:     <apic/>
Jul 29 15:23:38 user nova-compute[70924]:     <vmcoreinfo/>
Jul 29 15:23:38 user nova-compute[70924]:   </features>
Jul 29 15:23:38 user nova-compute[70924]:   <clock offset="utc">
Jul 29 15:23:38 user nova-compute[70924]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 15:23:38 user nova-compute[70924]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 15:23:38 user nova-compute[70924]:     <timer name="hpet" present="no"/>
Jul 29 15:23:38 user nova-compute[70924]:   </clock>
Jul 29 15:23:38 user nova-compute[70924]:   <cpu mode="custom" match="exact">
Jul 29 15:23:38 user nova-compute[70924]:     <model>Nehalem</model>
Jul 29 15:23:38 user nova-compute[70924]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 15:23:38 user nova-compute[70924]:   </cpu>
Jul 29 15:23:38 user nova-compute[70924]:   <devices>
Jul 29 15:23:38 user nova-compute[70924]:     <disk type="file" device="disk">
Jul 29 15:23:38 user nova-compute[70924]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 15:23:38 user nova-compute[70924]:       <source file="/opt/stack/data/nova/instances/7e326df4-7ada-40c0-9a1b-36f7ed021e4f/disk"/>
Jul 29 15:23:38 user nova-compute[70924]:       <target dev="vda" bus="virtio"/>
Jul 29 15:23:38 user nova-compute[70924]:     </disk>
Jul 29 15:23:38 user nova-compute[70924]:     <interface type="ethernet">
Jul 29 15:23:38 user nova-compute[70924]:       <mac address="fa:16:3e:ba:bb:dc"/>
Jul 29 15:23:38 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 15:23:38 user nova-compute[70924]:       <mtu size="1442"/>
Jul 29 15:23:38 user nova-compute[70924]:       <target dev="tapc66d9f39-37"/>
Jul 29 15:23:38 user nova-compute[70924]:     </interface>
Jul 29 15:23:38 user nova-compute[70924]:     <serial type="pty">
Jul 29 15:23:38 user nova-compute[70924]:       <log file="/opt/stack/data/nova/instances/7e326df4-7ada-40c0-9a1b-36f7ed021e4f/console.log" append="off"/>
Jul 29 15:23:38 user nova-compute[70924]:     </serial>
Jul 29 15:23:38 user nova-compute[70924]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 15:23:38 user nova-compute[70924]:     <video>
Jul 29 15:23:38 user nova-compute[70924]:       <model type="virtio"/>
Jul 29 15:23:38 user nova-compute[70924]:     </video>
Jul 29 15:23:38 user nova-compute[70924]:     <rng model="virtio">
Jul 29 15:23:38 user nova-compute[70924]:       <backend model="random">/dev/urandom</backend>
Jul 29 15:23:38 user nova-compute[70924]:     </rng>
Jul 29 15:23:38 user nova-compute[70924]:     <controller type="usb" index="0" model="none"/>
Jul 29 15:23:38 user nova-compute[70924]:     <memballoon model="virtio">
Jul 29 15:23:38 user nova-compute[70924]:       <stats period="10"/>
Jul 29 15:23:38 user nova-compute[70924]:     </memballoon>
Jul 29 15:23:38 user nova-compute[70924]:   </devices>
Jul 29 15:23:38 user nova-compute[70924]: </domain>
Jul 29 15:23:38 user nova-compute[70924]:  {{(pid=70924) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 15:23:38 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T15:23:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-768596180',display_name='tempest-SnapshotDataIntegrityTests-server-768596180',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-768596180',id=52,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMBW/D1TywWI3V4hgD9tRCrM4JOmUL0LIiYwIIlXEvGL9jslionyS74c+lv2/7VckACRTqeDcZTKykQScisoEYi6TOLSVkKWws046Ngk572/G8KgJvNi7IpcYKuYcjUkRA==',key_name='tempest-keypair-1101403743',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12083dc5cce2499ba433abb39e4372cf',ramdisk_id='',reservation_id='r-owrwxshr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1888206088',owner_user_name='tempest-SnapshotDataIntegrityTests-1888206088-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T15:23:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1d3ace4aae2946dd9b2fe01faf1dd5ff',uuid=7e326df4-7ada-40c0-9a1b-36f7ed021e4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c66d9f39-371c-4a66-80d1-d97246e223ee", "address": "fa:16:3e:ba:bb:dc", "network": {"id": "03aa753f-617e-49dd-a516-0daa709c41a3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-295275043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12083dc5cce2499ba433abb39e4372cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66d9f39-37", "ovs_interfaceid": "c66d9f39-371c-4a66-80d1-d97246e223ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 15:23:38 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Converting VIF {"id": "c66d9f39-371c-4a66-80d1-d97246e223ee", "address": "fa:16:3e:ba:bb:dc", "network": {"id": "03aa753f-617e-49dd-a516-0daa709c41a3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-295275043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12083dc5cce2499ba433abb39e4372cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66d9f39-37", "ovs_interfaceid": "c66d9f39-371c-4a66-80d1-d97246e223ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 15:23:38 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:bb:dc,bridge_name='br-int',has_traffic_filtering=True,id=c66d9f39-371c-4a66-80d1-d97246e223ee,network=Network(03aa753f-617e-49dd-a516-0daa709c41a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66d9f39-37') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 15:23:38 user nova-compute[70924]: DEBUG os_vif [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:bb:dc,bridge_name='br-int',has_traffic_filtering=True,id=c66d9f39-371c-4a66-80d1-d97246e223ee,network=Network(03aa753f-617e-49dd-a516-0daa709c41a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66d9f39-37') {{(pid=70924) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 15:23:38 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:23:38 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:23:38 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 15:23:38 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:23:38 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc66d9f39-37, may_exist=True, interface_attrs={}) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:23:38 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc66d9f39-37, col_values=(('external_ids', {'iface-id': 'c66d9f39-371c-4a66-80d1-d97246e223ee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:bb:dc', 'vm-uuid': '7e326df4-7ada-40c0-9a1b-36f7ed021e4f'}),), if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:23:38 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:23:38 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:23:38 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:23:38 user nova-compute[70924]: INFO os_vif [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:bb:dc,bridge_name='br-int',has_traffic_filtering=True,id=c66d9f39-371c-4a66-80d1-d97246e223ee,network=Network(03aa753f-617e-49dd-a516-0daa709c41a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66d9f39-37')
Jul 29 15:23:38 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 15:23:38 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] No VIF found with MAC fa:16:3e:ba:bb:dc, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 15:23:39 user nova-compute[70924]: DEBUG nova.network.neutron [req-f00d9598-520f-4c7a-bcf8-021c5a4dabe6 req-b5b902c3-acfd-4a67-9f05-95aef2f7619c service nova] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Updated VIF entry in instance network info cache for port c66d9f39-371c-4a66-80d1-d97246e223ee. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 15:23:39 user nova-compute[70924]: DEBUG nova.network.neutron [req-f00d9598-520f-4c7a-bcf8-021c5a4dabe6 req-b5b902c3-acfd-4a67-9f05-95aef2f7619c service nova] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Updating instance_info_cache with network_info: [{"id": "c66d9f39-371c-4a66-80d1-d97246e223ee", "address": "fa:16:3e:ba:bb:dc", "network": {"id": "03aa753f-617e-49dd-a516-0daa709c41a3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-295275043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12083dc5cce2499ba433abb39e4372cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66d9f39-37", "ovs_interfaceid": "c66d9f39-371c-4a66-80d1-d97246e223ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:23:39 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-f00d9598-520f-4c7a-bcf8-021c5a4dabe6 req-b5b902c3-acfd-4a67-9f05-95aef2f7619c service nova] Releasing lock "refresh_cache-7e326df4-7ada-40c0-9a1b-36f7ed021e4f" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:23:40 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:23:40 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:23:40 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:23:40 user nova-compute[70924]: DEBUG nova.compute.manager [req-56168ca1-1025-44b2-b3e2-8478dc640266 req-70284613-4121-4450-8e17-d468e6c77a09 service nova] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Received event network-vif-plugged-c66d9f39-371c-4a66-80d1-d97246e223ee {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:23:40 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-56168ca1-1025-44b2-b3e2-8478dc640266 req-70284613-4121-4450-8e17-d468e6c77a09 service nova] Acquiring lock "7e326df4-7ada-40c0-9a1b-36f7ed021e4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:23:40 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-56168ca1-1025-44b2-b3e2-8478dc640266 req-70284613-4121-4450-8e17-d468e6c77a09 service nova] Lock "7e326df4-7ada-40c0-9a1b-36f7ed021e4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:23:40 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-56168ca1-1025-44b2-b3e2-8478dc640266 req-70284613-4121-4450-8e17-d468e6c77a09 service nova] Lock "7e326df4-7ada-40c0-9a1b-36f7ed021e4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:23:40 user nova-compute[70924]: DEBUG nova.compute.manager [req-56168ca1-1025-44b2-b3e2-8478dc640266 req-70284613-4121-4450-8e17-d468e6c77a09 service nova] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] No waiting events found dispatching network-vif-plugged-c66d9f39-371c-4a66-80d1-d97246e223ee {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:23:40 user nova-compute[70924]: WARNING nova.compute.manager [req-56168ca1-1025-44b2-b3e2-8478dc640266 req-70284613-4121-4450-8e17-d468e6c77a09 service nova] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Received unexpected event network-vif-plugged-c66d9f39-371c-4a66-80d1-d97246e223ee for instance with vm_state building and task_state spawning.
Jul 29 15:23:40 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:23:40 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:23:40 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:23:41 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:23:42 user nova-compute[70924]: DEBUG nova.compute.manager [req-64d1b400-4c51-4ce6-a5dc-2fd6da575deb req-4d9e9eed-9f2f-46ab-a067-01d41e37c87a service nova] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Received event network-vif-plugged-c66d9f39-371c-4a66-80d1-d97246e223ee {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:23:42 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-64d1b400-4c51-4ce6-a5dc-2fd6da575deb req-4d9e9eed-9f2f-46ab-a067-01d41e37c87a service nova] Acquiring lock "7e326df4-7ada-40c0-9a1b-36f7ed021e4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:23:42 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-64d1b400-4c51-4ce6-a5dc-2fd6da575deb req-4d9e9eed-9f2f-46ab-a067-01d41e37c87a service nova] Lock "7e326df4-7ada-40c0-9a1b-36f7ed021e4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:23:42 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-64d1b400-4c51-4ce6-a5dc-2fd6da575deb req-4d9e9eed-9f2f-46ab-a067-01d41e37c87a service nova] Lock "7e326df4-7ada-40c0-9a1b-36f7ed021e4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:23:42 user nova-compute[70924]: DEBUG nova.compute.manager [req-64d1b400-4c51-4ce6-a5dc-2fd6da575deb req-4d9e9eed-9f2f-46ab-a067-01d41e37c87a service nova] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] No waiting events found dispatching network-vif-plugged-c66d9f39-371c-4a66-80d1-d97246e223ee {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:23:42 user nova-compute[70924]: WARNING nova.compute.manager [req-64d1b400-4c51-4ce6-a5dc-2fd6da575deb req-4d9e9eed-9f2f-46ab-a067-01d41e37c87a service nova] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Received unexpected event network-vif-plugged-c66d9f39-371c-4a66-80d1-d97246e223ee for instance with vm_state building and task_state spawning.
Jul 29 15:23:42 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690644222.6690636, 7e326df4-7ada-40c0-9a1b-36f7ed021e4f => Resumed> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 15:23:42 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] VM Resumed (Lifecycle Event)
Jul 29 15:23:42 user nova-compute[70924]: DEBUG nova.compute.manager [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Instance event wait completed in 0 seconds for  {{(pid=70924) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 15:23:42 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Guest created on hypervisor {{(pid=70924) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 15:23:42 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Instance spawned successfully.
Jul 29 15:23:42 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 15:23:42 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:23:42 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 15:23:42 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Found default for hw_cdrom_bus of ide {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:23:42 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Found default for hw_disk_bus of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:23:42 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Found default for hw_input_bus of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:23:42 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Found default for hw_pointer_model of None {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:23:42 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Found default for hw_video_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:23:42 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Found default for hw_vif_model of virtio {{(pid=70924) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 15:23:42 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 15:23:42 user nova-compute[70924]: DEBUG nova.virt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Emitting event <LifecycleEvent: 1690644222.6713514, 7e326df4-7ada-40c0-9a1b-36f7ed021e4f => Started> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 15:23:42 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] VM Started (Lifecycle Event)
Jul 29 15:23:42 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:23:42 user nova-compute[70924]: DEBUG nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70924) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 15:23:42 user nova-compute[70924]: INFO nova.compute.manager [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 15:23:42 user nova-compute[70924]: INFO nova.compute.manager [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Took 7.09 seconds to spawn the instance on the hypervisor.
Jul 29 15:23:42 user nova-compute[70924]: DEBUG nova.compute.manager [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:23:42 user nova-compute[70924]: INFO nova.compute.manager [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Took 8.07 seconds to build instance.
Jul 29 15:23:42 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-16ec0f34-4365-4d71-a5ad-32b03db62e30 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lock "7e326df4-7ada-40c0-9a1b-36f7ed021e4f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.270s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:23:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:23:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:23:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:23:49 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:23:53 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:23:54 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:23:58 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:23:59 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:24:03 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:24:04 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:24:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:24:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:24:13 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:24:14 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:24:16 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:24:17 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:24:18 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:24:18 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:24:21 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:24:23 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:24:27 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:24:27 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:24:27 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:24:27 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:24:27 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Auditing locally available compute resources for user (node: user) {{(pid=70924) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 15:24:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e326df4-7ada-40c0-9a1b-36f7ed021e4f/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:24:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e326df4-7ada-40c0-9a1b-36f7ed021e4f/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:24:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e326df4-7ada-40c0-9a1b-36f7ed021e4f/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:24:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e326df4-7ada-40c0-9a1b-36f7ed021e4f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:24:28 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:24:28 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:24:28 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Hypervisor/Node resource view: name=user free_ram=8703MB free_disk=25.22237777709961GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70924) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 15:24:28 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:24:28 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:24:28 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 7e326df4-7ada-40c0-9a1b-36f7ed021e4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:24:28 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 15:24:28 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 15:24:28 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:24:28 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:24:28 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Compute_service record updated for user:user {{(pid=70924) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 15:24:28 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.259s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:24:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:24:29 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:24:29 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Starting heal instance info cache {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 15:24:29 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Rebuilding the list of instances to heal {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 29 15:24:29 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "refresh_cache-7e326df4-7ada-40c0-9a1b-36f7ed021e4f" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:24:29 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquired lock "refresh_cache-7e326df4-7ada-40c0-9a1b-36f7ed021e4f" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:24:29 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Forcefully refreshing network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 29 15:24:29 user nova-compute[70924]: DEBUG nova.objects.instance [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lazy-loading 'info_cache' on Instance uuid 7e326df4-7ada-40c0-9a1b-36f7ed021e4f {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:24:30 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Updating instance_info_cache with network_info: [{"id": "c66d9f39-371c-4a66-80d1-d97246e223ee", "address": "fa:16:3e:ba:bb:dc", "network": {"id": "03aa753f-617e-49dd-a516-0daa709c41a3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-295275043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12083dc5cce2499ba433abb39e4372cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66d9f39-37", "ovs_interfaceid": "c66d9f39-371c-4a66-80d1-d97246e223ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:24:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Releasing lock "refresh_cache-7e326df4-7ada-40c0-9a1b-36f7ed021e4f" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:24:30 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Updated the network info_cache for instance {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 29 15:24:30 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:24:30 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:24:30 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:24:30 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70924) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 15:24:33 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:24:38 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:24:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:24:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:24:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:24:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70924) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 29 15:24:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70924) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 15:24:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70924) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 15:24:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:24:53 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:24:58 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:25:03 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:25:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:25:13 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:25:18 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:25:18 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:25:18 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:25:20 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:25:21 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:25:23 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:25:25 user nova-compute[70924]: DEBUG nova.compute.manager [req-3a712d60-d1d2-40f4-9777-b4dfe353a9a1 req-3f8ed3f0-e674-4eb5-9e48-77fd84000c11 service nova] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Received event network-changed-c66d9f39-371c-4a66-80d1-d97246e223ee {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:25:25 user nova-compute[70924]: DEBUG nova.compute.manager [req-3a712d60-d1d2-40f4-9777-b4dfe353a9a1 req-3f8ed3f0-e674-4eb5-9e48-77fd84000c11 service nova] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Refreshing instance network info cache due to event network-changed-c66d9f39-371c-4a66-80d1-d97246e223ee. {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 15:25:25 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-3a712d60-d1d2-40f4-9777-b4dfe353a9a1 req-3f8ed3f0-e674-4eb5-9e48-77fd84000c11 service nova] Acquiring lock "refresh_cache-7e326df4-7ada-40c0-9a1b-36f7ed021e4f" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:25:25 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-3a712d60-d1d2-40f4-9777-b4dfe353a9a1 req-3f8ed3f0-e674-4eb5-9e48-77fd84000c11 service nova] Acquired lock "refresh_cache-7e326df4-7ada-40c0-9a1b-36f7ed021e4f" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:25:25 user nova-compute[70924]: DEBUG nova.network.neutron [req-3a712d60-d1d2-40f4-9777-b4dfe353a9a1 req-3f8ed3f0-e674-4eb5-9e48-77fd84000c11 service nova] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Refreshing network info cache for port c66d9f39-371c-4a66-80d1-d97246e223ee {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 15:25:26 user nova-compute[70924]: DEBUG nova.network.neutron [req-3a712d60-d1d2-40f4-9777-b4dfe353a9a1 req-3f8ed3f0-e674-4eb5-9e48-77fd84000c11 service nova] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Updated VIF entry in instance network info cache for port c66d9f39-371c-4a66-80d1-d97246e223ee. {{(pid=70924) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 15:25:26 user nova-compute[70924]: DEBUG nova.network.neutron [req-3a712d60-d1d2-40f4-9777-b4dfe353a9a1 req-3f8ed3f0-e674-4eb5-9e48-77fd84000c11 service nova] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Updating instance_info_cache with network_info: [{"id": "c66d9f39-371c-4a66-80d1-d97246e223ee", "address": "fa:16:3e:ba:bb:dc", "network": {"id": "03aa753f-617e-49dd-a516-0daa709c41a3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-295275043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12083dc5cce2499ba433abb39e4372cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66d9f39-37", "ovs_interfaceid": "c66d9f39-371c-4a66-80d1-d97246e223ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:25:26 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-3a712d60-d1d2-40f4-9777-b4dfe353a9a1 req-3f8ed3f0-e674-4eb5-9e48-77fd84000c11 service nova] Releasing lock "refresh_cache-7e326df4-7ada-40c0-9a1b-36f7ed021e4f" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:25:27 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:25:27 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:25:27 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:25:27 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:25:27 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Auditing locally available compute resources for user (node: user) {{(pid=70924) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 15:25:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e326df4-7ada-40c0-9a1b-36f7ed021e4f/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:25:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e326df4-7ada-40c0-9a1b-36f7ed021e4f/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:25:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e326df4-7ada-40c0-9a1b-36f7ed021e4f/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:25:27 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e326df4-7ada-40c0-9a1b-36f7ed021e4f/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:25:28 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:25:28 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:25:28 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Hypervisor/Node resource view: name=user free_ram=8808MB free_disk=25.22134017944336GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70924) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 15:25:28 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:25:28 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:25:28 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 7e326df4-7ada-40c0-9a1b-36f7ed021e4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:25:28 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 15:25:28 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 15:25:28 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:25:28 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:25:28 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Compute_service record updated for user:user {{(pid=70924) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 15:25:28 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.154s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:25:28 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:25:29 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:25:30 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:25:30 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Starting heal instance info cache {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 15:25:30 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Rebuilding the list of instances to heal {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 29 15:25:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "refresh_cache-7e326df4-7ada-40c0-9a1b-36f7ed021e4f" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:25:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquired lock "refresh_cache-7e326df4-7ada-40c0-9a1b-36f7ed021e4f" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:25:30 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Forcefully refreshing network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 29 15:25:30 user nova-compute[70924]: DEBUG nova.objects.instance [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lazy-loading 'info_cache' on Instance uuid 7e326df4-7ada-40c0-9a1b-36f7ed021e4f {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:25:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-8c40aa5c-48da-4178-b2be-c8b9cb8d3333 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Acquiring lock "7e326df4-7ada-40c0-9a1b-36f7ed021e4f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:25:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-8c40aa5c-48da-4178-b2be-c8b9cb8d3333 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lock "7e326df4-7ada-40c0-9a1b-36f7ed021e4f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:25:30 user nova-compute[70924]: DEBUG nova.objects.instance [None req-8c40aa5c-48da-4178-b2be-c8b9cb8d3333 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lazy-loading 'flavor' on Instance uuid 7e326df4-7ada-40c0-9a1b-36f7ed021e4f {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:25:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-8c40aa5c-48da-4178-b2be-c8b9cb8d3333 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lock "7e326df4-7ada-40c0-9a1b-36f7ed021e4f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:25:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-8c40aa5c-48da-4178-b2be-c8b9cb8d3333 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Acquiring lock "7e326df4-7ada-40c0-9a1b-36f7ed021e4f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:25:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-8c40aa5c-48da-4178-b2be-c8b9cb8d3333 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lock "7e326df4-7ada-40c0-9a1b-36f7ed021e4f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:25:30 user nova-compute[70924]: INFO nova.compute.manager [None req-8c40aa5c-48da-4178-b2be-c8b9cb8d3333 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Attaching volume 5ea1a02f-d619-4afe-95c7-71e97ad67d6a to /dev/vdb
Jul 29 15:25:30 user nova-compute[70924]: DEBUG os_brick.utils [None req-8c40aa5c-48da-4178-b2be-c8b9cb8d3333 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 15:25:30 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:25:30 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:25:30 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cecd8f2-7036-4491-92e6-f23c78cdce01]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f2127c4a30d9\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:25:30 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:25:30 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:25:30 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[7457e02e-7b58-4650-adf3-449593d87ec9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:25:30 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:25:30 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:25:30 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4601dc6-a080-4d3f-9d73-8d89f4c9913a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:25:30 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[07076f83-d6cd-4676-ba35-c99c7afb47bd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:25:30 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-8c40aa5c-48da-4178-b2be-c8b9cb8d3333 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Running cmd (subprocess): nvme version {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:25:30 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-8c40aa5c-48da-4178-b2be-c8b9cb8d3333 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] 'nvme version' failed. Not Retrying. {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 15:25:30 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8c40aa5c-48da-4178-b2be-c8b9cb8d3333 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] nvme not present on system {{(pid=70924) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 15:25:30 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:25:30 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 15:25:30 user nova-compute[70924]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 15:25:30 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5383c22-a37e-4ef6-ba28-ee33b22c9907]: (4, '') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:25:30 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-8c40aa5c-48da-4178-b2be-c8b9cb8d3333 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70924) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 15:25:30 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-8c40aa5c-48da-4178-b2be-c8b9cb8d3333 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 15:25:30 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-8c40aa5c-48da-4178-b2be-c8b9cb8d3333 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] LIGHTOS: no hostnqn found. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 15:25:30 user nova-compute[70924]: DEBUG os_brick.utils [None req-8c40aa5c-48da-4178-b2be-c8b9cb8d3333 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f2127c4a30d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 15:25:30 user nova-compute[70924]: DEBUG nova.virt.block_device [None req-8c40aa5c-48da-4178-b2be-c8b9cb8d3333 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Updating existing volume attachment record: 6a3e428f-1043-4d1e-b8ec-321c758f3b1f {{(pid=70924) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 15:25:30 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Updating instance_info_cache with network_info: [{"id": "c66d9f39-371c-4a66-80d1-d97246e223ee", "address": "fa:16:3e:ba:bb:dc", "network": {"id": "03aa753f-617e-49dd-a516-0daa709c41a3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-295275043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12083dc5cce2499ba433abb39e4372cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66d9f39-37", "ovs_interfaceid": "c66d9f39-371c-4a66-80d1-d97246e223ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:25:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Releasing lock "refresh_cache-7e326df4-7ada-40c0-9a1b-36f7ed021e4f" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:25:30 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Updated the network info_cache for instance {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 29 15:25:30 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:25:30 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:25:30 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70924) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 15:25:31 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:25:33 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:25:33 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:25:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:25:37 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c40aa5c-48da-4178-b2be-c8b9cb8d3333 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Calling os-brick to attach iSCSI Volume {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 15:25:37 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c40aa5c-48da-4178-b2be-c8b9cb8d3333 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5ea1a02f-d619-4afe-95c7-71e97ad67d6a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TgzuaAoM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 15:25:37 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-8c40aa5c-48da-4178-b2be-c8b9cb8d3333 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 15:25:37 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-8c40aa5c-48da-4178-b2be-c8b9cb8d3333 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 15:25:37 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-8c40aa5c-48da-4178-b2be-c8b9cb8d3333 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 15:25:37 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-8c40aa5c-48da-4178-b2be-c8b9cb8d3333 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 15:25:37 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-8c40aa5c-48da-4178-b2be-c8b9cb8d3333 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ea1a02f-d619-4afe-95c7-71e97ad67d6a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 15:25:37 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-8c40aa5c-48da-4178-b2be-c8b9cb8d3333 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ea1a02f-d619-4afe-95c7-71e97ad67d6a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 15:25:37 user nova-compute[70924]: INFO os_brick.initiator.connectors.iscsi [None req-8c40aa5c-48da-4178-b2be-c8b9cb8d3333 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 15:25:37 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ea1a02f-d619-4afe-95c7-71e97ad67d6a -p 172.16.0.220:3260 {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:25:37 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ea1a02f-d619-4afe-95c7-71e97ad67d6a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:25:37 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d99566b-9d72-4622-8081-abea3c5d0b56]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:25:37 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c40aa5c-48da-4178-b2be-c8b9cb8d3333 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 15:25:37 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:25:37 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ea1a02f-d619-4afe-95c7-71e97ad67d6a -p 172.16.0.220:3260 --interface default --op new {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:25:37 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ea1a02f-d619-4afe-95c7-71e97ad67d6a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:25:37 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[7470aceb-2d2e-44b0-8128-b4c7e5a2c0b5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ea1a02f-d619-4afe-95c7-71e97ad67d6a] added\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:25:37 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c40aa5c-48da-4178-b2be-c8b9cb8d3333 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ea1a02f-d619-4afe-95c7-71e97ad67d6a] added
Jul 29 15:25:37 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:25:37 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ea1a02f-d619-4afe-95c7-71e97ad67d6a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:25:37 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ea1a02f-d619-4afe-95c7-71e97ad67d6a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:25:37 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b79d95-107a-4e0b-8837-d255de6e6386]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:25:37 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c40aa5c-48da-4178-b2be-c8b9cb8d3333 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:25:37 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ea1a02f-d619-4afe-95c7-71e97ad67d6a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:25:37 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ea1a02f-d619-4afe-95c7-71e97ad67d6a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:25:37 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93642d1-5399-4916-9231-649653db3256]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:25:37 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c40aa5c-48da-4178-b2be-c8b9cb8d3333 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:25:37 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ea1a02f-d619-4afe-95c7-71e97ad67d6a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TgzuaAoM {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:25:37 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ea1a02f-d619-4afe-95c7-71e97ad67d6a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TgzuaAoM" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:25:37 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bcbb0c3-f3fc-4ba7-8934-2bd9ae768114]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:25:37 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c40aa5c-48da-4178-b2be-c8b9cb8d3333 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TgzuaAoM'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:25:37 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ea1a02f-d619-4afe-95c7-71e97ad67d6a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:25:37 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ea1a02f-d619-4afe-95c7-71e97ad67d6a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:25:37 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f59316ac-c926-45ed-8f82-c74a4a7fb43e]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:25:37 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c40aa5c-48da-4178-b2be-c8b9cb8d3333 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:25:37 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:25:37 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:25:37 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d1c52a5-dbd2-4261-9beb-3a6db32d19ec]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:25:37 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c40aa5c-48da-4178-b2be-c8b9cb8d3333 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 29 15:25:37 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 15:25:37 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c40aa5c-48da-4178-b2be-c8b9cb8d3333 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 29 15:25:37 user nova-compute[70924]:  {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 15:25:37 user nova-compute[70924]: WARNING os_brick.initiator.connectors.iscsi [None req-8c40aa5c-48da-4178-b2be-c8b9cb8d3333 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 29 15:25:37 user nova-compute[70924]: 
Jul 29 15:25:37 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ea1a02f-d619-4afe-95c7-71e97ad67d6a -p 172.16.0.220:3260 --login {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:25:37 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ea1a02f-d619-4afe-95c7-71e97ad67d6a -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:25:37 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[7644509e-2ce3-4026-b24b-34f9e44cb717]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ea1a02f-d619-4afe-95c7-71e97ad67d6a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5ea1a02f-d619-4afe-95c7-71e97ad67d6a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:25:37 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c40aa5c-48da-4178-b2be-c8b9cb8d3333 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ea1a02f-d619-4afe-95c7-71e97ad67d6a, portal: 172.16.0.220,3260]
Jul 29 15:25:37 user nova-compute[70924]: Login to [iface: default, target: iqn.2010-10.org.openstack:5ea1a02f-d619-4afe-95c7-71e97ad67d6a, portal: 172.16.0.220,3260] successful.
Jul 29 15:25:37 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:25:37 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ea1a02f-d619-4afe-95c7-71e97ad67d6a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:25:37 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ea1a02f-d619-4afe-95c7-71e97ad67d6a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:25:37 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e389ad9-7085-4b89-a531-b62adcd7f22d]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:25:37 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c40aa5c-48da-4178-b2be-c8b9cb8d3333 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:25:37 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:25:37 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:25:37 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[71285529-fb00-47c0-a93b-bbaaff7d822f]: (4, ('tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ea1a02f-d619-4afe-95c7-71e97ad67d6a (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:25:37 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c40aa5c-48da-4178-b2be-c8b9cb8d3333 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ea1a02f-d619-4afe-95c7-71e97ad67d6a (non-flash)
Jul 29 15:25:37 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 15:25:37 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c40aa5c-48da-4178-b2be-c8b9cb8d3333 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsi session list stdout=tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ea1a02f-d619-4afe-95c7-71e97ad67d6a (non-flash)
Jul 29 15:25:37 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 15:25:37 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-8c40aa5c-48da-4178-b2be-c8b9cb8d3333 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ea1a02f-d619-4afe-95c7-71e97ad67d6a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 15:25:37 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c40aa5c-48da-4178-b2be-c8b9cb8d3333 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Connected to 172.16.0.220:3260 {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 15:25:37 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-8c40aa5c-48da-4178-b2be-c8b9cb8d3333 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] HCTL ('33', '-', '-', 0) found on session 66 with lun 0 {{(pid=70924) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 15:25:37 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-8c40aa5c-48da-4178-b2be-c8b9cb8d3333 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70924) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 15:25:37 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:25:37 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:25:37 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de0babf-f2d8-416f-ac2e-83606412994e]: (4, ('- - 0', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:25:37 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-8c40aa5c-48da-4178-b2be-c8b9cb8d3333 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Searching for a device in session 66 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 15:25:37 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c40aa5c-48da-4178-b2be-c8b9cb8d3333 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TgzuaAoM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 15:25:38 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-8c40aa5c-48da-4178-b2be-c8b9cb8d3333 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 15:25:38 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c40aa5c-48da-4178-b2be-c8b9cb8d3333 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '23664326662636662', 'path': '/dev/sdb'} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 15:25:38 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c40aa5c-48da-4178-b2be-c8b9cb8d3333 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23664326662636662', 'path': '/dev/sdb'} {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 15:25:38 user nova-compute[70924]: DEBUG nova.objects.instance [None req-8c40aa5c-48da-4178-b2be-c8b9cb8d3333 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lazy-loading 'flavor' on Instance uuid 7e326df4-7ada-40c0-9a1b-36f7ed021e4f {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:25:38 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-8c40aa5c-48da-4178-b2be-c8b9cb8d3333 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] attach device xml: <disk type="block" device="disk">
Jul 29 15:25:38 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 15:25:38 user nova-compute[70924]:   <source dev="/dev/sdb"/>
Jul 29 15:25:38 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 15:25:38 user nova-compute[70924]:   <serial>5ea1a02f-d619-4afe-95c7-71e97ad67d6a</serial>
Jul 29 15:25:38 user nova-compute[70924]: </disk>
Jul 29 15:25:38 user nova-compute[70924]:  {{(pid=70924) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 29 15:25:38 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:25:39 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-8c40aa5c-48da-4178-b2be-c8b9cb8d3333 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 15:25:39 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-8c40aa5c-48da-4178-b2be-c8b9cb8d3333 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 15:25:39 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-8c40aa5c-48da-4178-b2be-c8b9cb8d3333 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] No VIF found with MAC fa:16:3e:ba:bb:dc, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 15:25:39 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-8c40aa5c-48da-4178-b2be-c8b9cb8d3333 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lock "7e326df4-7ada-40c0-9a1b-36f7ed021e4f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.819s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:25:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:25:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:25:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70924) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 29 15:25:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70924) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 15:25:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70924) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 15:25:43 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:25:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:25:48 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:25:49 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:25:53 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:25:54 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:25:57 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-3417c054-7f16-49f6-b49d-5e710b16d0dc tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Acquiring lock "7e326df4-7ada-40c0-9a1b-36f7ed021e4f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:25:57 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-3417c054-7f16-49f6-b49d-5e710b16d0dc tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lock "7e326df4-7ada-40c0-9a1b-36f7ed021e4f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:25:57 user nova-compute[70924]: INFO nova.compute.manager [None req-3417c054-7f16-49f6-b49d-5e710b16d0dc tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Detaching volume 5ea1a02f-d619-4afe-95c7-71e97ad67d6a
Jul 29 15:25:57 user nova-compute[70924]: INFO nova.virt.block_device [None req-3417c054-7f16-49f6-b49d-5e710b16d0dc tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Attempting to driver detach volume 5ea1a02f-d619-4afe-95c7-71e97ad67d6a from mountpoint /dev/vdb
Jul 29 15:25:57 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-3417c054-7f16-49f6-b49d-5e710b16d0dc tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Attempting to detach device vdb from instance 7e326df4-7ada-40c0-9a1b-36f7ed021e4f from the persistent domain config. {{(pid=70924) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 29 15:25:57 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-3417c054-7f16-49f6-b49d-5e710b16d0dc tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 15:25:57 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 15:25:57 user nova-compute[70924]:   <source dev="/dev/sdb"/>
Jul 29 15:25:57 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 15:25:57 user nova-compute[70924]:   <serial>5ea1a02f-d619-4afe-95c7-71e97ad67d6a</serial>
Jul 29 15:25:57 user nova-compute[70924]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 15:25:57 user nova-compute[70924]: </disk>
Jul 29 15:25:57 user nova-compute[70924]:  {{(pid=70924) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 15:25:57 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-3417c054-7f16-49f6-b49d-5e710b16d0dc tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Successfully detached device vdb from instance 7e326df4-7ada-40c0-9a1b-36f7ed021e4f from the persistent domain config.
Jul 29 15:25:57 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-3417c054-7f16-49f6-b49d-5e710b16d0dc tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7e326df4-7ada-40c0-9a1b-36f7ed021e4f from the live domain config. {{(pid=70924) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 29 15:25:57 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-3417c054-7f16-49f6-b49d-5e710b16d0dc tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 15:25:57 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 15:25:57 user nova-compute[70924]:   <source dev="/dev/sdb"/>
Jul 29 15:25:57 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 15:25:57 user nova-compute[70924]:   <serial>5ea1a02f-d619-4afe-95c7-71e97ad67d6a</serial>
Jul 29 15:25:57 user nova-compute[70924]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 15:25:57 user nova-compute[70924]: </disk>
Jul 29 15:25:57 user nova-compute[70924]:  {{(pid=70924) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 15:25:57 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Received event <DeviceRemovedEvent: 1690644357.730691, 7e326df4-7ada-40c0-9a1b-36f7ed021e4f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70924) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 29 15:25:57 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-3417c054-7f16-49f6-b49d-5e710b16d0dc tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7e326df4-7ada-40c0-9a1b-36f7ed021e4f {{(pid=70924) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 29 15:25:57 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-3417c054-7f16-49f6-b49d-5e710b16d0dc tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Successfully detached device vdb from instance 7e326df4-7ada-40c0-9a1b-36f7ed021e4f from the live domain config.
Jul 29 15:25:57 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3417c054-7f16-49f6-b49d-5e710b16d0dc tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] calling os-brick to detach iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 15:25:57 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-3417c054-7f16-49f6-b49d-5e710b16d0dc tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, {'target_iqns': ['iqn.2010-10.org.openstack:5ea1a02f-d619-4afe-95c7-71e97ad67d6a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TgzuaAoM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 15:25:57 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-3417c054-7f16-49f6-b49d-5e710b16d0dc tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 15:25:57 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-3417c054-7f16-49f6-b49d-5e710b16d0dc tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 15:25:57 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-3417c054-7f16-49f6-b49d-5e710b16d0dc tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 15:25:57 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-3417c054-7f16-49f6-b49d-5e710b16d0dc tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ea1a02f-d619-4afe-95c7-71e97ad67d6a', 0)] {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 15:25:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:25:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:25:57 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee82f52-717d-49ba-b9de-825f82922001]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ea1a02f-d619-4afe-95c7-71e97ad67d6a\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:25:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:25:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:25:57 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e3647d-16a8-45fb-83ab-37a98156f3e9]: (4, ('tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ea1a02f-d619-4afe-95c7-71e97ad67d6a (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:25:57 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-3417c054-7f16-49f6-b49d-5e710b16d0dc tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ea1a02f-d619-4afe-95c7-71e97ad67d6a (non-flash)
Jul 29 15:25:57 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 15:25:57 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-3417c054-7f16-49f6-b49d-5e710b16d0dc tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsi session list stdout=tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ea1a02f-d619-4afe-95c7-71e97ad67d6a (non-flash)
Jul 29 15:25:57 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 15:25:57 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-3417c054-7f16-49f6-b49d-5e710b16d0dc tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feedc57e5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ea1a02f-d619-4afe-95c7-71e97ad67d6a'): ({'sdb'}, set())}) {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 15:25:57 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-3417c054-7f16-49f6-b49d-5e710b16d0dc tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Removing single pathed devices sdb {{(pid=70924) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 15:25:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:25:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:25:57 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[08afb7b5-f3d7-433c-bf8a-f2b16373bd8a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:25:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:25:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:25:57 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bdd41d3-6a27-489b-a270-61837d1409ee]: (4, ('ok\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:25:57 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-3417c054-7f16-49f6-b49d-5e710b16d0dc tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Flushing IO for device /dev/sdb {{(pid=70924) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 15:25:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:25:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:25:57 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[396320cf-6a84-41af-bd0c-8e017fd23f2a]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:25:57 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-3417c054-7f16-49f6-b49d-5e710b16d0dc tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70924) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 15:25:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:25:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:25:57 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79c26b7-02ed-4071-a3e5-ce1e0e628995]: (4, ('1', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:25:57 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-3417c054-7f16-49f6-b49d-5e710b16d0dc tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 15:25:57 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-3417c054-7f16-49f6-b49d-5e710b16d0dc tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] SCSI volumes sdb have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 15:25:57 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-3417c054-7f16-49f6-b49d-5e710b16d0dc tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ea1a02f-d619-4afe-95c7-71e97ad67d6a')] {{(pid=70924) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 15:25:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ea1a02f-d619-4afe-95c7-71e97ad67d6a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:25:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ea1a02f-d619-4afe-95c7-71e97ad67d6a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:25:57 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[4598ac3a-cf66-45eb-a919-b1c0457bae24]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:25:57 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-3417c054-7f16-49f6-b49d-5e710b16d0dc tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:25:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ea1a02f-d619-4afe-95c7-71e97ad67d6a -p 172.16.0.220:3260 --logout {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:25:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ea1a02f-d619-4afe-95c7-71e97ad67d6a -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:25:57 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[316bd7b8-85ae-43de-8f1a-26963884bae0]: (4, ('Logging out of session [sid: 66, target: iqn.2010-10.org.openstack:5ea1a02f-d619-4afe-95c7-71e97ad67d6a, portal: 172.16.0.220,3260]\nLogout of [sid: 66, target: iqn.2010-10.org.openstack:5ea1a02f-d619-4afe-95c7-71e97ad67d6a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:25:57 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-3417c054-7f16-49f6-b49d-5e710b16d0dc tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 66, target: iqn.2010-10.org.openstack:5ea1a02f-d619-4afe-95c7-71e97ad67d6a, portal: 172.16.0.220,3260]
Jul 29 15:25:57 user nova-compute[70924]: Logout of [sid: 66, target: iqn.2010-10.org.openstack:5ea1a02f-d619-4afe-95c7-71e97ad67d6a, portal: 172.16.0.220,3260] successful.
Jul 29 15:25:57 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:25:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ea1a02f-d619-4afe-95c7-71e97ad67d6a -p 172.16.0.220:3260 --op delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:25:57 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ea1a02f-d619-4afe-95c7-71e97ad67d6a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:25:57 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b9288e-2bbd-45e5-b100-9f8034d1d239]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:25:57 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-3417c054-7f16-49f6-b49d-5e710b16d0dc tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:25:57 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-3417c054-7f16-49f6-b49d-5e710b16d0dc tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.251s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 15:25:57 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-3417c054-7f16-49f6-b49d-5e710b16d0dc tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] <== disconnect_volume: return (252ms) None {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 15:25:57 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3417c054-7f16-49f6-b49d-5e710b16d0dc tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Disconnected iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 15:25:58 user nova-compute[70924]: DEBUG nova.objects.instance [None req-3417c054-7f16-49f6-b49d-5e710b16d0dc tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lazy-loading 'flavor' on Instance uuid 7e326df4-7ada-40c0-9a1b-36f7ed021e4f {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:25:58 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:25:58 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-3417c054-7f16-49f6-b49d-5e710b16d0dc tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lock "7e326df4-7ada-40c0-9a1b-36f7ed021e4f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.694s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:25:59 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:26:03 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:26:08 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:26:13 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:26:17 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:26:18 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:26:20 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:26:20 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:26:22 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:26:23 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:26:28 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:26:28 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:26:28 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:26:28 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:26:28 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Auditing locally available compute resources for user (node: user) {{(pid=70924) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 15:26:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e326df4-7ada-40c0-9a1b-36f7ed021e4f/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:26:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e326df4-7ada-40c0-9a1b-36f7ed021e4f/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:26:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e326df4-7ada-40c0-9a1b-36f7ed021e4f/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:26:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e326df4-7ada-40c0-9a1b-36f7ed021e4f/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:26:29 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:26:29 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:26:29 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:26:29 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Hypervisor/Node resource view: name=user free_ram=8822MB free_disk=25.212261199951172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70924) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 15:26:29 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:26:29 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:26:29 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 7e326df4-7ada-40c0-9a1b-36f7ed021e4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:26:29 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 15:26:29 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 15:26:29 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:26:29 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:26:29 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Compute_service record updated for user:user {{(pid=70924) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 15:26:29 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.173s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:26:31 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:26:31 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Starting heal instance info cache {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 15:26:31 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Rebuilding the list of instances to heal {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 29 15:26:31 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "refresh_cache-7e326df4-7ada-40c0-9a1b-36f7ed021e4f" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:26:31 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquired lock "refresh_cache-7e326df4-7ada-40c0-9a1b-36f7ed021e4f" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:26:31 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Forcefully refreshing network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 29 15:26:31 user nova-compute[70924]: DEBUG nova.objects.instance [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lazy-loading 'info_cache' on Instance uuid 7e326df4-7ada-40c0-9a1b-36f7ed021e4f {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:26:31 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Updating instance_info_cache with network_info: [{"id": "c66d9f39-371c-4a66-80d1-d97246e223ee", "address": "fa:16:3e:ba:bb:dc", "network": {"id": "03aa753f-617e-49dd-a516-0daa709c41a3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-295275043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12083dc5cce2499ba433abb39e4372cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66d9f39-37", "ovs_interfaceid": "c66d9f39-371c-4a66-80d1-d97246e223ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:26:31 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Releasing lock "refresh_cache-7e326df4-7ada-40c0-9a1b-36f7ed021e4f" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:26:31 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Updated the network info_cache for instance {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 29 15:26:31 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:26:32 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:26:32 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:26:32 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70924) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 15:26:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:26:39 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:26:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:26:49 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:26:51 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-b68e00e0-e2a3-4fdb-8e02-7759f8ee6cae tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Acquiring lock "7e326df4-7ada-40c0-9a1b-36f7ed021e4f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:26:51 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-b68e00e0-e2a3-4fdb-8e02-7759f8ee6cae tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lock "7e326df4-7ada-40c0-9a1b-36f7ed021e4f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:26:51 user nova-compute[70924]: DEBUG nova.objects.instance [None req-b68e00e0-e2a3-4fdb-8e02-7759f8ee6cae tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lazy-loading 'flavor' on Instance uuid 7e326df4-7ada-40c0-9a1b-36f7ed021e4f {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:26:51 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-b68e00e0-e2a3-4fdb-8e02-7759f8ee6cae tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lock "7e326df4-7ada-40c0-9a1b-36f7ed021e4f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.119s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:26:51 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-b68e00e0-e2a3-4fdb-8e02-7759f8ee6cae tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Acquiring lock "7e326df4-7ada-40c0-9a1b-36f7ed021e4f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:26:51 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-b68e00e0-e2a3-4fdb-8e02-7759f8ee6cae tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lock "7e326df4-7ada-40c0-9a1b-36f7ed021e4f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:26:51 user nova-compute[70924]: INFO nova.compute.manager [None req-b68e00e0-e2a3-4fdb-8e02-7759f8ee6cae tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Attaching volume bcb95d4c-f839-42c5-ad36-c85c18811bc7 to /dev/vdb
Jul 29 15:26:51 user nova-compute[70924]: DEBUG os_brick.utils [None req-b68e00e0-e2a3-4fdb-8e02-7759f8ee6cae tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 15:26:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:26:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:26:51 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c62538-9efe-4a7f-84be-dd55787decb0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f2127c4a30d9\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:26:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:26:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:26:51 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e558819-a4cc-4699-9b3a-0b66bb226bd8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:26:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:26:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:26:51 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de63c4c-46ea-47be-828e-42f4078fdca8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:26:51 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[3513d4a0-3885-443e-a345-ac4c99f8ceca]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:26:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-b68e00e0-e2a3-4fdb-8e02-7759f8ee6cae tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Running cmd (subprocess): nvme version {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:26:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-b68e00e0-e2a3-4fdb-8e02-7759f8ee6cae tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] 'nvme version' failed. Not Retrying. {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 15:26:51 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b68e00e0-e2a3-4fdb-8e02-7759f8ee6cae tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] nvme not present on system {{(pid=70924) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 15:26:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:26:51 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 15:26:51 user nova-compute[70924]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 15:26:51 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e435500a-6e19-4d41-9f4d-61200026c06a]: (4, '') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:26:51 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-b68e00e0-e2a3-4fdb-8e02-7759f8ee6cae tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70924) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 15:26:51 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-b68e00e0-e2a3-4fdb-8e02-7759f8ee6cae tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 15:26:51 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-b68e00e0-e2a3-4fdb-8e02-7759f8ee6cae tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] LIGHTOS: no hostnqn found. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 15:26:51 user nova-compute[70924]: DEBUG os_brick.utils [None req-b68e00e0-e2a3-4fdb-8e02-7759f8ee6cae tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f2127c4a30d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 15:26:51 user nova-compute[70924]: DEBUG nova.virt.block_device [None req-b68e00e0-e2a3-4fdb-8e02-7759f8ee6cae tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Updating existing volume attachment record: a6cc3b43-2366-4686-aa08-984461dff4da {{(pid=70924) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 15:26:54 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:26:54 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:26:58 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b68e00e0-e2a3-4fdb-8e02-7759f8ee6cae tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Calling os-brick to attach iSCSI Volume {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 15:26:58 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b68e00e0-e2a3-4fdb-8e02-7759f8ee6cae tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bcb95d4c-f839-42c5-ad36-c85c18811bc7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OKyMmQHu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 15:26:58 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-b68e00e0-e2a3-4fdb-8e02-7759f8ee6cae tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 15:26:58 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-b68e00e0-e2a3-4fdb-8e02-7759f8ee6cae tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 15:26:58 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-b68e00e0-e2a3-4fdb-8e02-7759f8ee6cae tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 15:26:58 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-b68e00e0-e2a3-4fdb-8e02-7759f8ee6cae tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 15:26:58 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-b68e00e0-e2a3-4fdb-8e02-7759f8ee6cae tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bcb95d4c-f839-42c5-ad36-c85c18811bc7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 15:26:58 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-b68e00e0-e2a3-4fdb-8e02-7759f8ee6cae tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bcb95d4c-f839-42c5-ad36-c85c18811bc7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 15:26:58 user nova-compute[70924]: INFO os_brick.initiator.connectors.iscsi [None req-b68e00e0-e2a3-4fdb-8e02-7759f8ee6cae tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 15:26:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcb95d4c-f839-42c5-ad36-c85c18811bc7 -p 172.16.0.220:3260 {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:26:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcb95d4c-f839-42c5-ad36-c85c18811bc7 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:26:58 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa39a38c-254d-44d4-b6eb-cf9bec0286bc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:26:58 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b68e00e0-e2a3-4fdb-8e02-7759f8ee6cae tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 15:26:58 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:26:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcb95d4c-f839-42c5-ad36-c85c18811bc7 -p 172.16.0.220:3260 --interface default --op new {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:26:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcb95d4c-f839-42c5-ad36-c85c18811bc7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:26:58 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e060dcf-c64c-491e-839e-7563b998fef2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bcb95d4c-f839-42c5-ad36-c85c18811bc7] added\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:26:58 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b68e00e0-e2a3-4fdb-8e02-7759f8ee6cae tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bcb95d4c-f839-42c5-ad36-c85c18811bc7] added
Jul 29 15:26:58 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:26:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcb95d4c-f839-42c5-ad36-c85c18811bc7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:26:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcb95d4c-f839-42c5-ad36-c85c18811bc7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:26:58 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[62feaf1d-3c48-497f-848e-bf244888372c]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:26:58 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b68e00e0-e2a3-4fdb-8e02-7759f8ee6cae tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:26:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcb95d4c-f839-42c5-ad36-c85c18811bc7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:26:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcb95d4c-f839-42c5-ad36-c85c18811bc7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:26:58 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1a030c-82f6-4747-958e-dbafa9ea0a60]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:26:58 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b68e00e0-e2a3-4fdb-8e02-7759f8ee6cae tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:26:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcb95d4c-f839-42c5-ad36-c85c18811bc7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OKyMmQHu {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:26:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcb95d4c-f839-42c5-ad36-c85c18811bc7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OKyMmQHu" returned: 0 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:26:58 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab02bb2c-ccd7-4d59-a53f-f7319e06547f]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:26:58 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b68e00e0-e2a3-4fdb-8e02-7759f8ee6cae tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OKyMmQHu'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:26:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcb95d4c-f839-42c5-ad36-c85c18811bc7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:26:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcb95d4c-f839-42c5-ad36-c85c18811bc7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:26:58 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9908ad-3bbf-4ec8-baed-ca47c27bcd7a]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:26:58 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b68e00e0-e2a3-4fdb-8e02-7759f8ee6cae tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:26:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:26:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:26:58 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[22de64f2-993f-48e6-a877-18ac427f336b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:26:58 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b68e00e0-e2a3-4fdb-8e02-7759f8ee6cae tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 29 15:26:58 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 15:26:58 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b68e00e0-e2a3-4fdb-8e02-7759f8ee6cae tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 29 15:26:58 user nova-compute[70924]:  {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 15:26:58 user nova-compute[70924]: WARNING os_brick.initiator.connectors.iscsi [None req-b68e00e0-e2a3-4fdb-8e02-7759f8ee6cae tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 29 15:26:58 user nova-compute[70924]: 
Jul 29 15:26:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcb95d4c-f839-42c5-ad36-c85c18811bc7 -p 172.16.0.220:3260 --login {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:26:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcb95d4c-f839-42c5-ad36-c85c18811bc7 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:26:58 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1c4b7d-51a1-416e-96f2-6696268f8df4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bcb95d4c-f839-42c5-ad36-c85c18811bc7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bcb95d4c-f839-42c5-ad36-c85c18811bc7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:26:58 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b68e00e0-e2a3-4fdb-8e02-7759f8ee6cae tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bcb95d4c-f839-42c5-ad36-c85c18811bc7, portal: 172.16.0.220,3260]
Jul 29 15:26:58 user nova-compute[70924]: Login to [iface: default, target: iqn.2010-10.org.openstack:bcb95d4c-f839-42c5-ad36-c85c18811bc7, portal: 172.16.0.220,3260] successful.
Jul 29 15:26:58 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:26:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcb95d4c-f839-42c5-ad36-c85c18811bc7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:26:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcb95d4c-f839-42c5-ad36-c85c18811bc7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:26:58 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b15aec-8fb5-46ab-8a76-c16206178c75]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:26:58 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b68e00e0-e2a3-4fdb-8e02-7759f8ee6cae tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:26:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:26:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:26:58 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[209ec013-0039-44ca-9469-b37ee9f27520]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcb95d4c-f839-42c5-ad36-c85c18811bc7 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:26:58 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b68e00e0-e2a3-4fdb-8e02-7759f8ee6cae tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcb95d4c-f839-42c5-ad36-c85c18811bc7 (non-flash)
Jul 29 15:26:58 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 15:26:58 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b68e00e0-e2a3-4fdb-8e02-7759f8ee6cae tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcb95d4c-f839-42c5-ad36-c85c18811bc7 (non-flash)
Jul 29 15:26:58 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 15:26:58 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-b68e00e0-e2a3-4fdb-8e02-7759f8ee6cae tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bcb95d4c-f839-42c5-ad36-c85c18811bc7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 15:26:58 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b68e00e0-e2a3-4fdb-8e02-7759f8ee6cae tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Connected to 172.16.0.220:3260 {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 15:26:58 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-b68e00e0-e2a3-4fdb-8e02-7759f8ee6cae tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=70924) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 15:26:58 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-b68e00e0-e2a3-4fdb-8e02-7759f8ee6cae tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70924) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 15:26:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:26:58 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:26:58 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5dc624-092f-4aae-b0ed-f79757bf1b94]: (4, ('- - 0', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:26:58 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-b68e00e0-e2a3-4fdb-8e02-7759f8ee6cae tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: None {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 15:26:59 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:26:59 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-b68e00e0-e2a3-4fdb-8e02-7759f8ee6cae tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 15:26:59 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b68e00e0-e2a3-4fdb-8e02-7759f8ee6cae tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OKyMmQHu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 15:26:59 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-b68e00e0-e2a3-4fdb-8e02-7759f8ee6cae tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 15:26:59 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-b68e00e0-e2a3-4fdb-8e02-7759f8ee6cae tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '23231656430663634', 'path': '/dev/sdb'} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 15:26:59 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b68e00e0-e2a3-4fdb-8e02-7759f8ee6cae tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231656430663634', 'path': '/dev/sdb'} {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 15:26:59 user nova-compute[70924]: DEBUG nova.objects.instance [None req-b68e00e0-e2a3-4fdb-8e02-7759f8ee6cae tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lazy-loading 'flavor' on Instance uuid 7e326df4-7ada-40c0-9a1b-36f7ed021e4f {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:26:59 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-b68e00e0-e2a3-4fdb-8e02-7759f8ee6cae tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] attach device xml: <disk type="block" device="disk">
Jul 29 15:26:59 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 15:26:59 user nova-compute[70924]:   <source dev="/dev/sdb"/>
Jul 29 15:26:59 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 15:26:59 user nova-compute[70924]:   <serial>bcb95d4c-f839-42c5-ad36-c85c18811bc7</serial>
Jul 29 15:26:59 user nova-compute[70924]: </disk>
Jul 29 15:26:59 user nova-compute[70924]:  {{(pid=70924) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 29 15:26:59 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-b68e00e0-e2a3-4fdb-8e02-7759f8ee6cae tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 15:26:59 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-b68e00e0-e2a3-4fdb-8e02-7759f8ee6cae tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 15:26:59 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-b68e00e0-e2a3-4fdb-8e02-7759f8ee6cae tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] No VIF found with MAC fa:16:3e:ba:bb:dc, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 15:27:00 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-b68e00e0-e2a3-4fdb-8e02-7759f8ee6cae tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lock "7e326df4-7ada-40c0-9a1b-36f7ed021e4f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.657s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:27:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1828ea18-2bd2-4f86-9f52-a02e82355a8d tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Acquiring lock "7e326df4-7ada-40c0-9a1b-36f7ed021e4f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:27:02 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1828ea18-2bd2-4f86-9f52-a02e82355a8d tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lock "7e326df4-7ada-40c0-9a1b-36f7ed021e4f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:27:02 user nova-compute[70924]: INFO nova.compute.manager [None req-1828ea18-2bd2-4f86-9f52-a02e82355a8d tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Detaching volume bcb95d4c-f839-42c5-ad36-c85c18811bc7
Jul 29 15:27:02 user nova-compute[70924]: INFO nova.virt.block_device [None req-1828ea18-2bd2-4f86-9f52-a02e82355a8d tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Attempting to driver detach volume bcb95d4c-f839-42c5-ad36-c85c18811bc7 from mountpoint /dev/vdb
Jul 29 15:27:02 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-1828ea18-2bd2-4f86-9f52-a02e82355a8d tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Attempting to detach device vdb from instance 7e326df4-7ada-40c0-9a1b-36f7ed021e4f from the persistent domain config. {{(pid=70924) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 29 15:27:02 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-1828ea18-2bd2-4f86-9f52-a02e82355a8d tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 15:27:02 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 15:27:02 user nova-compute[70924]:   <source dev="/dev/sdb"/>
Jul 29 15:27:02 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 15:27:02 user nova-compute[70924]:   <serial>bcb95d4c-f839-42c5-ad36-c85c18811bc7</serial>
Jul 29 15:27:02 user nova-compute[70924]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 15:27:02 user nova-compute[70924]: </disk>
Jul 29 15:27:02 user nova-compute[70924]:  {{(pid=70924) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 15:27:02 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-1828ea18-2bd2-4f86-9f52-a02e82355a8d tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Successfully detached device vdb from instance 7e326df4-7ada-40c0-9a1b-36f7ed021e4f from the persistent domain config.
Jul 29 15:27:02 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-1828ea18-2bd2-4f86-9f52-a02e82355a8d tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7e326df4-7ada-40c0-9a1b-36f7ed021e4f from the live domain config. {{(pid=70924) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 29 15:27:02 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-1828ea18-2bd2-4f86-9f52-a02e82355a8d tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 15:27:02 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 15:27:02 user nova-compute[70924]:   <source dev="/dev/sdb"/>
Jul 29 15:27:02 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 15:27:02 user nova-compute[70924]:   <serial>bcb95d4c-f839-42c5-ad36-c85c18811bc7</serial>
Jul 29 15:27:02 user nova-compute[70924]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 15:27:02 user nova-compute[70924]: </disk>
Jul 29 15:27:02 user nova-compute[70924]:  {{(pid=70924) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 15:27:03 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Received event <DeviceRemovedEvent: 1690644423.3130023, 7e326df4-7ada-40c0-9a1b-36f7ed021e4f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70924) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 29 15:27:03 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-1828ea18-2bd2-4f86-9f52-a02e82355a8d tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7e326df4-7ada-40c0-9a1b-36f7ed021e4f {{(pid=70924) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 29 15:27:03 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-1828ea18-2bd2-4f86-9f52-a02e82355a8d tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Successfully detached device vdb from instance 7e326df4-7ada-40c0-9a1b-36f7ed021e4f from the live domain config.
Jul 29 15:27:03 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1828ea18-2bd2-4f86-9f52-a02e82355a8d tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] calling os-brick to detach iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 15:27:03 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-1828ea18-2bd2-4f86-9f52-a02e82355a8d tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, {'target_iqns': ['iqn.2010-10.org.openstack:bcb95d4c-f839-42c5-ad36-c85c18811bc7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OKyMmQHu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 15:27:03 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-1828ea18-2bd2-4f86-9f52-a02e82355a8d tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 15:27:03 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-1828ea18-2bd2-4f86-9f52-a02e82355a8d tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 15:27:03 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-1828ea18-2bd2-4f86-9f52-a02e82355a8d tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 15:27:03 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-1828ea18-2bd2-4f86-9f52-a02e82355a8d tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bcb95d4c-f839-42c5-ad36-c85c18811bc7', 0)] {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 15:27:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:27:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:27:03 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9fd0168-cfa9-473e-af17-391207cd735d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bcb95d4c-f839-42c5-ad36-c85c18811bc7\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:27:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:27:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:27:03 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e517692-0a4b-4025-ada5-bd5d83929da8]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcb95d4c-f839-42c5-ad36-c85c18811bc7 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:27:03 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-1828ea18-2bd2-4f86-9f52-a02e82355a8d tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcb95d4c-f839-42c5-ad36-c85c18811bc7 (non-flash)
Jul 29 15:27:03 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 15:27:03 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-1828ea18-2bd2-4f86-9f52-a02e82355a8d tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcb95d4c-f839-42c5-ad36-c85c18811bc7 (non-flash)
Jul 29 15:27:03 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 15:27:03 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-1828ea18-2bd2-4f86-9f52-a02e82355a8d tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feecc394b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bcb95d4c-f839-42c5-ad36-c85c18811bc7'): ({'sdb'}, set())}) {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 15:27:03 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-1828ea18-2bd2-4f86-9f52-a02e82355a8d tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Removing single pathed devices sdb {{(pid=70924) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 15:27:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:27:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:27:03 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a7fba8-543e-4ab7-a900-1afa09d006f4]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:27:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:27:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:27:03 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70c32fb-9a7f-4d51-9150-c24630aa583d]: (4, ('ok\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:27:03 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-1828ea18-2bd2-4f86-9f52-a02e82355a8d tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Flushing IO for device /dev/sdb {{(pid=70924) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 15:27:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:27:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:27:03 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e773e120-d8e5-4916-8f72-5fc6474be23b]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:27:03 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-1828ea18-2bd2-4f86-9f52-a02e82355a8d tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70924) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 15:27:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:27:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:27:03 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0e1afc-8beb-4327-8adc-c126cd07ce40]: (4, ('1', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:27:03 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-1828ea18-2bd2-4f86-9f52-a02e82355a8d tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 15:27:03 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-1828ea18-2bd2-4f86-9f52-a02e82355a8d tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] SCSI volumes sdb have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 15:27:03 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-1828ea18-2bd2-4f86-9f52-a02e82355a8d tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bcb95d4c-f839-42c5-ad36-c85c18811bc7')] {{(pid=70924) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 15:27:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcb95d4c-f839-42c5-ad36-c85c18811bc7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:27:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcb95d4c-f839-42c5-ad36-c85c18811bc7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:27:03 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9588dc6-3a7e-4d2c-9d66-e715e3195378]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:27:03 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-1828ea18-2bd2-4f86-9f52-a02e82355a8d tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:27:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcb95d4c-f839-42c5-ad36-c85c18811bc7 -p 172.16.0.220:3260 --logout {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:27:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcb95d4c-f839-42c5-ad36-c85c18811bc7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:27:03 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba376ce-ce66-4d03-9ba6-d9037649ab08]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:bcb95d4c-f839-42c5-ad36-c85c18811bc7, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:bcb95d4c-f839-42c5-ad36-c85c18811bc7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:27:03 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-1828ea18-2bd2-4f86-9f52-a02e82355a8d tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:bcb95d4c-f839-42c5-ad36-c85c18811bc7, portal: 172.16.0.220,3260]
Jul 29 15:27:03 user nova-compute[70924]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:bcb95d4c-f839-42c5-ad36-c85c18811bc7, portal: 172.16.0.220,3260] successful.
Jul 29 15:27:03 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:27:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcb95d4c-f839-42c5-ad36-c85c18811bc7 -p 172.16.0.220:3260 --op delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:27:03 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcb95d4c-f839-42c5-ad36-c85c18811bc7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:27:03 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21fe3b1-a549-4973-a02d-ee9b6f4ffc2b]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:27:03 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-1828ea18-2bd2-4f86-9f52-a02e82355a8d tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:27:03 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-1828ea18-2bd2-4f86-9f52-a02e82355a8d tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.258s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 15:27:03 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-1828ea18-2bd2-4f86-9f52-a02e82355a8d tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] <== disconnect_volume: return (258ms) None {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 15:27:03 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1828ea18-2bd2-4f86-9f52-a02e82355a8d tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Disconnected iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 15:27:04 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:27:04 user nova-compute[70924]: DEBUG nova.objects.instance [None req-1828ea18-2bd2-4f86-9f52-a02e82355a8d tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lazy-loading 'flavor' on Instance uuid 7e326df4-7ada-40c0-9a1b-36f7ed021e4f {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:27:04 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-1828ea18-2bd2-4f86-9f52-a02e82355a8d tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lock "7e326df4-7ada-40c0-9a1b-36f7ed021e4f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.588s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:27:04 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:27:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:27:14 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:27:15 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:27:15 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Cleaning up deleted instances {{(pid=70924) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 29 15:27:15 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] There are 0 instances to clean {{(pid=70924) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 29 15:27:19 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:27:19 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:27:19 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70924) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 29 15:27:19 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70924) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 15:27:19 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70924) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 15:27:19 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:27:19 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:27:20 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:27:22 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:27:22 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:27:24 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:27:28 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:27:28 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:27:28 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:27:28 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:27:28 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Auditing locally available compute resources for user (node: user) {{(pid=70924) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 15:27:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e326df4-7ada-40c0-9a1b-36f7ed021e4f/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:27:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e326df4-7ada-40c0-9a1b-36f7ed021e4f/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:27:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e326df4-7ada-40c0-9a1b-36f7ed021e4f/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:27:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e326df4-7ada-40c0-9a1b-36f7ed021e4f/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:27:29 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:27:29 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:27:29 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Hypervisor/Node resource view: name=user free_ram=8795MB free_disk=25.211284637451172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70924) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 15:27:29 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:27:29 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:27:29 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:27:29 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 7e326df4-7ada-40c0-9a1b-36f7ed021e4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:27:29 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 15:27:29 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 15:27:29 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:27:29 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:27:29 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Compute_service record updated for user:user {{(pid=70924) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 15:27:29 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.159s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:27:29 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:27:31 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:27:31 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Starting heal instance info cache {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 15:27:31 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Rebuilding the list of instances to heal {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 29 15:27:31 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "refresh_cache-7e326df4-7ada-40c0-9a1b-36f7ed021e4f" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:27:31 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquired lock "refresh_cache-7e326df4-7ada-40c0-9a1b-36f7ed021e4f" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:27:31 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Forcefully refreshing network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 29 15:27:31 user nova-compute[70924]: DEBUG nova.objects.instance [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lazy-loading 'info_cache' on Instance uuid 7e326df4-7ada-40c0-9a1b-36f7ed021e4f {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:27:31 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Updating instance_info_cache with network_info: [{"id": "c66d9f39-371c-4a66-80d1-d97246e223ee", "address": "fa:16:3e:ba:bb:dc", "network": {"id": "03aa753f-617e-49dd-a516-0daa709c41a3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-295275043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12083dc5cce2499ba433abb39e4372cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66d9f39-37", "ovs_interfaceid": "c66d9f39-371c-4a66-80d1-d97246e223ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:27:31 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Releasing lock "refresh_cache-7e326df4-7ada-40c0-9a1b-36f7ed021e4f" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:27:31 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Updated the network info_cache for instance {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 29 15:27:31 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:27:32 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:27:32 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70924) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 15:27:33 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:27:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:27:34 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:27:39 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:27:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:27:49 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:27:49 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:27:49 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70924) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 29 15:27:49 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70924) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 15:27:49 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70924) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 15:27:49 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:27:54 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:27:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-6fab1e48-d732-4d12-9722-5eefa55e7552 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Acquiring lock "7e326df4-7ada-40c0-9a1b-36f7ed021e4f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:27:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-6fab1e48-d732-4d12-9722-5eefa55e7552 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lock "7e326df4-7ada-40c0-9a1b-36f7ed021e4f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:27:55 user nova-compute[70924]: DEBUG nova.objects.instance [None req-6fab1e48-d732-4d12-9722-5eefa55e7552 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lazy-loading 'flavor' on Instance uuid 7e326df4-7ada-40c0-9a1b-36f7ed021e4f {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:27:55 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-6fab1e48-d732-4d12-9722-5eefa55e7552 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lock "7e326df4-7ada-40c0-9a1b-36f7ed021e4f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.088s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:27:56 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-6fab1e48-d732-4d12-9722-5eefa55e7552 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Acquiring lock "7e326df4-7ada-40c0-9a1b-36f7ed021e4f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:27:56 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-6fab1e48-d732-4d12-9722-5eefa55e7552 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lock "7e326df4-7ada-40c0-9a1b-36f7ed021e4f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:27:56 user nova-compute[70924]: INFO nova.compute.manager [None req-6fab1e48-d732-4d12-9722-5eefa55e7552 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Attaching volume b492edeb-feba-49b2-8b67-fdcad4102074 to /dev/vdb
Jul 29 15:27:56 user nova-compute[70924]: DEBUG os_brick.utils [None req-6fab1e48-d732-4d12-9722-5eefa55e7552 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 15:27:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:27:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:27:56 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea560dd-a822-42f8-be01-367c2f279523]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f2127c4a30d9\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:27:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:27:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:27:56 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d43ff8-6d84-4c47-8085-d7380a074b25]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:27:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:27:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:27:56 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f6aebd-8310-472c-8854-93bd792a1d48]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:27:56 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[658bf5f6-13ba-4379-a70f-4ef9510b22cb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:27:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-6fab1e48-d732-4d12-9722-5eefa55e7552 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Running cmd (subprocess): nvme version {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:27:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-6fab1e48-d732-4d12-9722-5eefa55e7552 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] 'nvme version' failed. Not Retrying. {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 15:27:56 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6fab1e48-d732-4d12-9722-5eefa55e7552 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] nvme not present on system {{(pid=70924) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 15:27:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:27:56 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 15:27:56 user nova-compute[70924]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 15:27:56 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e2c463-80d0-4140-bdce-adbb79df40c8]: (4, '') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:27:56 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-6fab1e48-d732-4d12-9722-5eefa55e7552 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70924) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 15:27:56 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-6fab1e48-d732-4d12-9722-5eefa55e7552 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 15:27:56 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-6fab1e48-d732-4d12-9722-5eefa55e7552 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] LIGHTOS: no hostnqn found. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 15:27:56 user nova-compute[70924]: DEBUG os_brick.utils [None req-6fab1e48-d732-4d12-9722-5eefa55e7552 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f2127c4a30d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 15:27:56 user nova-compute[70924]: DEBUG nova.virt.block_device [None req-6fab1e48-d732-4d12-9722-5eefa55e7552 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Updating existing volume attachment record: 9b5089e1-2710-41be-86a3-394a88059ad3 {{(pid=70924) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 15:27:59 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:27:59 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:28:02 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:28:02 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Cleaning up deleted instances with incomplete migration  {{(pid=70924) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 29 15:28:04 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:28:07 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fab1e48-d732-4d12-9722-5eefa55e7552 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Calling os-brick to attach iSCSI Volume {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 15:28:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fab1e48-d732-4d12-9722-5eefa55e7552 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b492edeb-feba-49b2-8b67-fdcad4102074'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QTLgFpiB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 15:28:07 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-6fab1e48-d732-4d12-9722-5eefa55e7552 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 15:28:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-6fab1e48-d732-4d12-9722-5eefa55e7552 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 15:28:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-6fab1e48-d732-4d12-9722-5eefa55e7552 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 15:28:07 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-6fab1e48-d732-4d12-9722-5eefa55e7552 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 15:28:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-6fab1e48-d732-4d12-9722-5eefa55e7552 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b492edeb-feba-49b2-8b67-fdcad4102074" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 15:28:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-6fab1e48-d732-4d12-9722-5eefa55e7552 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b492edeb-feba-49b2-8b67-fdcad4102074" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 15:28:07 user nova-compute[70924]: INFO os_brick.initiator.connectors.iscsi [None req-6fab1e48-d732-4d12-9722-5eefa55e7552 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 15:28:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b492edeb-feba-49b2-8b67-fdcad4102074 -p 172.16.0.220:3260 {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:28:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b492edeb-feba-49b2-8b67-fdcad4102074 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:28:07 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[409184d9-65ab-45dd-b296-f7ee6c2bfa87]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:28:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fab1e48-d732-4d12-9722-5eefa55e7552 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 15:28:07 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:28:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b492edeb-feba-49b2-8b67-fdcad4102074 -p 172.16.0.220:3260 --interface default --op new {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:28:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b492edeb-feba-49b2-8b67-fdcad4102074 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:28:07 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f632d419-07df-4493-815f-628d82e39d9d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b492edeb-feba-49b2-8b67-fdcad4102074] added\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:28:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fab1e48-d732-4d12-9722-5eefa55e7552 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b492edeb-feba-49b2-8b67-fdcad4102074] added
Jul 29 15:28:07 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:28:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b492edeb-feba-49b2-8b67-fdcad4102074 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:28:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b492edeb-feba-49b2-8b67-fdcad4102074 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:28:07 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ff572e-3a04-4e0e-9664-48a9e92543d3]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:28:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fab1e48-d732-4d12-9722-5eefa55e7552 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:28:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b492edeb-feba-49b2-8b67-fdcad4102074 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:28:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b492edeb-feba-49b2-8b67-fdcad4102074 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:28:07 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[502208e1-6e1a-4293-88a6-44e7bb4a716a]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:28:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fab1e48-d732-4d12-9722-5eefa55e7552 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:28:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b492edeb-feba-49b2-8b67-fdcad4102074 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QTLgFpiB {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:28:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b492edeb-feba-49b2-8b67-fdcad4102074 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QTLgFpiB" returned: 0 in 0.025s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:28:07 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[98eccb2a-4907-470e-9f08-9653a2c20d62]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:28:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fab1e48-d732-4d12-9722-5eefa55e7552 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QTLgFpiB'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:28:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b492edeb-feba-49b2-8b67-fdcad4102074 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:28:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b492edeb-feba-49b2-8b67-fdcad4102074 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:28:07 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[719edd1f-ac98-49c9-84bf-4121ce4e35d7]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:28:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fab1e48-d732-4d12-9722-5eefa55e7552 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:28:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:28:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:28:07 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb75baf-c607-4061-9701-79eebf4f12d9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:28:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fab1e48-d732-4d12-9722-5eefa55e7552 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 29 15:28:07 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 15:28:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fab1e48-d732-4d12-9722-5eefa55e7552 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 29 15:28:07 user nova-compute[70924]:  {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 15:28:07 user nova-compute[70924]: WARNING os_brick.initiator.connectors.iscsi [None req-6fab1e48-d732-4d12-9722-5eefa55e7552 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 29 15:28:07 user nova-compute[70924]: 
Jul 29 15:28:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b492edeb-feba-49b2-8b67-fdcad4102074 -p 172.16.0.220:3260 --login {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:28:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b492edeb-feba-49b2-8b67-fdcad4102074 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:28:07 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf46d6f7-fa31-4e6e-8ca5-a92e8a04ddd7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b492edeb-feba-49b2-8b67-fdcad4102074, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b492edeb-feba-49b2-8b67-fdcad4102074, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:28:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fab1e48-d732-4d12-9722-5eefa55e7552 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b492edeb-feba-49b2-8b67-fdcad4102074, portal: 172.16.0.220,3260]
Jul 29 15:28:07 user nova-compute[70924]: Login to [iface: default, target: iqn.2010-10.org.openstack:b492edeb-feba-49b2-8b67-fdcad4102074, portal: 172.16.0.220,3260] successful.
Jul 29 15:28:07 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:28:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b492edeb-feba-49b2-8b67-fdcad4102074 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:28:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b492edeb-feba-49b2-8b67-fdcad4102074 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:28:07 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9ef2ae-32eb-49cb-8b5b-bb5e1c3f423c]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:28:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fab1e48-d732-4d12-9722-5eefa55e7552 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:28:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:28:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:28:07 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[603f1e5f-c118-45cd-9667-dc5654b5022c]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b492edeb-feba-49b2-8b67-fdcad4102074 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:28:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fab1e48-d732-4d12-9722-5eefa55e7552 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b492edeb-feba-49b2-8b67-fdcad4102074 (non-flash)
Jul 29 15:28:07 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 15:28:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fab1e48-d732-4d12-9722-5eefa55e7552 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b492edeb-feba-49b2-8b67-fdcad4102074 (non-flash)
Jul 29 15:28:07 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 15:28:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-6fab1e48-d732-4d12-9722-5eefa55e7552 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b492edeb-feba-49b2-8b67-fdcad4102074" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 15:28:07 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fab1e48-d732-4d12-9722-5eefa55e7552 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Connected to 172.16.0.220:3260 {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 15:28:07 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-6fab1e48-d732-4d12-9722-5eefa55e7552 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=70924) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 15:28:07 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-6fab1e48-d732-4d12-9722-5eefa55e7552 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70924) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 15:28:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:28:07 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:28:07 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[38bbc725-1d1e-4a7e-a176-3c58e664f48d]: (4, ('- - 0', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:28:07 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-6fab1e48-d732-4d12-9722-5eefa55e7552 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: None {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 15:28:08 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-6fab1e48-d732-4d12-9722-5eefa55e7552 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 15:28:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fab1e48-d732-4d12-9722-5eefa55e7552 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QTLgFpiB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 15:28:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-6fab1e48-d732-4d12-9722-5eefa55e7552 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 15:28:08 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fab1e48-d732-4d12-9722-5eefa55e7552 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '26433656539666336', 'path': '/dev/sdb'} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 15:28:08 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fab1e48-d732-4d12-9722-5eefa55e7552 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26433656539666336', 'path': '/dev/sdb'} {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 15:28:08 user nova-compute[70924]: DEBUG nova.objects.instance [None req-6fab1e48-d732-4d12-9722-5eefa55e7552 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lazy-loading 'flavor' on Instance uuid 7e326df4-7ada-40c0-9a1b-36f7ed021e4f {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:28:08 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-6fab1e48-d732-4d12-9722-5eefa55e7552 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] attach device xml: <disk type="block" device="disk">
Jul 29 15:28:08 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 15:28:08 user nova-compute[70924]:   <source dev="/dev/sdb"/>
Jul 29 15:28:08 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 15:28:08 user nova-compute[70924]:   <serial>b492edeb-feba-49b2-8b67-fdcad4102074</serial>
Jul 29 15:28:08 user nova-compute[70924]: </disk>
Jul 29 15:28:08 user nova-compute[70924]:  {{(pid=70924) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 29 15:28:09 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-6fab1e48-d732-4d12-9722-5eefa55e7552 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 15:28:09 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-6fab1e48-d732-4d12-9722-5eefa55e7552 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 15:28:09 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-6fab1e48-d732-4d12-9722-5eefa55e7552 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] No VIF found with MAC fa:16:3e:ba:bb:dc, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 15:28:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:28:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-6fab1e48-d732-4d12-9722-5eefa55e7552 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lock "7e326df4-7ada-40c0-9a1b-36f7ed021e4f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.272s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:28:09 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._sync_power_states {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:28:09 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Triggering sync for uuid 7e326df4-7ada-40c0-9a1b-36f7ed021e4f {{(pid=70924) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 29 15:28:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "7e326df4-7ada-40c0-9a1b-36f7ed021e4f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:28:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "7e326df4-7ada-40c0-9a1b-36f7ed021e4f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:28:09 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "7e326df4-7ada-40c0-9a1b-36f7ed021e4f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:28:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a6a0b69d-697e-4e72-819b-9e4af802e0cf tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Acquiring lock "7e326df4-7ada-40c0-9a1b-36f7ed021e4f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:28:11 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a6a0b69d-697e-4e72-819b-9e4af802e0cf tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lock "7e326df4-7ada-40c0-9a1b-36f7ed021e4f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:28:11 user nova-compute[70924]: INFO nova.compute.manager [None req-a6a0b69d-697e-4e72-819b-9e4af802e0cf tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Detaching volume b492edeb-feba-49b2-8b67-fdcad4102074
Jul 29 15:28:11 user nova-compute[70924]: INFO nova.virt.block_device [None req-a6a0b69d-697e-4e72-819b-9e4af802e0cf tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Attempting to driver detach volume b492edeb-feba-49b2-8b67-fdcad4102074 from mountpoint /dev/vdb
Jul 29 15:28:11 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-a6a0b69d-697e-4e72-819b-9e4af802e0cf tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Attempting to detach device vdb from instance 7e326df4-7ada-40c0-9a1b-36f7ed021e4f from the persistent domain config. {{(pid=70924) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 29 15:28:11 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-a6a0b69d-697e-4e72-819b-9e4af802e0cf tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 15:28:11 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 15:28:11 user nova-compute[70924]:   <source dev="/dev/sdb"/>
Jul 29 15:28:11 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 15:28:11 user nova-compute[70924]:   <serial>b492edeb-feba-49b2-8b67-fdcad4102074</serial>
Jul 29 15:28:11 user nova-compute[70924]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 15:28:11 user nova-compute[70924]: </disk>
Jul 29 15:28:11 user nova-compute[70924]:  {{(pid=70924) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 15:28:11 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-a6a0b69d-697e-4e72-819b-9e4af802e0cf tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Successfully detached device vdb from instance 7e326df4-7ada-40c0-9a1b-36f7ed021e4f from the persistent domain config.
Jul 29 15:28:11 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-a6a0b69d-697e-4e72-819b-9e4af802e0cf tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7e326df4-7ada-40c0-9a1b-36f7ed021e4f from the live domain config. {{(pid=70924) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 29 15:28:11 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-a6a0b69d-697e-4e72-819b-9e4af802e0cf tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 15:28:11 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 15:28:11 user nova-compute[70924]:   <source dev="/dev/sdb"/>
Jul 29 15:28:11 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 15:28:11 user nova-compute[70924]:   <serial>b492edeb-feba-49b2-8b67-fdcad4102074</serial>
Jul 29 15:28:11 user nova-compute[70924]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 15:28:11 user nova-compute[70924]: </disk>
Jul 29 15:28:11 user nova-compute[70924]:  {{(pid=70924) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 15:28:12 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Received event <DeviceRemovedEvent: 1690644492.1661775, 7e326df4-7ada-40c0-9a1b-36f7ed021e4f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70924) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 29 15:28:12 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-a6a0b69d-697e-4e72-819b-9e4af802e0cf tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7e326df4-7ada-40c0-9a1b-36f7ed021e4f {{(pid=70924) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 29 15:28:12 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-a6a0b69d-697e-4e72-819b-9e4af802e0cf tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Successfully detached device vdb from instance 7e326df4-7ada-40c0-9a1b-36f7ed021e4f from the live domain config.
Jul 29 15:28:12 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6a0b69d-697e-4e72-819b-9e4af802e0cf tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] calling os-brick to detach iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 15:28:12 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6a0b69d-697e-4e72-819b-9e4af802e0cf tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, {'target_iqns': ['iqn.2010-10.org.openstack:b492edeb-feba-49b2-8b67-fdcad4102074'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QTLgFpiB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 15:28:12 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-a6a0b69d-697e-4e72-819b-9e4af802e0cf tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 15:28:12 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-a6a0b69d-697e-4e72-819b-9e4af802e0cf tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 15:28:12 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-a6a0b69d-697e-4e72-819b-9e4af802e0cf tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 15:28:12 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6a0b69d-697e-4e72-819b-9e4af802e0cf tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b492edeb-feba-49b2-8b67-fdcad4102074', 0)] {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 15:28:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:28:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:28:12 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[022b4da2-caa2-4437-93af-d480fa9ea3e9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b492edeb-feba-49b2-8b67-fdcad4102074\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:28:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:28:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:28:12 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0be7b8-0729-4f8c-9b19-5ada4734fefb]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b492edeb-feba-49b2-8b67-fdcad4102074 (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:28:12 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6a0b69d-697e-4e72-819b-9e4af802e0cf tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b492edeb-feba-49b2-8b67-fdcad4102074 (non-flash)
Jul 29 15:28:12 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 15:28:12 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6a0b69d-697e-4e72-819b-9e4af802e0cf tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b492edeb-feba-49b2-8b67-fdcad4102074 (non-flash)
Jul 29 15:28:12 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 15:28:12 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6a0b69d-697e-4e72-819b-9e4af802e0cf tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feecc5eab00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b492edeb-feba-49b2-8b67-fdcad4102074'): ({'sdb'}, set())}) {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 15:28:12 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-a6a0b69d-697e-4e72-819b-9e4af802e0cf tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Removing single pathed devices sdb {{(pid=70924) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 15:28:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:28:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:28:12 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d60d2f-24de-46b5-8f81-f7e705467fe7]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:28:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:28:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:28:12 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[21547720-9795-452b-a6ac-11008453954f]: (4, ('ok\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:28:12 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-a6a0b69d-697e-4e72-819b-9e4af802e0cf tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Flushing IO for device /dev/sdb {{(pid=70924) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 15:28:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:28:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:28:12 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cfa9d03-b27c-4d41-ab16-48a60ea2ff20]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:28:12 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-a6a0b69d-697e-4e72-819b-9e4af802e0cf tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70924) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 15:28:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:28:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:28:12 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d8e3f0-cd86-4474-a411-be0d03225a37]: (4, ('1', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:28:12 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-a6a0b69d-697e-4e72-819b-9e4af802e0cf tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 15:28:12 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-a6a0b69d-697e-4e72-819b-9e4af802e0cf tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] SCSI volumes sdb have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 15:28:12 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6a0b69d-697e-4e72-819b-9e4af802e0cf tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b492edeb-feba-49b2-8b67-fdcad4102074')] {{(pid=70924) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 15:28:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b492edeb-feba-49b2-8b67-fdcad4102074 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:28:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b492edeb-feba-49b2-8b67-fdcad4102074 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:28:12 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[4475cae7-3eff-49de-ad67-9ad66e5c1282]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:28:12 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6a0b69d-697e-4e72-819b-9e4af802e0cf tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:28:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b492edeb-feba-49b2-8b67-fdcad4102074 -p 172.16.0.220:3260 --logout {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:28:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b492edeb-feba-49b2-8b67-fdcad4102074 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:28:12 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[59947aeb-0c22-4802-8d07-c96a2e1e1097]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:b492edeb-feba-49b2-8b67-fdcad4102074, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:b492edeb-feba-49b2-8b67-fdcad4102074, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:28:12 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6a0b69d-697e-4e72-819b-9e4af802e0cf tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:b492edeb-feba-49b2-8b67-fdcad4102074, portal: 172.16.0.220,3260]
Jul 29 15:28:12 user nova-compute[70924]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:b492edeb-feba-49b2-8b67-fdcad4102074, portal: 172.16.0.220,3260] successful.
Jul 29 15:28:12 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:28:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b492edeb-feba-49b2-8b67-fdcad4102074 -p 172.16.0.220:3260 --op delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:28:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b492edeb-feba-49b2-8b67-fdcad4102074 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:28:12 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d004c45-2252-4289-b25c-0241f1e71850]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:28:12 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6a0b69d-697e-4e72-819b-9e4af802e0cf tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:28:12 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-a6a0b69d-697e-4e72-819b-9e4af802e0cf tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.272s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 15:28:12 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6a0b69d-697e-4e72-819b-9e4af802e0cf tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] <== disconnect_volume: return (273ms) None {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 15:28:12 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6a0b69d-697e-4e72-819b-9e4af802e0cf tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Disconnected iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 15:28:13 user nova-compute[70924]: DEBUG nova.objects.instance [None req-a6a0b69d-697e-4e72-819b-9e4af802e0cf tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lazy-loading 'flavor' on Instance uuid 7e326df4-7ada-40c0-9a1b-36f7ed021e4f {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:28:13 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-a6a0b69d-697e-4e72-819b-9e4af802e0cf tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lock "7e326df4-7ada-40c0-9a1b-36f7ed021e4f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.633s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:28:14 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:28:14 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:28:19 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:28:19 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:28:20 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:28:23 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:28:24 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:28:24 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:28:28 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:28:28 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:28:28 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:28:28 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:28:28 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Auditing locally available compute resources for user (node: user) {{(pid=70924) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 15:28:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e326df4-7ada-40c0-9a1b-36f7ed021e4f/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:28:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e326df4-7ada-40c0-9a1b-36f7ed021e4f/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:28:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e326df4-7ada-40c0-9a1b-36f7ed021e4f/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:28:28 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e326df4-7ada-40c0-9a1b-36f7ed021e4f/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:28:29 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:28:29 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:28:29 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Hypervisor/Node resource view: name=user free_ram=8802MB free_disk=25.21025848388672GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70924) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 15:28:29 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:28:29 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:28:29 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:28:29 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 7e326df4-7ada-40c0-9a1b-36f7ed021e4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:28:29 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 15:28:29 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 15:28:29 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Refreshing inventories for resource provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 29 15:28:29 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Updating ProviderTree inventory for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 29 15:28:29 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Updating inventory in ProviderTree for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 29 15:28:29 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Refreshing aggregate associations for resource provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832, aggregates: None {{(pid=70924) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 29 15:28:29 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Refreshing trait associations for resource provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832, traits: COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=70924) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 29 15:28:29 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:28:29 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:28:29 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Compute_service record updated for user:user {{(pid=70924) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 15:28:29 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.513s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:28:33 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:28:33 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Starting heal instance info cache {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 15:28:33 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Rebuilding the list of instances to heal {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 29 15:28:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "refresh_cache-7e326df4-7ada-40c0-9a1b-36f7ed021e4f" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:28:33 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquired lock "refresh_cache-7e326df4-7ada-40c0-9a1b-36f7ed021e4f" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:28:33 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Forcefully refreshing network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 29 15:28:33 user nova-compute[70924]: DEBUG nova.objects.instance [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lazy-loading 'info_cache' on Instance uuid 7e326df4-7ada-40c0-9a1b-36f7ed021e4f {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:28:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:28:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:28:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70924) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 29 15:28:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70924) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 15:28:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70924) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 15:28:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:28:34 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Updating instance_info_cache with network_info: [{"id": "c66d9f39-371c-4a66-80d1-d97246e223ee", "address": "fa:16:3e:ba:bb:dc", "network": {"id": "03aa753f-617e-49dd-a516-0daa709c41a3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-295275043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12083dc5cce2499ba433abb39e4372cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66d9f39-37", "ovs_interfaceid": "c66d9f39-371c-4a66-80d1-d97246e223ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:28:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Releasing lock "refresh_cache-7e326df4-7ada-40c0-9a1b-36f7ed021e4f" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:28:34 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Updated the network info_cache for instance {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 29 15:28:34 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:28:34 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:28:34 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:28:34 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70924) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 15:28:39 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:28:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:28:49 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:28:54 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:28:59 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:29:04 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:29:04 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:29:04 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-8c369734-34f8-4e75-8ce6-5ce77a64c3a9 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Acquiring lock "7e326df4-7ada-40c0-9a1b-36f7ed021e4f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:29:04 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-8c369734-34f8-4e75-8ce6-5ce77a64c3a9 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lock "7e326df4-7ada-40c0-9a1b-36f7ed021e4f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:29:04 user nova-compute[70924]: DEBUG nova.objects.instance [None req-8c369734-34f8-4e75-8ce6-5ce77a64c3a9 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lazy-loading 'flavor' on Instance uuid 7e326df4-7ada-40c0-9a1b-36f7ed021e4f {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:29:04 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-8c369734-34f8-4e75-8ce6-5ce77a64c3a9 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lock "7e326df4-7ada-40c0-9a1b-36f7ed021e4f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:29:05 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-8c369734-34f8-4e75-8ce6-5ce77a64c3a9 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Acquiring lock "7e326df4-7ada-40c0-9a1b-36f7ed021e4f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:29:05 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-8c369734-34f8-4e75-8ce6-5ce77a64c3a9 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lock "7e326df4-7ada-40c0-9a1b-36f7ed021e4f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:29:05 user nova-compute[70924]: INFO nova.compute.manager [None req-8c369734-34f8-4e75-8ce6-5ce77a64c3a9 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Attaching volume d1314ecb-35b4-4aeb-ad6f-c57b04d0300a to /dev/vdb
Jul 29 15:29:05 user nova-compute[70924]: DEBUG os_brick.utils [None req-8c369734-34f8-4e75-8ce6-5ce77a64c3a9 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 15:29:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:29:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:29:05 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b062a32-b4a7-405e-b406-ddf0c98f019b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f2127c4a30d9\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:29:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:29:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:29:05 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9e854f-97d2-4610-9bc8-2d263527a6a2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:29:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:29:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:29:05 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b64b25-7053-46fa-b321-3ab326dc46eb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:29:05 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e2a56e-0d60-43dc-a900-12afd395eba1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:29:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-8c369734-34f8-4e75-8ce6-5ce77a64c3a9 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Running cmd (subprocess): nvme version {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:29:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-8c369734-34f8-4e75-8ce6-5ce77a64c3a9 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] 'nvme version' failed. Not Retrying. {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 15:29:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8c369734-34f8-4e75-8ce6-5ce77a64c3a9 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] nvme not present on system {{(pid=70924) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 15:29:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:29:05 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 15:29:05 user nova-compute[70924]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 15:29:05 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b731074-d3f7-4ca6-9290-406d81b6adbc]: (4, '') {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:29:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-8c369734-34f8-4e75-8ce6-5ce77a64c3a9 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70924) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 15:29:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-8c369734-34f8-4e75-8ce6-5ce77a64c3a9 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 15:29:05 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.lightos [None req-8c369734-34f8-4e75-8ce6-5ce77a64c3a9 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] LIGHTOS: no hostnqn found. {{(pid=70924) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 15:29:05 user nova-compute[70924]: DEBUG os_brick.utils [None req-8c369734-34f8-4e75-8ce6-5ce77a64c3a9 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f2127c4a30d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 15:29:05 user nova-compute[70924]: DEBUG nova.virt.block_device [None req-8c369734-34f8-4e75-8ce6-5ce77a64c3a9 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Updating existing volume attachment record: fdb86c11-c6c8-4d86-88e9-9a78c19cad53 {{(pid=70924) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 15:29:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:29:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:29:11 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c369734-34f8-4e75-8ce6-5ce77a64c3a9 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Calling os-brick to attach iSCSI Volume {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 15:29:11 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c369734-34f8-4e75-8ce6-5ce77a64c3a9 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d1314ecb-35b4-4aeb-ad6f-c57b04d0300a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WCDmNwiv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 15:29:11 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-8c369734-34f8-4e75-8ce6-5ce77a64c3a9 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 15:29:11 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-8c369734-34f8-4e75-8ce6-5ce77a64c3a9 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 15:29:12 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-8c369734-34f8-4e75-8ce6-5ce77a64c3a9 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 15:29:12 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-8c369734-34f8-4e75-8ce6-5ce77a64c3a9 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 15:29:12 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-8c369734-34f8-4e75-8ce6-5ce77a64c3a9 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1314ecb-35b4-4aeb-ad6f-c57b04d0300a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 15:29:12 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-8c369734-34f8-4e75-8ce6-5ce77a64c3a9 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1314ecb-35b4-4aeb-ad6f-c57b04d0300a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 15:29:12 user nova-compute[70924]: INFO os_brick.initiator.connectors.iscsi [None req-8c369734-34f8-4e75-8ce6-5ce77a64c3a9 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 15:29:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1314ecb-35b4-4aeb-ad6f-c57b04d0300a -p 172.16.0.220:3260 {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:29:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1314ecb-35b4-4aeb-ad6f-c57b04d0300a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:29:12 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd08e56-5ff5-4b12-b3bc-1eb90938dfd3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:29:12 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c369734-34f8-4e75-8ce6-5ce77a64c3a9 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 15:29:12 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:29:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1314ecb-35b4-4aeb-ad6f-c57b04d0300a -p 172.16.0.220:3260 --interface default --op new {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:29:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1314ecb-35b4-4aeb-ad6f-c57b04d0300a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:29:12 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f0db36-217a-44a5-9e8b-a6a5ad9dd664]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1314ecb-35b4-4aeb-ad6f-c57b04d0300a] added\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:29:12 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c369734-34f8-4e75-8ce6-5ce77a64c3a9 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1314ecb-35b4-4aeb-ad6f-c57b04d0300a] added
Jul 29 15:29:12 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:29:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1314ecb-35b4-4aeb-ad6f-c57b04d0300a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:29:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1314ecb-35b4-4aeb-ad6f-c57b04d0300a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:29:12 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce844ee-44ae-4d34-8d70-c8b0bd2733d3]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:29:12 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c369734-34f8-4e75-8ce6-5ce77a64c3a9 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:29:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1314ecb-35b4-4aeb-ad6f-c57b04d0300a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:29:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1314ecb-35b4-4aeb-ad6f-c57b04d0300a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:29:12 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ee51f4-5aa2-4766-bad9-069106508408]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:29:12 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c369734-34f8-4e75-8ce6-5ce77a64c3a9 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:29:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1314ecb-35b4-4aeb-ad6f-c57b04d0300a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WCDmNwiv {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:29:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1314ecb-35b4-4aeb-ad6f-c57b04d0300a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WCDmNwiv" returned: 0 in 0.023s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:29:12 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[619a3c23-fbc8-4d7a-ad27-6860a433934a]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:29:12 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c369734-34f8-4e75-8ce6-5ce77a64c3a9 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WCDmNwiv'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:29:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1314ecb-35b4-4aeb-ad6f-c57b04d0300a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:29:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1314ecb-35b4-4aeb-ad6f-c57b04d0300a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:29:12 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d02116e-9e3a-4c01-891d-2b45a9d5680d]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:29:12 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c369734-34f8-4e75-8ce6-5ce77a64c3a9 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:29:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:29:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:29:12 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8eb0fc6-4e02-4832-95f4-afe4398a13ab]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:29:12 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c369734-34f8-4e75-8ce6-5ce77a64c3a9 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 29 15:29:12 user nova-compute[70924]:  {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 15:29:12 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c369734-34f8-4e75-8ce6-5ce77a64c3a9 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 29 15:29:12 user nova-compute[70924]:  {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 15:29:12 user nova-compute[70924]: WARNING os_brick.initiator.connectors.iscsi [None req-8c369734-34f8-4e75-8ce6-5ce77a64c3a9 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 29 15:29:12 user nova-compute[70924]: 
Jul 29 15:29:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1314ecb-35b4-4aeb-ad6f-c57b04d0300a -p 172.16.0.220:3260 --login {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:29:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1314ecb-35b4-4aeb-ad6f-c57b04d0300a -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:29:12 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a57746-5f06-4d0b-b960-6c5314431ee1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1314ecb-35b4-4aeb-ad6f-c57b04d0300a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d1314ecb-35b4-4aeb-ad6f-c57b04d0300a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:29:12 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c369734-34f8-4e75-8ce6-5ce77a64c3a9 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1314ecb-35b4-4aeb-ad6f-c57b04d0300a, portal: 172.16.0.220,3260]
Jul 29 15:29:12 user nova-compute[70924]: Login to [iface: default, target: iqn.2010-10.org.openstack:d1314ecb-35b4-4aeb-ad6f-c57b04d0300a, portal: 172.16.0.220,3260] successful.
Jul 29 15:29:12 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:29:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1314ecb-35b4-4aeb-ad6f-c57b04d0300a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:29:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1314ecb-35b4-4aeb-ad6f-c57b04d0300a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:29:12 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed81042-6845-4c22-8449-925d0ba7b7b3]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:29:12 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c369734-34f8-4e75-8ce6-5ce77a64c3a9 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:29:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:29:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:29:12 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[3187b1bb-7894-468f-88c1-8378070cfe1f]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1314ecb-35b4-4aeb-ad6f-c57b04d0300a (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:29:12 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c369734-34f8-4e75-8ce6-5ce77a64c3a9 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1314ecb-35b4-4aeb-ad6f-c57b04d0300a (non-flash)
Jul 29 15:29:12 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 15:29:12 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c369734-34f8-4e75-8ce6-5ce77a64c3a9 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1314ecb-35b4-4aeb-ad6f-c57b04d0300a (non-flash)
Jul 29 15:29:12 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 15:29:12 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-8c369734-34f8-4e75-8ce6-5ce77a64c3a9 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1314ecb-35b4-4aeb-ad6f-c57b04d0300a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 15:29:12 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c369734-34f8-4e75-8ce6-5ce77a64c3a9 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Connected to 172.16.0.220:3260 {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 15:29:12 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-8c369734-34f8-4e75-8ce6-5ce77a64c3a9 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=70924) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 15:29:12 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-8c369734-34f8-4e75-8ce6-5ce77a64c3a9 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70924) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 15:29:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:29:12 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:29:12 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf5067b-8ae6-4722-881a-f7b74597393c]: (4, ('- - 0', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:29:12 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-8c369734-34f8-4e75-8ce6-5ce77a64c3a9 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70924) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 15:29:12 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c369734-34f8-4e75-8ce6-5ce77a64c3a9 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WCDmNwiv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=70924) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 15:29:13 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-8c369734-34f8-4e75-8ce6-5ce77a64c3a9 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 15:29:13 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c369734-34f8-4e75-8ce6-5ce77a64c3a9 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '23662353531616537', 'path': '/dev/sdb'} {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 15:29:13 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c369734-34f8-4e75-8ce6-5ce77a64c3a9 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662353531616537', 'path': '/dev/sdb'} {{(pid=70924) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 15:29:13 user nova-compute[70924]: DEBUG nova.objects.instance [None req-8c369734-34f8-4e75-8ce6-5ce77a64c3a9 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lazy-loading 'flavor' on Instance uuid 7e326df4-7ada-40c0-9a1b-36f7ed021e4f {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:29:13 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-8c369734-34f8-4e75-8ce6-5ce77a64c3a9 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] attach device xml: <disk type="block" device="disk">
Jul 29 15:29:13 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 15:29:13 user nova-compute[70924]:   <source dev="/dev/sdb"/>
Jul 29 15:29:13 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 15:29:13 user nova-compute[70924]:   <serial>d1314ecb-35b4-4aeb-ad6f-c57b04d0300a</serial>
Jul 29 15:29:13 user nova-compute[70924]: </disk>
Jul 29 15:29:13 user nova-compute[70924]:  {{(pid=70924) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 29 15:29:13 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-8c369734-34f8-4e75-8ce6-5ce77a64c3a9 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] No BDM found with device name vda, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 15:29:13 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-8c369734-34f8-4e75-8ce6-5ce77a64c3a9 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70924) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 15:29:13 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-8c369734-34f8-4e75-8ce6-5ce77a64c3a9 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] No VIF found with MAC fa:16:3e:ba:bb:dc, not building metadata {{(pid=70924) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 15:29:13 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-8c369734-34f8-4e75-8ce6-5ce77a64c3a9 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lock "7e326df4-7ada-40c0-9a1b-36f7ed021e4f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.871s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:29:14 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:29:14 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:29:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ecf561cd-149f-44cd-bc2f-6c0a0b1dcc23 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Acquiring lock "7e326df4-7ada-40c0-9a1b-36f7ed021e4f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:29:16 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ecf561cd-149f-44cd-bc2f-6c0a0b1dcc23 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lock "7e326df4-7ada-40c0-9a1b-36f7ed021e4f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:29:16 user nova-compute[70924]: INFO nova.compute.manager [None req-ecf561cd-149f-44cd-bc2f-6c0a0b1dcc23 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Detaching volume d1314ecb-35b4-4aeb-ad6f-c57b04d0300a
Jul 29 15:29:16 user nova-compute[70924]: INFO nova.virt.block_device [None req-ecf561cd-149f-44cd-bc2f-6c0a0b1dcc23 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Attempting to driver detach volume d1314ecb-35b4-4aeb-ad6f-c57b04d0300a from mountpoint /dev/vdb
Jul 29 15:29:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-ecf561cd-149f-44cd-bc2f-6c0a0b1dcc23 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Attempting to detach device vdb from instance 7e326df4-7ada-40c0-9a1b-36f7ed021e4f from the persistent domain config. {{(pid=70924) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 29 15:29:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-ecf561cd-149f-44cd-bc2f-6c0a0b1dcc23 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 15:29:16 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 15:29:16 user nova-compute[70924]:   <source dev="/dev/sdb"/>
Jul 29 15:29:16 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 15:29:16 user nova-compute[70924]:   <serial>d1314ecb-35b4-4aeb-ad6f-c57b04d0300a</serial>
Jul 29 15:29:16 user nova-compute[70924]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 15:29:16 user nova-compute[70924]: </disk>
Jul 29 15:29:16 user nova-compute[70924]:  {{(pid=70924) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 15:29:16 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-ecf561cd-149f-44cd-bc2f-6c0a0b1dcc23 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Successfully detached device vdb from instance 7e326df4-7ada-40c0-9a1b-36f7ed021e4f from the persistent domain config.
Jul 29 15:29:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-ecf561cd-149f-44cd-bc2f-6c0a0b1dcc23 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7e326df4-7ada-40c0-9a1b-36f7ed021e4f from the live domain config. {{(pid=70924) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 29 15:29:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.guest [None req-ecf561cd-149f-44cd-bc2f-6c0a0b1dcc23 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 15:29:16 user nova-compute[70924]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 15:29:16 user nova-compute[70924]:   <source dev="/dev/sdb"/>
Jul 29 15:29:16 user nova-compute[70924]:   <target dev="vdb" bus="virtio"/>
Jul 29 15:29:16 user nova-compute[70924]:   <serial>d1314ecb-35b4-4aeb-ad6f-c57b04d0300a</serial>
Jul 29 15:29:16 user nova-compute[70924]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 15:29:16 user nova-compute[70924]: </disk>
Jul 29 15:29:16 user nova-compute[70924]:  {{(pid=70924) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 15:29:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-d174aeb7-16db-471a-b987-6e2233ea7a67 None None] Received event <DeviceRemovedEvent: 1690644556.6958306, 7e326df4-7ada-40c0-9a1b-36f7ed021e4f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70924) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 29 15:29:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.driver [None req-ecf561cd-149f-44cd-bc2f-6c0a0b1dcc23 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7e326df4-7ada-40c0-9a1b-36f7ed021e4f {{(pid=70924) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 29 15:29:16 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-ecf561cd-149f-44cd-bc2f-6c0a0b1dcc23 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Successfully detached device vdb from instance 7e326df4-7ada-40c0-9a1b-36f7ed021e4f from the live domain config.
Jul 29 15:29:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecf561cd-149f-44cd-bc2f-6c0a0b1dcc23 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] calling os-brick to detach iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 15:29:16 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf561cd-149f-44cd-bc2f-6c0a0b1dcc23 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7feee40b3e80>, {'target_iqns': ['iqn.2010-10.org.openstack:d1314ecb-35b4-4aeb-ad6f-c57b04d0300a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WCDmNwiv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 15:29:16 user nova-compute[70924]: WARNING os_brick.initiator.connectors.base [None req-ecf561cd-149f-44cd-bc2f-6c0a0b1dcc23 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 15:29:16 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-ecf561cd-149f-44cd-bc2f-6c0a0b1dcc23 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 15:29:16 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-ecf561cd-149f-44cd-bc2f-6c0a0b1dcc23 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 15:29:16 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf561cd-149f-44cd-bc2f-6c0a0b1dcc23 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1314ecb-35b4-4aeb-ad6f-c57b04d0300a', 0)] {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 15:29:16 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:29:16 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:29:16 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0aff059-7283-4d53-bc7f-49e2d753b108]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1314ecb-35b4-4aeb-ad6f-c57b04d0300a\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:29:16 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:29:16 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:29:16 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[75bf7d45-af18-4aca-9548-5372f8f0d33d]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1314ecb-35b4-4aeb-ad6f-c57b04d0300a (non-flash)\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:29:16 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf561cd-149f-44cd-bc2f-6c0a0b1dcc23 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1314ecb-35b4-4aeb-ad6f-c57b04d0300a (non-flash)
Jul 29 15:29:16 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 15:29:16 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf561cd-149f-44cd-bc2f-6c0a0b1dcc23 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1314ecb-35b4-4aeb-ad6f-c57b04d0300a (non-flash)
Jul 29 15:29:16 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 15:29:16 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf561cd-149f-44cd-bc2f-6c0a0b1dcc23 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feee41c7760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1314ecb-35b4-4aeb-ad6f-c57b04d0300a'): ({'sdb'}, set())}) {{(pid=70924) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 15:29:16 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-ecf561cd-149f-44cd-bc2f-6c0a0b1dcc23 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Removing single pathed devices sdb {{(pid=70924) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 15:29:16 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:29:16 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:29:16 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c4c882c-5a49-4572-a4f7-c3aaddca3d52]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:29:16 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:29:16 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:29:16 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ba1da0-5b73-4a27-ae32-de620dbb7c57]: (4, ('ok\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:29:16 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-ecf561cd-149f-44cd-bc2f-6c0a0b1dcc23 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Flushing IO for device /dev/sdb {{(pid=70924) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 15:29:16 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:29:16 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:29:16 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[51bbe0a2-9fff-40ee-ab9f-547863b624f1]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:29:16 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-ecf561cd-149f-44cd-bc2f-6c0a0b1dcc23 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70924) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 15:29:16 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:29:16 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:29:16 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fcea4c6-fc0d-4d7f-b6da-5411bb717a9c]: (4, ('1', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:29:16 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-ecf561cd-149f-44cd-bc2f-6c0a0b1dcc23 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 15:29:16 user nova-compute[70924]: DEBUG os_brick.initiator.linuxscsi [None req-ecf561cd-149f-44cd-bc2f-6c0a0b1dcc23 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] SCSI volumes sdb have been removed. {{(pid=70924) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 15:29:16 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf561cd-149f-44cd-bc2f-6c0a0b1dcc23 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1314ecb-35b4-4aeb-ad6f-c57b04d0300a')] {{(pid=70924) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 15:29:16 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1314ecb-35b4-4aeb-ad6f-c57b04d0300a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:29:16 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1314ecb-35b4-4aeb-ad6f-c57b04d0300a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:29:16 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9285205d-13ca-49b1-b62c-935bc4bc6770]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:29:16 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf561cd-149f-44cd-bc2f-6c0a0b1dcc23 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:29:16 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1314ecb-35b4-4aeb-ad6f-c57b04d0300a -p 172.16.0.220:3260 --logout {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:29:16 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1314ecb-35b4-4aeb-ad6f-c57b04d0300a -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:29:16 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f52452-f944-4b79-8680-0fa708d5566e]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:d1314ecb-35b4-4aeb-ad6f-c57b04d0300a, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:d1314ecb-35b4-4aeb-ad6f-c57b04d0300a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:29:16 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf561cd-149f-44cd-bc2f-6c0a0b1dcc23 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:d1314ecb-35b4-4aeb-ad6f-c57b04d0300a, portal: 172.16.0.220,3260]
Jul 29 15:29:16 user nova-compute[70924]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:d1314ecb-35b4-4aeb-ad6f-c57b04d0300a, portal: 172.16.0.220,3260] successful.
Jul 29 15:29:16 user nova-compute[70924]:  stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:29:16 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1314ecb-35b4-4aeb-ad6f-c57b04d0300a -p 172.16.0.220:3260 --op delete {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:29:16 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1314ecb-35b4-4aeb-ad6f-c57b04d0300a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=81998) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:29:16 user nova-compute[70924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c899b45-8cf5-4125-80d1-2e7608d84916]: (4, ('', '')) {{(pid=81998) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 15:29:16 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf561cd-149f-44cd-bc2f-6c0a0b1dcc23 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70924) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 15:29:16 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.base [None req-ecf561cd-149f-44cd-bc2f-6c0a0b1dcc23 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.253s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 15:29:16 user nova-compute[70924]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf561cd-149f-44cd-bc2f-6c0a0b1dcc23 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] <== disconnect_volume: return (254ms) None {{(pid=70924) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 15:29:16 user nova-compute[70924]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecf561cd-149f-44cd-bc2f-6c0a0b1dcc23 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Disconnected iSCSI Volume {{(pid=70924) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 15:29:17 user nova-compute[70924]: DEBUG nova.objects.instance [None req-ecf561cd-149f-44cd-bc2f-6c0a0b1dcc23 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lazy-loading 'flavor' on Instance uuid 7e326df4-7ada-40c0-9a1b-36f7ed021e4f {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:29:17 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-ecf561cd-149f-44cd-bc2f-6c0a0b1dcc23 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lock "7e326df4-7ada-40c0-9a1b-36f7ed021e4f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.571s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:29:19 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:29:19 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:29:21 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:29:22 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:29:24 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:29:24 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:29:25 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:29:29 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:29:29 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:29:29 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70924) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 29 15:29:29 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70924) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 15:29:29 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70924) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 15:29:29 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:29:30 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:29:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:29:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:29:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:29:30 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Auditing locally available compute resources for user (node: user) {{(pid=70924) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 15:29:30 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e326df4-7ada-40c0-9a1b-36f7ed021e4f/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:29:30 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e326df4-7ada-40c0-9a1b-36f7ed021e4f/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:29:30 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e326df4-7ada-40c0-9a1b-36f7ed021e4f/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:29:30 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e326df4-7ada-40c0-9a1b-36f7ed021e4f/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:29:31 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:29:31 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:29:31 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Hypervisor/Node resource view: name=user free_ram=8787MB free_disk=25.209213256835938GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70924) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 15:29:31 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:29:31 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:29:31 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 7e326df4-7ada-40c0-9a1b-36f7ed021e4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:29:31 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 15:29:31 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 15:29:31 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:29:31 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:29:31 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Compute_service record updated for user:user {{(pid=70924) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 15:29:31 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.295s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:29:33 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:29:33 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:29:33 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70924) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 15:29:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:29:34 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:29:34 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Starting heal instance info cache {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 15:29:34 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Rebuilding the list of instances to heal {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 29 15:29:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "refresh_cache-7e326df4-7ada-40c0-9a1b-36f7ed021e4f" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:29:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquired lock "refresh_cache-7e326df4-7ada-40c0-9a1b-36f7ed021e4f" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:29:34 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Forcefully refreshing network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 29 15:29:34 user nova-compute[70924]: DEBUG nova.objects.instance [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lazy-loading 'info_cache' on Instance uuid 7e326df4-7ada-40c0-9a1b-36f7ed021e4f {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:29:34 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Updating instance_info_cache with network_info: [{"id": "c66d9f39-371c-4a66-80d1-d97246e223ee", "address": "fa:16:3e:ba:bb:dc", "network": {"id": "03aa753f-617e-49dd-a516-0daa709c41a3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-295275043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12083dc5cce2499ba433abb39e4372cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66d9f39-37", "ovs_interfaceid": "c66d9f39-371c-4a66-80d1-d97246e223ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:29:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Releasing lock "refresh_cache-7e326df4-7ada-40c0-9a1b-36f7ed021e4f" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:29:35 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Updated the network info_cache for instance {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 29 15:29:36 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:29:36 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:29:39 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:29:39 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:29:39 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70924) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 29 15:29:39 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70924) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 15:29:39 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70924) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 15:29:39 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:29:44 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:29:49 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:29:54 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:29:59 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:30:04 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:30:09 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:30:14 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:30:19 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:30:19 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:30:19 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70924) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 29 15:30:19 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70924) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 15:30:19 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70924) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 15:30:19 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:30:20 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:30:22 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:30:24 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:30:26 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:30:26 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:30:29 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:30:30 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:30:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:30:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:30:30 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:30:30 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Auditing locally available compute resources for user (node: user) {{(pid=70924) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 15:30:30 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e326df4-7ada-40c0-9a1b-36f7ed021e4f/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:30:30 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e326df4-7ada-40c0-9a1b-36f7ed021e4f/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:30:30 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e326df4-7ada-40c0-9a1b-36f7ed021e4f/disk --force-share --output=json {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 15:30:30 user nova-compute[70924]: DEBUG oslo_concurrency.processutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e326df4-7ada-40c0-9a1b-36f7ed021e4f/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70924) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 15:30:31 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:30:31 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:30:31 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Hypervisor/Node resource view: name=user free_ram=8789MB free_disk=25.208332061767578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70924) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 15:30:31 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:30:31 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:30:31 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Instance 7e326df4-7ada-40c0-9a1b-36f7ed021e4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70924) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 15:30:31 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 15:30:31 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 15:30:31 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:30:31 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:30:31 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Compute_service record updated for user:user {{(pid=70924) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 15:30:31 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.159s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:30:34 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:30:34 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:30:34 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:30:34 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Starting heal instance info cache {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 15:30:34 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Rebuilding the list of instances to heal {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 29 15:30:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "refresh_cache-7e326df4-7ada-40c0-9a1b-36f7ed021e4f" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 15:30:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquired lock "refresh_cache-7e326df4-7ada-40c0-9a1b-36f7ed021e4f" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 15:30:34 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Forcefully refreshing network info cache for instance {{(pid=70924) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 29 15:30:34 user nova-compute[70924]: DEBUG nova.objects.instance [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lazy-loading 'info_cache' on Instance uuid 7e326df4-7ada-40c0-9a1b-36f7ed021e4f {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:30:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2b2b48b7-4160-4bda-80dc-093e34bad339 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Acquiring lock "7e326df4-7ada-40c0-9a1b-36f7ed021e4f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:30:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2b2b48b7-4160-4bda-80dc-093e34bad339 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lock "7e326df4-7ada-40c0-9a1b-36f7ed021e4f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.004s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:30:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2b2b48b7-4160-4bda-80dc-093e34bad339 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Acquiring lock "7e326df4-7ada-40c0-9a1b-36f7ed021e4f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:30:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2b2b48b7-4160-4bda-80dc-093e34bad339 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lock "7e326df4-7ada-40c0-9a1b-36f7ed021e4f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:30:34 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2b2b48b7-4160-4bda-80dc-093e34bad339 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lock "7e326df4-7ada-40c0-9a1b-36f7ed021e4f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:30:34 user nova-compute[70924]: INFO nova.compute.manager [None req-2b2b48b7-4160-4bda-80dc-093e34bad339 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Terminating instance
Jul 29 15:30:34 user nova-compute[70924]: DEBUG nova.compute.manager [None req-2b2b48b7-4160-4bda-80dc-093e34bad339 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Start destroying the instance on the hypervisor. {{(pid=70924) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 15:30:35 user nova-compute[70924]: DEBUG nova.network.neutron [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Updating instance_info_cache with network_info: [{"id": "c66d9f39-371c-4a66-80d1-d97246e223ee", "address": "fa:16:3e:ba:bb:dc", "network": {"id": "03aa753f-617e-49dd-a516-0daa709c41a3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-295275043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12083dc5cce2499ba433abb39e4372cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66d9f39-37", "ovs_interfaceid": "c66d9f39-371c-4a66-80d1-d97246e223ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:30:35 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:30:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Releasing lock "refresh_cache-7e326df4-7ada-40c0-9a1b-36f7ed021e4f" {{(pid=70924) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 15:30:35 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Updated the network info_cache for instance {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 29 15:30:35 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:30:35 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70924) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 15:30:35 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:30:35 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:30:35 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:30:35 user nova-compute[70924]: DEBUG nova.compute.manager [req-b441ee85-ef3b-4c0d-a0c6-14c2151aedd1 req-32948c5b-e6a1-4898-9d4b-b72d5706fc24 service nova] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Received event network-vif-unplugged-c66d9f39-371c-4a66-80d1-d97246e223ee {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:30:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b441ee85-ef3b-4c0d-a0c6-14c2151aedd1 req-32948c5b-e6a1-4898-9d4b-b72d5706fc24 service nova] Acquiring lock "7e326df4-7ada-40c0-9a1b-36f7ed021e4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:30:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b441ee85-ef3b-4c0d-a0c6-14c2151aedd1 req-32948c5b-e6a1-4898-9d4b-b72d5706fc24 service nova] Lock "7e326df4-7ada-40c0-9a1b-36f7ed021e4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:30:35 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-b441ee85-ef3b-4c0d-a0c6-14c2151aedd1 req-32948c5b-e6a1-4898-9d4b-b72d5706fc24 service nova] Lock "7e326df4-7ada-40c0-9a1b-36f7ed021e4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:30:35 user nova-compute[70924]: DEBUG nova.compute.manager [req-b441ee85-ef3b-4c0d-a0c6-14c2151aedd1 req-32948c5b-e6a1-4898-9d4b-b72d5706fc24 service nova] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] No waiting events found dispatching network-vif-unplugged-c66d9f39-371c-4a66-80d1-d97246e223ee {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:30:35 user nova-compute[70924]: DEBUG nova.compute.manager [req-b441ee85-ef3b-4c0d-a0c6-14c2151aedd1 req-32948c5b-e6a1-4898-9d4b-b72d5706fc24 service nova] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Received event network-vif-unplugged-c66d9f39-371c-4a66-80d1-d97246e223ee for instance with task_state deleting. {{(pid=70924) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 15:30:35 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:30:35 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:30:35 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:30:35 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:30:35 user nova-compute[70924]: INFO nova.virt.libvirt.driver [-] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Instance destroyed successfully.
Jul 29 15:30:35 user nova-compute[70924]: DEBUG nova.objects.instance [None req-2b2b48b7-4160-4bda-80dc-093e34bad339 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lazy-loading 'resources' on Instance uuid 7e326df4-7ada-40c0-9a1b-36f7ed021e4f {{(pid=70924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 15:30:35 user nova-compute[70924]: DEBUG nova.virt.libvirt.vif [None req-2b2b48b7-4160-4bda-80dc-093e34bad339 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T15:23:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-768596180',display_name='tempest-SnapshotDataIntegrityTests-server-768596180',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-768596180',id=52,image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMBW/D1TywWI3V4hgD9tRCrM4JOmUL0LIiYwIIlXEvGL9jslionyS74c+lv2/7VckACRTqeDcZTKykQScisoEYi6TOLSVkKWws046Ngk572/G8KgJvNi7IpcYKuYcjUkRA==',key_name='tempest-keypair-1101403743',keypairs=<?>,launch_index=0,launched_at=2023-07-29T15:23:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='12083dc5cce2499ba433abb39e4372cf',ramdisk_id='',reservation_id='r-owrwxshr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3aba2e73-6832-404b-8bd0-d0503ce82b8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1888206088',owner_user_name='tempest-SnapshotDataIntegrityTests-1888206088-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T15:23:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1d3ace4aae2946dd9b2fe01faf1dd5ff',uuid=7e326df4-7ada-40c0-9a1b-36f7ed021e4f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c66d9f39-371c-4a66-80d1-d97246e223ee", "address": "fa:16:3e:ba:bb:dc", "network": {"id": "03aa753f-617e-49dd-a516-0daa709c41a3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-295275043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12083dc5cce2499ba433abb39e4372cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66d9f39-37", "ovs_interfaceid": "c66d9f39-371c-4a66-80d1-d97246e223ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 15:30:35 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-2b2b48b7-4160-4bda-80dc-093e34bad339 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Converting VIF {"id": "c66d9f39-371c-4a66-80d1-d97246e223ee", "address": "fa:16:3e:ba:bb:dc", "network": {"id": "03aa753f-617e-49dd-a516-0daa709c41a3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-295275043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12083dc5cce2499ba433abb39e4372cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66d9f39-37", "ovs_interfaceid": "c66d9f39-371c-4a66-80d1-d97246e223ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 15:30:35 user nova-compute[70924]: DEBUG nova.network.os_vif_util [None req-2b2b48b7-4160-4bda-80dc-093e34bad339 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ba:bb:dc,bridge_name='br-int',has_traffic_filtering=True,id=c66d9f39-371c-4a66-80d1-d97246e223ee,network=Network(03aa753f-617e-49dd-a516-0daa709c41a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66d9f39-37') {{(pid=70924) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 15:30:35 user nova-compute[70924]: DEBUG os_vif [None req-2b2b48b7-4160-4bda-80dc-093e34bad339 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:bb:dc,bridge_name='br-int',has_traffic_filtering=True,id=c66d9f39-371c-4a66-80d1-d97246e223ee,network=Network(03aa753f-617e-49dd-a516-0daa709c41a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66d9f39-37') {{(pid=70924) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 15:30:35 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:30:35 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc66d9f39-37, bridge=br-int, if_exists=True) {{(pid=70924) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 15:30:35 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:30:35 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:30:35 user nova-compute[70924]: INFO os_vif [None req-2b2b48b7-4160-4bda-80dc-093e34bad339 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:bb:dc,bridge_name='br-int',has_traffic_filtering=True,id=c66d9f39-371c-4a66-80d1-d97246e223ee,network=Network(03aa753f-617e-49dd-a516-0daa709c41a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66d9f39-37')
Jul 29 15:30:35 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-2b2b48b7-4160-4bda-80dc-093e34bad339 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Deleting instance files /opt/stack/data/nova/instances/7e326df4-7ada-40c0-9a1b-36f7ed021e4f_del
Jul 29 15:30:35 user nova-compute[70924]: INFO nova.virt.libvirt.driver [None req-2b2b48b7-4160-4bda-80dc-093e34bad339 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Deletion of /opt/stack/data/nova/instances/7e326df4-7ada-40c0-9a1b-36f7ed021e4f_del complete
Jul 29 15:30:35 user nova-compute[70924]: INFO nova.compute.manager [None req-2b2b48b7-4160-4bda-80dc-093e34bad339 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Took 1.03 seconds to destroy the instance on the hypervisor.
Jul 29 15:30:35 user nova-compute[70924]: DEBUG oslo.service.loopingcall [None req-2b2b48b7-4160-4bda-80dc-093e34bad339 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70924) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 15:30:35 user nova-compute[70924]: DEBUG nova.compute.manager [-] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Deallocating network for instance {{(pid=70924) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 15:30:35 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] deallocate_for_instance() {{(pid=70924) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 15:30:36 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:30:36 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:30:36 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:30:36 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:30:36 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:30:36 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:30:36 user nova-compute[70924]: DEBUG nova.network.neutron [-] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Updating instance_info_cache with network_info: [] {{(pid=70924) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 15:30:36 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Took 1.00 seconds to deallocate network for instance.
Jul 29 15:30:37 user nova-compute[70924]: DEBUG nova.compute.manager [req-7b594df2-4e2e-4a17-bcb9-efff0c1459d3 req-f1cc09f3-6df1-40fd-8935-e183b9c240e5 service nova] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Received event network-vif-deleted-c66d9f39-371c-4a66-80d1-d97246e223ee {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:30:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2b2b48b7-4160-4bda-80dc-093e34bad339 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:30:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2b2b48b7-4160-4bda-80dc-093e34bad339 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:30:37 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-2b2b48b7-4160-4bda-80dc-093e34bad339 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:30:37 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-2b2b48b7-4160-4bda-80dc-093e34bad339 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:30:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2b2b48b7-4160-4bda-80dc-093e34bad339 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.135s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:30:37 user nova-compute[70924]: INFO nova.scheduler.client.report [None req-2b2b48b7-4160-4bda-80dc-093e34bad339 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Deleted allocations for instance 7e326df4-7ada-40c0-9a1b-36f7ed021e4f
Jul 29 15:30:37 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-2b2b48b7-4160-4bda-80dc-093e34bad339 tempest-SnapshotDataIntegrityTests-1888206088 tempest-SnapshotDataIntegrityTests-1888206088-project-member] Lock "7e326df4-7ada-40c0-9a1b-36f7ed021e4f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.383s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:30:37 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:30:38 user nova-compute[70924]: DEBUG nova.compute.manager [req-05f8d22f-100d-4179-a975-3e0125ce47ce req-63356b84-4855-42c6-9233-bc0810194d1d service nova] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Received event network-vif-plugged-c66d9f39-371c-4a66-80d1-d97246e223ee {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:30:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-05f8d22f-100d-4179-a975-3e0125ce47ce req-63356b84-4855-42c6-9233-bc0810194d1d service nova] Acquiring lock "7e326df4-7ada-40c0-9a1b-36f7ed021e4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:30:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-05f8d22f-100d-4179-a975-3e0125ce47ce req-63356b84-4855-42c6-9233-bc0810194d1d service nova] Lock "7e326df4-7ada-40c0-9a1b-36f7ed021e4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:30:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-05f8d22f-100d-4179-a975-3e0125ce47ce req-63356b84-4855-42c6-9233-bc0810194d1d service nova] Lock "7e326df4-7ada-40c0-9a1b-36f7ed021e4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:30:38 user nova-compute[70924]: DEBUG nova.compute.manager [req-05f8d22f-100d-4179-a975-3e0125ce47ce req-63356b84-4855-42c6-9233-bc0810194d1d service nova] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] No waiting events found dispatching network-vif-plugged-c66d9f39-371c-4a66-80d1-d97246e223ee {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:30:38 user nova-compute[70924]: WARNING nova.compute.manager [req-05f8d22f-100d-4179-a975-3e0125ce47ce req-63356b84-4855-42c6-9233-bc0810194d1d service nova] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Received unexpected event network-vif-plugged-c66d9f39-371c-4a66-80d1-d97246e223ee for instance with vm_state deleted and task_state None.
Jul 29 15:30:38 user nova-compute[70924]: DEBUG nova.compute.manager [req-05f8d22f-100d-4179-a975-3e0125ce47ce req-63356b84-4855-42c6-9233-bc0810194d1d service nova] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Received event network-vif-plugged-c66d9f39-371c-4a66-80d1-d97246e223ee {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:30:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-05f8d22f-100d-4179-a975-3e0125ce47ce req-63356b84-4855-42c6-9233-bc0810194d1d service nova] Acquiring lock "7e326df4-7ada-40c0-9a1b-36f7ed021e4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:30:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-05f8d22f-100d-4179-a975-3e0125ce47ce req-63356b84-4855-42c6-9233-bc0810194d1d service nova] Lock "7e326df4-7ada-40c0-9a1b-36f7ed021e4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:30:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-05f8d22f-100d-4179-a975-3e0125ce47ce req-63356b84-4855-42c6-9233-bc0810194d1d service nova] Lock "7e326df4-7ada-40c0-9a1b-36f7ed021e4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:30:38 user nova-compute[70924]: DEBUG nova.compute.manager [req-05f8d22f-100d-4179-a975-3e0125ce47ce req-63356b84-4855-42c6-9233-bc0810194d1d service nova] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] No waiting events found dispatching network-vif-plugged-c66d9f39-371c-4a66-80d1-d97246e223ee {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:30:38 user nova-compute[70924]: WARNING nova.compute.manager [req-05f8d22f-100d-4179-a975-3e0125ce47ce req-63356b84-4855-42c6-9233-bc0810194d1d service nova] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Received unexpected event network-vif-plugged-c66d9f39-371c-4a66-80d1-d97246e223ee for instance with vm_state deleted and task_state None.
Jul 29 15:30:38 user nova-compute[70924]: DEBUG nova.compute.manager [req-05f8d22f-100d-4179-a975-3e0125ce47ce req-63356b84-4855-42c6-9233-bc0810194d1d service nova] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Received event network-vif-plugged-c66d9f39-371c-4a66-80d1-d97246e223ee {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:30:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-05f8d22f-100d-4179-a975-3e0125ce47ce req-63356b84-4855-42c6-9233-bc0810194d1d service nova] Acquiring lock "7e326df4-7ada-40c0-9a1b-36f7ed021e4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:30:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-05f8d22f-100d-4179-a975-3e0125ce47ce req-63356b84-4855-42c6-9233-bc0810194d1d service nova] Lock "7e326df4-7ada-40c0-9a1b-36f7ed021e4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:30:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-05f8d22f-100d-4179-a975-3e0125ce47ce req-63356b84-4855-42c6-9233-bc0810194d1d service nova] Lock "7e326df4-7ada-40c0-9a1b-36f7ed021e4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:30:38 user nova-compute[70924]: DEBUG nova.compute.manager [req-05f8d22f-100d-4179-a975-3e0125ce47ce req-63356b84-4855-42c6-9233-bc0810194d1d service nova] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] No waiting events found dispatching network-vif-plugged-c66d9f39-371c-4a66-80d1-d97246e223ee {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:30:38 user nova-compute[70924]: WARNING nova.compute.manager [req-05f8d22f-100d-4179-a975-3e0125ce47ce req-63356b84-4855-42c6-9233-bc0810194d1d service nova] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Received unexpected event network-vif-plugged-c66d9f39-371c-4a66-80d1-d97246e223ee for instance with vm_state deleted and task_state None.
Jul 29 15:30:38 user nova-compute[70924]: DEBUG nova.compute.manager [req-05f8d22f-100d-4179-a975-3e0125ce47ce req-63356b84-4855-42c6-9233-bc0810194d1d service nova] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Received event network-vif-plugged-c66d9f39-371c-4a66-80d1-d97246e223ee {{(pid=70924) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 15:30:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-05f8d22f-100d-4179-a975-3e0125ce47ce req-63356b84-4855-42c6-9233-bc0810194d1d service nova] Acquiring lock "7e326df4-7ada-40c0-9a1b-36f7ed021e4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:30:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-05f8d22f-100d-4179-a975-3e0125ce47ce req-63356b84-4855-42c6-9233-bc0810194d1d service nova] Lock "7e326df4-7ada-40c0-9a1b-36f7ed021e4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:30:38 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [req-05f8d22f-100d-4179-a975-3e0125ce47ce req-63356b84-4855-42c6-9233-bc0810194d1d service nova] Lock "7e326df4-7ada-40c0-9a1b-36f7ed021e4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:30:38 user nova-compute[70924]: DEBUG nova.compute.manager [req-05f8d22f-100d-4179-a975-3e0125ce47ce req-63356b84-4855-42c6-9233-bc0810194d1d service nova] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] No waiting events found dispatching network-vif-plugged-c66d9f39-371c-4a66-80d1-d97246e223ee {{(pid=70924) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 15:30:38 user nova-compute[70924]: WARNING nova.compute.manager [req-05f8d22f-100d-4179-a975-3e0125ce47ce req-63356b84-4855-42c6-9233-bc0810194d1d service nova] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Received unexpected event network-vif-plugged-c66d9f39-371c-4a66-80d1-d97246e223ee for instance with vm_state deleted and task_state None.
Jul 29 15:30:40 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:30:45 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:30:50 user nova-compute[70924]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690644635.859626, 7e326df4-7ada-40c0-9a1b-36f7ed021e4f => Stopped> {{(pid=70924) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 15:30:50 user nova-compute[70924]: INFO nova.compute.manager [-] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] VM Stopped (Lifecycle Event)
Jul 29 15:30:50 user nova-compute[70924]: DEBUG nova.compute.manager [None req-00b4f2a1-769d-483d-a312-d9139891c316 None None] [instance: 7e326df4-7ada-40c0-9a1b-36f7ed021e4f] Checking state {{(pid=70924) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 15:30:50 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:30:55 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:31:00 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:31:05 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:31:10 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 15:31:15 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:31:20 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:31:22 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:31:22 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:31:25 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:31:27 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:31:28 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:31:28 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:31:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:31:30 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:31:32 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:31:32 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:31:32 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:31:32 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:31:32 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Auditing locally available compute resources for user (node: user) {{(pid=70924) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 15:31:32 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:31:32 user nova-compute[70924]: WARNING nova.virt.libvirt.driver [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 15:31:32 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Hypervisor/Node resource view: name=user free_ram=8941MB free_disk=25.235034942626953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70924) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 15:31:32 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 15:31:32 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 15:31:32 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 15:31:32 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70924) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 15:31:32 user nova-compute[70924]: DEBUG nova.compute.provider_tree [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed in ProviderTree for provider: e285c8ee-f39c-4daa-8d15-3de9c4f5f832 {{(pid=70924) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 15:31:32 user nova-compute[70924]: DEBUG nova.scheduler.client.report [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Inventory has not changed for provider e285c8ee-f39c-4daa-8d15-3de9c4f5f832 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70924) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 15:31:32 user nova-compute[70924]: DEBUG nova.compute.resource_tracker [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Compute_service record updated for user:user {{(pid=70924) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 15:31:32 user nova-compute[70924]: DEBUG oslo_concurrency.lockutils [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.138s {{(pid=70924) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 15:31:33 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:31:34 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:31:35 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:31:35 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Starting heal instance info cache {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 15:31:35 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Rebuilding the list of instances to heal {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 29 15:31:35 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Didn't find any instances for network info cache update. {{(pid=70924) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 29 15:31:35 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:31:36 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:31:36 user nova-compute[70924]: DEBUG nova.compute.manager [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70924) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 15:31:37 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:31:37 user nova-compute[70924]: DEBUG oslo_service.periodic_task [None req-df4ec260-2cc5-4a92-ab52-7b3196165939 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70924) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 15:31:40 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:31:45 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 15:31:50 user nova-compute[70924]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70924) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}